2024-04-25T00:28:27.609 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T00:28:27.609 DEBUG:teuthology.run:Teuthology command: teuthology --name teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi --description fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/5 tasks/fsstress validater/valgrind} --verbose --owner scheduled_teuthology@teuthology --archive /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672274 -- /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672274/orig.config.yaml 2024-04-25T00:28:27.658 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T00:28:27.741 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672274 branch: squid description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/5 tasks/fsstress validater/valgrind} email: ceph-qa@ceph.com first_in_suite: false job_id: '7672274' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mds beacon grace: 60 mds heartbeat grace: 60 osd heartbeat grace: 60 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds valgrind exit: true mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow request - SLOW_OPS - MON_DOWN sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 valgrind: exit_on_first_error: false mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes watchdog: daemon_restart: normal ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: valgrind: - --tool=memcheck - --leak-check=full - --show-reachable=yes check-counter: counters: mds: - mds.exported - mds.imported install: ceph: debuginfo: true flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 8528 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 122/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi162.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM904qXsBlfruaETNbdYlRUpEJ04/ypC+Ggk6Wg50rh5Pe0298/XAaVO+vkfA2SN8NeO2X1QEWDk23DYYEQSvOc= smithi179.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZBoJii4aVktl98RvFIdboPuZoht2OQaKgvhGp/sByOOV+kDADxPqLoUBI0u9faJbfWEiXwWJH1YWv4cW+3oaM= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-24_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T00:28:27.741 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa; will attempt to use it 2024-04-25T00:28:27.742 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks 2024-04-25T00:28:27.742 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T00:28:27.744 INFO:teuthology.task.internal:Checking packages... 2024-04-25T00:28:27.769 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-25T00:28:27.769 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T00:28:27.769 INFO:teuthology.packaging:ref: None 2024-04-25T00:28:27.769 INFO:teuthology.packaging:tag: None 2024-04-25T00:28:27.769 INFO:teuthology.packaging:branch: squid 2024-04-25T00:28:27.769 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T00:28:27.769 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-04-25T00:28:28.070 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T00:28:28.071 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T00:28:28.077 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T00:28:28.077 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T00:28:28.128 INFO:teuthology.task.internal:Saving configuration 2024-04-25T00:28:28.146 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T00:28:28.151 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T00:28:28.178 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672274', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 00:22:40.366635', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOJZ5o5DpUiqOY0CsFEcKN/LOIXNCQEIPy+Ut1ccpd05'} 2024-04-25T00:28:28.202 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672274', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 00:22:40.368593', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILpFTcMG4owFeIQfZFkQh8XuMjzL/rIgpyM6QAhukW0/'} 2024-04-25T00:28:28.202 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T00:28:28.208 INFO:teuthology.task.internal:roles: ubuntu@smithi162.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-25T00:28:28.208 INFO:teuthology.task.internal:roles: ubuntu@smithi179.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-25T00:28:28.208 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T00:28:28.296 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f5c27b3bee0>, signals=[15]) 2024-04-25T00:28:28.297 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T00:28:28.303 INFO:teuthology.task.internal:Opening connections... 2024-04-25T00:28:28.303 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi162.front.sepia.ceph.com 2024-04-25T00:28:28.305 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T00:28:28.391 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi179.front.sepia.ceph.com 2024-04-25T00:28:28.392 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T00:28:28.470 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T00:28:28.476 DEBUG:teuthology.orchestra.run.smithi162:> uname -m 2024-04-25T00:28:28.481 INFO:teuthology.orchestra.run.smithi162.stdout:x86_64 2024-04-25T00:28:28.481 DEBUG:teuthology.orchestra.run.smithi162:> cat /etc/os-release 2024-04-25T00:28:28.528 INFO:teuthology.orchestra.run.smithi162.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T00:28:28.529 INFO:teuthology.orchestra.run.smithi162.stdout:NAME="Ubuntu" 2024-04-25T00:28:28.529 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_ID="22.04" 2024-04-25T00:28:28.529 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T00:28:28.529 INFO:teuthology.orchestra.run.smithi162.stdout:VERSION_CODENAME=jammy 2024-04-25T00:28:28.529 INFO:teuthology.orchestra.run.smithi162.stdout:ID=ubuntu 2024-04-25T00:28:28.529 INFO:teuthology.orchestra.run.smithi162.stdout:ID_LIKE=debian 2024-04-25T00:28:28.529 INFO:teuthology.orchestra.run.smithi162.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T00:28:28.529 INFO:teuthology.orchestra.run.smithi162.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T00:28:28.529 INFO:teuthology.orchestra.run.smithi162.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T00:28:28.529 INFO:teuthology.orchestra.run.smithi162.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T00:28:28.529 INFO:teuthology.orchestra.run.smithi162.stdout:UBUNTU_CODENAME=jammy 2024-04-25T00:28:28.530 INFO:teuthology.lock.ops:Updating smithi162.front.sepia.ceph.com on lock server 2024-04-25T00:28:28.554 DEBUG:teuthology.orchestra.run.smithi179:> uname -m 2024-04-25T00:28:28.559 INFO:teuthology.orchestra.run.smithi179.stdout:x86_64 2024-04-25T00:28:28.559 DEBUG:teuthology.orchestra.run.smithi179:> cat /etc/os-release 2024-04-25T00:28:28.609 INFO:teuthology.orchestra.run.smithi179.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T00:28:28.609 INFO:teuthology.orchestra.run.smithi179.stdout:NAME="Ubuntu" 2024-04-25T00:28:28.609 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_ID="22.04" 2024-04-25T00:28:28.609 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T00:28:28.610 INFO:teuthology.orchestra.run.smithi179.stdout:VERSION_CODENAME=jammy 2024-04-25T00:28:28.610 INFO:teuthology.orchestra.run.smithi179.stdout:ID=ubuntu 2024-04-25T00:28:28.610 INFO:teuthology.orchestra.run.smithi179.stdout:ID_LIKE=debian 2024-04-25T00:28:28.610 INFO:teuthology.orchestra.run.smithi179.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T00:28:28.610 INFO:teuthology.orchestra.run.smithi179.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T00:28:28.610 INFO:teuthology.orchestra.run.smithi179.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T00:28:28.610 INFO:teuthology.orchestra.run.smithi179.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T00:28:28.610 INFO:teuthology.orchestra.run.smithi179.stdout:UBUNTU_CODENAME=jammy 2024-04-25T00:28:28.611 INFO:teuthology.lock.ops:Updating smithi179.front.sepia.ceph.com on lock server 2024-04-25T00:28:28.715 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T00:28:28.906 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T00:28:28.920 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T00:28:28.920 DEBUG:teuthology.orchestra.run.smithi162:> test '!' -e /home/ubuntu/cephtest 2024-04-25T00:28:28.923 DEBUG:teuthology.orchestra.run.smithi179:> test '!' -e /home/ubuntu/cephtest 2024-04-25T00:28:28.928 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T00:28:28.937 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T00:28:28.937 DEBUG:teuthology.orchestra.run.smithi162:> test -z $(ls -A /var/lib/ceph) 2024-04-25T00:28:28.970 DEBUG:teuthology.orchestra.run.smithi179:> test -z $(ls -A /var/lib/ceph) 2024-04-25T00:28:28.977 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T00:28:29.033 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T00:28:29.048 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-25T00:28:29.049 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-25T00:28:29.049 DEBUG:teuthology.orchestra.run.smithi162:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T00:28:29.049 DEBUG:teuthology.orchestra.run.smithi179:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T00:28:29.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T00:28:29.054 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-04-25T00:28:29.055 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T00:28:29.055 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-04-25T00:28:29.103 INFO:teuthology.orchestra.run.smithi179.stdout:5.15.0-56-generic 2024-04-25T00:28:29.104 INFO:teuthology.task.kernel:Running kernel on smithi179: 5.15.0-56-generic 2024-04-25T00:28:29.104 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get clean 2024-04-25T00:28:29.105 INFO:teuthology.orchestra.run.smithi162.stdout:5.15.0-56-generic 2024-04-25T00:28:29.105 INFO:teuthology.task.kernel:Running kernel on smithi162: 5.15.0-56-generic 2024-04-25T00:28:29.106 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get clean 2024-04-25T00:28:29.230 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get update 2024-04-25T00:28:29.245 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get update 2024-04-25T00:28:29.389 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T00:28:29.390 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T00:28:29.416 INFO:teuthology.orchestra.run.smithi179.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T00:28:29.492 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T00:28:29.498 INFO:teuthology.orchestra.run.smithi179.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T00:28:29.501 INFO:teuthology.orchestra.run.smithi179.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T00:28:29.575 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T00:28:29.605 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T00:28:29.647 INFO:teuthology.orchestra.run.smithi179.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-25T00:28:29.687 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T00:28:29.729 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T00:28:29.732 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T00:28:29.736 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T00:28:29.737 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T00:28:29.737 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T00:28:29.771 INFO:teuthology.orchestra.run.smithi162.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T00:28:29.776 INFO:teuthology.orchestra.run.smithi162.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T00:28:29.776 INFO:teuthology.orchestra.run.smithi162.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T00:28:29.789 INFO:teuthology.orchestra.run.smithi162.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T00:28:29.792 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T00:28:29.798 INFO:teuthology.orchestra.run.smithi162.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T00:28:29.800 INFO:teuthology.orchestra.run.smithi162.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T00:28:29.805 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T00:28:29.805 INFO:teuthology.orchestra.run.smithi179.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T00:28:29.811 INFO:teuthology.orchestra.run.smithi162.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T00:28:29.812 INFO:teuthology.orchestra.run.smithi162.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T00:28:29.829 INFO:teuthology.orchestra.run.smithi162.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T00:28:29.837 INFO:teuthology.orchestra.run.smithi179.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T00:28:29.838 INFO:teuthology.orchestra.run.smithi179.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T00:28:29.841 INFO:teuthology.orchestra.run.smithi162.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T00:28:29.841 INFO:teuthology.orchestra.run.smithi179.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T00:28:29.841 INFO:teuthology.orchestra.run.smithi179.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-25T00:28:29.855 INFO:teuthology.orchestra.run.smithi179.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T00:28:29.864 INFO:teuthology.orchestra.run.smithi179.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T00:28:29.868 INFO:teuthology.orchestra.run.smithi179.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T00:28:29.869 INFO:teuthology.orchestra.run.smithi179.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T00:28:29.897 INFO:teuthology.orchestra.run.smithi179.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T00:28:29.897 INFO:teuthology.orchestra.run.smithi179.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T00:28:29.898 INFO:teuthology.orchestra.run.smithi179.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T00:28:29.898 INFO:teuthology.orchestra.run.smithi179.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [90.8 kB] 2024-04-25T00:28:29.898 INFO:teuthology.orchestra.run.smithi179.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [82.9 kB] 2024-04-25T00:28:29.899 INFO:teuthology.orchestra.run.smithi179.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T00:28:29.901 INFO:teuthology.orchestra.run.smithi179.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T00:28:29.901 INFO:teuthology.orchestra.run.smithi179.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [18.5 kB] 2024-04-25T00:28:29.902 INFO:teuthology.orchestra.run.smithi179.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [29.8 kB] 2024-04-25T00:28:29.915 INFO:teuthology.orchestra.run.smithi179.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T00:28:29.922 INFO:teuthology.orchestra.run.smithi179.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T00:28:29.923 INFO:teuthology.orchestra.run.smithi179.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T00:28:29.929 INFO:teuthology.orchestra.run.smithi162.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T00:28:30.069 INFO:teuthology.orchestra.run.smithi162.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-25T00:28:30.200 INFO:teuthology.orchestra.run.smithi179.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T00:28:30.269 INFO:teuthology.orchestra.run.smithi162.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T00:28:30.368 INFO:teuthology.orchestra.run.smithi179.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T00:28:30.380 INFO:teuthology.orchestra.run.smithi179.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T00:28:30.381 INFO:teuthology.orchestra.run.smithi179.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T00:28:30.382 INFO:teuthology.orchestra.run.smithi179.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T00:28:30.421 INFO:teuthology.orchestra.run.smithi162.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T00:28:30.434 INFO:teuthology.orchestra.run.smithi162.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T00:28:30.435 INFO:teuthology.orchestra.run.smithi162.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T00:28:30.436 INFO:teuthology.orchestra.run.smithi162.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T00:28:30.464 INFO:teuthology.orchestra.run.smithi179.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T00:28:30.473 INFO:teuthology.orchestra.run.smithi179.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T00:28:30.473 INFO:teuthology.orchestra.run.smithi179.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T00:28:30.494 INFO:teuthology.orchestra.run.smithi179.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T00:28:30.502 INFO:teuthology.orchestra.run.smithi162.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T00:28:30.508 INFO:teuthology.orchestra.run.smithi162.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T00:28:30.671 INFO:teuthology.orchestra.run.smithi179.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T00:28:30.672 INFO:teuthology.orchestra.run.smithi162.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-25T00:28:31.079 INFO:teuthology.orchestra.run.smithi179.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T00:28:31.084 INFO:teuthology.orchestra.run.smithi179.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T00:28:31.085 INFO:teuthology.orchestra.run.smithi179.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T00:28:31.098 INFO:teuthology.orchestra.run.smithi179.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T00:28:31.102 INFO:teuthology.orchestra.run.smithi179.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T00:28:31.310 INFO:teuthology.orchestra.run.smithi162.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T00:28:31.348 INFO:teuthology.orchestra.run.smithi162.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T00:28:31.360 INFO:teuthology.orchestra.run.smithi162.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T00:28:31.361 INFO:teuthology.orchestra.run.smithi162.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T00:28:31.362 INFO:teuthology.orchestra.run.smithi162.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T00:28:31.364 INFO:teuthology.orchestra.run.smithi162.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T00:28:31.364 INFO:teuthology.orchestra.run.smithi162.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T00:28:31.365 INFO:teuthology.orchestra.run.smithi162.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [90.8 kB] 2024-04-25T00:28:31.392 INFO:teuthology.orchestra.run.smithi162.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [82.9 kB] 2024-04-25T00:28:31.397 INFO:teuthology.orchestra.run.smithi162.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T00:28:31.561 INFO:teuthology.orchestra.run.smithi162.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T00:28:31.643 INFO:teuthology.orchestra.run.smithi162.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [18.5 kB] 2024-04-25T00:28:31.727 INFO:teuthology.orchestra.run.smithi162.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [29.8 kB] 2024-04-25T00:28:31.814 INFO:teuthology.orchestra.run.smithi162.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T00:28:31.847 INFO:teuthology.orchestra.run.smithi162.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T00:28:35.664 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 13.3 MB in 2s (7,080 kB/s) 2024-04-25T00:28:36.199 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 13.3 MB in 3s (5,222 kB/s) 2024-04-25T00:28:37.091 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-04-25T00:28:37.108 DEBUG:teuthology.orchestra.run.smithi179:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T00:28:37.159 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-04-25T00:28:37.335 INFO:teuthology.orchestra.run.smithi179.stdout:Building dependency tree... 2024-04-25T00:28:37.336 INFO:teuthology.orchestra.run.smithi179.stdout:Reading state information... 2024-04-25T00:28:37.487 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T00:28:37.488 INFO:teuthology.orchestra.run.smithi179.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T00:28:37.488 INFO:teuthology.orchestra.run.smithi179.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T00:28:37.488 INFO:teuthology.orchestra.run.smithi179.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T00:28:37.488 INFO:teuthology.orchestra.run.smithi179.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T00:28:37.488 INFO:teuthology.orchestra.run.smithi179.stdout: python2.7-minimal 2024-04-25T00:28:37.489 INFO:teuthology.orchestra.run.smithi179.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T00:28:37.489 INFO:teuthology.orchestra.run.smithi179.stdout:The following additional packages will be installed: 2024-04-25T00:28:37.489 INFO:teuthology.orchestra.run.smithi179.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T00:28:37.490 INFO:teuthology.orchestra.run.smithi179.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T00:28:37.490 INFO:teuthology.orchestra.run.smithi179.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T00:28:37.491 INFO:teuthology.orchestra.run.smithi179.stdout:Suggested packages: 2024-04-25T00:28:37.491 INFO:teuthology.orchestra.run.smithi179.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T00:28:37.491 INFO:teuthology.orchestra.run.smithi179.stdout:Recommended packages: 2024-04-25T00:28:37.491 INFO:teuthology.orchestra.run.smithi179.stdout: thermald 2024-04-25T00:28:37.545 INFO:teuthology.orchestra.run.smithi179.stdout:The following NEW packages will be installed: 2024-04-25T00:28:37.545 INFO:teuthology.orchestra.run.smithi179.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T00:28:37.545 INFO:teuthology.orchestra.run.smithi179.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T00:28:37.545 INFO:teuthology.orchestra.run.smithi179.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T00:28:37.546 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages will be upgraded: 2024-04-25T00:28:37.547 INFO:teuthology.orchestra.run.smithi179.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T00:28:37.581 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-04-25T00:28:37.599 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T00:28:37.604 INFO:teuthology.orchestra.run.smithi179.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T00:28:37.604 INFO:teuthology.orchestra.run.smithi179.stdout:Need to get 113 MB of archives. 2024-04-25T00:28:37.604 INFO:teuthology.orchestra.run.smithi179.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T00:28:37.604 INFO:teuthology.orchestra.run.smithi179.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T00:28:37.659 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-04-25T00:28:37.859 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2024-04-25T00:28:37.859 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2024-04-25T00:28:38.021 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T00:28:38.022 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T00:28:38.022 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T00:28:38.022 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T00:28:38.022 INFO:teuthology.orchestra.run.smithi162.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T00:28:38.023 INFO:teuthology.orchestra.run.smithi162.stdout: python2.7-minimal 2024-04-25T00:28:38.023 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T00:28:38.023 INFO:teuthology.orchestra.run.smithi162.stdout:The following additional packages will be installed: 2024-04-25T00:28:38.024 INFO:teuthology.orchestra.run.smithi162.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T00:28:38.024 INFO:teuthology.orchestra.run.smithi162.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T00:28:38.024 INFO:teuthology.orchestra.run.smithi162.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T00:28:38.025 INFO:teuthology.orchestra.run.smithi162.stdout:Suggested packages: 2024-04-25T00:28:38.025 INFO:teuthology.orchestra.run.smithi162.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T00:28:38.025 INFO:teuthology.orchestra.run.smithi162.stdout:Recommended packages: 2024-04-25T00:28:38.025 INFO:teuthology.orchestra.run.smithi162.stdout: thermald 2024-04-25T00:28:38.074 INFO:teuthology.orchestra.run.smithi162.stdout:The following NEW packages will be installed: 2024-04-25T00:28:38.074 INFO:teuthology.orchestra.run.smithi162.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T00:28:38.074 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T00:28:38.075 INFO:teuthology.orchestra.run.smithi162.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T00:28:38.076 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages will be upgraded: 2024-04-25T00:28:38.076 INFO:teuthology.orchestra.run.smithi162.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T00:28:38.086 INFO:teuthology.orchestra.run.smithi179.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T00:28:38.155 INFO:teuthology.orchestra.run.smithi162.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T00:28:38.155 INFO:teuthology.orchestra.run.smithi162.stdout:Need to get 113 MB of archives. 2024-04-25T00:28:38.155 INFO:teuthology.orchestra.run.smithi162.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T00:28:38.156 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T00:28:38.213 INFO:teuthology.orchestra.run.smithi179.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T00:28:39.136 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T00:28:39.547 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T00:28:40.141 INFO:teuthology.orchestra.run.smithi179.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T00:28:40.141 INFO:teuthology.orchestra.run.smithi179.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T00:28:40.142 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T00:28:40.503 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T00:28:40.653 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T00:28:41.063 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 113 MB in 3s (36.5 MB/s) 2024-04-25T00:28:41.251 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T00:28:42.141 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T00:28:42.141 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T00:28:42.141 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T00:28:42.498 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T00:28:42.544 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T00:28:42.933 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 113 MB in 4s (25.4 MB/s) 2024-04-25T00:28:43.103 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T00:28:43.350 INFO:teuthology.orchestra.run.smithi179.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T00:28:43.354 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T00:28:43.456 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T00:28:45.049 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T00:28:45.053 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T00:28:45.116 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T00:28:45.849 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T00:28:45.871 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T00:28:46.208 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T00:28:46.694 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T00:28:46.715 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T00:28:46.852 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T00:28:47.283 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T00:28:47.305 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T00:28:47.402 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T00:28:47.870 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T00:28:47.891 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T00:28:47.928 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T00:28:53.538 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T00:28:53.654 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T00:28:53.970 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T00:28:54.091 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T00:28:54.419 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T00:28:54.430 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T00:28:54.469 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T00:28:54.844 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T00:28:54.970 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T00:28:55.261 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T00:28:55.415 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T00:28:55.743 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T00:28:55.765 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T00:28:55.801 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T00:29:00.212 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T00:29:00.250 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T00:29:00.287 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T00:29:01.894 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T00:29:01.931 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T00:29:01.968 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T00:29:03.540 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T00:29:03.665 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T00:29:04.031 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T00:29:04.145 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T00:29:04.271 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T00:29:04.416 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T00:29:04.511 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T00:29:04.630 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T00:29:05.256 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T00:29:05.727 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T00:29:05.761 INFO:teuthology.orchestra.run.smithi179.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T00:29:05.761 INFO:teuthology.orchestra.run.smithi179.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T00:29:05.761 INFO:teuthology.orchestra.run.smithi179.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T00:29:05.762 INFO:teuthology.orchestra.run.smithi179.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T00:29:05.854 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T00:29:05.926 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T00:29:05.965 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T00:29:07.287 INFO:teuthology.orchestra.run.smithi162.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T00:29:07.287 INFO:teuthology.orchestra.run.smithi162.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T00:29:07.287 INFO:teuthology.orchestra.run.smithi162.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T00:29:07.288 INFO:teuthology.orchestra.run.smithi162.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T00:29:07.329 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T00:29:07.451 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T00:29:08.713 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T00:29:08.822 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T00:29:08.861 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T00:29:08.965 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T00:29:09.022 INFO:teuthology.orchestra.run.smithi179.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T00:29:09.022 INFO:teuthology.orchestra.run.smithi179.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T00:29:10.245 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T00:29:10.354 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T00:29:10.481 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T00:29:10.555 INFO:teuthology.orchestra.run.smithi162.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T00:29:10.556 INFO:teuthology.orchestra.run.smithi162.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T00:29:23.272 INFO:teuthology.orchestra.run.smithi179.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T00:29:23.273 INFO:teuthology.orchestra.run.smithi179.stdout:Sourcing file `/etc/default/grub' 2024-04-25T00:29:23.303 INFO:teuthology.orchestra.run.smithi179.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T00:29:23.317 INFO:teuthology.orchestra.run.smithi179.stdout:Generating grub configuration file ... 2024-04-25T00:29:23.592 INFO:teuthology.orchestra.run.smithi179.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T00:29:23.624 INFO:teuthology.orchestra.run.smithi179.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T00:29:23.929 INFO:teuthology.orchestra.run.smithi179.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T00:29:23.934 INFO:teuthology.orchestra.run.smithi179.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T00:29:24.009 INFO:teuthology.orchestra.run.smithi179.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T00:29:24.014 INFO:teuthology.orchestra.run.smithi179.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T00:29:24.167 INFO:teuthology.orchestra.run.smithi179.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T00:29:24.167 INFO:teuthology.orchestra.run.smithi179.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T00:29:24.168 INFO:teuthology.orchestra.run.smithi179.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T00:29:24.213 INFO:teuthology.orchestra.run.smithi179.stdout:done 2024-04-25T00:29:24.659 DEBUG:teuthology.orchestra.run.smithi179:> dpkg -s linux-image-generic 2024-04-25T00:29:24.677 INFO:teuthology.orchestra.run.smithi179.stdout:Package: linux-image-generic 2024-04-25T00:29:24.678 INFO:teuthology.orchestra.run.smithi179.stdout:Status: install ok installed 2024-04-25T00:29:24.678 INFO:teuthology.orchestra.run.smithi179.stdout:Priority: optional 2024-04-25T00:29:24.678 INFO:teuthology.orchestra.run.smithi179.stdout:Section: kernel 2024-04-25T00:29:24.678 INFO:teuthology.orchestra.run.smithi179.stdout:Installed-Size: 21 2024-04-25T00:29:24.678 INFO:teuthology.orchestra.run.smithi179.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T00:29:24.678 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: amd64 2024-04-25T00:29:24.678 INFO:teuthology.orchestra.run.smithi179.stdout:Source: linux-meta 2024-04-25T00:29:24.678 INFO:teuthology.orchestra.run.smithi179.stdout:Version: 5.15.0.105.102 2024-04-25T00:29:24.678 INFO:teuthology.orchestra.run.smithi179.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T00:29:24.678 INFO:teuthology.orchestra.run.smithi179.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T00:29:24.678 INFO:teuthology.orchestra.run.smithi179.stdout:Recommends: thermald 2024-04-25T00:29:24.678 INFO:teuthology.orchestra.run.smithi179.stdout:Description: Generic Linux kernel image 2024-04-25T00:29:24.678 INFO:teuthology.orchestra.run.smithi179.stdout: This package will always depend on the latest generic kernel image 2024-04-25T00:29:24.679 INFO:teuthology.orchestra.run.smithi179.stdout: available. 2024-04-25T00:29:24.679 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T00:29:24.679 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T00:29:24.679 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T00:29:24.679 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-25T00:29:24.679 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi179.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T00:29:24.679 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get clean 2024-04-25T00:29:24.680 INFO:teuthology.orchestra.run.smithi162.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T00:29:24.680 INFO:teuthology.orchestra.run.smithi162.stdout:Sourcing file `/etc/default/grub' 2024-04-25T00:29:24.689 INFO:teuthology.orchestra.run.smithi162.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T00:29:24.706 INFO:teuthology.orchestra.run.smithi162.stdout:Generating grub configuration file ... 2024-04-25T00:29:24.857 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get update 2024-04-25T00:29:24.942 INFO:teuthology.orchestra.run.smithi162.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T00:29:24.965 INFO:teuthology.orchestra.run.smithi162.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T00:29:24.977 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T00:29:24.977 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T00:29:24.992 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T00:29:25.012 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T00:29:25.235 INFO:teuthology.orchestra.run.smithi162.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T00:29:25.240 INFO:teuthology.orchestra.run.smithi162.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T00:29:25.313 INFO:teuthology.orchestra.run.smithi162.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T00:29:25.319 INFO:teuthology.orchestra.run.smithi162.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T00:29:25.480 INFO:teuthology.orchestra.run.smithi162.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T00:29:25.480 INFO:teuthology.orchestra.run.smithi162.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T00:29:25.480 INFO:teuthology.orchestra.run.smithi162.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T00:29:25.519 INFO:teuthology.orchestra.run.smithi162.stdout:done 2024-04-25T00:29:25.976 DEBUG:teuthology.orchestra.run.smithi162:> dpkg -s linux-image-generic 2024-04-25T00:29:25.993 INFO:teuthology.orchestra.run.smithi162.stdout:Package: linux-image-generic 2024-04-25T00:29:25.993 INFO:teuthology.orchestra.run.smithi162.stdout:Status: install ok installed 2024-04-25T00:29:25.993 INFO:teuthology.orchestra.run.smithi162.stdout:Priority: optional 2024-04-25T00:29:25.993 INFO:teuthology.orchestra.run.smithi162.stdout:Section: kernel 2024-04-25T00:29:25.993 INFO:teuthology.orchestra.run.smithi162.stdout:Installed-Size: 21 2024-04-25T00:29:25.993 INFO:teuthology.orchestra.run.smithi162.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T00:29:25.993 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: amd64 2024-04-25T00:29:25.993 INFO:teuthology.orchestra.run.smithi162.stdout:Source: linux-meta 2024-04-25T00:29:25.993 INFO:teuthology.orchestra.run.smithi162.stdout:Version: 5.15.0.105.102 2024-04-25T00:29:25.993 INFO:teuthology.orchestra.run.smithi162.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T00:29:25.993 INFO:teuthology.orchestra.run.smithi162.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T00:29:25.994 INFO:teuthology.orchestra.run.smithi162.stdout:Recommends: thermald 2024-04-25T00:29:25.994 INFO:teuthology.orchestra.run.smithi162.stdout:Description: Generic Linux kernel image 2024-04-25T00:29:25.994 INFO:teuthology.orchestra.run.smithi162.stdout: This package will always depend on the latest generic kernel image 2024-04-25T00:29:25.994 INFO:teuthology.orchestra.run.smithi162.stdout: available. 2024-04-25T00:29:25.995 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T00:29:25.995 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T00:29:25.995 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T00:29:25.995 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-25T00:29:25.995 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi162.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T00:29:25.995 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get clean 2024-04-25T00:29:26.204 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get update 2024-04-25T00:29:26.241 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-04-25T00:29:26.258 DEBUG:teuthology.orchestra.run.smithi179:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T00:29:26.314 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-04-25T00:29:26.327 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T00:29:26.444 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T00:29:26.527 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T00:29:26.528 INFO:teuthology.orchestra.run.smithi179.stdout:Building dependency tree... 2024-04-25T00:29:26.529 INFO:teuthology.orchestra.run.smithi179.stdout:Reading state information... 2024-04-25T00:29:26.607 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T00:29:26.692 INFO:teuthology.orchestra.run.smithi179.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T00:29:26.692 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T00:29:26.692 INFO:teuthology.orchestra.run.smithi179.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T00:29:26.692 INFO:teuthology.orchestra.run.smithi179.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T00:29:26.692 INFO:teuthology.orchestra.run.smithi179.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T00:29:26.692 INFO:teuthology.orchestra.run.smithi179.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T00:29:26.692 INFO:teuthology.orchestra.run.smithi179.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T00:29:26.693 INFO:teuthology.orchestra.run.smithi179.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T00:29:26.731 INFO:teuthology.orchestra.run.smithi179.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T00:29:26.733 DEBUG:teuthology.orchestra.run.smithi179:> dpkg -s linux-image-generic 2024-04-25T00:29:26.745 INFO:teuthology.orchestra.run.smithi179.stdout:Package: linux-image-generic 2024-04-25T00:29:26.745 INFO:teuthology.orchestra.run.smithi179.stdout:Status: install ok installed 2024-04-25T00:29:26.745 INFO:teuthology.orchestra.run.smithi179.stdout:Priority: optional 2024-04-25T00:29:26.745 INFO:teuthology.orchestra.run.smithi179.stdout:Section: kernel 2024-04-25T00:29:26.745 INFO:teuthology.orchestra.run.smithi179.stdout:Installed-Size: 21 2024-04-25T00:29:26.745 INFO:teuthology.orchestra.run.smithi179.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T00:29:26.745 INFO:teuthology.orchestra.run.smithi179.stdout:Architecture: amd64 2024-04-25T00:29:26.745 INFO:teuthology.orchestra.run.smithi179.stdout:Source: linux-meta 2024-04-25T00:29:26.745 INFO:teuthology.orchestra.run.smithi179.stdout:Version: 5.15.0.105.102 2024-04-25T00:29:26.745 INFO:teuthology.orchestra.run.smithi179.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T00:29:26.746 INFO:teuthology.orchestra.run.smithi179.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T00:29:26.746 INFO:teuthology.orchestra.run.smithi179.stdout:Recommends: thermald 2024-04-25T00:29:26.746 INFO:teuthology.orchestra.run.smithi179.stdout:Description: Generic Linux kernel image 2024-04-25T00:29:26.746 INFO:teuthology.orchestra.run.smithi179.stdout: This package will always depend on the latest generic kernel image 2024-04-25T00:29:26.746 INFO:teuthology.orchestra.run.smithi179.stdout: available. 2024-04-25T00:29:26.747 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-04-25T00:29:26.790 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.E73JCGBrh6 2024-04-25T00:29:26.790 DEBUG:teuthology.orchestra.run.smithi179:> sudo cp /boot/grub/grub.cfg /tmp/tmp.E73JCGBrh6 2024-04-25T00:29:26.859 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.E73JCGBrh6 2024-04-25T00:29:26.977 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.E73JCGBrh6 is 10KB 2024-04-25T00:29:26.990 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.E73JCGBrh6 2024-04-25T00:29:26.995 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T00:29:27.050 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:29:27.050 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T00:29:27.050 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T00:29:27.130 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T00:29:27.131 DEBUG:teuthology.orchestra.run.smithi179:> sudo update-grub 2024-04-25T00:29:27.782 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-04-25T00:29:27.800 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T00:29:27.861 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-04-25T00:29:28.062 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2024-04-25T00:29:28.063 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2024-04-25T00:29:28.241 INFO:teuthology.orchestra.run.smithi162.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T00:29:28.242 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T00:29:28.242 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T00:29:28.242 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T00:29:28.242 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T00:29:28.242 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T00:29:28.243 INFO:teuthology.orchestra.run.smithi162.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T00:29:28.243 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T00:29:28.284 INFO:teuthology.orchestra.run.smithi162.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T00:29:28.287 DEBUG:teuthology.orchestra.run.smithi162:> dpkg -s linux-image-generic 2024-04-25T00:29:28.302 INFO:teuthology.orchestra.run.smithi162.stdout:Package: linux-image-generic 2024-04-25T00:29:28.302 INFO:teuthology.orchestra.run.smithi162.stdout:Status: install ok installed 2024-04-25T00:29:28.302 INFO:teuthology.orchestra.run.smithi162.stdout:Priority: optional 2024-04-25T00:29:28.302 INFO:teuthology.orchestra.run.smithi162.stdout:Section: kernel 2024-04-25T00:29:28.302 INFO:teuthology.orchestra.run.smithi162.stdout:Installed-Size: 21 2024-04-25T00:29:28.302 INFO:teuthology.orchestra.run.smithi162.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T00:29:28.303 INFO:teuthology.orchestra.run.smithi162.stdout:Architecture: amd64 2024-04-25T00:29:28.303 INFO:teuthology.orchestra.run.smithi162.stdout:Source: linux-meta 2024-04-25T00:29:28.303 INFO:teuthology.orchestra.run.smithi162.stdout:Version: 5.15.0.105.102 2024-04-25T00:29:28.303 INFO:teuthology.orchestra.run.smithi162.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T00:29:28.303 INFO:teuthology.orchestra.run.smithi162.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T00:29:28.303 INFO:teuthology.orchestra.run.smithi162.stdout:Recommends: thermald 2024-04-25T00:29:28.303 INFO:teuthology.orchestra.run.smithi162.stdout:Description: Generic Linux kernel image 2024-04-25T00:29:28.303 INFO:teuthology.orchestra.run.smithi162.stdout: This package will always depend on the latest generic kernel image 2024-04-25T00:29:28.303 INFO:teuthology.orchestra.run.smithi162.stdout: available. 2024-04-25T00:29:28.303 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-04-25T00:29:28.348 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.evDsVc2Eft 2024-04-25T00:29:28.349 DEBUG:teuthology.orchestra.run.smithi162:> sudo cp /boot/grub/grub.cfg /tmp/tmp.evDsVc2Eft 2024-04-25T00:29:28.389 INFO:teuthology.orchestra.run.smithi179.stderr:Sourcing file `/etc/default/grub' 2024-04-25T00:29:28.390 INFO:teuthology.orchestra.run.smithi179.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T00:29:28.392 INFO:teuthology.orchestra.run.smithi179.stderr:Generating grub configuration file ... 2024-04-25T00:29:28.405 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.evDsVc2Eft 2024-04-25T00:29:28.518 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.evDsVc2Eft is 10KB 2024-04-25T00:29:28.531 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.evDsVc2Eft 2024-04-25T00:29:28.536 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T00:29:28.544 INFO:teuthology.orchestra.run.smithi179.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T00:29:28.550 INFO:teuthology.orchestra.run.smithi179.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T00:29:28.588 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:29:28.588 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T00:29:28.588 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T00:29:28.655 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T00:29:28.655 DEBUG:teuthology.orchestra.run.smithi162:> sudo update-grub 2024-04-25T00:29:28.788 INFO:teuthology.orchestra.run.smithi179.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T00:29:28.794 INFO:teuthology.orchestra.run.smithi179.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T00:29:28.832 INFO:teuthology.orchestra.run.smithi179.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T00:29:28.836 INFO:teuthology.orchestra.run.smithi179.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T00:29:28.950 INFO:teuthology.orchestra.run.smithi179.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T00:29:28.950 INFO:teuthology.orchestra.run.smithi179.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T00:29:28.951 INFO:teuthology.orchestra.run.smithi179.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T00:29:28.967 INFO:teuthology.orchestra.run.smithi179.stderr:done 2024-04-25T00:29:28.969 DEBUG:teuthology.orchestra.run.smithi179:> sudo shutdown -r now 2024-04-25T00:29:29.844 INFO:teuthology.orchestra.run.smithi162.stderr:Sourcing file `/etc/default/grub' 2024-04-25T00:29:29.845 INFO:teuthology.orchestra.run.smithi162.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T00:29:29.847 INFO:teuthology.orchestra.run.smithi162.stderr:Generating grub configuration file ... 2024-04-25T00:29:30.016 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T00:29:30.022 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T00:29:30.247 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T00:29:30.252 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T00:29:30.295 INFO:teuthology.orchestra.run.smithi162.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T00:29:30.300 INFO:teuthology.orchestra.run.smithi162.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T00:29:30.417 INFO:teuthology.orchestra.run.smithi162.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T00:29:30.417 INFO:teuthology.orchestra.run.smithi162.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T00:29:30.417 INFO:teuthology.orchestra.run.smithi162.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T00:29:30.428 INFO:teuthology.orchestra.run.smithi162.stderr:done 2024-04-25T00:29:30.443 DEBUG:teuthology.orchestra.run.smithi162:> sudo shutdown -r now 2024-04-25T00:29:59.001 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-25T00:29:59.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-25T00:29:59.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T00:30:00.447 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-25T00:30:00.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-04-25T00:30:00.447 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T00:30:17.375 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-25T00:30:18.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-04-25T00:30:26.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-25T00:30:26.384 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T00:30:27.912 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-04-25T00:30:27.912 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T00:30:29.438 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-25T00:30:30.974 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.162 2024-04-25T00:30:41.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-25T00:30:41.451 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T00:30:42.977 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-04-25T00:30:42.978 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T00:30:59.871 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.179 2024-04-25T00:31:14.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-25T00:31:14.888 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T00:31:15.394 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-04-25T00:31:16.201 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-25T00:31:16.201 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-04-25T00:31:16.202 DEBUG:teuthology.orchestra.run.smithi179:> uname -r 2024-04-25T00:31:16.253 INFO:teuthology.orchestra.run.smithi179.stdout:5.15.0-105-generic 2024-04-25T00:31:16.253 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T00:31:16.253 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T00:31:16.253 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T00:31:17.254 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-25T00:31:17.254 DEBUG:teuthology.orchestra.run.smithi179:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T00:31:17.333 INFO:teuthology.orchestra.run.smithi179.stdout:ttyS1 2024-04-25T00:31:17.379 DEBUG:teuthology.parallel:result is None 2024-04-25T00:31:42.980 DEBUG:teuthology.orchestra.remote:timed out 2024-04-25T00:31:57.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-04-25T00:31:57.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T00:31:58.278 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-04-25T00:31:58.859 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-04-25T00:31:58.859 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-25T00:31:58.860 DEBUG:teuthology.orchestra.run.smithi162:> uname -r 2024-04-25T00:31:58.905 INFO:teuthology.orchestra.run.smithi162.stdout:5.15.0-105-generic 2024-04-25T00:31:58.905 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T00:31:58.905 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T00:31:58.906 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T00:31:59.906 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T00:31:59.907 DEBUG:teuthology.orchestra.run.smithi162:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T00:31:59.982 INFO:teuthology.orchestra.run.smithi162.stdout:ttyS1 2024-04-25T00:32:00.006 DEBUG:teuthology.parallel:result is None 2024-04-25T00:32:00.007 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T00:32:00.014 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T00:32:00.015 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T00:32:00.017 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T00:32:00.023 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T00:32:00.039 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T00:32:00.073 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T00:32:00.073 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T00:32:00.075 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T00:32:00.178 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T00:32:00.185 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T00:32:00.185 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T00:32:00.188 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T00:32:00.207 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T00:32:00.215 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T00:32:00.238 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T00:32:00.244 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T00:32:00.246 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T00:32:00.253 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T00:32:00.253 DEBUG:teuthology.orchestra.run.smithi162:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T00:32:00.262 DEBUG:teuthology.orchestra.run.smithi179:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T00:32:00.277 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T00:32:00.288 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T00:32:00.288 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T00:32:00.323 DEBUG:teuthology.orchestra.run.smithi179:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T00:32:00.328 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T00:32:00.373 DEBUG:teuthology.orchestra.run.smithi162:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T00:32:00.421 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:32:00.421 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T00:32:00.487 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T00:32:00.493 DEBUG:teuthology.orchestra.run.smithi179:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T00:32:00.541 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:32:00.541 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T00:32:00.612 DEBUG:teuthology.orchestra.run.smithi162:> sudo service rsyslog restart 2024-04-25T00:32:00.615 DEBUG:teuthology.orchestra.run.smithi179:> sudo service rsyslog restart 2024-04-25T00:32:00.687 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T00:32:00.726 INFO:teuthology.task.internal:Starting timer... 2024-04-25T00:32:00.726 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T00:32:00.757 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T00:32:00.809 DEBUG:teuthology.task.selinux:Excluding smithi162: OS 'ubuntu' does not support SELinux 2024-04-25T00:32:00.809 DEBUG:teuthology.task.selinux:Excluding smithi179: OS 'ubuntu' does not support SELinux 2024-04-25T00:32:00.809 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T00:32:00.809 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-25T00:32:00.809 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T00:32:00.809 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T00:32:00.845 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T00:32:00.862 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T00:32:00.863 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi162.front.sepia.ceph.com,smithi179.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T00:39:37.361 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi162.front.sepia.ceph.com'), Remote(name='ubuntu@smithi179.front.sepia.ceph.com')] 2024-04-25T00:39:37.362 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-04-25T00:39:37.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi162.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T00:39:37.444 DEBUG:teuthology.orchestra.run.smithi162:> true 2024-04-25T00:39:37.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi162.front.sepia.ceph.com' 2024-04-25T00:39:37.519 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-25T00:39:37.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi179.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T00:39:37.597 DEBUG:teuthology.orchestra.run.smithi179:> true 2024-04-25T00:39:37.675 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi179.front.sepia.ceph.com' 2024-04-25T00:39:37.675 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T00:39:37.686 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T00:39:37.687 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T00:39:37.687 DEBUG:teuthology.orchestra.run.smithi162:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T00:39:37.689 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T00:39:37.690 DEBUG:teuthology.orchestra.run.smithi179:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T00:39:37.717 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T00:39:37.717 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: Command line: ntpd -gq 2024-04-25T00:39:37.717 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: ---------------------------------------------------- 2024-04-25T00:39:37.718 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T00:39:37.718 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T00:39:37.718 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: corporation. Support and training for ntp-4 are 2024-04-25T00:39:37.718 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: available at https://www.nwtime.org/support 2024-04-25T00:39:37.718 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: ---------------------------------------------------- 2024-04-25T00:39:37.719 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: proto: precision = 0.062 usec (-24) 2024-04-25T00:39:37.719 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: basedate set to 2022-02-04 2024-04-25T00:39:37.719 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: gps base set to 2022-02-06 (week 2196) 2024-04-25T00:39:37.719 INFO:teuthology.orchestra.run.smithi162.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T00:39:37.720 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T00:39:37.720 INFO:teuthology.orchestra.run.smithi162.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T00:39:37.721 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T00:39:37.721 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T00:39:37.721 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T00:39:37.721 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T00:39:37.721 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: Listen normally on 3 enp3s0f1 172.21.15.162:123 2024-04-25T00:39:37.721 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: Listen normally on 4 lo [::1]:123 2024-04-25T00:39:37.722 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f41%5]:123 2024-04-25T00:39:37.722 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:37 ntpd[17214]: Listening on routing socket on fd #22 for interface updates 2024-04-25T00:39:37.741 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T00:39:37.741 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: Command line: ntpd -gq 2024-04-25T00:39:37.741 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: ---------------------------------------------------- 2024-04-25T00:39:37.741 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T00:39:37.741 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T00:39:37.741 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: corporation. Support and training for ntp-4 are 2024-04-25T00:39:37.741 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: available at https://www.nwtime.org/support 2024-04-25T00:39:37.742 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: ---------------------------------------------------- 2024-04-25T00:39:37.742 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: proto: precision = 0.055 usec (-24) 2024-04-25T00:39:37.742 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: basedate set to 2022-02-04 2024-04-25T00:39:37.742 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: gps base set to 2022-02-06 (week 2196) 2024-04-25T00:39:37.742 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T00:39:37.743 INFO:teuthology.orchestra.run.smithi179.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T00:39:37.743 INFO:teuthology.orchestra.run.smithi179.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T00:39:37.743 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T00:39:37.744 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T00:39:37.744 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T00:39:37.744 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T00:39:37.744 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: Listen normally on 3 enp3s0f1 172.21.15.179:123 2024-04-25T00:39:37.744 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: Listen normally on 4 lo [::1]:123 2024-04-25T00:39:37.744 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:725b%5]:123 2024-04-25T00:39:37.744 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:37 ntpd[17235]: Listening on routing socket on fd #22 for interface updates 2024-04-25T00:39:38.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:38 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:38.745 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:38 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:38.745 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:38 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:38.745 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:38 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:38.745 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:38 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:38.745 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:38 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:38.745 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:38 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:38.745 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:38 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:38.745 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:38 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:38.745 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:38 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:38.745 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:38 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:38.746 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:38 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:38.746 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:38 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:38.746 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:38 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:38.746 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:38 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:38.746 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:38 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:38.746 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:38 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:38.746 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:38 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:39.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:39 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:39.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:39 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:39.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:39 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:39.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:39 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:39.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:39 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:39.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:39 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:39.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:39 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:39.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:39 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:40.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:40 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:40.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:40 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:40.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:40 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:40.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:40 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:40.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:40 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:40.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:40 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:40.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:40 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:40.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:40 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:40.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:40 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:40.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:40 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:40.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:40 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:40.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:40 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:40.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:40 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:40.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:40 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:40.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:40 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:40.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:40 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:40.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:40 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:40.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:40 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:40.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:40 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:40.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:40 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:40.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:40 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:40.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:40 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:40.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:40 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:40.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:40 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:41.720 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:41 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:41.720 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:41 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:41.720 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:41 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:41.720 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:41 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:41.721 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:41 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:41.721 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:41 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:41.721 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:41 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:41.721 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:41 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:41.721 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:41 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:41.721 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:41 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:41.721 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:41 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:41.721 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:41 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:42.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:42 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:42.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:42 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:42.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:42 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:42.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:42 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:42.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:42 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:42.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:42 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:42.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:42.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:42.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:42.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:42.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:42.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:42.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:42.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:42.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:42.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:42.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:42.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:42.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:42.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:42.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:42.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:42.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:42.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:42.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:42.744 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:42 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:43.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:43 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:43.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:43 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:43.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:43 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:43.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:43 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:43.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:43 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:43.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:43 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:43.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:43 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:43.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:43 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:43.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:43 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:43.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:43 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:43.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:43 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:43.720 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:43 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:44.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:44 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:44.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:44 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:44.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:44 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:44.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:44 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:44.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:44 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:44.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:44 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:44.742 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:44 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:44.742 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:44 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:44.742 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:44 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:44.742 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:44 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:44.742 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:44 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:44.742 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:44 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:44.742 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:44 ntpd[17235]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:44.742 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:44 ntpd[17235]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:44.742 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:44 ntpd[17235]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:44.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:44 ntpd[17235]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:44.743 INFO:teuthology.orchestra.run.smithi179.stdout:25 Apr 00:39:44 ntpd[17235]: ntpd: time slew -0.000923 s 2024-04-25T00:39:44.743 INFO:teuthology.orchestra.run.smithi179.stdout:ntpd: time slew -0.000923s 2024-04-25T00:39:44.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:44 ntpd[17235]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T00:39:44.743 INFO:teuthology.orchestra.run.smithi179.stderr:25 Apr 00:39:44 ntpd[17235]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T00:39:44.833 INFO:teuthology.orchestra.run.smithi179.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T00:39:44.833 INFO:teuthology.orchestra.run.smithi179.stdout:============================================================================== 2024-04-25T00:39:44.833 INFO:teuthology.orchestra.run.smithi179.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T00:39:44.833 INFO:teuthology.orchestra.run.smithi179.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T00:39:44.833 INFO:teuthology.orchestra.run.smithi179.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T00:39:44.834 INFO:teuthology.orchestra.run.smithi179.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T00:39:45.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:45 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:45.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:45 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:45.718 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:45 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:45.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:45 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:45.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:45 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T00:39:45.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:45 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T00:39:45.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:45 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T00:39:45.719 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:45 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T00:39:45.719 INFO:teuthology.orchestra.run.smithi162.stdout:25 Apr 00:39:45 ntpd[17214]: ntpd: time slew -0.000804 s 2024-04-25T00:39:45.719 INFO:teuthology.orchestra.run.smithi162.stdout:ntpd: time slew -0.000804s 2024-04-25T00:39:45.720 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:45 ntpd[17214]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T00:39:45.720 INFO:teuthology.orchestra.run.smithi162.stderr:25 Apr 00:39:45 ntpd[17214]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T00:39:45.757 INFO:teuthology.orchestra.run.smithi162.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T00:39:45.757 INFO:teuthology.orchestra.run.smithi162.stdout:============================================================================== 2024-04-25T00:39:45.757 INFO:teuthology.orchestra.run.smithi162.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T00:39:45.757 INFO:teuthology.orchestra.run.smithi162.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T00:39:45.757 INFO:teuthology.orchestra.run.smithi162.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T00:39:45.757 INFO:teuthology.orchestra.run.smithi162.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T00:39:45.758 INFO:teuthology.run_tasks:Running task install... 2024-04-25T00:39:45.767 DEBUG:teuthology.task.install:project ceph 2024-04-25T00:39:45.767 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-25T00:39:45.768 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-25T00:39:45.768 INFO:teuthology.task.install:Using flavor: default 2024-04-25T00:39:45.775 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse', 'ceph-common-dbg', 'ceph-fuse-dbg', 'ceph-mds-dbg', 'ceph-mgr-dbg', 'ceph-mon-dbg', 'ceph-osd-dbg', 'ceph-test-dbg', 'libcephfs2-dbg', 'librados2-dbg', 'libradosstriper1-dbg', 'librbd1-dbg', 'librgw2-dbg', 'radosgw-dbg', 'rbd-fuse-dbg', 'rbd-mirror-dbg', 'rbd-nbd-dbg'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd', 'ceph-base-debuginfo', 'ceph-common-debuginfo', 'ceph-immutable-object-cache-debuginfo', 'ceph-radosgw-debuginfo', 'ceph-test-debuginfo', 'ceph-base-debuginfo', 'ceph-mgr-debuginfo', 'ceph-mds-debuginfo', 'ceph-mon-debuginfo', 'ceph-osd-debuginfo', 'ceph-fuse-debuginfo', 'librados-devel-debuginfo', 'libcephfs2-debuginfo', 'librados2-debuginfo', 'librbd1-debuginfo', 'python3-cephfs-debuginfo', 'python3-rados-debuginfo', 'python3-rbd-debuginfo', 'python3-rgw-debuginfo', 'rbd-fuse-debuginfo', 'rbd-mirror-debuginfo', 'rbd-nbd-debuginfo']} 2024-04-25T00:39:45.775 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T00:39:45.776 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-key list | grep Ceph 2024-04-25T00:39:45.776 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-key list | grep Ceph 2024-04-25T00:39:45.839 INFO:teuthology.orchestra.run.smithi179.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T00:39:45.859 INFO:teuthology.orchestra.run.smithi162.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T00:39:45.869 INFO:teuthology.orchestra.run.smithi179.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T00:39:45.869 INFO:teuthology.orchestra.run.smithi179.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T00:39:45.870 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T00:39:45.870 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T00:39:45.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T00:39:45.886 INFO:teuthology.orchestra.run.smithi162.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T00:39:45.886 INFO:teuthology.orchestra.run.smithi162.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T00:39:45.886 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, ceph-common-dbg, ceph-fuse-dbg, ceph-mds-dbg, ceph-mgr-dbg, ceph-mon-dbg, ceph-osd-dbg, ceph-test-dbg, libcephfs2-dbg, librados2-dbg, libradosstriper1-dbg, librbd1-dbg, librgw2-dbg, radosgw-dbg, rbd-fuse-dbg, rbd-mirror-dbg, rbd-nbd-dbg, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-25T00:39:45.886 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-25T00:39:45.887 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T00:39:46.023 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-25T00:39:46.023 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T00:39:46.108 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-25T00:39:46.108 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T00:39:46.195 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:39:46.195 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T00:39:46.209 DEBUG:teuthology.orchestra.run.smithi179:> sudo apt-get update 2024-04-25T00:39:46.213 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:39:46.213 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T00:39:46.226 DEBUG:teuthology.orchestra.run.smithi162:> sudo apt-get update 2024-04-25T00:39:46.411 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T00:39:46.411 INFO:teuthology.orchestra.run.smithi179.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T00:39:46.412 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T00:39:46.412 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T00:39:46.424 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T00:39:46.425 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T00:39:46.448 INFO:teuthology.orchestra.run.smithi179.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T00:39:46.489 INFO:teuthology.orchestra.run.smithi179.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T00:39:46.516 INFO:teuthology.orchestra.run.smithi162.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T00:39:46.520 INFO:teuthology.orchestra.run.smithi162.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T00:39:46.526 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T00:39:46.552 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T00:39:46.562 INFO:teuthology.orchestra.run.smithi179.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T00:39:46.589 INFO:teuthology.orchestra.run.smithi162.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T00:39:46.599 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-04-25T00:39:46.626 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,410 B] 2024-04-25T00:39:46.641 INFO:teuthology.orchestra.run.smithi179.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-25T00:39:46.689 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.8 kB] 2024-04-25T00:39:46.768 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 139 kB in 0s (363 kB/s) 2024-04-25T00:39:46.786 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 148 kB in 0s (391 kB/s) 2024-04-25T00:39:47.749 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-04-25T00:39:47.752 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-04-25T00:39:47.766 DEBUG:teuthology.orchestra.run.smithi179:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-common-dbg=19.0.0-2445-gd2c45d97-1jammy ceph-fuse-dbg=19.0.0-2445-gd2c45d97-1jammy ceph-mds-dbg=19.0.0-2445-gd2c45d97-1jammy ceph-mgr-dbg=19.0.0-2445-gd2c45d97-1jammy ceph-mon-dbg=19.0.0-2445-gd2c45d97-1jammy ceph-osd-dbg=19.0.0-2445-gd2c45d97-1jammy ceph-test-dbg=19.0.0-2445-gd2c45d97-1jammy libcephfs2-dbg=19.0.0-2445-gd2c45d97-1jammy librados2-dbg=19.0.0-2445-gd2c45d97-1jammy libradosstriper1-dbg=19.0.0-2445-gd2c45d97-1jammy librbd1-dbg=19.0.0-2445-gd2c45d97-1jammy librgw2-dbg=19.0.0-2445-gd2c45d97-1jammy radosgw-dbg=19.0.0-2445-gd2c45d97-1jammy rbd-fuse-dbg=19.0.0-2445-gd2c45d97-1jammy rbd-mirror-dbg=19.0.0-2445-gd2c45d97-1jammy rbd-nbd-dbg=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy cephfs-shell=19.0.0-2445-gd2c45d97-1jammy cephfs-top=19.0.0-2445-gd2c45d97-1jammy cephfs-mirror=19.0.0-2445-gd2c45d97-1jammy 2024-04-25T00:39:47.767 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-common-dbg=19.0.0-2445-gd2c45d97-1jammy ceph-fuse-dbg=19.0.0-2445-gd2c45d97-1jammy ceph-mds-dbg=19.0.0-2445-gd2c45d97-1jammy ceph-mgr-dbg=19.0.0-2445-gd2c45d97-1jammy ceph-mon-dbg=19.0.0-2445-gd2c45d97-1jammy ceph-osd-dbg=19.0.0-2445-gd2c45d97-1jammy ceph-test-dbg=19.0.0-2445-gd2c45d97-1jammy libcephfs2-dbg=19.0.0-2445-gd2c45d97-1jammy librados2-dbg=19.0.0-2445-gd2c45d97-1jammy libradosstriper1-dbg=19.0.0-2445-gd2c45d97-1jammy librbd1-dbg=19.0.0-2445-gd2c45d97-1jammy librgw2-dbg=19.0.0-2445-gd2c45d97-1jammy radosgw-dbg=19.0.0-2445-gd2c45d97-1jammy rbd-fuse-dbg=19.0.0-2445-gd2c45d97-1jammy rbd-mirror-dbg=19.0.0-2445-gd2c45d97-1jammy rbd-nbd-dbg=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy cephfs-shell=19.0.0-2445-gd2c45d97-1jammy cephfs-top=19.0.0-2445-gd2c45d97-1jammy cephfs-mirror=19.0.0-2445-gd2c45d97-1jammy 2024-04-25T00:39:47.827 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-04-25T00:39:47.828 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-04-25T00:39:48.034 INFO:teuthology.orchestra.run.smithi179.stdout:Building dependency tree... 2024-04-25T00:39:48.034 INFO:teuthology.orchestra.run.smithi179.stdout:Reading state information... 2024-04-25T00:39:48.037 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2024-04-25T00:39:48.038 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2024-04-25T00:39:48.226 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T00:39:48.226 INFO:teuthology.orchestra.run.smithi179.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T00:39:48.226 INFO:teuthology.orchestra.run.smithi179.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T00:39:48.226 INFO:teuthology.orchestra.run.smithi179.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T00:39:48.227 INFO:teuthology.orchestra.run.smithi179.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T00:39:48.227 INFO:teuthology.orchestra.run.smithi179.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T00:39:48.227 INFO:teuthology.orchestra.run.smithi179.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T00:39:48.229 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T00:39:48.229 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T00:39:48.229 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T00:39:48.229 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T00:39:48.229 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T00:39:48.229 INFO:teuthology.orchestra.run.smithi162.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T00:39:48.229 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T00:39:48.229 INFO:teuthology.orchestra.run.smithi162.stdout:The following additional packages will be installed: 2024-04-25T00:39:48.229 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T00:39:48.230 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T00:39:48.230 INFO:teuthology.orchestra.run.smithi162.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T00:39:48.230 INFO:teuthology.orchestra.run.smithi162.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T00:39:48.230 INFO:teuthology.orchestra.run.smithi162.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T00:39:48.230 INFO:teuthology.orchestra.run.smithi162.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T00:39:48.230 INFO:teuthology.orchestra.run.smithi162.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T00:39:48.230 INFO:teuthology.orchestra.run.smithi162.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T00:39:48.230 INFO:teuthology.orchestra.run.smithi162.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T00:39:48.230 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T00:39:48.230 INFO:teuthology.orchestra.run.smithi162.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T00:39:48.230 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T00:39:48.230 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T00:39:48.230 INFO:teuthology.orchestra.run.smithi162.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T00:39:48.230 INFO:teuthology.orchestra.run.smithi162.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T00:39:48.230 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T00:39:48.231 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T00:39:48.231 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T00:39:48.231 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T00:39:48.231 INFO:teuthology.orchestra.run.smithi162.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T00:39:48.231 INFO:teuthology.orchestra.run.smithi162.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T00:39:48.231 INFO:teuthology.orchestra.run.smithi162.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T00:39:48.231 INFO:teuthology.orchestra.run.smithi162.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T00:39:48.231 INFO:teuthology.orchestra.run.smithi162.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2024-04-25T00:39:48.231 INFO:teuthology.orchestra.run.smithi162.stdout:Suggested packages: 2024-04-25T00:39:48.232 INFO:teuthology.orchestra.run.smithi162.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T00:39:48.232 INFO:teuthology.orchestra.run.smithi162.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T00:39:48.232 INFO:teuthology.orchestra.run.smithi162.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T00:39:48.232 INFO:teuthology.orchestra.run.smithi162.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T00:39:48.232 INFO:teuthology.orchestra.run.smithi162.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T00:39:48.232 INFO:teuthology.orchestra.run.smithi162.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T00:39:48.232 INFO:teuthology.orchestra.run.smithi162.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T00:39:48.232 INFO:teuthology.orchestra.run.smithi162.stdout:Recommended packages: 2024-04-25T00:39:48.232 INFO:teuthology.orchestra.run.smithi162.stdout: btrfs-tools 2024-04-25T00:39:48.233 INFO:teuthology.orchestra.run.smithi179.stdout:The following additional packages will be installed: 2024-04-25T00:39:48.233 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T00:39:48.233 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T00:39:48.234 INFO:teuthology.orchestra.run.smithi179.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T00:39:48.234 INFO:teuthology.orchestra.run.smithi179.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T00:39:48.234 INFO:teuthology.orchestra.run.smithi179.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T00:39:48.234 INFO:teuthology.orchestra.run.smithi179.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T00:39:48.234 INFO:teuthology.orchestra.run.smithi179.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T00:39:48.234 INFO:teuthology.orchestra.run.smithi179.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T00:39:48.234 INFO:teuthology.orchestra.run.smithi179.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T00:39:48.234 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-25T00:39:48.234 INFO:teuthology.orchestra.run.smithi179.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-25T00:39:48.234 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-25T00:39:48.234 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-25T00:39:48.234 INFO:teuthology.orchestra.run.smithi179.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-25T00:39:48.234 INFO:teuthology.orchestra.run.smithi179.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-25T00:39:48.234 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-25T00:39:48.234 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-25T00:39:48.235 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-25T00:39:48.235 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-25T00:39:48.235 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-25T00:39:48.235 INFO:teuthology.orchestra.run.smithi179.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-25T00:39:48.235 INFO:teuthology.orchestra.run.smithi179.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-25T00:39:48.235 INFO:teuthology.orchestra.run.smithi179.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-25T00:39:48.235 INFO:teuthology.orchestra.run.smithi179.stdout: qttranslations5-l10n rbd-mirror rbd-nbd socat unzip xmlstarlet zip 2024-04-25T00:39:48.235 INFO:teuthology.orchestra.run.smithi179.stdout:Suggested packages: 2024-04-25T00:39:48.235 INFO:teuthology.orchestra.run.smithi179.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T00:39:48.235 INFO:teuthology.orchestra.run.smithi179.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T00:39:48.235 INFO:teuthology.orchestra.run.smithi179.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T00:39:48.235 INFO:teuthology.orchestra.run.smithi179.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T00:39:48.235 INFO:teuthology.orchestra.run.smithi179.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T00:39:48.235 INFO:teuthology.orchestra.run.smithi179.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T00:39:48.235 INFO:teuthology.orchestra.run.smithi179.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T00:39:48.235 INFO:teuthology.orchestra.run.smithi179.stdout:Recommended packages: 2024-04-25T00:39:48.236 INFO:teuthology.orchestra.run.smithi179.stdout: btrfs-tools 2024-04-25T00:39:48.359 INFO:teuthology.orchestra.run.smithi179.stdout:The following NEW packages will be installed: 2024-04-25T00:39:48.359 INFO:teuthology.orchestra.run.smithi179.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-04-25T00:39:48.359 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-04-25T00:39:48.360 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-04-25T00:39:48.360 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-04-25T00:39:48.360 INFO:teuthology.orchestra.run.smithi179.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2024-04-25T00:39:48.360 INFO:teuthology.orchestra.run.smithi179.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2024-04-25T00:39:48.360 INFO:teuthology.orchestra.run.smithi179.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-25T00:39:48.360 INFO:teuthology.orchestra.run.smithi179.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2024-04-25T00:39:48.361 INFO:teuthology.orchestra.run.smithi179.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2024-04-25T00:39:48.361 INFO:teuthology.orchestra.run.smithi179.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T00:39:48.361 INFO:teuthology.orchestra.run.smithi179.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T00:39:48.361 INFO:teuthology.orchestra.run.smithi179.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T00:39:48.361 INFO:teuthology.orchestra.run.smithi179.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T00:39:48.361 INFO:teuthology.orchestra.run.smithi179.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T00:39:48.361 INFO:teuthology.orchestra.run.smithi179.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T00:39:48.361 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T00:39:48.361 INFO:teuthology.orchestra.run.smithi179.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T00:39:48.362 INFO:teuthology.orchestra.run.smithi179.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T00:39:48.362 INFO:teuthology.orchestra.run.smithi179.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T00:39:48.362 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T00:39:48.362 INFO:teuthology.orchestra.run.smithi179.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T00:39:48.362 INFO:teuthology.orchestra.run.smithi179.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T00:39:48.362 INFO:teuthology.orchestra.run.smithi179.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T00:39:48.362 INFO:teuthology.orchestra.run.smithi179.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T00:39:48.362 INFO:teuthology.orchestra.run.smithi179.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T00:39:48.362 INFO:teuthology.orchestra.run.smithi179.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T00:39:48.362 INFO:teuthology.orchestra.run.smithi179.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T00:39:48.362 INFO:teuthology.orchestra.run.smithi179.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T00:39:48.362 INFO:teuthology.orchestra.run.smithi179.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-04-25T00:39:48.362 INFO:teuthology.orchestra.run.smithi179.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-04-25T00:39:48.362 INFO:teuthology.orchestra.run.smithi179.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-04-25T00:39:48.364 INFO:teuthology.orchestra.run.smithi162.stdout:The following NEW packages will be installed: 2024-04-25T00:39:48.364 INFO:teuthology.orchestra.run.smithi162.stdout: ceph ceph-base ceph-common ceph-common-dbg ceph-fuse ceph-fuse-dbg ceph-mds 2024-04-25T00:39:48.364 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mds-dbg ceph-mgr ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-dbg 2024-04-25T00:39:48.364 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2024-04-25T00:39:48.364 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-mon ceph-mon-dbg ceph-osd ceph-osd-dbg ceph-test ceph-test-dbg 2024-04-25T00:39:48.364 INFO:teuthology.orchestra.run.smithi162.stdout: ceph-volume cephadm cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev 2024-04-25T00:39:48.364 INFO:teuthology.orchestra.run.smithi162.stdout: libcephfs2 libcephfs2-dbg libdouble-conversion3 libjq1 liblttng-ust1 2024-04-25T00:39:48.364 INFO:teuthology.orchestra.run.smithi162.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-25T00:39:48.364 INFO:teuthology.orchestra.run.smithi162.stdout: libqt5network5 librados2 librados2-dbg libradosstriper1 libradosstriper1-dbg 2024-04-25T00:39:48.365 INFO:teuthology.orchestra.run.smithi162.stdout: librbd1 librbd1-dbg librdkafka1 libreadline-dev librgw2 librgw2-dbg 2024-04-25T00:39:48.365 INFO:teuthology.orchestra.run.smithi162.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-25T00:39:48.365 INFO:teuthology.orchestra.run.smithi162.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-25T00:39:48.365 INFO:teuthology.orchestra.run.smithi162.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-25T00:39:48.365 INFO:teuthology.orchestra.run.smithi162.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-25T00:39:48.365 INFO:teuthology.orchestra.run.smithi162.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-25T00:39:48.365 INFO:teuthology.orchestra.run.smithi162.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-25T00:39:48.365 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T00:39:48.365 INFO:teuthology.orchestra.run.smithi162.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T00:39:48.365 INFO:teuthology.orchestra.run.smithi162.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T00:39:48.365 INFO:teuthology.orchestra.run.smithi162.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T00:39:48.365 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T00:39:48.365 INFO:teuthology.orchestra.run.smithi162.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T00:39:48.365 INFO:teuthology.orchestra.run.smithi162.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-25T00:39:48.365 INFO:teuthology.orchestra.run.smithi162.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-25T00:39:48.365 INFO:teuthology.orchestra.run.smithi162.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-25T00:39:48.366 INFO:teuthology.orchestra.run.smithi162.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T00:39:48.366 INFO:teuthology.orchestra.run.smithi162.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T00:39:48.366 INFO:teuthology.orchestra.run.smithi162.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T00:39:48.366 INFO:teuthology.orchestra.run.smithi162.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T00:39:48.366 INFO:teuthology.orchestra.run.smithi162.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw 2024-04-25T00:39:48.366 INFO:teuthology.orchestra.run.smithi162.stdout: radosgw-dbg rbd-fuse rbd-fuse-dbg rbd-mirror rbd-mirror-dbg rbd-nbd 2024-04-25T00:39:48.366 INFO:teuthology.orchestra.run.smithi162.stdout: rbd-nbd-dbg socat unzip xmlstarlet zip 2024-04-25T00:39:48.428 INFO:teuthology.orchestra.run.smithi162.stdout:0 upgraded, 142 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T00:39:48.428 INFO:teuthology.orchestra.run.smithi162.stdout:Need to get 3,875 MB of archives. 2024-04-25T00:39:48.428 INFO:teuthology.orchestra.run.smithi162.stdout:After this operation, 4,781 MB of additional disk space will be used. 2024-04-25T00:39:48.428 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T00:39:48.448 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T00:39:48.460 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T00:39:48.507 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T00:39:48.531 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T00:39:48.534 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T00:39:48.549 INFO:teuthology.orchestra.run.smithi179.stdout:0 upgraded, 142 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T00:39:48.549 INFO:teuthology.orchestra.run.smithi179.stdout:Need to get 3,875 MB of archives. 2024-04-25T00:39:48.549 INFO:teuthology.orchestra.run.smithi179.stdout:After this operation, 4,781 MB of additional disk space will be used. 2024-04-25T00:39:48.549 INFO:teuthology.orchestra.run.smithi179.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-25T00:39:48.549 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T00:39:48.579 INFO:teuthology.orchestra.run.smithi179.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,540 kB] 2024-04-25T00:39:48.582 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,540 kB] 2024-04-25T00:39:48.601 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T00:39:48.606 INFO:teuthology.orchestra.run.smithi162.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T00:39:48.618 INFO:teuthology.orchestra.run.smithi162.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T00:39:48.622 INFO:teuthology.orchestra.run.smithi162.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T00:39:48.622 INFO:teuthology.orchestra.run.smithi162.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T00:39:48.631 INFO:teuthology.orchestra.run.smithi162.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T00:39:48.631 INFO:teuthology.orchestra.run.smithi179.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T00:39:48.633 INFO:teuthology.orchestra.run.smithi162.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T00:39:48.635 INFO:teuthology.orchestra.run.smithi162.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T00:39:48.636 INFO:teuthology.orchestra.run.smithi162.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T00:39:48.637 INFO:teuthology.orchestra.run.smithi162.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T00:39:48.645 INFO:teuthology.orchestra.run.smithi162.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T00:39:48.647 INFO:teuthology.orchestra.run.smithi162.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T00:39:48.649 INFO:teuthology.orchestra.run.smithi162.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T00:39:48.664 INFO:teuthology.orchestra.run.smithi162.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T00:39:48.665 INFO:teuthology.orchestra.run.smithi162.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T00:39:48.666 INFO:teuthology.orchestra.run.smithi162.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T00:39:48.666 INFO:teuthology.orchestra.run.smithi162.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T00:39:48.666 INFO:teuthology.orchestra.run.smithi162.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T00:39:48.667 INFO:teuthology.orchestra.run.smithi162.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T00:39:48.667 INFO:teuthology.orchestra.run.smithi162.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T00:39:48.677 INFO:teuthology.orchestra.run.smithi179.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-25T00:39:48.684 INFO:teuthology.orchestra.run.smithi162.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T00:39:48.684 INFO:teuthology.orchestra.run.smithi162.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T00:39:48.687 INFO:teuthology.orchestra.run.smithi162.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T00:39:48.704 INFO:teuthology.orchestra.run.smithi162.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T00:39:48.704 INFO:teuthology.orchestra.run.smithi162.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T00:39:48.704 INFO:teuthology.orchestra.run.smithi162.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T00:39:48.705 INFO:teuthology.orchestra.run.smithi162.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T00:39:48.706 INFO:teuthology.orchestra.run.smithi162.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T00:39:48.706 INFO:teuthology.orchestra.run.smithi162.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T00:39:48.708 INFO:teuthology.orchestra.run.smithi162.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T00:39:48.723 INFO:teuthology.orchestra.run.smithi162.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T00:39:48.724 INFO:teuthology.orchestra.run.smithi162.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T00:39:48.729 INFO:teuthology.orchestra.run.smithi162.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T00:39:48.743 INFO:teuthology.orchestra.run.smithi162.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T00:39:48.743 INFO:teuthology.orchestra.run.smithi162.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T00:39:48.744 INFO:teuthology.orchestra.run.smithi162.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T00:39:48.745 INFO:teuthology.orchestra.run.smithi162.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T00:39:48.747 INFO:teuthology.orchestra.run.smithi162.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T00:39:48.748 INFO:teuthology.orchestra.run.smithi162.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T00:39:48.749 INFO:teuthology.orchestra.run.smithi162.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T00:39:48.762 INFO:teuthology.orchestra.run.smithi162.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T00:39:48.764 INFO:teuthology.orchestra.run.smithi162.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T00:39:48.765 INFO:teuthology.orchestra.run.smithi162.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T00:39:48.782 INFO:teuthology.orchestra.run.smithi162.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T00:39:48.784 INFO:teuthology.orchestra.run.smithi162.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T00:39:48.848 INFO:teuthology.orchestra.run.smithi162.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T00:39:48.850 INFO:teuthology.orchestra.run.smithi162.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T00:39:48.851 INFO:teuthology.orchestra.run.smithi162.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T00:39:48.852 INFO:teuthology.orchestra.run.smithi162.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T00:39:48.853 INFO:teuthology.orchestra.run.smithi162.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T00:39:48.877 INFO:teuthology.orchestra.run.smithi162.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T00:39:48.878 INFO:teuthology.orchestra.run.smithi179.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T00:39:48.879 INFO:teuthology.orchestra.run.smithi162.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T00:39:48.879 INFO:teuthology.orchestra.run.smithi162.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T00:39:48.898 INFO:teuthology.orchestra.run.smithi162.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T00:39:48.898 INFO:teuthology.orchestra.run.smithi162.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T00:39:48.905 INFO:teuthology.orchestra.run.smithi162.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T00:39:48.906 INFO:teuthology.orchestra.run.smithi162.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T00:39:48.906 INFO:teuthology.orchestra.run.smithi162.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T00:39:48.909 INFO:teuthology.orchestra.run.smithi162.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T00:39:48.910 INFO:teuthology.orchestra.run.smithi162.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T00:39:48.910 INFO:teuthology.orchestra.run.smithi162.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T00:39:48.911 INFO:teuthology.orchestra.run.smithi162.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T00:39:48.925 INFO:teuthology.orchestra.run.smithi162.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T00:39:48.927 INFO:teuthology.orchestra.run.smithi162.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T00:39:48.927 INFO:teuthology.orchestra.run.smithi162.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T00:39:48.945 INFO:teuthology.orchestra.run.smithi162.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T00:39:48.948 INFO:teuthology.orchestra.run.smithi162.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T00:39:48.948 INFO:teuthology.orchestra.run.smithi162.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T00:39:48.949 INFO:teuthology.orchestra.run.smithi162.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T00:39:48.950 INFO:teuthology.orchestra.run.smithi162.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T00:39:48.954 INFO:teuthology.orchestra.run.smithi162.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T00:39:48.955 INFO:teuthology.orchestra.run.smithi162.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T00:39:48.965 INFO:teuthology.orchestra.run.smithi162.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T00:39:48.965 INFO:teuthology.orchestra.run.smithi162.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T00:39:48.966 INFO:teuthology.orchestra.run.smithi162.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T00:39:48.973 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T00:39:48.984 INFO:teuthology.orchestra.run.smithi162.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T00:39:48.986 INFO:teuthology.orchestra.run.smithi162.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T00:39:48.986 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T00:39:48.987 INFO:teuthology.orchestra.run.smithi162.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T00:39:48.993 INFO:teuthology.orchestra.run.smithi162.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T00:39:48.994 INFO:teuthology.orchestra.run.smithi162.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T00:39:48.994 INFO:teuthology.orchestra.run.smithi162.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T00:39:48.996 INFO:teuthology.orchestra.run.smithi162.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T00:39:49.004 INFO:teuthology.orchestra.run.smithi162.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T00:39:49.038 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T00:39:49.211 INFO:teuthology.orchestra.run.smithi179.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T00:39:49.220 INFO:teuthology.orchestra.run.smithi179.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T00:39:49.248 INFO:teuthology.orchestra.run.smithi179.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T00:39:49.256 INFO:teuthology.orchestra.run.smithi179.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T00:39:49.276 INFO:teuthology.orchestra.run.smithi179.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-25T00:39:49.288 INFO:teuthology.orchestra.run.smithi162.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-25T00:39:49.420 INFO:teuthology.orchestra.run.smithi179.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T00:39:49.568 INFO:teuthology.orchestra.run.smithi179.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-25T00:39:49.576 INFO:teuthology.orchestra.run.smithi162.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-25T00:39:49.617 INFO:teuthology.orchestra.run.smithi162.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-25T00:39:49.633 INFO:teuthology.orchestra.run.smithi179.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-25T00:39:49.643 INFO:teuthology.orchestra.run.smithi179.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-25T00:39:49.644 INFO:teuthology.orchestra.run.smithi179.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-25T00:39:49.648 INFO:teuthology.orchestra.run.smithi162.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-25T00:39:49.650 INFO:teuthology.orchestra.run.smithi162.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-25T00:39:49.654 INFO:teuthology.orchestra.run.smithi162.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.7 kB] 2024-04-25T00:39:49.656 INFO:teuthology.orchestra.run.smithi162.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-25T00:39:49.671 INFO:teuthology.orchestra.run.smithi179.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.7 kB] 2024-04-25T00:39:49.673 INFO:teuthology.orchestra.run.smithi179.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-25T00:39:49.681 INFO:teuthology.orchestra.run.smithi179.stdout:Get:21 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-25T00:39:49.687 INFO:teuthology.orchestra.run.smithi162.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-25T00:39:49.990 INFO:teuthology.orchestra.run.smithi179.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T00:39:50.005 INFO:teuthology.orchestra.run.smithi179.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T00:39:50.020 INFO:teuthology.orchestra.run.smithi179.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T00:39:50.029 INFO:teuthology.orchestra.run.smithi179.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T00:39:50.029 INFO:teuthology.orchestra.run.smithi179.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T00:39:50.045 INFO:teuthology.orchestra.run.smithi179.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T00:39:50.083 INFO:teuthology.orchestra.run.smithi179.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T00:39:50.097 INFO:teuthology.orchestra.run.smithi179.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T00:39:50.101 INFO:teuthology.orchestra.run.smithi179.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T00:39:50.101 INFO:teuthology.orchestra.run.smithi179.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T00:39:50.128 INFO:teuthology.orchestra.run.smithi179.stdout:Get:32 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-25T00:39:50.134 INFO:teuthology.orchestra.run.smithi179.stdout:Get:33 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [466 kB] 2024-04-25T00:39:50.146 INFO:teuthology.orchestra.run.smithi162.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-25T00:39:50.149 INFO:teuthology.orchestra.run.smithi162.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [466 kB] 2024-04-25T00:39:50.158 INFO:teuthology.orchestra.run.smithi162.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-25T00:39:50.175 INFO:teuthology.orchestra.run.smithi179.stdout:Get:34 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-25T00:39:50.272 INFO:teuthology.orchestra.run.smithi179.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T00:39:50.355 INFO:teuthology.orchestra.run.smithi179.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T00:39:50.379 INFO:teuthology.orchestra.run.smithi179.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T00:39:50.437 INFO:teuthology.orchestra.run.smithi179.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T00:39:50.480 INFO:teuthology.orchestra.run.smithi179.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T00:39:50.502 INFO:teuthology.orchestra.run.smithi179.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T00:39:50.530 INFO:teuthology.orchestra.run.smithi179.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T00:39:50.713 INFO:teuthology.orchestra.run.smithi179.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T00:39:50.729 INFO:teuthology.orchestra.run.smithi179.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T00:39:50.736 INFO:teuthology.orchestra.run.smithi179.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T00:39:50.741 INFO:teuthology.orchestra.run.smithi179.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T00:39:50.925 INFO:teuthology.orchestra.run.smithi179.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T00:39:51.008 INFO:teuthology.orchestra.run.smithi179.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T00:39:51.023 INFO:teuthology.orchestra.run.smithi179.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T00:39:51.207 INFO:teuthology.orchestra.run.smithi179.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T00:39:51.258 INFO:teuthology.orchestra.run.smithi179.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T00:39:51.271 INFO:teuthology.orchestra.run.smithi179.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T00:39:51.429 INFO:teuthology.orchestra.run.smithi179.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T00:39:51.430 INFO:teuthology.orchestra.run.smithi179.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T00:39:51.434 INFO:teuthology.orchestra.run.smithi179.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T00:39:51.439 INFO:teuthology.orchestra.run.smithi179.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T00:39:51.453 INFO:teuthology.orchestra.run.smithi179.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T00:39:51.638 INFO:teuthology.orchestra.run.smithi179.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T00:39:51.881 INFO:teuthology.orchestra.run.smithi162.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-25T00:39:51.895 INFO:teuthology.orchestra.run.smithi179.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T00:39:52.001 INFO:teuthology.orchestra.run.smithi179.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-25T00:39:52.011 INFO:teuthology.orchestra.run.smithi179.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T00:39:52.054 INFO:teuthology.orchestra.run.smithi179.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T00:39:52.079 INFO:teuthology.orchestra.run.smithi162.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-25T00:39:52.086 INFO:teuthology.orchestra.run.smithi162.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-25T00:39:52.102 INFO:teuthology.orchestra.run.smithi162.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,525 kB] 2024-04-25T00:39:52.137 INFO:teuthology.orchestra.run.smithi179.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T00:39:52.149 INFO:teuthology.orchestra.run.smithi179.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T00:39:52.162 INFO:teuthology.orchestra.run.smithi179.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T00:39:52.187 INFO:teuthology.orchestra.run.smithi162.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-25T00:39:52.202 INFO:teuthology.orchestra.run.smithi179.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T00:39:52.302 INFO:teuthology.orchestra.run.smithi179.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-25T00:39:52.334 INFO:teuthology.orchestra.run.smithi179.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-25T00:39:52.339 INFO:teuthology.orchestra.run.smithi179.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,525 kB] 2024-04-25T00:39:52.458 INFO:teuthology.orchestra.run.smithi179.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-25T00:39:52.466 INFO:teuthology.orchestra.run.smithi179.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T00:39:52.469 INFO:teuthology.orchestra.run.smithi179.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T00:39:52.472 INFO:teuthology.orchestra.run.smithi179.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T00:39:52.563 INFO:teuthology.orchestra.run.smithi162.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-25T00:39:52.636 INFO:teuthology.orchestra.run.smithi179.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T00:39:52.905 INFO:teuthology.orchestra.run.smithi179.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-25T00:39:52.974 INFO:teuthology.orchestra.run.smithi179.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T00:39:53.370 INFO:teuthology.orchestra.run.smithi179.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T00:39:53.380 INFO:teuthology.orchestra.run.smithi179.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T00:39:53.381 INFO:teuthology.orchestra.run.smithi179.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T00:39:53.454 INFO:teuthology.orchestra.run.smithi179.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T00:39:53.454 INFO:teuthology.orchestra.run.smithi179.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T00:39:53.456 INFO:teuthology.orchestra.run.smithi179.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T00:39:53.458 INFO:teuthology.orchestra.run.smithi179.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T00:39:53.459 INFO:teuthology.orchestra.run.smithi179.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T00:39:53.627 INFO:teuthology.orchestra.run.smithi179.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T00:39:53.720 INFO:teuthology.orchestra.run.smithi179.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T00:39:53.818 INFO:teuthology.orchestra.run.smithi179.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T00:39:54.004 INFO:teuthology.orchestra.run.smithi162.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-25T00:39:54.004 INFO:teuthology.orchestra.run.smithi162.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-25T00:39:54.021 INFO:teuthology.orchestra.run.smithi162.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-25T00:39:54.064 INFO:teuthology.orchestra.run.smithi179.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T00:39:54.107 INFO:teuthology.orchestra.run.smithi179.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T00:39:54.125 INFO:teuthology.orchestra.run.smithi162.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [790 kB] 2024-04-25T00:39:54.131 INFO:teuthology.orchestra.run.smithi179.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T00:39:54.139 INFO:teuthology.orchestra.run.smithi179.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T00:39:54.160 INFO:teuthology.orchestra.run.smithi162.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-25T00:39:54.165 INFO:teuthology.orchestra.run.smithi162.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-25T00:39:54.183 INFO:teuthology.orchestra.run.smithi179.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T00:39:54.208 INFO:teuthology.orchestra.run.smithi179.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-25T00:39:54.210 INFO:teuthology.orchestra.run.smithi179.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T00:39:54.217 INFO:teuthology.orchestra.run.smithi179.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T00:39:54.304 INFO:teuthology.orchestra.run.smithi162.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-25T00:39:54.386 INFO:teuthology.orchestra.run.smithi179.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T00:39:54.612 INFO:teuthology.orchestra.run.smithi179.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-25T00:39:54.612 INFO:teuthology.orchestra.run.smithi179.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-25T00:39:54.629 INFO:teuthology.orchestra.run.smithi179.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-25T00:39:54.778 INFO:teuthology.orchestra.run.smithi179.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [790 kB] 2024-04-25T00:39:54.833 INFO:teuthology.orchestra.run.smithi162.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-25T00:39:54.834 INFO:teuthology.orchestra.run.smithi162.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-25T00:39:54.842 INFO:teuthology.orchestra.run.smithi179.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-25T00:39:54.847 INFO:teuthology.orchestra.run.smithi179.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-25T00:39:54.928 INFO:teuthology.orchestra.run.smithi179.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T00:39:54.933 INFO:teuthology.orchestra.run.smithi179.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T00:39:54.972 INFO:teuthology.orchestra.run.smithi179.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T00:39:54.973 INFO:teuthology.orchestra.run.smithi179.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T00:39:54.979 INFO:teuthology.orchestra.run.smithi179.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T00:39:54.982 INFO:teuthology.orchestra.run.smithi179.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T00:39:55.023 INFO:teuthology.orchestra.run.smithi179.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T00:39:55.025 INFO:teuthology.orchestra.run.smithi179.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-25T00:39:55.032 INFO:teuthology.orchestra.run.smithi179.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T00:39:55.104 INFO:teuthology.orchestra.run.smithi179.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T00:39:55.106 INFO:teuthology.orchestra.run.smithi179.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T00:39:55.271 INFO:teuthology.orchestra.run.smithi179.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T00:39:55.681 INFO:teuthology.orchestra.run.smithi179.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-25T00:39:55.681 INFO:teuthology.orchestra.run.smithi179.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-25T00:39:55.704 INFO:teuthology.orchestra.run.smithi179.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T00:39:55.719 INFO:teuthology.orchestra.run.smithi179.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T00:39:58.127 INFO:teuthology.orchestra.run.smithi162.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-25T00:39:58.129 INFO:teuthology.orchestra.run.smithi162.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2445-gd2c45d97-1jammy [229 kB] 2024-04-25T00:39:58.134 INFO:teuthology.orchestra.run.smithi162.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2445-gd2c45d97-1jammy [34.0 kB] 2024-04-25T00:39:58.135 INFO:teuthology.orchestra.run.smithi162.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2445-gd2c45d97-1jammy [23.4 kB] 2024-04-25T00:39:58.136 INFO:teuthology.orchestra.run.smithi162.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-25T00:39:58.138 INFO:teuthology.orchestra.run.smithi162.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-25T00:39:58.926 INFO:teuthology.orchestra.run.smithi162.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.2 kB] 2024-04-25T00:39:58.928 INFO:teuthology.orchestra.run.smithi162.stdout:Get:125 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-2445-gd2c45d97-1jammy [3,122 kB] 2024-04-25T00:39:59.003 INFO:teuthology.orchestra.run.smithi162.stdout:Get:126 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-2445-gd2c45d97-1jammy [179 kB] 2024-04-25T00:39:59.031 INFO:teuthology.orchestra.run.smithi162.stdout:Get:127 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [775 MB] 2024-04-25T00:39:59.511 INFO:teuthology.orchestra.run.smithi179.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-25T00:39:59.513 INFO:teuthology.orchestra.run.smithi179.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-2445-gd2c45d97-1jammy [229 kB] 2024-04-25T00:39:59.518 INFO:teuthology.orchestra.run.smithi179.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-2445-gd2c45d97-1jammy [34.0 kB] 2024-04-25T00:39:59.519 INFO:teuthology.orchestra.run.smithi179.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-2445-gd2c45d97-1jammy [23.4 kB] 2024-04-25T00:39:59.520 INFO:teuthology.orchestra.run.smithi179.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-25T00:39:59.522 INFO:teuthology.orchestra.run.smithi179.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-25T00:40:00.154 INFO:teuthology.orchestra.run.smithi179.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.2 kB] 2024-04-25T00:40:00.156 INFO:teuthology.orchestra.run.smithi179.stdout:Get:125 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror amd64 19.0.0-2445-gd2c45d97-1jammy [3,122 kB] 2024-04-25T00:40:00.349 INFO:teuthology.orchestra.run.smithi179.stdout:Get:126 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd amd64 19.0.0-2445-gd2c45d97-1jammy [179 kB] 2024-04-25T00:40:00.363 INFO:teuthology.orchestra.run.smithi179.stdout:Get:127 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [775 MB] 2024-04-25T00:41:01.776 INFO:teuthology.orchestra.run.smithi162.stdout:Get:128 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [18.9 MB] 2024-04-25T00:41:02.759 INFO:teuthology.orchestra.run.smithi162.stdout:Get:129 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [86.4 MB] 2024-04-25T00:41:03.639 INFO:teuthology.orchestra.run.smithi179.stdout:Get:128 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [18.9 MB] 2024-04-25T00:41:04.604 INFO:teuthology.orchestra.run.smithi179.stdout:Get:129 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [86.4 MB] 2024-04-25T00:41:10.288 INFO:teuthology.orchestra.run.smithi162.stdout:Get:130 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [42.7 MB] 2024-04-25T00:41:10.343 INFO:teuthology.orchestra.run.smithi179.stdout:Get:130 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [42.7 MB] 2024-04-25T00:41:13.098 INFO:teuthology.orchestra.run.smithi179.stdout:Get:131 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [159 MB] 2024-04-25T00:41:13.990 INFO:teuthology.orchestra.run.smithi162.stdout:Get:131 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [159 MB] 2024-04-25T00:41:29.181 INFO:teuthology.orchestra.run.smithi179.stdout:Get:132 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [540 MB] 2024-04-25T00:41:33.149 INFO:teuthology.orchestra.run.smithi162.stdout:Get:132 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [540 MB] 2024-04-25T00:42:13.230 INFO:teuthology.orchestra.run.smithi179.stdout:Get:133 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [1,215 MB] 2024-04-25T00:42:35.644 INFO:teuthology.orchestra.run.smithi162.stdout:Get:133 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [1,215 MB] 2024-04-25T00:43:51.089 INFO:teuthology.orchestra.run.smithi179.stdout:Get:134 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [17.0 MB] 2024-04-25T00:43:52.151 INFO:teuthology.orchestra.run.smithi179.stdout:Get:135 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [83.0 MB] 2024-04-25T00:43:58.474 INFO:teuthology.orchestra.run.smithi179.stdout:Get:136 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [11.4 MB] 2024-04-25T00:43:59.011 INFO:teuthology.orchestra.run.smithi179.stdout:Get:137 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [103 MB] 2024-04-25T00:44:07.008 INFO:teuthology.orchestra.run.smithi179.stdout:Get:138 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [183 MB] 2024-04-25T00:44:19.000 INFO:teuthology.orchestra.run.smithi179.stdout:Get:139 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [355 MB] 2024-04-25T00:44:28.903 INFO:teuthology.orchestra.run.smithi162.stdout:Get:134 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [17.0 MB] 2024-04-25T00:44:29.798 INFO:teuthology.orchestra.run.smithi162.stdout:Get:135 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [83.0 MB] 2024-04-25T00:44:35.186 INFO:teuthology.orchestra.run.smithi162.stdout:Get:136 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [11.4 MB] 2024-04-25T00:44:36.036 INFO:teuthology.orchestra.run.smithi162.stdout:Get:137 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [103 MB] 2024-04-25T00:44:43.504 INFO:teuthology.orchestra.run.smithi162.stdout:Get:138 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [183 MB] 2024-04-25T00:44:46.012 INFO:teuthology.orchestra.run.smithi179.stdout:Get:140 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [1,792 kB] 2024-04-25T00:44:46.045 INFO:teuthology.orchestra.run.smithi179.stdout:Get:141 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [97.3 MB] 2024-04-25T00:44:55.013 INFO:teuthology.orchestra.run.smithi179.stdout:Get:142 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [3,139 kB] 2024-04-25T00:44:55.683 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 3,875 MB in 5min 7s (12.6 MB/s) 2024-04-25T00:44:55.827 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T00:44:55.925 INFO:teuthology.orchestra.run.smithi179.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T00:44:55.931 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T00:44:55.974 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T00:44:56.285 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T00:44:56.301 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T00:44:56.343 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T00:44:56.621 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T00:44:56.636 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T00:44:56.671 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T00:44:56.999 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T00:44:57.025 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T00:44:57.091 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T00:44:57.444 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T00:44:57.471 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T00:44:57.511 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T00:44:57.618 INFO:teuthology.orchestra.run.smithi162.stdout:Get:139 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [355 MB] 2024-04-25T00:44:57.847 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T00:44:57.873 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T00:44:57.914 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T00:44:58.325 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T00:44:58.352 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T00:44:58.392 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T00:44:58.795 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T00:44:58.821 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T00:44:58.862 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T00:44:59.223 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T00:44:59.250 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T00:44:59.290 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T00:44:59.660 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T00:44:59.686 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T00:44:59.726 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T00:45:00.046 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librados2. 2024-04-25T00:45:00.072 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../010-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:00.112 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:00.548 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librbd1. 2024-04-25T00:45:00.575 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../011-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:00.615 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:01.118 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T00:45:01.145 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:01.193 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:01.546 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rados. 2024-04-25T00:45:01.561 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:01.604 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:01.924 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T00:45:01.950 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:45:01.990 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:02.259 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T00:45:02.285 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:02.334 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:02.720 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T00:45:02.747 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:45:02.795 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:03.148 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T00:45:03.175 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T00:45:03.215 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T00:45:03.459 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T00:45:03.474 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:03.517 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:03.879 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T00:45:03.905 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T00:45:03.945 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T00:45:04.223 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T00:45:04.238 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T00:45:04.273 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T00:45:04.542 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T00:45:04.569 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T00:45:04.609 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T00:45:04.912 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua5.1. 2024-04-25T00:45:04.939 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T00:45:04.979 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T00:45:05.290 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua-any. 2024-04-25T00:45:05.317 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T00:45:05.357 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T00:45:05.609 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package zip. 2024-04-25T00:45:05.635 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T00:45:05.676 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T00:45:05.971 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package unzip. 2024-04-25T00:45:05.997 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T00:45:06.192 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T00:45:06.733 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package luarocks. 2024-04-25T00:45:06.759 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T00:45:06.799 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T00:45:07.174 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librgw2. 2024-04-25T00:45:07.200 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../027-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:07.240 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:07.810 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T00:45:07.835 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:07.876 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:08.170 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T00:45:08.197 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T00:45:08.229 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T00:45:08.565 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T00:45:08.591 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:08.631 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:09.060 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-common. 2024-04-25T00:45:09.086 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:09.126 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:10.582 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-base. 2024-04-25T00:45:10.608 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:10.665 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:11.327 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T00:45:11.354 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T00:45:11.402 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T00:45:11.705 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T00:45:11.731 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T00:45:11.771 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T00:45:12.092 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T00:45:12.118 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T00:45:12.178 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T00:45:12.528 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T00:45:12.554 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T00:45:12.602 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T00:45:12.972 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T00:45:12.998 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T00:45:13.047 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T00:45:13.350 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T00:45:13.376 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T00:45:13.416 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T00:45:13.720 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-portend. 2024-04-25T00:45:13.746 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T00:45:13.794 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T00:45:14.164 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T00:45:14.190 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T00:45:14.238 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T00:45:14.566 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T00:45:14.593 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T00:45:14.633 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T00:45:14.987 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T00:45:15.013 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T00:45:15.053 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T00:45:15.315 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T00:45:15.341 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T00:45:15.373 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T00:45:15.676 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T00:45:15.702 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T00:45:15.742 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T00:45:16.070 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-mako. 2024-04-25T00:45:16.097 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T00:45:16.137 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T00:45:16.465 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T00:45:16.492 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T00:45:16.531 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T00:45:16.809 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T00:45:16.836 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T00:45:16.867 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T00:45:17.154 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-webob. 2024-04-25T00:45:17.180 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T00:45:17.220 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T00:45:17.573 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T00:45:17.600 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T00:45:17.642 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T00:45:17.951 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T00:45:17.977 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T00:45:18.017 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T00:45:18.296 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-paste. 2024-04-25T00:45:18.311 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T00:45:18.345 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T00:45:18.674 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T00:45:18.689 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T00:45:18.732 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T00:45:19.018 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T00:45:19.033 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T00:45:19.068 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T00:45:19.330 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T00:45:19.356 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T00:45:19.396 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T00:45:19.707 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T00:45:19.733 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T00:45:19.773 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T00:45:20.164 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T00:45:20.191 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T00:45:20.231 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T00:45:20.534 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-idna. 2024-04-25T00:45:20.549 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T00:45:20.583 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T00:45:20.870 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T00:45:20.896 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T00:45:20.936 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T00:45:21.257 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-requests. 2024-04-25T00:45:21.283 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T00:45:21.324 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T00:45:21.635 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T00:45:21.662 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T00:45:21.701 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T00:45:21.729 INFO:teuthology.orchestra.run.smithi162.stdout:Get:140 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [1,792 kB] 2024-04-25T00:45:21.763 INFO:teuthology.orchestra.run.smithi162.stdout:Get:141 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-mirror-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [97.3 MB] 2024-04-25T00:45:22.006 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T00:45:22.032 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:45:22.072 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:22.444 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T00:45:22.471 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:22.511 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:22.822 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T00:45:22.849 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T00:45:22.889 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T00:45:23.192 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T00:45:23.218 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T00:45:23.258 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T00:45:23.553 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T00:45:23.569 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:23.611 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:24.041 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T00:45:24.067 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:24.107 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:24.752 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T00:45:24.779 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:24.819 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:25.506 INFO:teuthology.orchestra.run.smithi162.stdout:Get:142 https://3.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-nbd-dbg amd64 19.0.0-2445-gd2c45d97-1jammy [3,139 kB] 2024-04-25T00:45:25.872 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph. 2024-04-25T00:45:25.888 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../068-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:25.931 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:26.146 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 3,875 MB in 5min 37s (11.5 MB/s) 2024-04-25T00:45:26.250 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T00:45:26.259 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-25T00:45:26.276 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:26.315 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T00:45:26.316 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:26.320 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-25T00:45:26.359 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-25T00:45:26.653 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T00:45:26.679 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T00:45:26.695 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T00:45:26.720 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T00:45:26.722 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:26.812 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:27.023 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cmd2. 2024-04-25T00:45:27.049 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-25T00:45:27.089 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-25T00:45:27.190 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package cephadm. 2024-04-25T00:45:27.217 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../071-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:27.257 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:27.434 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T00:45:27.460 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T00:45:27.543 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T00:45:27.602 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T00:45:27.628 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T00:45:27.668 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T00:45:27.880 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T00:45:27.906 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T00:45:27.938 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T00:45:27.996 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T00:45:28.011 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T00:45:28.054 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T00:45:28.266 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T00:45:28.292 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T00:45:28.333 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T00:45:28.778 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T00:45:28.805 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T00:45:28.853 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T00:45:29.085 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-babel. 2024-04-25T00:45:29.112 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T00:45:29.152 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T00:45:29.198 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T00:45:29.224 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T00:45:29.265 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T00:45:29.488 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T00:45:29.504 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T00:45:29.546 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T00:45:29.610 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T00:45:29.636 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T00:45:29.676 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T00:45:29.892 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T00:45:29.918 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:45:29.958 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:30.030 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T00:45:30.056 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T00:45:30.096 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T00:45:30.304 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T00:45:30.330 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T00:45:30.370 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T00:45:30.374 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librados2. 2024-04-25T00:45:30.400 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../010-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:30.441 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:30.682 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-routes. 2024-04-25T00:45:30.709 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T00:45:30.748 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T00:45:30.944 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librbd1. 2024-04-25T00:45:30.970 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../011-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:31.011 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:31.094 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T00:45:31.120 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:45:31.160 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:31.422 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T00:45:31.437 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:31.472 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:31.758 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rados. 2024-04-25T00:45:31.773 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../013-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:31.816 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:32.136 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T00:45:32.162 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:45:32.202 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:32.430 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T00:45:32.442 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T00:45:32.445 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:32.469 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T00:45:32.480 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:32.508 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T00:45:32.774 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T00:45:32.801 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:45:32.841 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:33.003 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T00:45:33.019 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T00:45:33.053 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T00:45:33.153 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T00:45:33.179 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T00:45:33.219 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T00:45:33.424 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T00:45:33.451 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T00:45:33.488 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T00:45:33.515 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:33.555 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:33.584 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T00:45:33.867 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T00:45:33.879 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T00:45:33.893 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T00:45:33.906 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T00:45:33.946 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T00:45:33.950 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T00:45:34.203 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T00:45:34.218 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T00:45:34.261 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T00:45:34.564 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T00:45:34.587 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T00:45:34.631 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T00:45:34.640 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T00:45:34.667 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:45:34.706 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:34.976 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package lua5.1. 2024-04-25T00:45:35.002 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T00:45:35.051 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T00:45:35.379 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package lua-any. 2024-04-25T00:45:35.405 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-25T00:45:35.445 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T00:45:35.648 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package zip. 2024-04-25T00:45:35.675 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-25T00:45:35.706 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T00:45:35.718 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T00:45:35.745 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T00:45:35.776 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T00:45:36.020 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package unzip. 2024-04-25T00:45:36.047 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T00:45:36.063 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T00:45:36.087 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T00:45:36.090 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T00:45:36.129 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T00:45:36.441 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package luarocks. 2024-04-25T00:45:36.466 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T00:45:36.467 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T00:45:36.494 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T00:45:36.499 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T00:45:36.533 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T00:45:36.824 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librgw2. 2024-04-25T00:45:36.840 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../027-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:36.845 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T00:45:36.872 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T00:45:36.882 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:36.911 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T00:45:37.418 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T00:45:37.433 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:37.474 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T00:45:37.476 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:37.502 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T00:45:37.532 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T00:45:37.836 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T00:45:37.863 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T00:45:37.902 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T00:45:38.038 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T00:45:38.064 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T00:45:38.104 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T00:45:38.214 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T00:45:38.241 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T00:45:38.280 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T00:45:38.365 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T00:45:38.381 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:38.424 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:38.593 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T00:45:38.621 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T00:45:38.659 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T00:45:38.861 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-common. 2024-04-25T00:45:38.887 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../031-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:38.927 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:39.349 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T00:45:39.377 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:45:39.415 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:39.701 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T00:45:39.718 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T00:45:39.752 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T00:45:40.072 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T00:45:40.100 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T00:45:40.138 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T00:45:40.241 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-base. 2024-04-25T00:45:40.267 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../032-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:40.317 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:40.400 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package jq. 2024-04-25T00:45:40.427 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T00:45:40.466 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T00:45:40.711 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package socat. 2024-04-25T00:45:40.727 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T00:45:40.761 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T00:45:40.888 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T00:45:40.914 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T00:45:40.945 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T00:45:41.031 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T00:45:41.047 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T00:45:41.081 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T00:45:41.290 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T00:45:41.317 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T00:45:41.357 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T00:45:41.428 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-test. 2024-04-25T00:45:41.456 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:41.486 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:41.677 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T00:45:41.703 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T00:45:41.743 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T00:45:42.022 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T00:45:42.048 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T00:45:42.088 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T00:45:42.341 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T00:45:42.367 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T00:45:42.416 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T00:45:42.719 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T00:45:42.746 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T00:45:42.785 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T00:45:43.089 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-portend. 2024-04-25T00:45:43.116 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-25T00:45:43.180 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T00:45:43.416 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T00:45:43.432 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T00:45:43.474 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T00:45:43.761 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T00:45:43.777 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T00:45:43.799 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T00:45:43.827 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:45:43.828 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T00:45:43.865 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:44.148 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T00:45:44.163 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T00:45:44.206 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T00:45:44.237 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T00:45:44.264 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:44.303 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking cephfs-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:44.501 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T00:45:44.517 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T00:45:44.559 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T00:45:44.623 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T00:45:44.651 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T00:45:44.698 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T00:45:44.871 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T00:45:44.886 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T00:45:44.929 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T00:45:44.953 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T00:45:44.967 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:45:45.001 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking cephfs-shell (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:45.182 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-mako. 2024-04-25T00:45:45.197 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T00:45:45.237 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T00:45:45.240 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T00:45:45.265 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:45:45.304 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking cephfs-top (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:45.556 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T00:45:45.560 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T00:45:45.585 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:45.587 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T00:45:45.623 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:45.627 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T00:45:45.913 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T00:45:45.940 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T00:45:45.943 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T00:45:45.971 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T00:45:45.980 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T00:45:46.009 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T00:45:46.308 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-webob. 2024-04-25T00:45:46.323 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T00:45:46.334 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T00:45:46.351 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T00:45:46.374 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T00:45:46.381 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T00:45:46.753 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T00:45:46.769 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T00:45:46.779 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T00:45:46.797 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T00:45:46.831 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T00:45:46.835 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T00:45:47.139 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T00:45:47.166 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T00:45:47.206 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T00:45:47.233 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package pkg-config. 2024-04-25T00:45:47.261 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T00:45:47.291 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T00:45:47.467 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-paste. 2024-04-25T00:45:47.482 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T00:45:47.525 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T00:45:47.545 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T00:45:47.573 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T00:45:47.611 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T00:45:47.854 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T00:45:47.869 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T00:45:47.912 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T00:45:48.031 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T00:45:48.059 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T00:45:48.098 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T00:45:48.215 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T00:45:48.242 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T00:45:48.281 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T00:45:48.401 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T00:45:48.428 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T00:45:48.467 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T00:45:48.560 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T00:45:48.586 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T00:45:48.618 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T00:45:48.788 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T00:45:48.815 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T00:45:48.854 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T00:45:48.904 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T00:45:48.931 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T00:45:48.988 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T00:45:49.124 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T00:45:49.152 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T00:45:49.191 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T00:45:49.384 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T00:45:49.411 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T00:45:49.451 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T00:45:49.494 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-py. 2024-04-25T00:45:49.510 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T00:45:49.544 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T00:45:49.787 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-idna. 2024-04-25T00:45:49.814 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-25T00:45:49.854 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T00:45:49.873 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T00:45:49.900 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T00:45:49.931 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T00:45:50.140 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T00:45:50.167 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T00:45:50.207 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T00:45:50.361 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T00:45:50.389 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T00:45:50.419 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T00:45:50.510 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-requests. 2024-04-25T00:45:50.537 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T00:45:50.576 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T00:45:50.738 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-toml. 2024-04-25T00:45:50.766 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T00:45:50.805 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T00:45:50.830 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T00:45:50.845 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T00:45:50.879 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T00:45:51.117 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T00:45:51.144 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T00:45:51.158 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T00:45:51.183 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T00:45:51.185 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:45:51.216 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:51.504 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T00:45:51.523 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T00:45:51.562 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T00:45:51.580 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T00:45:51.604 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:51.646 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:51.848 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T00:45:51.876 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T00:45:51.914 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T00:45:51.924 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T00:45:51.940 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T00:45:51.974 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T00:45:52.244 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T00:45:52.271 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T00:45:52.310 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T00:45:52.669 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package radosgw. 2024-04-25T00:45:52.680 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T00:45:52.698 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../122-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:52.707 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:52.736 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:52.746 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:53.142 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T00:45:53.169 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:53.208 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:53.566 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T00:45:53.593 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:53.632 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:53.754 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T00:45:53.782 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:53.820 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:53.969 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package rbd-mirror. 2024-04-25T00:45:53.996 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:54.035 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking rbd-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:54.464 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package rbd-nbd. 2024-04-25T00:45:54.491 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:54.530 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking rbd-nbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:54.800 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-common-dbg. 2024-04-25T00:45:54.828 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:54.867 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-common-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:54.890 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph. 2024-04-25T00:45:54.917 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../068-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:54.956 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:55.276 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T00:45:55.303 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:55.342 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:55.704 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T00:45:55.731 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:55.762 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:56.157 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephadm. 2024-04-25T00:45:56.184 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../071-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:45:56.223 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:56.543 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T00:45:56.570 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T00:45:56.609 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T00:45:56.963 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T00:45:56.978 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T00:45:57.020 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T00:45:58.043 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-babel. 2024-04-25T00:45:58.070 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T00:45:58.126 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T00:45:58.413 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T00:45:58.440 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T00:45:58.470 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T00:45:58.799 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T00:45:58.814 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:45:58.848 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:45:59.135 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T00:45:59.163 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T00:45:59.193 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T00:45:59.490 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-routes. 2024-04-25T00:45:59.516 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T00:45:59.555 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T00:45:59.883 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T00:45:59.910 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:45:59.950 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:01.205 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T00:46:01.221 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T00:46:01.255 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T00:46:01.742 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T00:46:01.758 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T00:46:01.792 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T00:46:02.162 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T00:46:02.190 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T00:46:02.314 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T00:46:02.592 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T00:46:02.620 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T00:46:02.659 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T00:46:02.721 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-04-25T00:46:02.748 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:02.787 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-fuse-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:03.257 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-04-25T00:46:03.272 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:03.315 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mds-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:03.318 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T00:46:03.334 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:46:03.368 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:04.297 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T00:46:04.324 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T00:46:04.363 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T00:46:04.434 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-04-25T00:46:04.450 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:04.492 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mgr-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:04.691 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T00:46:04.718 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T00:46:04.758 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T00:46:05.061 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T00:46:05.077 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T00:46:05.111 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T00:46:05.178 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-04-25T00:46:05.194 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:05.228 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-mon-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:05.381 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T00:46:05.397 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-25T00:46:05.431 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T00:46:05.751 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T00:46:05.779 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T00:46:05.818 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T00:46:06.138 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T00:46:06.165 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T00:46:06.205 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T00:46:06.491 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T00:46:06.519 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T00:46:06.558 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T00:46:06.853 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T00:46:06.880 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T00:46:06.911 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T00:46:06.964 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-04-25T00:46:06.977 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:07.014 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-osd-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:07.609 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T00:46:07.625 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:46:07.667 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:07.995 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T00:46:08.022 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T00:46:08.061 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T00:46:08.373 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T00:46:08.400 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T00:46:08.439 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T00:46:08.701 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package jq. 2024-04-25T00:46:08.728 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T00:46:08.915 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T00:46:09.270 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package socat. 2024-04-25T00:46:09.298 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T00:46:09.337 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T00:46:09.623 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T00:46:09.639 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T00:46:09.681 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T00:46:10.044 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-test. 2024-04-25T00:46:10.072 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../099-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:10.110 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:12.357 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T00:46:12.374 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:46:12.406 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:12.559 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ceph-test-dbg. 2024-04-25T00:46:12.575 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:12.609 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ceph-test-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:12.744 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-25T00:46:12.760 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:12.794 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephfs-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:13.114 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-colorama. 2024-04-25T00:46:13.142 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-25T00:46:13.181 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-25T00:46:13.425 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephfs-shell. 2024-04-25T00:46:13.441 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:46:13.483 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephfs-shell (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:13.736 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package cephfs-top. 2024-04-25T00:46:13.752 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T00:46:13.790 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking cephfs-top (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:14.040 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T00:46:14.056 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:14.098 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:14.435 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T00:46:14.462 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T00:46:14.501 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T00:46:14.814 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T00:46:14.842 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T00:46:14.881 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T00:46:15.251 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T00:46:15.279 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T00:46:15.318 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T00:46:15.756 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package pkg-config. 2024-04-25T00:46:15.785 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T00:46:15.823 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T00:46:16.093 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T00:46:16.121 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T00:46:16.159 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T00:46:16.562 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T00:46:16.590 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T00:46:16.628 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T00:46:16.898 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T00:46:16.926 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T00:46:16.956 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T00:46:17.268 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T00:46:17.296 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T00:46:17.334 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T00:46:17.629 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T00:46:17.656 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T00:46:17.695 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T00:46:18.049 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-py. 2024-04-25T00:46:18.076 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-25T00:46:18.115 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T00:46:18.427 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T00:46:18.454 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T00:46:18.493 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T00:46:18.964 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T00:46:18.991 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T00:46:19.030 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T00:46:19.300 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-toml. 2024-04-25T00:46:19.316 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-25T00:46:19.358 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T00:46:19.602 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T00:46:19.630 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T00:46:19.668 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T00:46:20.014 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T00:46:20.042 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T00:46:20.080 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T00:46:20.366 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T00:46:20.383 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T00:46:20.416 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T00:46:21.137 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package radosgw. 2024-04-25T00:46:21.165 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../122-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:21.203 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:21.990 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T00:46:22.006 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:22.048 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:22.393 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package rbd-mirror. 2024-04-25T00:46:22.420 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../124-rbd-mirror_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:22.459 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking rbd-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:22.878 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package rbd-nbd. 2024-04-25T00:46:22.894 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../125-rbd-nbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:22.936 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking rbd-nbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:23.189 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-common-dbg. 2024-04-25T00:46:23.205 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../126-ceph-common-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:23.239 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-common-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:24.504 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-04-25T00:46:24.521 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:24.553 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libcephfs2-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:24.981 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librados2-dbg. 2024-04-25T00:46:24.997 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:25.048 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librados2-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:26.076 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-04-25T00:46:26.104 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:26.142 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libradosstriper1-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:26.553 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librbd1-dbg. 2024-04-25T00:46:26.581 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:26.620 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librbd1-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:27.931 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package librgw2-dbg. 2024-04-25T00:46:27.959 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:28.006 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking librgw2-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:30.008 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package radosgw-dbg. 2024-04-25T00:46:30.035 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:30.075 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking radosgw-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:31.126 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-fuse-dbg. 2024-04-25T00:46:31.154 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../127-ceph-fuse-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:31.192 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-fuse-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:31.636 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mds-dbg. 2024-04-25T00:46:31.652 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../128-ceph-mds-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:31.703 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mds-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:32.797 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mgr-dbg. 2024-04-25T00:46:32.824 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../129-ceph-mgr-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:32.855 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mgr-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:33.532 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-mon-dbg. 2024-04-25T00:46:33.560 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../130-ceph-mon-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:33.599 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-mon-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:33.761 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-04-25T00:46:33.789 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:33.828 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking rbd-fuse-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:34.097 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-04-25T00:46:34.125 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:34.155 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking rbd-mirror-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:35.377 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-osd-dbg. 2024-04-25T00:46:35.391 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-04-25T00:46:35.404 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../131-ceph-osd-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:35.419 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:35.443 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-osd-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:35.457 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking rbd-nbd-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:35.797 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T00:46:36.031 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T00:46:36.157 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T00:46:36.420 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T00:46:36.733 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T00:46:37.152 INFO:teuthology.orchestra.run.smithi179.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T00:46:37.217 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:37.718 INFO:teuthology.orchestra.run.smithi179.stdout:Adding system user cephadm....done 2024-04-25T00:46:37.874 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T00:46:38.167 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T00:46:38.427 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T00:46:38.529 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T00:46:38.779 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T00:46:39.039 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T00:46:39.166 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T00:46:39.467 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T00:46:39.819 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T00:46:40.062 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T00:46:40.297 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T00:46:40.565 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T00:46:40.837 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ceph-test-dbg. 2024-04-25T00:46:40.853 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../132-ceph-test-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:40.859 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T00:46:40.887 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ceph-test-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:41.127 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T00:46:41.386 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T00:46:41.654 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:41.906 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T00:46:42.032 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T00:46:42.158 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T00:46:42.418 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T00:46:42.544 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T00:46:42.795 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T00:46:43.176 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T00:46:43.210 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T00:46:43.282 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T00:46:43.408 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T00:46:43.768 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T00:46:43.877 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T00:46:44.145 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T00:46:44.738 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T00:46:45.040 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T00:46:45.158 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T00:46:45.852 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T00:46:46.094 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T00:46:46.221 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T00:46:46.347 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T00:46:46.640 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T00:46:47.008 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T00:46:47.267 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T00:46:47.636 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T00:46:47.937 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T00:46:48.238 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T00:46:48.594 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T00:46:48.825 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T00:46:48.934 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:49.219 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T00:46:49.528 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T00:46:50.702 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T00:46:50.954 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T00:46:51.088 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T00:46:51.365 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T00:46:51.491 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T00:46:51.617 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T00:46:51.902 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T00:46:52.144 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T00:46:52.404 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T00:46:52.547 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T00:46:52.670 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libcephfs2-dbg. 2024-04-25T00:46:52.686 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../133-libcephfs2-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:52.728 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libcephfs2-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:52.857 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T00:46:53.117 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T00:46:53.180 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librados2-dbg. 2024-04-25T00:46:53.196 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../134-librados2-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:53.238 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librados2-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:53.359 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T00:46:53.602 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T00:46:53.854 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T00:46:54.122 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T00:46:54.248 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T00:46:54.366 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libradosstriper1-dbg. 2024-04-25T00:46:54.382 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../135-libradosstriper1-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:54.416 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libradosstriper1-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:54.532 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T00:46:54.642 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T00:46:54.751 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librbd1-dbg. 2024-04-25T00:46:54.768 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../136-librbd1-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:54.810 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librbd1-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:54.926 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T00:46:55.220 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T00:46:55.487 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T00:46:55.613 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T00:46:55.748 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T00:46:55.838 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T00:46:56.083 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T00:46:56.095 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package librgw2-dbg. 2024-04-25T00:46:56.112 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../137-librgw2-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:56.154 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking librgw2-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:56.209 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T00:46:56.578 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T00:46:56.837 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T00:46:56.963 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T00:46:57.231 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T00:46:57.332 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T00:46:57.650 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T00:46:57.935 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T00:46:58.072 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package radosgw-dbg. 2024-04-25T00:46:58.089 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../138-radosgw-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:46:58.122 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking radosgw-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:46:58.219 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T00:46:58.432 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T00:46:58.708 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T00:46:58.968 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T00:46:59.211 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T00:46:59.597 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T00:46:59.898 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T00:47:00.242 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T00:47:00.344 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:00.462 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:00.588 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T00:47:00.925 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:01.051 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:01.152 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T00:47:01.412 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librados2-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:01.538 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:01.625 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package rbd-fuse-dbg. 2024-04-25T00:47:01.652 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../139-rbd-fuse-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:47:01.665 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libcephfs2-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:01.691 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking rbd-fuse-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:01.774 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:01.884 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:01.977 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package rbd-mirror-dbg. 2024-04-25T00:47:01.993 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../140-rbd-mirror-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:47:02.035 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking rbd-mirror-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:02.096 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T00:47:02.096 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T00:47:02.560 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libradosstriper1-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:02.669 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:02.787 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-fuse-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:02.913 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:03.039 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:03.174 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up cephfs-top (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:03.279 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package rbd-nbd-dbg. 2024-04-25T00:47:03.300 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T00:47:03.307 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../141-rbd-nbd-dbg_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T00:47:03.346 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking rbd-nbd-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:03.693 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T00:47:03.943 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T00:47:04.044 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T00:47:04.301 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T00:47:04.546 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librbd1-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:04.608 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T00:47:04.672 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:04.773 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up librgw2-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:04.874 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:05.001 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up rbd-nbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:05.007 INFO:teuthology.orchestra.run.smithi162.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T00:47:05.087 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:05.127 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:05.253 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:05.379 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up rbd-nbd-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:05.505 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up cephfs-shell (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:05.631 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up rbd-fuse-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:05.732 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:05.822 INFO:teuthology.orchestra.run.smithi162.stdout:Adding system user cephadm....done 2024-04-25T00:47:05.968 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T00:47:06.228 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T00:47:06.242 INFO:teuthology.orchestra.run.smithi179.stdout:Adding group ceph....done 2024-04-25T00:47:06.479 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T00:47:06.614 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T00:47:06.628 INFO:teuthology.orchestra.run.smithi179.stdout:Adding system user ceph....done 2024-04-25T00:47:06.796 INFO:teuthology.orchestra.run.smithi179.stdout:Setting system user ceph properties....done 2024-04-25T00:47:06.809 INFO:teuthology.orchestra.run.smithi179.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T00:47:06.865 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T00:47:06.946 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T00:47:07.125 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T00:47:07.254 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T00:47:07.271 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T00:47:07.544 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T00:47:07.921 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T00:47:08.065 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up cephfs-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:08.172 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-25T00:47:08.460 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T00:47:08.461 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T00:47:08.461 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T00:47:08.716 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T00:47:08.754 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:08.880 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:08.976 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T00:47:09.219 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T00:47:09.346 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T00:47:09.347 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T00:47:09.478 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T00:47:09.721 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:09.783 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:09.997 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T00:47:10.107 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T00:47:10.115 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T00:47:10.324 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-25T00:47:10.592 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T00:47:10.743 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T00:47:10.799 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:10.994 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T00:47:11.033 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T00:47:11.033 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T00:47:11.376 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T00:47:11.408 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T00:47:11.481 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T00:47:11.509 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-common-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:11.607 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T00:47:11.610 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up rbd-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:11.824 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T00:47:11.824 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T00:47:11.967 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T00:47:12.092 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T00:47:12.311 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:12.360 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T00:47:12.528 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T00:47:12.528 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T00:47:12.603 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T00:47:12.929 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T00:47:12.997 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mds-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:13.064 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T00:47:13.122 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up radosgw-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:13.257 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-test-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:13.383 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:13.656 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T00:47:13.656 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T00:47:13.707 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T00:47:14.000 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T00:47:14.118 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:14.126 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T00:47:14.219 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-osd-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:14.252 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T00:47:14.320 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up rbd-mirror-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:14.438 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:14.561 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T00:47:14.564 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:14.715 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:14.928 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T00:47:14.929 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T00:47:14.962 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T00:47:15.213 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T00:47:15.433 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:15.584 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:15.606 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T00:47:15.710 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:15.862 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-mon-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:15.899 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-25T00:47:15.988 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:16.192 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T00:47:16.342 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T00:47:16.459 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T00:47:16.560 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T00:47:16.586 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T00:47:16.803 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T00:47:16.929 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:17.205 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T00:47:17.515 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T00:47:17.797 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T00:47:18.528 INFO:teuthology.orchestra.run.smithi179.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T00:47:18.532 DEBUG:teuthology.orchestra.run.smithi179:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T00:47:18.593 INFO:teuthology.orchestra.run.smithi179.stdout:Reading package lists... 2024-04-25T00:47:18.629 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T00:47:18.793 INFO:teuthology.orchestra.run.smithi179.stdout:Building dependency tree... 2024-04-25T00:47:18.794 INFO:teuthology.orchestra.run.smithi179.stdout:Reading state information... 2024-04-25T00:47:18.864 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T00:47:18.988 INFO:teuthology.orchestra.run.smithi179.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T00:47:18.988 INFO:teuthology.orchestra.run.smithi179.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T00:47:18.988 INFO:teuthology.orchestra.run.smithi179.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T00:47:18.989 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T00:47:18.989 INFO:teuthology.orchestra.run.smithi179.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T00:47:18.989 INFO:teuthology.orchestra.run.smithi179.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T00:47:18.989 INFO:teuthology.orchestra.run.smithi179.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T00:47:18.989 INFO:teuthology.orchestra.run.smithi179.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T00:47:18.989 INFO:teuthology.orchestra.run.smithi179.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T00:47:18.989 INFO:teuthology.orchestra.run.smithi179.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T00:47:18.990 INFO:teuthology.orchestra.run.smithi179.stdout:The following additional packages will be installed: 2024-04-25T00:47:18.990 INFO:teuthology.orchestra.run.smithi179.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T00:47:18.990 INFO:teuthology.orchestra.run.smithi179.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T00:47:18.991 INFO:teuthology.orchestra.run.smithi179.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T00:47:18.991 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T00:47:18.991 INFO:teuthology.orchestra.run.smithi179.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T00:47:18.992 INFO:teuthology.orchestra.run.smithi179.stdout:Suggested packages: 2024-04-25T00:47:18.992 INFO:teuthology.orchestra.run.smithi179.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T00:47:18.992 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T00:47:18.992 INFO:teuthology.orchestra.run.smithi179.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T00:47:18.998 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T00:47:19.036 INFO:teuthology.orchestra.run.smithi179.stdout:The following NEW packages will be installed: 2024-04-25T00:47:19.036 INFO:teuthology.orchestra.run.smithi179.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T00:47:19.036 INFO:teuthology.orchestra.run.smithi179.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T00:47:19.036 INFO:teuthology.orchestra.run.smithi179.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T00:47:19.037 INFO:teuthology.orchestra.run.smithi179.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T00:47:19.037 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T00:47:19.037 INFO:teuthology.orchestra.run.smithi179.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T00:47:19.037 INFO:teuthology.orchestra.run.smithi179.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T00:47:19.038 INFO:teuthology.orchestra.run.smithi179.stdout:The following packages will be upgraded: 2024-04-25T00:47:19.039 INFO:teuthology.orchestra.run.smithi179.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T00:47:19.219 INFO:teuthology.orchestra.run.smithi179.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T00:47:19.219 INFO:teuthology.orchestra.run.smithi179.stdout:Need to get 55.7 MB of archives. 2024-04-25T00:47:19.219 INFO:teuthology.orchestra.run.smithi179.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T00:47:19.219 INFO:teuthology.orchestra.run.smithi179.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T00:47:19.282 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T00:47:19.409 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T00:47:19.535 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T00:47:19.819 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T00:47:19.851 INFO:teuthology.orchestra.run.smithi179.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T00:47:19.867 INFO:teuthology.orchestra.run.smithi179.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T00:47:19.993 INFO:teuthology.orchestra.run.smithi179.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T00:47:19.994 INFO:teuthology.orchestra.run.smithi179.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T00:47:19.996 INFO:teuthology.orchestra.run.smithi179.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T00:47:20.024 INFO:teuthology.orchestra.run.smithi179.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T00:47:20.026 INFO:teuthology.orchestra.run.smithi179.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T00:47:20.029 INFO:teuthology.orchestra.run.smithi179.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T00:47:20.032 INFO:teuthology.orchestra.run.smithi179.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T00:47:20.033 INFO:teuthology.orchestra.run.smithi179.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T00:47:20.062 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T00:47:20.199 INFO:teuthology.orchestra.run.smithi179.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T00:47:20.305 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T00:47:20.431 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T00:47:20.492 INFO:teuthology.orchestra.run.smithi179.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T00:47:20.502 INFO:teuthology.orchestra.run.smithi179.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T00:47:20.507 INFO:teuthology.orchestra.run.smithi179.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T00:47:20.592 INFO:teuthology.orchestra.run.smithi179.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T00:47:20.733 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T00:47:20.983 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T00:47:21.226 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T00:47:21.477 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T00:47:21.653 INFO:teuthology.orchestra.run.smithi179.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T00:47:21.657 INFO:teuthology.orchestra.run.smithi179.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T00:47:21.658 INFO:teuthology.orchestra.run.smithi179.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T00:47:21.664 INFO:teuthology.orchestra.run.smithi179.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T00:47:21.665 INFO:teuthology.orchestra.run.smithi179.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T00:47:21.676 INFO:teuthology.orchestra.run.smithi179.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T00:47:21.720 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T00:47:21.843 INFO:teuthology.orchestra.run.smithi179.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T00:47:21.979 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T00:47:22.106 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T00:47:22.390 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T00:47:22.440 INFO:teuthology.orchestra.run.smithi179.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T00:47:22.441 INFO:teuthology.orchestra.run.smithi179.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T00:47:22.516 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T00:47:22.620 INFO:teuthology.orchestra.run.smithi179.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T00:47:22.620 INFO:teuthology.orchestra.run.smithi179.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T00:47:22.659 INFO:teuthology.orchestra.run.smithi179.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T00:47:22.722 INFO:teuthology.orchestra.run.smithi179.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T00:47:22.729 INFO:teuthology.orchestra.run.smithi179.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T00:47:22.730 INFO:teuthology.orchestra.run.smithi179.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T00:47:22.731 INFO:teuthology.orchestra.run.smithi179.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T00:47:22.732 INFO:teuthology.orchestra.run.smithi179.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T00:47:22.800 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T00:47:22.939 INFO:teuthology.orchestra.run.smithi179.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T00:47:23.093 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T00:47:23.349 INFO:teuthology.orchestra.run.smithi179.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T00:47:23.361 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T00:47:23.470 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T00:47:23.571 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T00:47:23.660 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T00:47:23.898 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T00:47:24.024 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T00:47:24.187 INFO:teuthology.orchestra.run.smithi179.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T00:47:24.187 INFO:teuthology.orchestra.run.smithi179.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T00:47:24.187 INFO:teuthology.orchestra.run.smithi179.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T00:47:24.188 INFO:teuthology.orchestra.run.smithi179.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T00:47:24.189 INFO:teuthology.orchestra.run.smithi179.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T00:47:24.189 INFO:teuthology.orchestra.run.smithi179.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T00:47:24.216 INFO:teuthology.orchestra.run.smithi179.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T00:47:24.216 INFO:teuthology.orchestra.run.smithi179.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T00:47:24.409 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T00:47:24.618 INFO:teuthology.orchestra.run.smithi179.stdout:Preconfiguring packages ... 2024-04-25T00:47:24.660 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T00:47:24.782 INFO:teuthology.orchestra.run.smithi179.stdout:Fetched 55.7 MB in 5s (10.8 MB/s) 2024-04-25T00:47:24.786 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T00:47:25.034 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T00:47:25.086 INFO:teuthology.orchestra.run.smithi179.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174275 files and directories currently installed.) 2024-04-25T00:47:25.092 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T00:47:25.163 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T00:47:25.237 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T00:47:25.481 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T00:47:25.790 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T00:47:25.855 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T00:47:26.094 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T00:47:26.303 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T00:47:26.555 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T00:47:26.742 INFO:teuthology.orchestra.run.smithi179.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T00:47:26.823 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T00:47:27.021 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package flex. 2024-04-25T00:47:27.082 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T00:47:27.120 INFO:teuthology.orchestra.run.smithi179.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174275 files and directories currently installed.) 2024-04-25T00:47:27.126 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T00:47:27.169 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T00:47:27.451 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T00:47:27.694 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T00:47:27.744 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T00:47:27.875 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T00:47:28.080 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T00:47:28.206 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:28.320 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T00:47:28.332 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:28.458 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T00:47:28.794 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:28.797 INFO:teuthology.orchestra.run.smithi179.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174348 files and directories currently installed.) 2024-04-25T00:47:28.802 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T00:47:28.895 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:28.933 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T00:47:28.996 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T00:47:29.273 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librados2-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:29.326 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T00:47:29.382 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:29.456 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T00:47:29.483 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libcephfs2-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:29.593 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:29.719 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:29.792 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T00:47:29.932 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T00:47:29.932 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T00:47:30.174 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package bison. 2024-04-25T00:47:30.278 INFO:teuthology.orchestra.run.smithi179.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174348 files and directories currently installed.) 2024-04-25T00:47:30.284 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T00:47:30.326 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T00:47:30.420 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libradosstriper1-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:30.554 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:30.680 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-fuse-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:30.726 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T00:47:30.754 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T00:47:30.793 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T00:47:30.831 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:30.941 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:31.050 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephfs-top (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:31.138 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package dump. 2024-04-25T00:47:31.151 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T00:47:31.165 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T00:47:31.204 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T00:47:31.600 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package indent. 2024-04-25T00:47:31.627 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T00:47:31.675 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T00:47:31.977 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T00:47:31.993 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T00:47:32.044 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T00:47:32.348 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librbd1-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:32.356 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T00:47:32.384 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T00:47:32.423 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T00:47:32.449 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:32.550 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up librgw2-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:32.651 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:32.692 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T00:47:32.720 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T00:47:32.767 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T00:47:32.777 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up rbd-nbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:32.886 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:32.987 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:33.096 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up rbd-nbd-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:33.179 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T00:47:33.207 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T00:47:33.231 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephfs-shell (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:33.245 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T00:47:33.357 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up rbd-fuse-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:33.474 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:33.498 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T00:47:33.515 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T00:47:33.556 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T00:47:33.801 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T00:47:33.817 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T00:47:33.868 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T00:47:33.975 INFO:teuthology.orchestra.run.smithi162.stdout:Adding group ceph....done 2024-04-25T00:47:34.254 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T00:47:34.282 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T00:47:34.329 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T00:47:34.352 INFO:teuthology.orchestra.run.smithi162.stdout:Adding system user ceph....done 2024-04-25T00:47:34.512 INFO:teuthology.orchestra.run.smithi162.stdout:Setting system user ceph properties....done 2024-04-25T00:47:34.526 INFO:teuthology.orchestra.run.smithi162.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T00:47:34.664 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T00:47:35.050 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T00:47:35.509 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up cephfs-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:35.709 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T00:47:35.709 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-25T00:47:36.065 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T00:47:36.093 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T00:47:36.132 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T00:47:36.201 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:36.367 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:36.385 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T00:47:36.401 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T00:47:36.443 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T00:47:36.821 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T00:47:36.849 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T00:47:36.896 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T00:47:37.090 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T00:47:37.090 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T00:47:37.274 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T00:47:37.301 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T00:47:37.340 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T00:47:37.562 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:37.652 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T00:47:37.679 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T00:47:37.710 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T00:47:37.916 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T00:47:38.088 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T00:47:38.116 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T00:47:38.154 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T00:47:38.398 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:38.533 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T00:47:38.560 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T00:47:38.599 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T00:47:38.607 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T00:47:38.607 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T00:47:38.902 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T00:47:38.918 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T00:47:38.952 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T00:47:39.058 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-common-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:39.171 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T00:47:39.198 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T00:47:39.201 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up rbd-mirror (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:39.238 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T00:47:39.402 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T00:47:39.402 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T00:47:39.799 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T00:47:39.827 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T00:47:39.866 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T00:47:39.922 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:40.165 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T00:47:40.165 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T00:47:40.186 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package modemmanager. 2024-04-25T00:47:40.214 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T00:47:40.253 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T00:47:40.620 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mds-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:40.755 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up radosgw-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:40.881 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-test-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:40.892 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package network-manager. 2024-04-25T00:47:40.920 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T00:47:40.967 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T00:47:40.998 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:41.244 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T00:47:41.244 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T00:47:41.709 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:41.835 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-osd-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:41.961 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up rbd-mirror-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:42.087 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:42.125 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package ppp. 2024-04-25T00:47:42.153 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T00:47:42.213 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:42.348 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:42.456 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T00:47:42.544 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T00:47:42.545 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T00:47:42.855 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T00:47:42.883 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T00:47:42.930 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T00:47:43.024 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:43.158 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:43.267 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T00:47:43.284 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:43.294 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T00:47:43.370 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T00:47:43.435 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-mon-dbg (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:43.561 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T00:47:43.906 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T00:47:43.932 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T00:47:43.960 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T00:47:44.015 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T00:47:44.049 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T00:47:44.184 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T00:47:44.623 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T00:47:44.651 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T00:47:44.740 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T00:47:44.967 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T00:47:45.271 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T00:47:45.299 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T00:47:45.349 INFO:teuthology.orchestra.run.smithi179.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T00:47:45.368 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking postgresql-common (238) ... 2024-04-25T00:47:45.694 INFO:teuthology.orchestra.run.smithi162.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T00:47:45.697 DEBUG:teuthology.orchestra.run.smithi162:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-25T00:47:45.757 INFO:teuthology.orchestra.run.smithi162.stdout:Reading package lists... 2024-04-25T00:47:45.936 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T00:47:45.964 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T00:47:45.965 INFO:teuthology.orchestra.run.smithi162.stdout:Building dependency tree... 2024-04-25T00:47:45.966 INFO:teuthology.orchestra.run.smithi162.stdout:Reading state information... 2024-04-25T00:47:46.006 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T00:47:46.166 INFO:teuthology.orchestra.run.smithi162.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-25T00:47:46.166 INFO:teuthology.orchestra.run.smithi162.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-25T00:47:46.166 INFO:teuthology.orchestra.run.smithi162.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-25T00:47:46.166 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T00:47:46.167 INFO:teuthology.orchestra.run.smithi162.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T00:47:46.167 INFO:teuthology.orchestra.run.smithi162.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T00:47:46.167 INFO:teuthology.orchestra.run.smithi162.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T00:47:46.167 INFO:teuthology.orchestra.run.smithi162.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T00:47:46.167 INFO:teuthology.orchestra.run.smithi162.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T00:47:46.167 INFO:teuthology.orchestra.run.smithi162.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T00:47:46.168 INFO:teuthology.orchestra.run.smithi162.stdout:The following additional packages will be installed: 2024-04-25T00:47:46.168 INFO:teuthology.orchestra.run.smithi162.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-25T00:47:46.168 INFO:teuthology.orchestra.run.smithi162.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-25T00:47:46.169 INFO:teuthology.orchestra.run.smithi162.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-25T00:47:46.169 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-25T00:47:46.169 INFO:teuthology.orchestra.run.smithi162.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T00:47:46.170 INFO:teuthology.orchestra.run.smithi162.stdout:Suggested packages: 2024-04-25T00:47:46.170 INFO:teuthology.orchestra.run.smithi162.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-25T00:47:46.170 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-25T00:47:46.170 INFO:teuthology.orchestra.run.smithi162.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-25T00:47:46.212 INFO:teuthology.orchestra.run.smithi162.stdout:The following NEW packages will be installed: 2024-04-25T00:47:46.212 INFO:teuthology.orchestra.run.smithi162.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-25T00:47:46.212 INFO:teuthology.orchestra.run.smithi162.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-25T00:47:46.213 INFO:teuthology.orchestra.run.smithi162.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-25T00:47:46.213 INFO:teuthology.orchestra.run.smithi162.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-25T00:47:46.213 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-25T00:47:46.213 INFO:teuthology.orchestra.run.smithi162.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-25T00:47:46.213 INFO:teuthology.orchestra.run.smithi162.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-25T00:47:46.214 INFO:teuthology.orchestra.run.smithi162.stdout:The following packages will be upgraded: 2024-04-25T00:47:46.215 INFO:teuthology.orchestra.run.smithi162.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-25T00:47:46.273 INFO:teuthology.orchestra.run.smithi162.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-25T00:47:46.274 INFO:teuthology.orchestra.run.smithi162.stdout:Need to get 55.7 MB of archives. 2024-04-25T00:47:46.274 INFO:teuthology.orchestra.run.smithi162.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-25T00:47:46.274 INFO:teuthology.orchestra.run.smithi162.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-25T00:47:46.427 INFO:teuthology.orchestra.run.smithi162.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-25T00:47:46.436 INFO:teuthology.orchestra.run.smithi162.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-25T00:47:46.477 INFO:teuthology.orchestra.run.smithi162.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-25T00:47:46.478 INFO:teuthology.orchestra.run.smithi162.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-25T00:47:46.479 INFO:teuthology.orchestra.run.smithi162.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-25T00:47:46.490 INFO:teuthology.orchestra.run.smithi162.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-25T00:47:46.491 INFO:teuthology.orchestra.run.smithi162.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-25T00:47:46.493 INFO:teuthology.orchestra.run.smithi162.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-25T00:47:46.494 INFO:teuthology.orchestra.run.smithi162.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-25T00:47:46.495 INFO:teuthology.orchestra.run.smithi162.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-25T00:47:46.496 INFO:teuthology.orchestra.run.smithi162.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-25T00:47:46.510 INFO:teuthology.orchestra.run.smithi162.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-25T00:47:46.525 INFO:teuthology.orchestra.run.smithi162.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-25T00:47:46.525 INFO:teuthology.orchestra.run.smithi162.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-25T00:47:46.526 INFO:teuthology.orchestra.run.smithi162.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-25T00:47:47.030 INFO:teuthology.orchestra.run.smithi162.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-25T00:47:47.033 INFO:teuthology.orchestra.run.smithi162.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-25T00:47:47.033 INFO:teuthology.orchestra.run.smithi162.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-25T00:47:47.037 INFO:teuthology.orchestra.run.smithi162.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-25T00:47:47.037 INFO:teuthology.orchestra.run.smithi162.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-25T00:47:47.043 INFO:teuthology.orchestra.run.smithi162.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-25T00:47:47.046 INFO:teuthology.orchestra.run.smithi162.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-25T00:47:47.056 INFO:teuthology.orchestra.run.smithi162.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-25T00:47:47.056 INFO:teuthology.orchestra.run.smithi162.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-25T00:47:47.088 INFO:teuthology.orchestra.run.smithi162.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-25T00:47:47.088 INFO:teuthology.orchestra.run.smithi162.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-25T00:47:47.101 INFO:teuthology.orchestra.run.smithi162.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-25T00:47:47.125 INFO:teuthology.orchestra.run.smithi162.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-25T00:47:47.130 INFO:teuthology.orchestra.run.smithi162.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-25T00:47:47.130 INFO:teuthology.orchestra.run.smithi162.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-25T00:47:47.131 INFO:teuthology.orchestra.run.smithi162.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-25T00:47:47.132 INFO:teuthology.orchestra.run.smithi162.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-25T00:47:47.146 INFO:teuthology.orchestra.run.smithi162.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-25T00:47:47.148 INFO:teuthology.orchestra.run.smithi162.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-25T00:47:47.264 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package postgresql. 2024-04-25T00:47:47.281 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T00:47:47.331 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking postgresql (14+238) ... 2024-04-25T00:47:47.440 INFO:teuthology.orchestra.run.smithi162.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-25T00:47:47.440 INFO:teuthology.orchestra.run.smithi162.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-25T00:47:47.440 INFO:teuthology.orchestra.run.smithi162.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-25T00:47:47.440 INFO:teuthology.orchestra.run.smithi162.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-25T00:47:47.440 INFO:teuthology.orchestra.run.smithi162.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-25T00:47:47.440 INFO:teuthology.orchestra.run.smithi162.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-25T00:47:47.452 INFO:teuthology.orchestra.run.smithi162.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-25T00:47:47.452 INFO:teuthology.orchestra.run.smithi162.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-25T00:47:47.566 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T00:47:47.594 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T00:47:47.633 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T00:47:47.858 INFO:teuthology.orchestra.run.smithi162.stdout:Preconfiguring packages ... 2024-04-25T00:47:47.877 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T00:47:47.905 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T00:47:47.943 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T00:47:48.038 INFO:teuthology.orchestra.run.smithi162.stdout:Fetched 55.7 MB in 1s (45.3 MB/s) 2024-04-25T00:47:48.246 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T00:47:48.274 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T00:47:48.297 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174275 files and directories currently installed.) 2024-04-25T00:47:48.302 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T00:47:48.312 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T00:47:48.423 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T00:47:48.565 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package tcl. 2024-04-25T00:47:48.593 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T00:47:48.628 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T00:47:48.968 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T00:47:48.996 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T00:47:49.034 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T00:47:49.069 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-25T00:47:49.405 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T00:47:49.422 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T00:47:49.463 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T00:47:49.792 INFO:teuthology.orchestra.run.smithi179.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T00:47:49.820 INFO:teuthology.orchestra.run.smithi179.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T00:47:49.884 INFO:teuthology.orchestra.run.smithi179.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T00:47:50.018 INFO:teuthology.orchestra.run.smithi162.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-25T00:47:50.147 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T00:47:50.286 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package flex. 2024-04-25T00:47:50.356 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T00:47:50.380 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174275 files and directories currently installed.) 2024-04-25T00:47:50.386 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-25T00:47:50.426 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-25T00:47:50.499 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T00:47:50.625 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T00:47:50.751 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T00:47:50.877 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T00:47:50.986 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T00:47:51.092 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T00:47:51.249 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-25T00:47:51.420 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T00:47:51.500 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T00:47:51.642 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T00:47:51.828 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T00:47:51.828 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T00:47:52.313 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174348 files and directories currently installed.) 2024-04-25T00:47:52.319 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T00:47:52.328 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T00:47:52.424 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T00:47:52.454 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T00:47:52.580 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T00:47:52.706 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T00:47:52.824 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-25T00:47:52.832 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T00:47:52.958 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T00:47:52.972 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-25T00:47:53.076 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T00:47:53.177 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T00:47:53.307 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T00:47:53.680 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package bison. 2024-04-25T00:47:53.785 INFO:teuthology.orchestra.run.smithi162.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174348 files and directories currently installed.) 2024-04-25T00:47:53.791 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-25T00:47:53.832 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T00:47:53.840 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T00:47:53.958 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T00:47:54.052 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T00:47:54.109 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T00:47:54.225 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-25T00:47:54.252 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-25T00:47:54.277 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T00:47:54.291 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T00:47:54.454 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T00:47:54.580 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T00:47:54.636 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package dump. 2024-04-25T00:47:54.664 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-25T00:47:54.702 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking dump (0.4b47-3) ... 2024-04-25T00:47:54.705 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T00:47:54.796 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T00:47:54.865 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T00:47:54.999 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T00:47:55.039 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package indent. 2024-04-25T00:47:55.056 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T00:47:55.106 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T00:47:55.176 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T00:47:55.285 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T00:47:55.375 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-25T00:47:55.391 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-25T00:47:55.395 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T00:47:55.434 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T00:47:55.571 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T00:47:55.697 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T00:47:55.779 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-25T00:47:55.807 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-25T00:47:55.846 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T00:47:56.157 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-25T00:47:56.174 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:47:56.174 INFO:teuthology.orchestra.run.smithi179.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T00:47:56.174 INFO:teuthology.orchestra.run.smithi179.stdout:which means they are currently configured by ifupdown: 2024-04-25T00:47:56.174 INFO:teuthology.orchestra.run.smithi179.stdout:- enp3s0f1 2024-04-25T00:47:56.174 INFO:teuthology.orchestra.run.smithi179.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T00:47:56.174 INFO:teuthology.orchestra.run.smithi179.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T00:47:56.174 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:47:56.184 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-25T00:47:56.232 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T00:47:56.300 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T00:47:56.594 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-25T00:47:56.622 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-25T00:47:56.623 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T00:47:56.660 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T00:47:56.929 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-25T00:47:56.942 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T00:47:56.957 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-25T00:47:56.996 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T00:47:57.299 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libjson-perl. 2024-04-25T00:47:57.316 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-25T00:47:57.358 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-25T00:47:57.424 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T00:47:57.584 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T00:47:57.678 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-25T00:47:57.693 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T00:47:57.705 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-25T00:47:57.744 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T00:47:57.795 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up postgresql-common (238) ... 2024-04-25T00:47:58.673 INFO:teuthology.orchestra.run.smithi179.stdout:Adding user postgres to group ssl-cert 2024-04-25T00:47:58.895 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:47:58.895 INFO:teuthology.orchestra.run.smithi179.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T00:47:59.069 INFO:teuthology.orchestra.run.smithi179.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T00:47:59.069 INFO:teuthology.orchestra.run.smithi179.stdout:Removing obsolete dictionary files: 2024-04-25T00:47:59.405 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-25T00:47:59.433 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T00:47:59.472 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T00:47:59.632 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T00:47:59.774 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-25T00:47:59.802 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-25T00:47:59.866 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T00:48:00.030 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T00:48:00.227 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-25T00:48:00.255 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T00:48:00.293 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T00:48:00.370 INFO:teuthology.orchestra.run.smithi179.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T00:48:00.395 INFO:teuthology.orchestra.run.smithi179.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T00:48:00.432 INFO:teuthology.orchestra.run.smithi179.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T00:48:00.432 INFO:teuthology.orchestra.run.smithi179.stdout:This user must also own the server process. 2024-04-25T00:48:00.432 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:00.432 INFO:teuthology.orchestra.run.smithi179.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T00:48:00.432 INFO:teuthology.orchestra.run.smithi179.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T00:48:00.432 INFO:teuthology.orchestra.run.smithi179.stdout:The default text search configuration will be set to "english". 2024-04-25T00:48:00.433 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:00.433 INFO:teuthology.orchestra.run.smithi179.stdout:Data page checksums are disabled. 2024-04-25T00:48:00.433 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:00.433 INFO:teuthology.orchestra.run.smithi179.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T00:48:00.433 INFO:teuthology.orchestra.run.smithi179.stdout:creating subdirectories ... ok 2024-04-25T00:48:00.433 INFO:teuthology.orchestra.run.smithi179.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T00:48:00.448 INFO:teuthology.orchestra.run.smithi179.stdout:selecting default max_connections ... 100 2024-04-25T00:48:00.470 INFO:teuthology.orchestra.run.smithi179.stdout:selecting default shared_buffers ... 128MB 2024-04-25T00:48:00.476 INFO:teuthology.orchestra.run.smithi179.stdout:selecting default time zone ... Etc/UTC 2024-04-25T00:48:00.477 INFO:teuthology.orchestra.run.smithi179.stdout:creating configuration files ... ok 2024-04-25T00:48:00.594 INFO:teuthology.orchestra.run.smithi179.stdout:running bootstrap script ... ok 2024-04-25T00:48:00.713 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-25T00:48:00.741 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-25T00:48:00.780 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T00:48:01.133 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-25T00:48:01.161 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T00:48:01.207 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T00:48:01.244 INFO:teuthology.orchestra.run.smithi179.stdout:performing post-bootstrap initialization ... ok 2024-04-25T00:48:01.635 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-25T00:48:01.663 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T00:48:01.701 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T00:48:01.942 INFO:teuthology.orchestra.run.smithi179.stdout:syncing data to disk ... ok 2024-04-25T00:48:02.046 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-25T00:48:02.074 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T00:48:02.113 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T00:48:02.323 INFO:teuthology.orchestra.run.smithi179.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T00:48:02.584 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-25T00:48:02.612 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-25T00:48:02.659 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T00:48:02.970 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-25T00:48:02.997 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-25T00:48:03.036 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T00:48:03.548 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-25T00:48:03.576 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-25T00:48:03.615 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T00:48:03.968 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package modemmanager. 2024-04-25T00:48:03.995 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-25T00:48:04.034 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T00:48:04.649 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package network-manager. 2024-04-25T00:48:04.678 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-25T00:48:04.724 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-25T00:48:05.086 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T00:48:05.232 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T00:48:05.363 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up postgresql (14+238) ... 2024-04-25T00:48:05.373 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package ppp. 2024-04-25T00:48:05.401 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-25T00:48:05.489 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T00:48:05.615 INFO:teuthology.orchestra.run.smithi179.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T00:48:05.684 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T00:48:05.861 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T00:48:05.861 INFO:teuthology.orchestra.run.smithi179.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T00:48:05.986 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package pptp-linux. 2024-04-25T00:48:06.014 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-25T00:48:06.061 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-25T00:48:06.339 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-25T00:48:06.367 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-25T00:48:06.405 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-25T00:48:06.409 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T00:48:06.502 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T00:48:06.708 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-25T00:48:06.736 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-25T00:48:06.775 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-client-common (238) ... 2024-04-25T00:48:06.831 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T00:48:06.983 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T00:48:07.128 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-25T00:48:07.156 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T00:48:07.203 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T00:48:08.127 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T00:48:08.216 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-common. 2024-04-25T00:48:08.227 INFO:teuthology.orchestra.run.smithi179.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T00:48:08.246 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-25T00:48:08.303 INFO:teuthology.orchestra.run.smithi162.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-25T00:48:08.330 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-common (238) ... 2024-04-25T00:48:08.715 INFO:teuthology.orchestra.run.smithi179.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T00:48:08.721 DEBUG:teuthology.parallel:result is None 2024-04-25T00:48:08.790 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-14. 2024-04-25T00:48:08.819 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-25T00:48:08.860 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T00:48:10.234 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql. 2024-04-25T00:48:10.263 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-25T00:48:10.300 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql (14+238) ... 2024-04-25T00:48:10.536 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-client. 2024-04-25T00:48:10.564 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-25T00:48:10.602 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-client (14+238) ... 2024-04-25T00:48:10.821 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-25T00:48:10.838 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-25T00:48:10.880 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-25T00:48:11.199 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package tcl8.6. 2024-04-25T00:48:11.227 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-25T00:48:11.265 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T00:48:11.526 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package tcl. 2024-04-25T00:48:11.554 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-25T00:48:11.597 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-25T00:48:11.945 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package wpasupplicant. 2024-04-25T00:48:11.973 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-25T00:48:12.012 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T00:48:12.385 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-25T00:48:12.401 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-25T00:48:12.443 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-25T00:48:12.829 INFO:teuthology.orchestra.run.smithi162.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-25T00:48:12.857 INFO:teuthology.orchestra.run.smithi162.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-25T00:48:12.904 INFO:teuthology.orchestra.run.smithi162.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T00:48:13.200 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-client-common (238) ... 2024-04-25T00:48:13.385 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-25T00:48:13.511 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-25T00:48:13.637 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T00:48:13.763 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-25T00:48:13.889 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-25T00:48:14.023 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T00:48:14.521 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-25T00:48:14.604 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-25T00:48:15.001 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T00:48:15.001 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-25T00:48:15.448 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-25T00:48:15.574 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-25T00:48:15.717 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-25T00:48:15.868 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-25T00:48:16.019 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-25T00:48:16.162 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-25T00:48:16.287 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-25T00:48:16.413 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-25T00:48:17.119 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-25T00:48:17.317 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up dump (0.4b47-3) ... 2024-04-25T00:48:17.430 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-25T00:48:17.496 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T00:48:17.622 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-25T00:48:17.757 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-25T00:48:18.258 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-25T00:48:18.426 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-25T00:48:18.525 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-25T00:48:18.611 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-25T00:48:18.753 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-25T00:48:18.930 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-25T00:48:19.056 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T00:48:19.198 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-25T00:48:19.367 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-client (14+238) ... 2024-04-25T00:48:19.501 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-25T00:48:20.009 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:20.009 INFO:teuthology.orchestra.run.smithi162.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-25T00:48:20.009 INFO:teuthology.orchestra.run.smithi162.stdout:which means they are currently configured by ifupdown: 2024-04-25T00:48:20.010 INFO:teuthology.orchestra.run.smithi162.stdout:- enp3s0f1 2024-04-25T00:48:20.010 INFO:teuthology.orchestra.run.smithi162.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-25T00:48:20.010 INFO:teuthology.orchestra.run.smithi162.stdout:remove their configuration from /etc/network/interfaces. 2024-04-25T00:48:20.010 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:20.129 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-25T00:48:20.428 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-25T00:48:20.759 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-25T00:48:21.228 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-25T00:48:21.388 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-25T00:48:21.514 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-25T00:48:21.640 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-common (238) ... 2024-04-25T00:48:22.533 INFO:teuthology.orchestra.run.smithi162.stdout:Adding user postgres to group ssl-cert 2024-04-25T00:48:22.766 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:22.766 INFO:teuthology.orchestra.run.smithi162.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-25T00:48:22.959 INFO:teuthology.orchestra.run.smithi162.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-25T00:48:22.959 INFO:teuthology.orchestra.run.smithi162.stdout:Removing obsolete dictionary files: 2024-04-25T00:48:23.524 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-25T00:48:23.925 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-25T00:48:24.240 INFO:teuthology.orchestra.run.smithi162.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-25T00:48:24.253 INFO:teuthology.orchestra.run.smithi162.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-25T00:48:24.300 INFO:teuthology.orchestra.run.smithi162.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-25T00:48:24.300 INFO:teuthology.orchestra.run.smithi162.stdout:This user must also own the server process. 2024-04-25T00:48:24.300 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:24.300 INFO:teuthology.orchestra.run.smithi162.stdout:The database cluster will be initialized with locale "en_US". 2024-04-25T00:48:24.301 INFO:teuthology.orchestra.run.smithi162.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-25T00:48:24.301 INFO:teuthology.orchestra.run.smithi162.stdout:The default text search configuration will be set to "english". 2024-04-25T00:48:24.301 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:24.301 INFO:teuthology.orchestra.run.smithi162.stdout:Data page checksums are disabled. 2024-04-25T00:48:24.301 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:24.301 INFO:teuthology.orchestra.run.smithi162.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-25T00:48:24.301 INFO:teuthology.orchestra.run.smithi162.stdout:creating subdirectories ... ok 2024-04-25T00:48:24.301 INFO:teuthology.orchestra.run.smithi162.stdout:selecting dynamic shared memory implementation ... posix 2024-04-25T00:48:24.314 INFO:teuthology.orchestra.run.smithi162.stdout:selecting default max_connections ... 100 2024-04-25T00:48:24.334 INFO:teuthology.orchestra.run.smithi162.stdout:selecting default shared_buffers ... 128MB 2024-04-25T00:48:24.344 INFO:teuthology.orchestra.run.smithi162.stdout:selecting default time zone ... Etc/UTC 2024-04-25T00:48:24.345 INFO:teuthology.orchestra.run.smithi162.stdout:creating configuration files ... ok 2024-04-25T00:48:24.464 INFO:teuthology.orchestra.run.smithi162.stdout:running bootstrap script ... ok 2024-04-25T00:48:25.093 INFO:teuthology.orchestra.run.smithi162.stdout:performing post-bootstrap initialization ... ok 2024-04-25T00:48:25.786 INFO:teuthology.orchestra.run.smithi162.stdout:syncing data to disk ... ok 2024-04-25T00:48:26.169 INFO:teuthology.orchestra.run.smithi162.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-25T00:48:28.948 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T00:48:29.073 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-25T00:48:29.208 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up postgresql (14+238) ... 2024-04-25T00:48:29.359 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-25T00:48:29.510 INFO:teuthology.orchestra.run.smithi162.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-25T00:48:29.780 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T00:48:29.780 INFO:teuthology.orchestra.run.smithi162.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-25T00:48:30.321 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T00:48:30.413 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-25T00:48:30.774 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T00:48:30.909 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T00:48:32.278 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-25T00:48:32.378 INFO:teuthology.orchestra.run.smithi162.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T00:48:32.878 INFO:teuthology.orchestra.run.smithi162.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T00:48:32.882 DEBUG:teuthology.parallel:result is None 2024-04-25T00:48:32.883 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T00:48:33.029 DEBUG:teuthology.orchestra.run.smithi162:> dpkg-query -W -f '${Version}' ceph 2024-04-25T00:48:33.049 INFO:teuthology.orchestra.run.smithi162.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-25T00:48:33.049 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T00:48:33.050 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-25T00:48:33.052 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T00:48:33.193 DEBUG:teuthology.orchestra.run.smithi179:> dpkg-query -W -f '${Version}' ceph 2024-04-25T00:48:33.213 INFO:teuthology.orchestra.run.smithi179.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-25T00:48:33.214 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T00:48:33.214 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-25T00:48:33.216 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T00:48:33.216 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:48:33.216 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T00:48:33.230 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:48:33.231 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T00:48:33.270 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T00:48:33.270 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:48:33.270 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T00:48:33.286 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T00:48:33.342 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:48:33.342 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T00:48:33.355 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T00:48:33.408 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T00:48:33.408 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:48:33.409 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T00:48:33.422 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T00:48:33.482 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:48:33.482 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T00:48:33.494 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T00:48:33.548 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T00:48:33.549 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:48:33.549 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T00:48:33.562 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T00:48:33.617 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:48:33.618 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T00:48:33.630 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T00:48:33.684 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T00:48:33.772 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T00:48:33.772 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 777 /var/log/ceph 2024-04-25T00:48:33.774 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 777 /var/log/ceph 2024-04-25T00:48:33.787 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T00:48:33.787 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T00:48:33.828 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T00:48:33.840 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T00:48:33.840 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T00:48:33.884 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T00:48:33.906 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T00:48:33.907 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T00:48:33.907 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T00:48:33.907 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:48:33.907 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T00:48:33.943 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T00:48:34.021 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:48:34.021 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T00:48:34.027 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T00:48:34.108 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T00:48:34.108 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T00:48:34.108 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672274', 'branch': 'squid', 'description': 'fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/5 tasks/fsstress validater/valgrind}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7672274', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'debuginfo': True, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 8528, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'sleep_before_teardown': 0, 'subset': '122/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi162.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM904qXsBlfruaETNbdYlRUpEJ04/ypC+Ggk6Wg50rh5Pe0298/XAaVO+vkfA2SN8NeO2X1QEWDk23DYYEQSvOc=', 'smithi179.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZBoJii4aVktl98RvFIdboPuZoht2OQaKgvhGp/sByOOV+kDADxPqLoUBI0u9faJbfWEiXwWJH1YWv4cW+3oaM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'debuginfo': True, 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow request', 'SLOW_OPS', 'MON_DOWN'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'valgrind': {'exit_on_first_error': False, 'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']}, 'watchdog': {'daemon_restart': 'normal'}, 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-24_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T00:48:34.109 DEBUG:teuthology.orchestra.run.smithi162:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T00:48:34.111 DEBUG:teuthology.orchestra.run.smithi179:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T00:48:34.149 DEBUG:teuthology.orchestra.run.smithi162:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T00:48:34.160 DEBUG:teuthology.orchestra.run.smithi179:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T00:48:34.205 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:48:34.205 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T00:48:34.219 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T00:48:34.219 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_1 2024-04-25T00:48:34.267 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T00:48:34.268 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T00:48:34.268 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 872 Links: 1 2024-04-25T00:48:34.268 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T00:48:34.268 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-04-25 00:35:46.641992687 +0000 2024-04-25T00:48:34.268 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-04-25 00:35:46.401994828 +0000 2024-04-25T00:48:34.268 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-04-25 00:35:46.401994828 +0000 2024-04-25T00:48:34.268 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-04-25T00:48:34.268 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T00:48:34.321 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-04-25T00:48:34.321 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-04-25T00:48:34.321 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000431953 s, 1.2 MB/s 2024-04-25T00:48:34.323 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T00:48:34.372 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_2 2024-04-25T00:48:34.419 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T00:48:34.419 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T00:48:34.419 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 891 Links: 1 2024-04-25T00:48:34.419 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T00:48:34.419 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-04-25 00:35:47.141988226 +0000 2024-04-25T00:48:34.419 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-04-25 00:35:46.869990653 +0000 2024-04-25T00:48:34.419 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-04-25 00:35:46.869990653 +0000 2024-04-25T00:48:34.419 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-04-25T00:48:34.419 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T00:48:34.472 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-04-25T00:48:34.473 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-04-25T00:48:34.473 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000311459 s, 1.6 MB/s 2024-04-25T00:48:34.474 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T00:48:34.524 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_3 2024-04-25T00:48:34.570 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T00:48:34.571 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T00:48:34.571 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 903 Links: 1 2024-04-25T00:48:34.571 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T00:48:34.571 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-04-25 00:35:47.609984051 +0000 2024-04-25T00:48:34.571 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-04-25 00:35:47.373986156 +0000 2024-04-25T00:48:34.571 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-04-25 00:35:47.373986156 +0000 2024-04-25T00:48:34.571 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-04-25T00:48:34.571 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T00:48:34.625 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-04-25T00:48:34.625 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-04-25T00:48:34.626 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000438567 s, 1.2 MB/s 2024-04-25T00:48:34.627 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T00:48:34.676 DEBUG:teuthology.orchestra.run.smithi162:> stat /dev/vg_nvme/lv_4 2024-04-25T00:48:34.723 INFO:teuthology.orchestra.run.smithi162.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T00:48:34.723 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T00:48:34.723 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-04-25T00:48:34.723 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T00:48:34.723 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 2024-04-25 00:35:48.109979591 +0000 2024-04-25T00:48:34.724 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-04-25 00:35:47.853981875 +0000 2024-04-25T00:48:34.724 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-04-25 00:35:47.853981875 +0000 2024-04-25T00:48:34.724 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-04-25T00:48:34.724 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T00:48:34.777 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records in 2024-04-25T00:48:34.777 INFO:teuthology.orchestra.run.smithi162.stderr:1+0 records out 2024-04-25T00:48:34.777 INFO:teuthology.orchestra.run.smithi162.stderr:512 bytes copied, 0.000323793 s, 1.6 MB/s 2024-04-25T00:48:34.778 DEBUG:teuthology.orchestra.run.smithi162:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T00:48:34.828 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T00:48:34.828 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:48:34.828 DEBUG:teuthology.orchestra.run.smithi179:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T00:48:34.834 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T00:48:34.834 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_1 2024-04-25T00:48:34.881 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T00:48:34.882 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T00:48:34.882 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 872 Links: 1 2024-04-25T00:48:34.882 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T00:48:34.882 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-04-25 00:35:44.805118734 +0000 2024-04-25T00:48:34.882 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-04-25 00:35:44.517121307 +0000 2024-04-25T00:48:34.882 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-04-25 00:35:44.517121307 +0000 2024-04-25T00:48:34.882 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-04-25T00:48:34.882 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T00:48:34.936 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-04-25T00:48:34.936 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-04-25T00:48:34.936 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000443266 s, 1.2 MB/s 2024-04-25T00:48:34.938 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T00:48:34.986 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_2 2024-04-25T00:48:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T00:48:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T00:48:35.033 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-04-25T00:48:35.033 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T00:48:35.033 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-04-25 00:35:45.361113767 +0000 2024-04-25T00:48:35.033 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-04-25 00:35:45.085116233 +0000 2024-04-25T00:48:35.033 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-04-25 00:35:45.085116233 +0000 2024-04-25T00:48:35.033 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-04-25T00:48:35.034 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T00:48:35.087 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-04-25T00:48:35.087 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-04-25T00:48:35.087 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000357139 s, 1.4 MB/s 2024-04-25T00:48:35.088 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T00:48:35.138 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_3 2024-04-25T00:48:35.184 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T00:48:35.185 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T00:48:35.185 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-04-25T00:48:35.185 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T00:48:35.185 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-04-25 00:35:45.829109588 +0000 2024-04-25T00:48:35.185 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-04-25 00:35:45.581111803 +0000 2024-04-25T00:48:35.185 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-04-25 00:35:45.581111803 +0000 2024-04-25T00:48:35.185 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-04-25T00:48:35.185 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T00:48:35.239 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-04-25T00:48:35.239 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-04-25T00:48:35.239 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000398131 s, 1.3 MB/s 2024-04-25T00:48:35.240 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T00:48:35.290 DEBUG:teuthology.orchestra.run.smithi179:> stat /dev/vg_nvme/lv_4 2024-04-25T00:48:35.337 INFO:teuthology.orchestra.run.smithi179.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T00:48:35.337 INFO:teuthology.orchestra.run.smithi179.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T00:48:35.337 INFO:teuthology.orchestra.run.smithi179.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-04-25T00:48:35.337 INFO:teuthology.orchestra.run.smithi179.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T00:48:35.337 INFO:teuthology.orchestra.run.smithi179.stdout:Access: 2024-04-25 00:35:46.349104943 +0000 2024-04-25T00:48:35.337 INFO:teuthology.orchestra.run.smithi179.stdout:Modify: 2024-04-25 00:35:46.089107265 +0000 2024-04-25T00:48:35.337 INFO:teuthology.orchestra.run.smithi179.stdout:Change: 2024-04-25 00:35:46.089107265 +0000 2024-04-25T00:48:35.337 INFO:teuthology.orchestra.run.smithi179.stdout: Birth: - 2024-04-25T00:48:35.338 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T00:48:35.392 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records in 2024-04-25T00:48:35.392 INFO:teuthology.orchestra.run.smithi179.stderr:1+0 records out 2024-04-25T00:48:35.392 INFO:teuthology.orchestra.run.smithi179.stderr:512 bytes copied, 0.000348724 s, 1.5 MB/s 2024-04-25T00:48:35.393 DEBUG:teuthology.orchestra.run.smithi179:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T00:48:35.442 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T00:48:35.443 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T00:48:35.443 INFO:tasks.ceph:Generating config... 2024-04-25T00:48:35.444 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T00:48:35.444 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T00:48:35.444 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T00:48:35.444 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T00:48:35.445 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T00:48:35.445 INFO:tasks.ceph:[global] mds beacon grace = 60 2024-04-25T00:48:35.445 INFO:tasks.ceph:[global] mds heartbeat grace = 60 2024-04-25T00:48:35.445 INFO:tasks.ceph:[global] osd heartbeat grace = 60 2024-04-25T00:48:35.445 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T00:48:35.445 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T00:48:35.445 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T00:48:35.445 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T00:48:35.445 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T00:48:35.445 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T00:48:35.445 INFO:tasks.ceph:[mds] mds valgrind exit = True 2024-04-25T00:48:35.445 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T00:48:35.445 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T00:48:35.446 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T00:48:35.446 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T00:48:35.446 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T00:48:35.446 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T00:48:35.446 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T00:48:35.446 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T00:48:35.446 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T00:48:35.446 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T00:48:35.446 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T00:48:35.446 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T00:48:35.447 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-04-25T00:48:35.447 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-25T00:48:35.447 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-25T00:48:35.447 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-25T00:48:35.447 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T00:48:35.447 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T00:48:35.447 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T00:48:35.447 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T00:48:35.447 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T00:48:35.447 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T00:48:35.447 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T00:48:35.447 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T00:48:35.447 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T00:48:35.448 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T00:48:35.448 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T00:48:35.448 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-04-25T00:48:35.448 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T00:48:35.448 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T00:48:35.448 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T00:48:35.448 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T00:48:35.483 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T00:48:35.495 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T00:48:35.571 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T00:48:35.626 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.162'), ('mon.b', '172.21.15.179'), ('mon.c', '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]')] 2024-04-25T00:48:35.627 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.162,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]', 'mds beacon grace': 60, 'mds heartbeat grace': 60, 'osd heartbeat grace': 60}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds valgrind exit': True, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T00:48:35.628 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:48:35.628 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T00:48:35.674 DEBUG:teuthology.orchestra.run.smithi162:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.162 --add b 172.21.15.179 --addv c '[v2:172.21.15.179:3301,v1:172.21.15.179:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T00:48:35.759 INFO:teuthology.orchestra.run.smithi162.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T00:48:35.759 INFO:teuthology.orchestra.run.smithi162.stdout:monmaptool: generated fsid e141deed-4794-4a17-83c9-f6e6e8875f5e 2024-04-25T00:48:35.759 INFO:teuthology.orchestra.run.smithi162.stdout:setting min_mon_release = quincy 2024-04-25T00:48:35.759 INFO:teuthology.orchestra.run.smithi162.stdout:epoch 0 2024-04-25T00:48:35.760 INFO:teuthology.orchestra.run.smithi162.stdout:fsid e141deed-4794-4a17-83c9-f6e6e8875f5e 2024-04-25T00:48:35.760 INFO:teuthology.orchestra.run.smithi162.stdout:last_changed 2024-04-25T00:48:35.760712+0000 2024-04-25T00:48:35.760 INFO:teuthology.orchestra.run.smithi162.stdout:created 2024-04-25T00:48:35.760712+0000 2024-04-25T00:48:35.760 INFO:teuthology.orchestra.run.smithi162.stdout:min_mon_release 17 (quincy) 2024-04-25T00:48:35.760 INFO:teuthology.orchestra.run.smithi162.stdout:election_strategy: 1 2024-04-25T00:48:35.760 INFO:teuthology.orchestra.run.smithi162.stdout:0: [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] mon.a 2024-04-25T00:48:35.760 INFO:teuthology.orchestra.run.smithi162.stdout:1: [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] mon.b 2024-04-25T00:48:35.760 INFO:teuthology.orchestra.run.smithi162.stdout:2: [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] mon.c 2024-04-25T00:48:35.760 INFO:teuthology.orchestra.run.smithi162.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T00:48:35.761 DEBUG:teuthology.orchestra.run.smithi162:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T00:48:35.807 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e141deed-4794-4a17-83c9-f6e6e8875f5e... 2024-04-25T00:48:35.808 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T00:48:35.852 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T00:48:35.880 INFO:teuthology.orchestra.run.smithi162.stdout:[global] 2024-04-25T00:48:35.880 INFO:teuthology.orchestra.run.smithi162.stdout: chdir = "" 2024-04-25T00:48:35.880 INFO:teuthology.orchestra.run.smithi162.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T00:48:35.880 INFO:teuthology.orchestra.run.smithi162.stdout: auth supported = cephx 2024-04-25T00:48:35.880 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.880 INFO:teuthology.orchestra.run.smithi162.stdout: filestore xattr use omap = true 2024-04-25T00:48:35.880 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.881 INFO:teuthology.orchestra.run.smithi162.stdout: mon clock drift allowed = 1.000 2024-04-25T00:48:35.881 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.881 INFO:teuthology.orchestra.run.smithi162.stdout: osd crush chooseleaf type = 0 2024-04-25T00:48:35.881 INFO:teuthology.orchestra.run.smithi162.stdout: auth debug = true 2024-04-25T00:48:35.881 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.881 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on old message = true 2024-04-25T00:48:35.881 INFO:teuthology.orchestra.run.smithi162.stdout: ms die on bug = true 2024-04-25T00:48:35.881 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.881 INFO:teuthology.orchestra.run.smithi162.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T00:48:35.881 INFO:teuthology.orchestra.run.smithi162.stdout: mon pg warn max object skew = 0 2024-04-25T00:48:35.881 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.882 INFO:teuthology.orchestra.run.smithi162.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T00:48:35.882 INFO:teuthology.orchestra.run.smithi162.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T00:48:35.882 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.882 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default size = 2 2024-04-25T00:48:35.882 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.882 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow primary affinity = true 2024-04-25T00:48:35.882 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd allow pg remap = true 2024-04-25T00:48:35.882 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on legacy crush tunables = false 2024-04-25T00:48:35.882 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on crush straw calc version zero = false 2024-04-25T00:48:35.883 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on no sortbitwise = false 2024-04-25T00:48:35.883 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on osd down out interval zero = false 2024-04-25T00:48:35.883 INFO:teuthology.orchestra.run.smithi162.stdout: mon warn on too few osds = false 2024-04-25T00:48:35.883 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T00:48:35.883 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T00:48:35.883 INFO:teuthology.orchestra.run.smithi162.stdout: mon_allow_pool_size_one = true 2024-04-25T00:48:35.883 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.883 INFO:teuthology.orchestra.run.smithi162.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T00:48:35.883 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.883 INFO:teuthology.orchestra.run.smithi162.stdout: osd default data pool replay window = 5 2024-04-25T00:48:35.883 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.883 INFO:teuthology.orchestra.run.smithi162.stdout: mon allow pool delete = true 2024-04-25T00:48:35.883 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.883 INFO:teuthology.orchestra.run.smithi162.stdout: mon cluster log file level = debug 2024-04-25T00:48:35.883 INFO:teuthology.orchestra.run.smithi162.stdout: debug asserts on shutdown = true 2024-04-25T00:48:35.884 INFO:teuthology.orchestra.run.smithi162.stdout: mon health detail to clog = false 2024-04-25T00:48:35.884 INFO:teuthology.orchestra.run.smithi162.stdout: mon host = "172.21.15.162,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-04-25T00:48:35.884 INFO:teuthology.orchestra.run.smithi162.stdout: mds beacon grace = 60 2024-04-25T00:48:35.884 INFO:teuthology.orchestra.run.smithi162.stdout: mds heartbeat grace = 60 2024-04-25T00:48:35.884 INFO:teuthology.orchestra.run.smithi162.stdout: osd heartbeat grace = 60 2024-04-25T00:48:35.884 INFO:teuthology.orchestra.run.smithi162.stdout: fsid = e141deed-4794-4a17-83c9-f6e6e8875f5e 2024-04-25T00:48:35.884 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.884 INFO:teuthology.orchestra.run.smithi162.stdout:[osd] 2024-04-25T00:48:35.884 INFO:teuthology.orchestra.run.smithi162.stdout: osd journal size = 100 2024-04-25T00:48:35.884 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.884 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub load threshold = 5.0 2024-04-25T00:48:35.884 INFO:teuthology.orchestra.run.smithi162.stdout: osd scrub max interval = 600 2024-04-25T00:48:35.884 INFO:teuthology.orchestra.run.smithi162.stdout: osd mclock profile = high_recovery_ops 2024-04-25T00:48:35.884 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.885 INFO:teuthology.orchestra.run.smithi162.stdout: osd recover clone overlap = true 2024-04-25T00:48:35.885 INFO:teuthology.orchestra.run.smithi162.stdout: osd recovery max chunk = 1048576 2024-04-25T00:48:35.885 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.885 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug shutdown = true 2024-04-25T00:48:35.885 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug op order = true 2024-04-25T00:48:35.885 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug verify stray on activate = true 2024-04-25T00:48:35.885 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug trim objects = true 2024-04-25T00:48:35.885 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.885 INFO:teuthology.orchestra.run.smithi162.stdout: osd open classes on start = true 2024-04-25T00:48:35.885 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug pg log writeout = true 2024-04-25T00:48:35.885 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.885 INFO:teuthology.orchestra.run.smithi162.stdout: osd deep scrub update digest min age = 30 2024-04-25T00:48:35.885 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.885 INFO:teuthology.orchestra.run.smithi162.stdout: osd map max advance = 10 2024-04-25T00:48:35.885 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.886 INFO:teuthology.orchestra.run.smithi162.stdout: journal zero on create = true 2024-04-25T00:48:35.886 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.886 INFO:teuthology.orchestra.run.smithi162.stdout: filestore ondisk finisher threads = 3 2024-04-25T00:48:35.886 INFO:teuthology.orchestra.run.smithi162.stdout: filestore apply finisher threads = 3 2024-04-25T00:48:35.886 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.886 INFO:teuthology.orchestra.run.smithi162.stdout: bdev debug aio = true 2024-04-25T00:48:35.886 INFO:teuthology.orchestra.run.smithi162.stdout: osd debug misdirected ops = true 2024-04-25T00:48:35.886 INFO:teuthology.orchestra.run.smithi162.stdout: bdev async discard = True 2024-04-25T00:48:35.886 INFO:teuthology.orchestra.run.smithi162.stdout: bdev enable discard = True 2024-04-25T00:48:35.886 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore allocator = bitmap 2024-04-25T00:48:35.886 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore block size = 96636764160 2024-04-25T00:48:35.886 INFO:teuthology.orchestra.run.smithi162.stdout: bluestore fsck on mount = True 2024-04-25T00:48:35.886 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluefs = 1/20 2024-04-25T00:48:35.886 INFO:teuthology.orchestra.run.smithi162.stdout: debug bluestore = 1/20 2024-04-25T00:48:35.887 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-04-25T00:48:35.887 INFO:teuthology.orchestra.run.smithi162.stdout: debug osd = 20 2024-04-25T00:48:35.887 INFO:teuthology.orchestra.run.smithi162.stdout: debug rocksdb = 4/10 2024-04-25T00:48:35.887 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T00:48:35.887 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd full ratio = 0.9 2024-04-25T00:48:35.887 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd nearfull ratio = 0.8 2024-04-25T00:48:35.887 INFO:teuthology.orchestra.run.smithi162.stdout: osd failsafe full ratio = 0.95 2024-04-25T00:48:35.887 INFO:teuthology.orchestra.run.smithi162.stdout: osd fast shutdown = False 2024-04-25T00:48:35.887 INFO:teuthology.orchestra.run.smithi162.stdout: osd objectstore = bluestore 2024-04-25T00:48:35.887 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2024-04-25T00:48:35.887 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.887 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr] 2024-04-25T00:48:35.887 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-04-25T00:48:35.887 INFO:teuthology.orchestra.run.smithi162.stdout: debug mgr = 20 2024-04-25T00:48:35.888 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-04-25T00:48:35.888 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-04-25T00:48:35.888 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-04-25T00:48:35.888 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-04-25T00:48:35.888 INFO:teuthology.orchestra.run.smithi162.stdout: mgr/telemetry/nag = false 2024-04-25T00:48:35.888 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2024-04-25T00:48:35.888 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.888 INFO:teuthology.orchestra.run.smithi162.stdout:[mon] 2024-04-25T00:48:35.888 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-04-25T00:48:35.888 INFO:teuthology.orchestra.run.smithi162.stdout: debug mon = 20 2024-04-25T00:48:35.888 INFO:teuthology.orchestra.run.smithi162.stdout: debug paxos = 20 2024-04-25T00:48:35.888 INFO:teuthology.orchestra.run.smithi162.stdout: debug auth = 20 2024-04-25T00:48:35.888 INFO:teuthology.orchestra.run.smithi162.stdout: mon data avail warn = 5 2024-04-25T00:48:35.888 INFO:teuthology.orchestra.run.smithi162.stdout: mon mgr mkfs grace = 240 2024-04-25T00:48:35.889 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min pgs per osd = 4 2024-04-25T00:48:35.889 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd reporter subtree level = osd 2024-04-25T00:48:35.889 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd prime pg temp = true 2024-04-25T00:48:35.889 INFO:teuthology.orchestra.run.smithi162.stdout: mon reweight min bytes per osd = 10 2024-04-25T00:48:35.889 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.889 INFO:teuthology.orchestra.run.smithi162.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T00:48:35.889 INFO:teuthology.orchestra.run.smithi162.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T00:48:35.889 INFO:teuthology.orchestra.run.smithi162.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T00:48:35.889 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.889 INFO:teuthology.orchestra.run.smithi162.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T00:48:35.889 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T00:48:35.889 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T00:48:35.889 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.889 INFO:teuthology.orchestra.run.smithi162.stdout: # 1m isn't quite enough 2024-04-25T00:48:35.889 INFO:teuthology.orchestra.run.smithi162.stdout: mon_down_mkfs_grace = 2m 2024-04-25T00:48:35.889 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.890 INFO:teuthology.orchestra.run.smithi162.stdout: mon_warn_on_filestore_osds = false 2024-04-25T00:48:35.890 INFO:teuthology.orchestra.run.smithi162.stdout: mon down mkfs grace = 300 2024-04-25T00:48:35.890 INFO:teuthology.orchestra.run.smithi162.stdout: mon op complaint time = 120 2024-04-25T00:48:35.890 INFO:teuthology.orchestra.run.smithi162.stdout: mon osd crush smoke test = False 2024-04-25T00:48:35.890 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:48:35.890 INFO:teuthology.orchestra.run.smithi162.stdout:[client] 2024-04-25T00:48:35.890 INFO:teuthology.orchestra.run.smithi162.stdout: rgw cache enabled = true 2024-04-25T00:48:35.890 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable ops log = true 2024-04-25T00:48:35.890 INFO:teuthology.orchestra.run.smithi162.stdout: rgw enable usage log = true 2024-04-25T00:48:35.890 INFO:teuthology.orchestra.run.smithi162.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T00:48:35.890 INFO:teuthology.orchestra.run.smithi162.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T00:48:35.890 INFO:teuthology.orchestra.run.smithi162.stdout: client mount timeout = 600 2024-04-25T00:48:35.890 INFO:teuthology.orchestra.run.smithi162.stdout: debug client = 20 2024-04-25T00:48:35.890 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-04-25T00:48:35.891 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2024-04-25T00:48:35.891 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2024-04-25T00:48:35.891 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.a] 2024-04-25T00:48:35.891 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.b] 2024-04-25T00:48:35.891 INFO:teuthology.orchestra.run.smithi162.stdout:[mon.c] 2024-04-25T00:48:35.891 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-04-25T00:48:35.891 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2024-04-25T00:48:35.891 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.e] 2024-04-25T00:48:35.891 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-04-25T00:48:35.891 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2024-04-25T00:48:35.891 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.f] 2024-04-25T00:48:35.891 INFO:teuthology.orchestra.run.smithi162.stdout:[mds] 2024-04-25T00:48:35.892 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds = 20 2024-04-25T00:48:35.892 INFO:teuthology.orchestra.run.smithi162.stdout: debug mds balancer = 20 2024-04-25T00:48:35.892 INFO:teuthology.orchestra.run.smithi162.stdout: debug ms = 1 2024-04-25T00:48:35.892 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug frag = True 2024-04-25T00:48:35.892 INFO:teuthology.orchestra.run.smithi162.stdout: mds debug scatterstat = True 2024-04-25T00:48:35.892 INFO:teuthology.orchestra.run.smithi162.stdout: mds op complaint time = 180 2024-04-25T00:48:35.892 INFO:teuthology.orchestra.run.smithi162.stdout: mds valgrind exit = True 2024-04-25T00:48:35.892 INFO:teuthology.orchestra.run.smithi162.stdout: mds verify scatter = True 2024-04-25T00:48:35.892 INFO:teuthology.orchestra.run.smithi162.stdout: osd op complaint time = 180 2024-04-25T00:48:35.892 INFO:teuthology.orchestra.run.smithi162.stdout: rados mon op timeout = 900 2024-04-25T00:48:35.892 INFO:teuthology.orchestra.run.smithi162.stdout: rados osd op timeout = 900 2024-04-25T00:48:35.894 INFO:teuthology.orchestra.run.smithi179.stdout:[global] 2024-04-25T00:48:35.894 INFO:teuthology.orchestra.run.smithi179.stdout: chdir = "" 2024-04-25T00:48:35.894 INFO:teuthology.orchestra.run.smithi179.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T00:48:35.894 INFO:teuthology.orchestra.run.smithi179.stdout: auth supported = cephx 2024-04-25T00:48:35.894 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.894 INFO:teuthology.orchestra.run.smithi179.stdout: filestore xattr use omap = true 2024-04-25T00:48:35.894 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.894 INFO:teuthology.orchestra.run.smithi179.stdout: mon clock drift allowed = 1.000 2024-04-25T00:48:35.894 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.895 INFO:teuthology.orchestra.run.smithi179.stdout: osd crush chooseleaf type = 0 2024-04-25T00:48:35.895 INFO:teuthology.orchestra.run.smithi179.stdout: auth debug = true 2024-04-25T00:48:35.895 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.895 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on old message = true 2024-04-25T00:48:35.895 INFO:teuthology.orchestra.run.smithi179.stdout: ms die on bug = true 2024-04-25T00:48:35.895 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.895 INFO:teuthology.orchestra.run.smithi179.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T00:48:35.895 INFO:teuthology.orchestra.run.smithi179.stdout: mon pg warn max object skew = 0 2024-04-25T00:48:35.895 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.895 INFO:teuthology.orchestra.run.smithi179.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T00:48:35.895 INFO:teuthology.orchestra.run.smithi179.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T00:48:35.895 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.895 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default size = 2 2024-04-25T00:48:35.895 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.895 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow primary affinity = true 2024-04-25T00:48:35.895 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd allow pg remap = true 2024-04-25T00:48:35.896 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on legacy crush tunables = false 2024-04-25T00:48:35.896 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on crush straw calc version zero = false 2024-04-25T00:48:35.896 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on no sortbitwise = false 2024-04-25T00:48:35.896 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on osd down out interval zero = false 2024-04-25T00:48:35.896 INFO:teuthology.orchestra.run.smithi179.stdout: mon warn on too few osds = false 2024-04-25T00:48:35.896 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T00:48:35.896 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T00:48:35.896 INFO:teuthology.orchestra.run.smithi179.stdout: mon_allow_pool_size_one = true 2024-04-25T00:48:35.896 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.896 INFO:teuthology.orchestra.run.smithi179.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T00:48:35.896 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.896 INFO:teuthology.orchestra.run.smithi179.stdout: osd default data pool replay window = 5 2024-04-25T00:48:35.896 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.896 INFO:teuthology.orchestra.run.smithi179.stdout: mon allow pool delete = true 2024-04-25T00:48:35.896 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.897 INFO:teuthology.orchestra.run.smithi179.stdout: mon cluster log file level = debug 2024-04-25T00:48:35.897 INFO:teuthology.orchestra.run.smithi179.stdout: debug asserts on shutdown = true 2024-04-25T00:48:35.897 INFO:teuthology.orchestra.run.smithi179.stdout: mon health detail to clog = false 2024-04-25T00:48:35.897 INFO:teuthology.orchestra.run.smithi179.stdout: mon host = "172.21.15.162,172.21.15.179,[v2:172.21.15.179:3301,v1:172.21.15.179:6790]" 2024-04-25T00:48:35.897 INFO:teuthology.orchestra.run.smithi179.stdout: mds beacon grace = 60 2024-04-25T00:48:35.897 INFO:teuthology.orchestra.run.smithi179.stdout: mds heartbeat grace = 60 2024-04-25T00:48:35.897 INFO:teuthology.orchestra.run.smithi179.stdout: osd heartbeat grace = 60 2024-04-25T00:48:35.897 INFO:teuthology.orchestra.run.smithi179.stdout: fsid = e141deed-4794-4a17-83c9-f6e6e8875f5e 2024-04-25T00:48:35.897 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.897 INFO:teuthology.orchestra.run.smithi179.stdout:[osd] 2024-04-25T00:48:35.897 INFO:teuthology.orchestra.run.smithi179.stdout: osd journal size = 100 2024-04-25T00:48:35.897 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.897 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub load threshold = 5.0 2024-04-25T00:48:35.897 INFO:teuthology.orchestra.run.smithi179.stdout: osd scrub max interval = 600 2024-04-25T00:48:35.897 INFO:teuthology.orchestra.run.smithi179.stdout: osd mclock profile = high_recovery_ops 2024-04-25T00:48:35.897 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.898 INFO:teuthology.orchestra.run.smithi179.stdout: osd recover clone overlap = true 2024-04-25T00:48:35.898 INFO:teuthology.orchestra.run.smithi179.stdout: osd recovery max chunk = 1048576 2024-04-25T00:48:35.898 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.898 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug shutdown = true 2024-04-25T00:48:35.898 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug op order = true 2024-04-25T00:48:35.898 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug verify stray on activate = true 2024-04-25T00:48:35.898 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug trim objects = true 2024-04-25T00:48:35.898 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.898 INFO:teuthology.orchestra.run.smithi179.stdout: osd open classes on start = true 2024-04-25T00:48:35.898 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug pg log writeout = true 2024-04-25T00:48:35.898 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.898 INFO:teuthology.orchestra.run.smithi179.stdout: osd deep scrub update digest min age = 30 2024-04-25T00:48:35.898 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.898 INFO:teuthology.orchestra.run.smithi179.stdout: osd map max advance = 10 2024-04-25T00:48:35.899 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.899 INFO:teuthology.orchestra.run.smithi179.stdout: journal zero on create = true 2024-04-25T00:48:35.899 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.899 INFO:teuthology.orchestra.run.smithi179.stdout: filestore ondisk finisher threads = 3 2024-04-25T00:48:35.899 INFO:teuthology.orchestra.run.smithi179.stdout: filestore apply finisher threads = 3 2024-04-25T00:48:35.899 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.899 INFO:teuthology.orchestra.run.smithi179.stdout: bdev debug aio = true 2024-04-25T00:48:35.899 INFO:teuthology.orchestra.run.smithi179.stdout: osd debug misdirected ops = true 2024-04-25T00:48:35.899 INFO:teuthology.orchestra.run.smithi179.stdout: bdev async discard = True 2024-04-25T00:48:35.899 INFO:teuthology.orchestra.run.smithi179.stdout: bdev enable discard = True 2024-04-25T00:48:35.899 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore allocator = bitmap 2024-04-25T00:48:35.899 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore block size = 96636764160 2024-04-25T00:48:35.899 INFO:teuthology.orchestra.run.smithi179.stdout: bluestore fsck on mount = True 2024-04-25T00:48:35.899 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluefs = 1/20 2024-04-25T00:48:35.899 INFO:teuthology.orchestra.run.smithi179.stdout: debug bluestore = 1/20 2024-04-25T00:48:35.900 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-04-25T00:48:35.900 INFO:teuthology.orchestra.run.smithi179.stdout: debug osd = 20 2024-04-25T00:48:35.900 INFO:teuthology.orchestra.run.smithi179.stdout: debug rocksdb = 4/10 2024-04-25T00:48:35.900 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T00:48:35.900 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd full ratio = 0.9 2024-04-25T00:48:35.900 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd nearfull ratio = 0.8 2024-04-25T00:48:35.900 INFO:teuthology.orchestra.run.smithi179.stdout: osd failsafe full ratio = 0.95 2024-04-25T00:48:35.900 INFO:teuthology.orchestra.run.smithi179.stdout: osd fast shutdown = False 2024-04-25T00:48:35.900 INFO:teuthology.orchestra.run.smithi179.stdout: osd objectstore = bluestore 2024-04-25T00:48:35.900 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-04-25T00:48:35.900 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.900 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr] 2024-04-25T00:48:35.900 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-04-25T00:48:35.900 INFO:teuthology.orchestra.run.smithi179.stdout: debug mgr = 20 2024-04-25T00:48:35.900 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-04-25T00:48:35.900 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-04-25T00:48:35.901 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-04-25T00:48:35.901 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-04-25T00:48:35.901 INFO:teuthology.orchestra.run.smithi179.stdout: mgr/telemetry/nag = false 2024-04-25T00:48:35.901 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-04-25T00:48:35.901 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.901 INFO:teuthology.orchestra.run.smithi179.stdout:[mon] 2024-04-25T00:48:35.901 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-04-25T00:48:35.901 INFO:teuthology.orchestra.run.smithi179.stdout: debug mon = 20 2024-04-25T00:48:35.901 INFO:teuthology.orchestra.run.smithi179.stdout: debug paxos = 20 2024-04-25T00:48:35.901 INFO:teuthology.orchestra.run.smithi179.stdout: debug auth = 20 2024-04-25T00:48:35.901 INFO:teuthology.orchestra.run.smithi179.stdout: mon data avail warn = 5 2024-04-25T00:48:35.901 INFO:teuthology.orchestra.run.smithi179.stdout: mon mgr mkfs grace = 240 2024-04-25T00:48:35.901 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min pgs per osd = 4 2024-04-25T00:48:35.902 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd reporter subtree level = osd 2024-04-25T00:48:35.902 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd prime pg temp = true 2024-04-25T00:48:35.902 INFO:teuthology.orchestra.run.smithi179.stdout: mon reweight min bytes per osd = 10 2024-04-25T00:48:35.902 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.902 INFO:teuthology.orchestra.run.smithi179.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T00:48:35.902 INFO:teuthology.orchestra.run.smithi179.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T00:48:35.902 INFO:teuthology.orchestra.run.smithi179.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T00:48:35.902 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.902 INFO:teuthology.orchestra.run.smithi179.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T00:48:35.902 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T00:48:35.902 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T00:48:35.903 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.903 INFO:teuthology.orchestra.run.smithi179.stdout: # 1m isn't quite enough 2024-04-25T00:48:35.903 INFO:teuthology.orchestra.run.smithi179.stdout: mon_down_mkfs_grace = 2m 2024-04-25T00:48:35.903 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.903 INFO:teuthology.orchestra.run.smithi179.stdout: mon_warn_on_filestore_osds = false 2024-04-25T00:48:35.903 INFO:teuthology.orchestra.run.smithi179.stdout: mon down mkfs grace = 300 2024-04-25T00:48:35.903 INFO:teuthology.orchestra.run.smithi179.stdout: mon op complaint time = 120 2024-04-25T00:48:35.903 INFO:teuthology.orchestra.run.smithi179.stdout: mon osd crush smoke test = False 2024-04-25T00:48:35.903 INFO:teuthology.orchestra.run.smithi179.stdout: 2024-04-25T00:48:35.904 INFO:teuthology.orchestra.run.smithi179.stdout:[client] 2024-04-25T00:48:35.904 INFO:teuthology.orchestra.run.smithi179.stdout: rgw cache enabled = true 2024-04-25T00:48:35.904 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable ops log = true 2024-04-25T00:48:35.904 INFO:teuthology.orchestra.run.smithi179.stdout: rgw enable usage log = true 2024-04-25T00:48:35.904 INFO:teuthology.orchestra.run.smithi179.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T00:48:35.904 INFO:teuthology.orchestra.run.smithi179.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T00:48:35.904 INFO:teuthology.orchestra.run.smithi179.stdout: client mount timeout = 600 2024-04-25T00:48:35.904 INFO:teuthology.orchestra.run.smithi179.stdout: debug client = 20 2024-04-25T00:48:35.904 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-04-25T00:48:35.904 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-04-25T00:48:35.904 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-04-25T00:48:35.904 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.a] 2024-04-25T00:48:35.904 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.b] 2024-04-25T00:48:35.904 INFO:teuthology.orchestra.run.smithi179.stdout:[mon.c] 2024-04-25T00:48:35.905 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-04-25T00:48:35.905 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-04-25T00:48:35.905 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.e] 2024-04-25T00:48:35.905 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-04-25T00:48:35.905 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-04-25T00:48:35.905 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.f] 2024-04-25T00:48:35.905 INFO:teuthology.orchestra.run.smithi179.stdout:[mds] 2024-04-25T00:48:35.905 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds = 20 2024-04-25T00:48:35.905 INFO:teuthology.orchestra.run.smithi179.stdout: debug mds balancer = 20 2024-04-25T00:48:35.905 INFO:teuthology.orchestra.run.smithi179.stdout: debug ms = 1 2024-04-25T00:48:35.905 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug frag = True 2024-04-25T00:48:35.905 INFO:teuthology.orchestra.run.smithi179.stdout: mds debug scatterstat = True 2024-04-25T00:48:35.906 INFO:teuthology.orchestra.run.smithi179.stdout: mds op complaint time = 180 2024-04-25T00:48:35.906 INFO:teuthology.orchestra.run.smithi179.stdout: mds valgrind exit = True 2024-04-25T00:48:35.906 INFO:teuthology.orchestra.run.smithi179.stdout: mds verify scatter = True 2024-04-25T00:48:35.906 INFO:teuthology.orchestra.run.smithi179.stdout: osd op complaint time = 180 2024-04-25T00:48:35.906 INFO:teuthology.orchestra.run.smithi179.stdout: rados mon op timeout = 900 2024-04-25T00:48:35.906 INFO:teuthology.orchestra.run.smithi179.stdout: rados osd op timeout = 900 2024-04-25T00:48:35.906 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T00:48:35.906 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T00:48:35.986 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T00:48:35.986 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:48:35.986 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T00:48:35.991 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:48:35.991 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T00:48:36.038 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi162.front.sepia.ceph.com 2024-04-25T00:48:36.039 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:48:36.039 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T00:48:36.039 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T00:48:36.102 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:48:36.102 DEBUG:teuthology.orchestra.run.smithi162:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T00:48:36.151 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi179.front.sepia.ceph.com 2024-04-25T00:48:36.151 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:48:36.151 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T00:48:36.151 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T00:48:36.174 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:48:36.174 DEBUG:teuthology.orchestra.run.smithi179:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T00:48:36.221 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T00:48:36.222 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T00:48:36.222 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T00:48:36.266 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T00:48:36.269 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T00:48:36.313 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T00:48:36.322 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T00:48:36.323 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T00:48:36.364 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T00:48:36.367 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T00:48:36.422 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T00:48:36.507 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T00:48:36.510 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T00:48:36.566 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T00:48:36.651 INFO:teuthology.orchestra.run.smithi162.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T00:48:36.653 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-25T00:48:36.705 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T00:48:36.751 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T00:48:36.754 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T00:48:36.767 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T00:48:36.848 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T00:48:36.851 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T00:48:36.907 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T00:48:36.987 INFO:teuthology.orchestra.run.smithi179.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T00:48:36.989 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-25T00:48:37.043 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T00:48:37.044 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T00:48:37.080 INFO:teuthology.orchestra.run.smithi162.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T00:48:37.089 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T00:48:37.090 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi162.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi179.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T00:48:37.090 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T00:48:37.143 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T00:48:37.143 INFO:tasks.ceph:role: osd.0 2024-04-25T00:48:37.143 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com 2024-04-25T00:48:37.143 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T00:48:37.206 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T00:48:37.207 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T00:48:37.207 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T00:48:37.207 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T00:48:37.207 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T00:48:37.207 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-04-25T00:48:37.207 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T00:48:37.207 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T00:48:37.207 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T00:48:37.207 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T00:48:37.670 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-04-25T00:48:37.672 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-04-25T00:48:37.673 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T00:48:37.826 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T00:48:37.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T00:48:37.837 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T00:48:37.837 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T00:48:37.890 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T00:48:37.890 INFO:tasks.ceph:role: osd.1 2024-04-25T00:48:37.890 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com 2024-04-25T00:48:37.890 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T00:48:37.954 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T00:48:37.954 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T00:48:37.954 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T00:48:37.954 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T00:48:37.954 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T00:48:37.954 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-04-25T00:48:37.955 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T00:48:37.955 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T00:48:37.955 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T00:48:37.955 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T00:48:38.383 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-04-25T00:48:38.384 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-04-25T00:48:38.385 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T00:48:38.449 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T00:48:38.499 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T00:48:38.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T00:48:38.500 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T00:48:38.554 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T00:48:38.554 INFO:tasks.ceph:role: osd.2 2024-04-25T00:48:38.555 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com 2024-04-25T00:48:38.555 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T00:48:38.617 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T00:48:38.618 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T00:48:38.618 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T00:48:38.618 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T00:48:38.618 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T00:48:38.618 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-04-25T00:48:38.618 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T00:48:38.618 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T00:48:38.618 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T00:48:38.618 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T00:48:39.071 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-04-25T00:48:39.073 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-04-25T00:48:39.074 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T00:48:39.155 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T00:48:39.208 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T00:48:39.208 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T00:48:39.208 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T00:48:39.260 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T00:48:39.260 INFO:tasks.ceph:role: osd.3 2024-04-25T00:48:39.260 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com 2024-04-25T00:48:39.260 DEBUG:teuthology.orchestra.run.smithi162:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T00:48:39.322 INFO:teuthology.orchestra.run.smithi162.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T00:48:39.322 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T00:48:39.322 INFO:teuthology.orchestra.run.smithi162.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T00:48:39.323 INFO:teuthology.orchestra.run.smithi162.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T00:48:39.323 INFO:teuthology.orchestra.run.smithi162.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T00:48:39.323 INFO:teuthology.orchestra.run.smithi162.stdout: = sunit=0 swidth=0 blks 2024-04-25T00:48:39.323 INFO:teuthology.orchestra.run.smithi162.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T00:48:39.323 INFO:teuthology.orchestra.run.smithi162.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T00:48:39.323 INFO:teuthology.orchestra.run.smithi162.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T00:48:39.323 INFO:teuthology.orchestra.run.smithi162.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T00:48:39.779 INFO:teuthology.orchestra.run.smithi162.stdout:Discarding blocks...Done. 2024-04-25T00:48:39.781 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi162.front.sepia.ceph.com -o noatime 2024-04-25T00:48:39.782 DEBUG:teuthology.orchestra.run.smithi162:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T00:48:39.925 DEBUG:teuthology.orchestra.run.smithi162:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T00:48:39.936 INFO:teuthology.orchestra.run.smithi162.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T00:48:39.936 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T00:48:39.937 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T00:48:40.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:40.046+0000 7fa667bc87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T00:48:40.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:40.054+0000 7fa667bc87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T00:48:40.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:40.054+0000 7fa667bc87c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T00:48:40.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:40.054+0000 7fa667bc87c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T00:48:40.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:40.054+0000 7fa667bc87c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T00:48:40.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:40.062+0000 7fa667bc87c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T00:48:43.055 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T00:48:43.069 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T00:48:43.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:43.146+0000 7f894e3dd7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T00:48:43.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:43.150+0000 7f894e3dd7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T00:48:43.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:43.150+0000 7f894e3dd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T00:48:43.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:43.150+0000 7f894e3dd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T00:48:43.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:43.150+0000 7f894e3dd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T00:48:43.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:43.150+0000 7f894e3dd7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T00:48:46.142 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T00:48:46.200 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T00:48:46.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:46.278+0000 7fbd2262d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T00:48:46.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:46.278+0000 7fbd2262d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T00:48:46.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:46.278+0000 7fbd2262d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T00:48:46.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:46.278+0000 7fbd2262d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T00:48:46.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:46.278+0000 7fbd2262d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T00:48:46.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:46.278+0000 7fbd2262d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T00:48:49.270 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T00:48:49.327 DEBUG:teuthology.orchestra.run.smithi162:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T00:48:49.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:49.410+0000 7f402cdeb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T00:48:49.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:49.410+0000 7f402cdeb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T00:48:49.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:49.410+0000 7f402cdeb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T00:48:49.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:49.410+0000 7f402cdeb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T00:48:49.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:49.410+0000 7f402cdeb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T00:48:49.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:48:49.410+0000 7f402cdeb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T00:48:52.396 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T00:48:52.450 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T00:48:52.465 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T00:48:52.465 INFO:tasks.ceph:role: osd.4 2024-04-25T00:48:52.465 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-25T00:48:52.465 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T00:48:52.529 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T00:48:52.529 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T00:48:52.529 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T00:48:52.529 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T00:48:52.529 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T00:48:52.529 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-04-25T00:48:52.529 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T00:48:52.529 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T00:48:52.529 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T00:48:52.530 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T00:48:53.004 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-04-25T00:48:53.006 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-04-25T00:48:53.006 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T00:48:53.155 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T00:48:53.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T00:48:53.166 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T00:48:53.166 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T00:48:53.219 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T00:48:53.220 INFO:tasks.ceph:role: osd.5 2024-04-25T00:48:53.220 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-25T00:48:53.220 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T00:48:53.279 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T00:48:53.279 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T00:48:53.279 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T00:48:53.279 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T00:48:53.280 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T00:48:53.280 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-04-25T00:48:53.280 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T00:48:53.280 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T00:48:53.280 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T00:48:53.280 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T00:48:53.707 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-04-25T00:48:53.709 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-04-25T00:48:53.709 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T00:48:53.778 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T00:48:53.829 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T00:48:53.830 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T00:48:53.830 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T00:48:53.883 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T00:48:53.883 INFO:tasks.ceph:role: osd.6 2024-04-25T00:48:53.883 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-25T00:48:53.883 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T00:48:53.944 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T00:48:53.945 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T00:48:53.945 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T00:48:53.945 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T00:48:53.945 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T00:48:53.945 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-04-25T00:48:53.945 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T00:48:53.945 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T00:48:53.945 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T00:48:53.945 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T00:48:54.406 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-04-25T00:48:54.407 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-04-25T00:48:54.407 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T00:48:54.501 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T00:48:54.511 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T00:48:54.511 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T00:48:54.512 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T00:48:54.564 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T00:48:54.564 INFO:tasks.ceph:role: osd.7 2024-04-25T00:48:54.564 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-25T00:48:54.564 DEBUG:teuthology.orchestra.run.smithi179:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T00:48:54.628 INFO:teuthology.orchestra.run.smithi179.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T00:48:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T00:48:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T00:48:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T00:48:54.628 INFO:teuthology.orchestra.run.smithi179.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T00:48:54.628 INFO:teuthology.orchestra.run.smithi179.stdout: = sunit=0 swidth=0 blks 2024-04-25T00:48:54.629 INFO:teuthology.orchestra.run.smithi179.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T00:48:54.629 INFO:teuthology.orchestra.run.smithi179.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T00:48:54.629 INFO:teuthology.orchestra.run.smithi179.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T00:48:54.629 INFO:teuthology.orchestra.run.smithi179.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T00:48:55.098 INFO:teuthology.orchestra.run.smithi179.stdout:Discarding blocks...Done. 2024-04-25T00:48:55.100 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi179.front.sepia.ceph.com -o noatime 2024-04-25T00:48:55.100 DEBUG:teuthology.orchestra.run.smithi179:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T00:48:55.242 DEBUG:teuthology.orchestra.run.smithi179:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T00:48:55.253 INFO:teuthology.orchestra.run.smithi179.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T00:48:55.254 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T00:48:55.254 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T00:48:55.374 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:48:55.372+0000 7fac69dba7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T00:48:55.380 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:48:55.376+0000 7fac69dba7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T00:48:55.380 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:48:55.376+0000 7fac69dba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T00:48:55.380 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:48:55.376+0000 7fac69dba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T00:48:55.380 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:48:55.376+0000 7fac69dba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T00:48:55.388 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:48:55.388+0000 7fac69dba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T00:48:58.369 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T00:48:58.383 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T00:48:58.462 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:48:58.460+0000 7f285e50a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T00:48:58.463 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:48:58.460+0000 7f285e50a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T00:48:58.463 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:48:58.460+0000 7f285e50a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T00:48:58.463 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:48:58.460+0000 7f285e50a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T00:48:58.463 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:48:58.460+0000 7f285e50a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T00:48:58.463 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:48:58.460+0000 7f285e50a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T00:49:01.452 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T00:49:01.509 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T00:49:01.594 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:01.591+0000 7f02732a37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T00:49:01.595 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:01.591+0000 7f02732a37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T00:49:01.595 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:01.591+0000 7f02732a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T00:49:01.595 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:01.591+0000 7f02732a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T00:49:01.595 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:01.591+0000 7f02732a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T00:49:01.595 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:01.591+0000 7f02732a37c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T00:49:04.110 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:49:04.113 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:49:04.563 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T00:49:04.576 DEBUG:teuthology.orchestra.run.smithi179:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T00:49:04.655 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:04.651+0000 7f1d3eacb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T00:49:04.656 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:04.651+0000 7f1d3eacb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T00:49:04.656 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:04.651+0000 7f1d3eacb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T00:49:04.656 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:04.651+0000 7f1d3eacb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T00:49:04.656 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:04.651+0000 7f1d3eacb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T00:49:04.657 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:04.655+0000 7f1d3eacb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T00:49:07.635 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T00:49:07.689 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T00:49:07.689 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:49:07.689 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T00:49:07.703 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:49:07.703 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T00:49:07.757 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:49:07.757 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T00:49:07.809 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:49:07.810 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-25T00:49:07.866 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:49:07.866 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T00:49:07.922 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:49:07.922 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T00:49:07.977 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:49:07.978 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T00:49:08.033 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:49:08.033 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T00:49:08.086 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:49:08.086 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T00:49:08.102 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:49:08.102 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T00:49:08.156 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:49:08.156 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T00:49:08.211 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:49:08.211 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-25T00:49:08.263 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:49:08.264 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T00:49:08.316 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:49:08.316 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T00:49:08.372 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:49:08.372 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T00:49:08.428 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:49:08.428 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T00:49:08.483 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:49:08.483 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T00:49:08.489 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T00:49:08.490 DEBUG:teuthology.orchestra.run.smithi162:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T00:49:08.536 DEBUG:teuthology.orchestra.run.smithi179:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T00:49:08.545 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.y] 2024-04-25T00:49:08.545 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBkqClmEzX5DxAAJWHLY6pQaNGEhHIRH3+HWA== 2024-04-25T00:49:08.545 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.a] 2024-04-25T00:49:08.545 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBkqClmdCvPFRAADa4TW3DLs4ttr1D+Q7N6Ng== 2024-04-25T00:49:08.545 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.c] 2024-04-25T00:49:08.545 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBkqClmlzJUHhAA9W1CJeT2TM1DuRERH3E2mw== 2024-04-25T00:49:08.545 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.e] 2024-04-25T00:49:08.546 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBkqClmp5HkJhAAETta8N8aGN3sk3Ib8KnwGQ== 2024-04-25T00:49:08.546 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.0] 2024-04-25T00:49:08.546 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBoqClmvUwMAxAA9a56UDN+GzlEIGhuXKGwkg== 2024-04-25T00:49:08.546 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.1] 2024-04-25T00:49:08.546 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBrqClmVh8FCRAAjAQUb8faPMedCSa1On6AqA== 2024-04-25T00:49:08.546 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.2] 2024-04-25T00:49:08.546 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBuqClmOAPUEBAAcBNhgRtGGGQa24wU5w502w== 2024-04-25T00:49:08.546 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.3] 2024-04-25T00:49:08.546 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBxqClmhl2RGBAAOiru0ooawXDYfcz95GjeOA== 2024-04-25T00:49:08.546 INFO:teuthology.orchestra.run.smithi162.stdout:[mgr.x] 2024-04-25T00:49:08.546 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBkqClmRr3DEhAAPPUVesn++VTp7yyFIY0Fvw== 2024-04-25T00:49:08.546 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.b] 2024-04-25T00:49:08.546 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBkqClmtqLjLBAAaviMn5CHN001dSrOzDzFhw== 2024-04-25T00:49:08.547 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.d] 2024-04-25T00:49:08.547 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBkqClm4lGlMhAAr+zjg2zxdfEabI0UyU1L5g== 2024-04-25T00:49:08.547 INFO:teuthology.orchestra.run.smithi162.stdout:[mds.f] 2024-04-25T00:49:08.547 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBkqClmrXfqOhAA5M3RKLTRP+8TFKghT/IX1Q== 2024-04-25T00:49:08.547 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.4] 2024-04-25T00:49:08.547 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB3qClmnUxsFhAAoBjp77M+lm5G5hu7O7nKWQ== 2024-04-25T00:49:08.547 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.5] 2024-04-25T00:49:08.547 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB6qClm2iywGxAAAauJE2ek4mparp6Jx7H+RA== 2024-04-25T00:49:08.547 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.6] 2024-04-25T00:49:08.547 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQB9qClmZdqRIxAAjonMR1lDPhXtjOGPNJzrdw== 2024-04-25T00:49:08.547 INFO:teuthology.orchestra.run.smithi162.stdout:[osd.7] 2024-04-25T00:49:08.547 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQCAqClm1JUyJxAAayL7XD7bPx3coc4tIpxY8w== 2024-04-25T00:49:08.547 INFO:teuthology.orchestra.run.smithi162.stdout:[client.0] 2024-04-25T00:49:08.547 INFO:teuthology.orchestra.run.smithi162.stdout: key = AQBlqClmL3LYBBAABdbo5wcKR5zvziJUDs4bPQ== 2024-04-25T00:49:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.y] 2024-04-25T00:49:08.549 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBkqClmEzX5DxAAJWHLY6pQaNGEhHIRH3+HWA== 2024-04-25T00:49:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.a] 2024-04-25T00:49:08.549 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBkqClmdCvPFRAADa4TW3DLs4ttr1D+Q7N6Ng== 2024-04-25T00:49:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.c] 2024-04-25T00:49:08.549 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBkqClmlzJUHhAA9W1CJeT2TM1DuRERH3E2mw== 2024-04-25T00:49:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.e] 2024-04-25T00:49:08.549 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBkqClmp5HkJhAAETta8N8aGN3sk3Ib8KnwGQ== 2024-04-25T00:49:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.0] 2024-04-25T00:49:08.549 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBoqClmvUwMAxAA9a56UDN+GzlEIGhuXKGwkg== 2024-04-25T00:49:08.549 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.1] 2024-04-25T00:49:08.550 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBrqClmVh8FCRAAjAQUb8faPMedCSa1On6AqA== 2024-04-25T00:49:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.2] 2024-04-25T00:49:08.550 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBuqClmOAPUEBAAcBNhgRtGGGQa24wU5w502w== 2024-04-25T00:49:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.3] 2024-04-25T00:49:08.550 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBxqClmhl2RGBAAOiru0ooawXDYfcz95GjeOA== 2024-04-25T00:49:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:[mgr.x] 2024-04-25T00:49:08.550 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBkqClmRr3DEhAAPPUVesn++VTp7yyFIY0Fvw== 2024-04-25T00:49:08.550 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.b] 2024-04-25T00:49:08.550 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBkqClmtqLjLBAAaviMn5CHN001dSrOzDzFhw== 2024-04-25T00:49:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.d] 2024-04-25T00:49:08.551 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBkqClm4lGlMhAAr+zjg2zxdfEabI0UyU1L5g== 2024-04-25T00:49:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:[mds.f] 2024-04-25T00:49:08.551 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBkqClmrXfqOhAA5M3RKLTRP+8TFKghT/IX1Q== 2024-04-25T00:49:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.4] 2024-04-25T00:49:08.551 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB3qClmnUxsFhAAoBjp77M+lm5G5hu7O7nKWQ== 2024-04-25T00:49:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.5] 2024-04-25T00:49:08.551 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB6qClm2iywGxAAAauJE2ek4mparp6Jx7H+RA== 2024-04-25T00:49:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.6] 2024-04-25T00:49:08.551 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQB9qClmZdqRIxAAjonMR1lDPhXtjOGPNJzrdw== 2024-04-25T00:49:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:[osd.7] 2024-04-25T00:49:08.551 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQCAqClm1JUyJxAAayL7XD7bPx3coc4tIpxY8w== 2024-04-25T00:49:08.551 INFO:teuthology.orchestra.run.smithi179.stdout:[client.0] 2024-04-25T00:49:08.551 INFO:teuthology.orchestra.run.smithi179.stdout: key = AQBlqClmL3LYBBAABdbo5wcKR5zvziJUDs4bPQ== 2024-04-25T00:49:08.552 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T00:49:08.592 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T00:49:08.638 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T00:49:08.640 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T00:49:08.723 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T00:49:08.725 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T00:49:08.810 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T00:49:08.813 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T00:49:08.857 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T00:49:08.900 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T00:49:08.942 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T00:49:08.987 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T00:49:09.031 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T00:49:09.076 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T00:49:09.122 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T00:49:09.159 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T00:49:09.207 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T00:49:09.243 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T00:49:09.287 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T00:49:09.328 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T00:49:09.372 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T00:49:09.415 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T00:49:09.460 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T00:49:09.462 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T00:49:09.546 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T00:49:09.549 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T00:49:09.589 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T00:49:09.635 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T00:49:09.673 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T00:49:09.719 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T00:49:09.761 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T00:49:09.799 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T00:49:09.847 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T00:49:09.879 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T00:49:09.939 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T00:49:09.939 DEBUG:teuthology.orchestra.run.smithi162:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T00:49:09.972 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T00:49:10.064 DEBUG:teuthology.orchestra.run.smithi162:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T00:49:10.075 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T00:49:10.089 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T00:49:10.187 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T00:49:10.198 DEBUG:teuthology.orchestra.run.smithi179:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T00:49:10.250 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T00:49:10.339 DEBUG:teuthology.orchestra.run.smithi179:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T00:49:10.392 DEBUG:teuthology.orchestra.run.smithi162:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T00:49:10.395 DEBUG:teuthology.orchestra.run.smithi179:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T00:49:10.440 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T00:49:10.441 DEBUG:tasks.ceph_manager:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-25T00:49:10.441 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T00:49:10.441 DEBUG:teuthology.orchestra.run.smithi162:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2024-04-25T00:49:10.444 INFO:tasks.ceph.mon.a:Started 2024-04-25T00:49:10.444 DEBUG:tasks.ceph_manager:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-25T00:49:10.444 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T00:49:10.444 DEBUG:teuthology.orchestra.run.smithi179:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2024-04-25T00:49:10.490 INFO:tasks.ceph.mon.b:Started 2024-04-25T00:49:10.490 DEBUG:tasks.ceph_manager:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-25T00:49:10.490 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T00:49:10.490 DEBUG:teuthology.orchestra.run.smithi179:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2024-04-25T00:49:10.493 INFO:tasks.ceph.mon.c:Started 2024-04-25T00:49:10.493 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T00:49:10.493 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T00:49:10.493 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2024-04-25T00:49:10.496 INFO:tasks.ceph.mgr.y:Started 2024-04-25T00:49:10.496 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T00:49:10.497 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2024-04-25T00:49:10.499 INFO:tasks.ceph.mgr.x:Started 2024-04-25T00:49:10.499 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T00:49:10.499 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T00:49:10.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:10.610+0000 7f9bda581640 1 Processor -- start 2024-04-25T00:49:10.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:10.614+0000 7f9bda581640 1 -- start start 2024-04-25T00:49:10.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:10.614+0000 7f9bda581640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9bd41515b0 0x7f9bd413fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:10.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:10.614+0000 7f9bda581640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bd41402c0 0x7f9bd40c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:10.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:10.614+0000 7f9bda581640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd415a750 con 0x7f9bd40c6af0 2024-04-25T00:49:10.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:10.614+0000 7f9bda581640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd415a9f0 con 0x7f9bd41515b0 2024-04-25T00:49:10.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:10.614+0000 7f9bda581640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd415acd0 con 0x7f9bd41402c0 2024-04-25T00:49:10.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:10.614+0000 7f9bd3fff640 1 -- >> v2:172.21.15.162:3300/0 conn(0x7f9bd41515b0 msgr2=0x7f9bd413fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.162:3300/0 2024-04-25T00:49:10.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:10.614+0000 7f9bd3fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9bd41515b0 0x7f9bd413fd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T00:49:10.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:10.614+0000 7f9bd8b1e640 1 -- >> v1:172.21.15.179:6789/0 conn(0x7f9bd40c6af0 legacy=0x7f9bd41576f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.179:6789/0 2024-04-25T00:49:10.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:10.614+0000 7f9bd37fe640 1 -- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bd41402c0 msgr2=0x7f9bd40c65b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.179:3301/0 2024-04-25T00:49:10.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:10.614+0000 7f9bd37fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bd41402c0 0x7f9bd40c65b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T00:49:10.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:10.818+0000 7f9bd3fff640 1 -- >> v2:172.21.15.162:3300/0 conn(0x7f9bd41515b0 msgr2=0x7f9bd413fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.162:3300/0 2024-04-25T00:49:10.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:10.818+0000 7f9bd3fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9bd41515b0 0x7f9bd413fd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T00:49:10.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:10.818+0000 7f9bd8b1e640 1 -- >> v1:172.21.15.179:6789/0 conn(0x7f9bd40c6af0 legacy=0x7f9bd41576f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.179:6789/0 2024-04-25T00:49:10.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:10.818+0000 7f9bd37fe640 1 -- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bd41402c0 msgr2=0x7f9bd40c65b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.179:3301/0 2024-04-25T00:49:10.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:10.818+0000 7f9bd37fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bd41402c0 0x7f9bd40c65b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T00:49:11.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:11.222+0000 7f9bd3fff640 1 -- >> v2:172.21.15.162:3300/0 conn(0x7f9bd41515b0 msgr2=0x7f9bd413fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.162:3300/0 2024-04-25T00:49:11.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:11.222+0000 7f9bd3fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9bd41515b0 0x7f9bd413fd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T00:49:11.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:11.222+0000 7f9bd37fe640 1 -- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bd41402c0 msgr2=0x7f9bd40c65b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.179:3301/0 2024-04-25T00:49:11.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:11.222+0000 7f9bd37fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bd41402c0 0x7f9bd40c65b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T00:49:11.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:11.222+0000 7f9bd8b1e640 1 -- >> v1:172.21.15.179:6789/0 conn(0x7f9bd40c6af0 legacy=0x7f9bd41576f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.179:6789/0 2024-04-25T00:49:12.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:12.026+0000 7f9bd3fff640 1 -- >> v2:172.21.15.162:3300/0 conn(0x7f9bd41515b0 msgr2=0x7f9bd413fd80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.162:3300/0 2024-04-25T00:49:12.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:12.026+0000 7f9bd3fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9bd41515b0 0x7f9bd413fd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T00:49:12.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:12.026+0000 7f9bd37fe640 1 -- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bd41402c0 msgr2=0x7f9bd40c65b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.179:3301/0 2024-04-25T00:49:12.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:12.026+0000 7f9bd8b1e640 1 -- >> v1:172.21.15.179:6789/0 conn(0x7f9bd40c6af0 legacy=0x7f9bd41576f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.179:6789/0 2024-04-25T00:49:12.027 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:12.026+0000 7f9bd37fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bd41402c0 0x7f9bd40c65b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T00:49:13.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:13.614+0000 7f9bd1ffb640 1 -- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bd41402c0 msgr2=0x7f9bd40c65b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T00:49:13.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:13.614+0000 7f9bd1ffb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bd41402c0 0x7f9bd40c65b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:13.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:13.614+0000 7f9bd1ffb640 1 -- >> v2:172.21.15.162:3300/0 conn(0x7f9bd41515b0 msgr2=0x7f9bd413fd80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T00:49:13.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:13.614+0000 7f9bd1ffb640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9bd41515b0 0x7f9bd413fd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:13.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:13.614+0000 7f9bd1ffb640 1 -- >> v1:172.21.15.179:6789/0 conn(0x7f9bd40c6af0 legacy=0x7f9bd41576f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T00:49:13.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:13.614+0000 7f9bd1ffb640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:13.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:13.614+0000 7f9bd1ffb640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd415afb0 con 0x7f9bb40061a0 2024-04-25T00:49:13.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:13.614+0000 7f9bd1ffb640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd415a9f0 con 0x7f9bb40036d0 2024-04-25T00:49:13.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:13.614+0000 7f9bd37fe640 1 -- >> v1:172.21.15.162:6789/0 conn(0x7f9bb40061a0 legacy=0x7f9bb4008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.162:6789/0 2024-04-25T00:49:13.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:13.614+0000 7f9bd3fff640 1 -- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.179:3300/0 2024-04-25T00:49:13.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:13.614+0000 7f9bd3fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T00:49:13.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:13.818+0000 7f9bd37fe640 1 -- >> v1:172.21.15.162:6789/0 conn(0x7f9bb40061a0 legacy=0x7f9bb4008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.162:6789/0 2024-04-25T00:49:13.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:13.818+0000 7f9bd3fff640 1 -- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.179:3300/0 2024-04-25T00:49:13.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:13.818+0000 7f9bd3fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T00:49:14.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:14.222+0000 7f9bd37fe640 1 -- >> v1:172.21.15.162:6789/0 conn(0x7f9bb40061a0 legacy=0x7f9bb4008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.162:6789/0 2024-04-25T00:49:14.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:14.222+0000 7f9bd3fff640 1 -- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.179:3300/0 2024-04-25T00:49:14.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:14.222+0000 7f9bd3fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T00:49:15.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:15.026+0000 7f9bd37fe640 1 -- >> v1:172.21.15.162:6789/0 conn(0x7f9bb40061a0 legacy=0x7f9bb4008660 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.162:6789/0 2024-04-25T00:49:15.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:15.026+0000 7f9bd3fff640 1 -- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.179:3300/0 2024-04-25T00:49:15.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:15.026+0000 7f9bd3fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T00:49:16.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.614+0000 7f9bd1ffb640 1 -- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T00:49:16.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.614+0000 7f9bd1ffb640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:16.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.614+0000 7f9bd1ffb640 1 -- >> v1:172.21.15.162:6789/0 conn(0x7f9bb40061a0 legacy=0x7f9bb4008660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T00:49:16.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.614+0000 7f9bd8b1e640 1 -- reap_dead start 2024-04-25T00:49:16.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.614+0000 7f9bd1ffb640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:16.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.614+0000 7f9bd1ffb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400aab0 0x7f9bb40096f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:16.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.614+0000 7f9bd1ffb640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd415a750 con 0x7f9bb4009f00 2024-04-25T00:49:16.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.614+0000 7f9bd1ffb640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd415a9f0 con 0x7f9bb40036d0 2024-04-25T00:49:16.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.614+0000 7f9bd1ffb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd415acd0 con 0x7f9bb400aab0 2024-04-25T00:49:16.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.614+0000 7f9bd3fff640 1 -- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.179:3300/0 2024-04-25T00:49:16.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.614+0000 7f9bd3fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T00:49:16.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.614+0000 7f9bd37fe640 1 -- >> v1:172.21.15.179:6789/0 conn(0x7f9bb4009f00 legacy=0x7f9bb400a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.179:6789/0 2024-04-25T00:49:16.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.614+0000 7f9bd8b1e640 1 -- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400aab0 msgr2=0x7f9bb40096f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.179:3301/0 2024-04-25T00:49:16.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.614+0000 7f9bd8b1e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400aab0 0x7f9bb40096f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T00:49:16.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.818+0000 7f9bd8b1e640 1 -- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400aab0 msgr2=0x7f9bb40096f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.179:3301/0 2024-04-25T00:49:16.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.818+0000 7f9bd3fff640 1 -- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.179:3300/0 2024-04-25T00:49:16.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.818+0000 7f9bd37fe640 1 -- >> v1:172.21.15.179:6789/0 conn(0x7f9bb4009f00 legacy=0x7f9bb400a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.179:6789/0 2024-04-25T00:49:16.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.818+0000 7f9bd8b1e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400aab0 0x7f9bb40096f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T00:49:16.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:16.818+0000 7f9bd3fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T00:49:17.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:17.222+0000 7f9bd3fff640 1 -- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.179:3300/0 2024-04-25T00:49:17.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:17.222+0000 7f9bd8b1e640 1 -- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400aab0 msgr2=0x7f9bb40096f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.179:3301/0 2024-04-25T00:49:17.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:17.222+0000 7f9bd37fe640 1 -- >> v1:172.21.15.179:6789/0 conn(0x7f9bb4009f00 legacy=0x7f9bb400a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.179:6789/0 2024-04-25T00:49:17.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:17.222+0000 7f9bd3fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T00:49:17.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:17.222+0000 7f9bd8b1e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400aab0 0x7f9bb40096f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T00:49:18.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:18.026+0000 7f9bd3fff640 1 -- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.179:3300/0 2024-04-25T00:49:18.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:18.026+0000 7f9bd3fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T00:49:18.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:18.026+0000 7f9bd37fe640 1 -- >> v1:172.21.15.179:6789/0 conn(0x7f9bb4009f00 legacy=0x7f9bb400a2e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.179:6789/0 2024-04-25T00:49:18.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:18.026+0000 7f9bd8b1e640 1 -- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400aab0 msgr2=0x7f9bb40096f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.179:3301/0 2024-04-25T00:49:18.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:18.026+0000 7f9bd8b1e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400aab0 0x7f9bb40096f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T00:49:18.675 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:00:08.111 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T00:49:18.785 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:00:08.138 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T00:49:18.789 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:00:08.142 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T00:49:19.000 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:00:08.435 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T00:49:19.111 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:00:08.464 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T00:49:19.114 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:00:08.468 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T00:49:19.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:19.614+0000 7f9bd1ffb640 1 -- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400aab0 msgr2=0x7f9bb40096f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T00:49:19.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:19.614+0000 7f9bd1ffb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400aab0 0x7f9bb40096f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:19.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:19.614+0000 7f9bd1ffb640 1 -- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T00:49:19.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:19.614+0000 7f9bd1ffb640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:19.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:19.614+0000 7f9bd1ffb640 1 -- >> v1:172.21.15.179:6789/0 conn(0x7f9bb4009f00 legacy=0x7f9bb400a2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T00:49:19.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:19.614+0000 7f9bd1ffb640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9bb400dca0 0x7f9bb4013290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:19.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:19.614+0000 7f9bd1ffb640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd415afb0 con 0x7f9bb400d0c0 2024-04-25T00:49:19.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:19.614+0000 7f9bd1ffb640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd415a9f0 con 0x7f9bb400dca0 2024-04-25T00:49:19.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:19.614+0000 7f9bd37fe640 1 -- >> v2:172.21.15.162:3300/0 conn(0x7f9bb400dca0 msgr2=0x7f9bb4013290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.162:3300/0 2024-04-25T00:49:19.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:19.614+0000 7f9bd37fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9bb400dca0 0x7f9bb4013290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T00:49:19.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:19.614+0000 7f9bd3fff640 1 -- >> v1:172.21.15.162:6789/0 conn(0x7f9bb400d0c0 legacy=0x7f9bb400d4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.162:6789/0 2024-04-25T00:49:19.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:19.818+0000 7f9bd37fe640 1 -- >> v2:172.21.15.162:3300/0 conn(0x7f9bb400dca0 msgr2=0x7f9bb4013290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.162:3300/0 2024-04-25T00:49:19.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:19.818+0000 7f9bd37fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9bb400dca0 0x7f9bb4013290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T00:49:19.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:19.818+0000 7f9bd3fff640 1 -- >> v1:172.21.15.162:6789/0 conn(0x7f9bb400d0c0 legacy=0x7f9bb400d4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.162:6789/0 2024-04-25T00:49:20.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:20.222+0000 7f9bd37fe640 1 -- >> v2:172.21.15.162:3300/0 conn(0x7f9bb400dca0 msgr2=0x7f9bb4013290 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.162:3300/0 2024-04-25T00:49:20.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:20.222+0000 7f9bd37fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9bb400dca0 0x7f9bb4013290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T00:49:20.222 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:20.222+0000 7f9bd3fff640 1 -- >> v1:172.21.15.162:6789/0 conn(0x7f9bb400d0c0 legacy=0x7f9bb400d4d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.162:6789/0 2024-04-25T00:49:21.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:21.098+0000 7f9bd37fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9bb400dca0 0x7f9bb4013290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:21.118 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:21.118+0000 7f9bd37fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9bb400dca0 0x7f9bb4013290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:37106/0 (socket says 172.21.15.162:37106) 2024-04-25T00:49:21.118 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:21.118+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 learned_addr learned my addr 172.21.15.162:0/1320165005 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:49:21.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:21.674+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb400dca0 msgr2=0x7f9bb4013290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T00:49:21.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:21.674+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb400dca0 msgr2=0x7f9bb4013290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:21.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:21.674+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb400dca0 0x7f9bb4013290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:21.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:21.674+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb400dca0 0x7f9bb4013290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T00:49:22.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:22.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb400dca0 msgr2=0x7f9bb4013290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T00:49:22.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:22.614+0000 7f9bd1ffb640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb400dca0 0x7f9bb4013290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:22.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:22.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 >> v1:172.21.15.162:6789/0 conn(0x7f9bb400d0c0 legacy=0x7f9bb400d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:22.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:22.614+0000 7f9bd8b1e640 1 -- 172.21.15.162:0/1320165005 reap_dead start 2024-04-25T00:49:22.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:22.614+0000 7f9bd1ffb640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:22.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:22.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bd415a750 con 0x7f9bb400d0c0 2024-04-25T00:49:22.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:22.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bb400d530 con 0x7f9bb4009f00 2024-04-25T00:49:22.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:22.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd415a9f0 con 0x7f9bb40036d0 2024-04-25T00:49:22.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:22.646+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:22.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:22.670+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T00:49:22.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:22.670+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:22.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:22.670+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:22.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:22.670+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T00:49:22.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:22.942+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:22.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:22.950+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T00:49:22.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:22.950+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:22.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:22.950+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:22.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:22.950+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T00:49:23.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:23.354+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:23.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:23.354+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T00:49:23.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:23.354+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:23.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:23.358+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:23.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:23.358+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T00:49:24.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:24.274+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:24.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:24.290+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T00:49:24.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:24.290+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:24.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:24.290+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:24.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:24.290+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T00:49:25.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4005b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T00:49:25.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.614+0000 7f9bd1ffb640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4005b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:25.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 >> v1:172.21.15.179:6789/0 conn(0x7f9bb4009f00 legacy=0x7f9bb400a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:25.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 >> v1:172.21.15.162:6789/0 conn(0x7f9bb400d0c0 legacy=0x7f9bb4013940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:25.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.614+0000 7f9bd1ffb640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 0x7f9bb4014050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:25.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.614+0000 7f9bd1ffb640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 0x7f9bb4013290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:25.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd415a9f0 con 0x7f9bb40096f0 2024-04-25T00:49:25.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd415acd0 con 0x7f9bb4014590 2024-04-25T00:49:25.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.618+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 0x7f9bb4013290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:25.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.618+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 0x7f9bb4014050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:25.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.618+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 msgr2=0x7f9bb4013290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T00:49:25.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.618+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 msgr2=0x7f9bb4013290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:25.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.618+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 0x7f9bb4013290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:25.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.618+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 0x7f9bb4013290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T00:49:25.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.622+0000 7f9bd3fff640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 msgr2=0x7f9bb4014050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T00:49:25.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.622+0000 7f9bd3fff640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 msgr2=0x7f9bb4014050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:25.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.622+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 0x7f9bb4014050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:25.624 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.622+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 0x7f9bb4014050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T00:49:25.824 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.822+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 0x7f9bb4013290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:25.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.826+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 msgr2=0x7f9bb4013290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T00:49:25.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.826+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 msgr2=0x7f9bb4013290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:25.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.826+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 0x7f9bb4013290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:25.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.826+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 0x7f9bb4013290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T00:49:25.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.826+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 0x7f9bb4014050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:25.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.830+0000 7f9bd3fff640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 msgr2=0x7f9bb4014050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T00:49:25.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.830+0000 7f9bd3fff640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 msgr2=0x7f9bb4014050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:25.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.830+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 0x7f9bb4014050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:25.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:25.830+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 0x7f9bb4014050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T00:49:26.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:26.230+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 0x7f9bb4013290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:26.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:26.234+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 msgr2=0x7f9bb4013290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T00:49:26.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:26.234+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 msgr2=0x7f9bb4013290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:26.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:26.234+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 0x7f9bb4013290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:26.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:26.234+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 0x7f9bb4013290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T00:49:26.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:26.234+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 0x7f9bb4014050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:26.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:26.238+0000 7f9bd3fff640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 msgr2=0x7f9bb4014050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T00:49:26.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:26.238+0000 7f9bd3fff640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 msgr2=0x7f9bb4014050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:26.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:26.238+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 0x7f9bb4014050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:26.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:26.238+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 0x7f9bb4014050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T00:49:27.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:27.038+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 0x7f9bb4013290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:27.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:27.042+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 msgr2=0x7f9bb4013290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T00:49:27.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:27.042+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 msgr2=0x7f9bb4013290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:27.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:27.042+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 0x7f9bb4013290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:27.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:27.042+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 0x7f9bb4013290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T00:49:27.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:27.042+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 0x7f9bb4014050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:27.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:27.046+0000 7f9bd3fff640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 msgr2=0x7f9bb4014050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T00:49:27.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:27.046+0000 7f9bd3fff640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 msgr2=0x7f9bb4014050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:27.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:27.046+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 0x7f9bb4014050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:27.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:27.046+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 0x7f9bb4014050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T00:49:28.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 msgr2=0x7f9bb4013290 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T00:49:28.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.614+0000 7f9bd1ffb640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb4014590 0x7f9bb4013290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:28.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 msgr2=0x7f9bb4014050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T00:49:28.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.614+0000 7f9bd1ffb640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.162:3300/0 conn(0x7f9bb40096f0 0x7f9bb4014050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:28.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.614+0000 7f9bd8b1e640 1 -- 172.21.15.162:0/1320165005 reap_dead start 2024-04-25T00:49:28.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.614+0000 7f9bd1ffb640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4014030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:28.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.614+0000 7f9bd1ffb640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bb4005b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:28.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bb400d700 con 0x7f9bb400d0c0 2024-04-25T00:49:28.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f9bd415a9f0 con 0x7f9bb40036d0 2024-04-25T00:49:28.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd415acd0 con 0x7f9bb400a2e0 2024-04-25T00:49:28.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.618+0000 7f9bd8b1e640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bb4005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:28.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.618+0000 7f9bd8b1e640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 msgr2=0x7f9bb4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T00:49:28.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.618+0000 7f9bd8b1e640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 msgr2=0x7f9bb4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:28.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.618+0000 7f9bd8b1e640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bb4005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:28.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.618+0000 7f9bd8b1e640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bb4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T00:49:28.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.622+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4014030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:28.626 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.626+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4014030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T00:49:28.626 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.626+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4014030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:28.626 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.626+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4014030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:28.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.626+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4014030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T00:49:28.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.822+0000 7f9bd8b1e640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bb4005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:28.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.826+0000 7f9bd8b1e640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 msgr2=0x7f9bb4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T00:49:28.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.826+0000 7f9bd8b1e640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 msgr2=0x7f9bb4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:28.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.826+0000 7f9bd8b1e640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bb4005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:28.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.826+0000 7f9bd8b1e640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bb4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T00:49:28.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.830+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4014030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:28.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.834+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4014030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T00:49:28.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.834+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4014030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:28.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.834+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4014030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:28.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:28.834+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4014030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T00:49:29.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:29.230+0000 7f9bd8b1e640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bb4005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:29.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:29.230+0000 7f9bd8b1e640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 msgr2=0x7f9bb4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T00:49:29.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:29.230+0000 7f9bd8b1e640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 msgr2=0x7f9bb4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:29.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:29.230+0000 7f9bd8b1e640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bb4005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:29.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:29.230+0000 7f9bd8b1e640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bb4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T00:49:29.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:29.238+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4014030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:29.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:29.242+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4014030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T00:49:29.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:29.242+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4014030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:29.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:29.242+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4014030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:29.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:29.242+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4014030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T00:49:30.036 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:30.034+0000 7f9bd8b1e640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bb4005b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:30.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:30.038+0000 7f9bd8b1e640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 msgr2=0x7f9bb4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T00:49:30.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:30.038+0000 7f9bd8b1e640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 msgr2=0x7f9bb4005b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:30.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:30.038+0000 7f9bd8b1e640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bb4005b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:30.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:30.038+0000 7f9bd8b1e640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bb4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T00:49:30.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:30.046+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4014030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:30.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:30.050+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4014030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T00:49:30.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:30.050+0000 7f9bd37fe640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4014030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T00:49:30.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:30.050+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4014030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T00:49:30.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:30.050+0000 7f9bd37fe640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4014030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T00:49:31.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.470+0000 7f9bd2ffd640 1 -- 172.21.15.162:0/1320165005 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 846630842 0 0) 0x7f9bb400d700 con 0x7f9bb400d0c0 2024-04-25T00:49:31.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.470+0000 7f9bd2ffd640 1 -- 172.21.15.162:0/1320165005 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bc0003530 con 0x7f9bb400d0c0 2024-04-25T00:49:31.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.598+0000 7f9bd2ffd640 1 -- 172.21.15.162:0/1320165005 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1091079317 0 0) 0x7f9bc0003530 con 0x7f9bb400d0c0 2024-04-25T00:49:31.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.598+0000 7f9bd2ffd640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 msgr2=0x7f9bb4005b30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T00:49:31.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.598+0000 7f9bd2ffd640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bb4005b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:31.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.598+0000 7f9bd2ffd640 1 -- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 msgr2=0x7f9bb4014030 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T00:49:31.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.598+0000 7f9bd2ffd640 1 --2- 172.21.15.162:0/1320165005 >> v2:172.21.15.179:3300/0 conn(0x7f9bb40036d0 0x7f9bb4014030 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:31.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.598+0000 7f9bd2ffd640 1 -- 172.21.15.162:0/1320165005 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb400a7c0 con 0x7f9bb400d0c0 2024-04-25T00:49:31.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.598+0000 7f9bd2ffd640 1 -- 172.21.15.162:0/1320165005 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7f9bcc009900 con 0x7f9bb400d0c0 2024-04-25T00:49:31.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.598+0000 7f9bd2ffd640 1 -- 172.21.15.162:0/1320165005 >> v1:172.21.15.162:6789/0 conn(0x7f9bb400d0c0 legacy=0x7f9bb4013920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:31.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.598+0000 7f9bd2ffd640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bc00039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:31.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.598+0000 7f9bd2ffd640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bc0003ff0 0x7f9bc0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:31.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.598+0000 7f9bd2ffd640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bc0004d50 0x7f9bc00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:31.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.598+0000 7f9bd2ffd640 1 -- 172.21.15.162:0/1320165005 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd415a9f0 con 0x7f9bc0003ff0 2024-04-25T00:49:31.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.598+0000 7f9bd2ffd640 1 -- 172.21.15.162:0/1320165005 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd415acd0 con 0x7f9bc0004d50 2024-04-25T00:49:31.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.598+0000 7f9bd2ffd640 1 -- 172.21.15.162:0/1320165005 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc000bb90 con 0x7f9bb400a2e0 2024-04-25T00:49:31.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.602+0000 7f9bd8b1e640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bc0004d50 0x7f9bc00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:31.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.602+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bc00039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:31.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 msgr2=0x7f9bc00039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:31.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.614+0000 7f9bd1ffb640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bc00039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:31.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bc0004d50 msgr2=0x7f9bc00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:31.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.614+0000 7f9bd1ffb640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bc0004d50 0x7f9bc00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:31.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bc0003ff0 msgr2=0x7f9bc0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:31.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.614+0000 7f9bd1ffb640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bc0003ff0 0x7f9bc0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:31.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.614+0000 7f9bd1ffb640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4003b20 0x7f9bb4011280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:31.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.614+0000 7f9bd8b1e640 1 -- 172.21.15.162:0/1320165005 reap_dead start 2024-04-25T00:49:31.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.614+0000 7f9bd1ffb640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bb400a2e0 0x7f9bb4013920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:31.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.614+0000 7f9bd1ffb640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400d0c0 0x7f9bb4013e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:31.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd415a9f0 con 0x7f9bb400a2e0 2024-04-25T00:49:31.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd415acd0 con 0x7f9bb4003b20 2024-04-25T00:49:31.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.614+0000 7f9bd1ffb640 1 -- 172.21.15.162:0/1320165005 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc000bb90 con 0x7f9bb400d0c0 2024-04-25T00:49:31.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.638+0000 7f9bd8b1e640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400d0c0 0x7f9bb4013e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:31.712 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.710+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4003b20 0x7f9bb4011280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:31.716 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.714+0000 7f9bd3fff640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400d0c0 msgr2=0x7f9bb4013e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:31.716 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.714+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400d0c0 0x7f9bb4013e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:31.716 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.714+0000 7f9bd3fff640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bb400a2e0 msgr2=0x7f9bb4013920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:31.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.714+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bb400a2e0 0x7f9bb4013920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:31.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.714+0000 7f9bd3fff640 1 -- 172.21.15.162:0/1320165005 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=2+}) -- 0x7f9bc0003530 con 0x7f9bb4003b20 2024-04-25T00:49:31.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.754+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4003b20 0x7f9bb4011280 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009510 tx=0x7f9bcc01d9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72085fdb3f7bcbd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:31.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.834+0000 7f9bd2ffd640 1 -- 172.21.15.162:0/1320165005 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc0ab070 con 0x7f9bb4003b20 2024-04-25T00:49:31.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.834+0000 7f9bd2ffd640 1 -- 172.21.15.162:0/1320165005 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bcc0a5c90 con 0x7f9bb4003b20 2024-04-25T00:49:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.834+0000 7f9bda581640 1 -- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4003b20 msgr2=0x7f9bb4011280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.834+0000 7f9bda581640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4003b20 0x7f9bb4011280 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009510 tx=0x7f9bcc01d9e0 comp rx=0 tx=0).stop 2024-04-25T00:49:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.834+0000 7f9bda581640 1 -- 172.21.15.162:0/1320165005 shutdown_connections 2024-04-25T00:49:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.834+0000 7f9bda581640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400d0c0 0x7f9bb4013e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.834+0000 7f9bda581640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bb400a2e0 0x7f9bb4013920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.834+0000 7f9bda581640 1 --2- 172.21.15.162:0/1320165005 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4003b20 0x7f9bb4011280 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.834+0000 7f9bda581640 1 -- 172.21.15.162:0/1320165005 >> 172.21.15.162:0/1320165005 conn(0x7f9bd4070280 msgr2=0x7f9bd4070690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.834+0000 7f9bda581640 1 -- 172.21.15.162:0/1320165005 shutdown_connections 2024-04-25T00:49:31.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.834+0000 7f9bda581640 1 -- 172.21.15.162:0/1320165005 wait complete. 2024-04-25T00:49:31.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.838+0000 7f9bda581640 1 Processor -- start 2024-04-25T00:49:31.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.838+0000 7f9bda581640 1 -- start start 2024-04-25T00:49:31.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.838+0000 7f9bda581640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4003b20 0x7f9bd4152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:31.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.838+0000 7f9bda581640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bd4151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:31.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.838+0000 7f9bda581640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bb400d0c0 0x7f9bd40cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:31.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.838+0000 7f9bda581640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd4157160 con 0x7f9bb400d0c0 2024-04-25T00:49:31.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.838+0000 7f9bda581640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9bd415b570 con 0x7f9bb4003b20 2024-04-25T00:49:31.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.838+0000 7f9bda581640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9bd413d070 con 0x7f9bb400a2e0 2024-04-25T00:49:31.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.850+0000 7f9bd3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4003b20 0x7f9bd4152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:31.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.854+0000 7f9bd3fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4003b20 0x7f9bd4152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:45186/0 (socket says 172.21.15.162:45186) 2024-04-25T00:49:31.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.854+0000 7f9bd3fff640 1 -- 172.21.15.162:0/853795325 learned_addr learned my addr 172.21.15.162:0/853795325 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:49:31.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.886+0000 7f9bd3fff640 1 -- 172.21.15.162:0/853795325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 msgr2=0x7f9bd4151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:31.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.886+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/853795325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bd4151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:31.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.886+0000 7f9bd3fff640 1 -- 172.21.15.162:0/853795325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bb400d0c0 msgr2=0x7f9bd40cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:31.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.886+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/853795325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bb400d0c0 0x7f9bd40cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:31.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.886+0000 7f9bd3fff640 1 -- 172.21.15.162:0/853795325 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bd40cda90 con 0x7f9bb4003b20 2024-04-25T00:49:31.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.898+0000 7f9bd3fff640 1 --2- 172.21.15.162:0/853795325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4003b20 0x7f9bd4152f00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc0987b0 tx=0x7f9bcc005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:31.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.910+0000 7f9bd0ff9640 1 -- 172.21.15.162:0/853795325 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc0ab040 con 0x7f9bb4003b20 2024-04-25T00:49:31.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.910+0000 7f9bd0ff9640 1 -- 172.21.15.162:0/853795325 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bcc0be070 con 0x7f9bb4003b20 2024-04-25T00:49:31.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.910+0000 7f9bd0ff9640 1 -- 172.21.15.162:0/853795325 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc00c410 con 0x7f9bb4003b20 2024-04-25T00:49:31.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.910+0000 7f9bda581640 1 -- 172.21.15.162:0/853795325 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bd40cab50 con 0x7f9bb4003b20 2024-04-25T00:49:31.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.910+0000 7f9bda581640 1 -- 172.21.15.162:0/853795325 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bd40cd4d0 con 0x7f9bb4003b20 2024-04-25T00:49:31.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.914+0000 7f9bda581640 1 -- 172.21.15.162:0/853795325 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bd41509b0 con 0x7f9bb4003b20 2024-04-25T00:49:31.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.978+0000 7f9bd0ff9640 1 -- 172.21.15.162:0/853795325 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9bcc0b6070 con 0x7f9bb4003b20 2024-04-25T00:49:31.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:31.978+0000 7f9bd0ff9640 1 -- 172.21.15.162:0/853795325 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9bcc0c3b70 con 0x7f9bb4003b20 2024-04-25T00:49:32.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:32.210+0000 7f9bd0ff9640 1 -- 172.21.15.162:0/853795325 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f9bcc017a70 con 0x7f9bb4003b20 2024-04-25T00:49:32.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:32.282+0000 7f9bda581640 1 -- 172.21.15.162:0/853795325 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f9bd40c77d0 con 0x7f9bb4003b20 2024-04-25T00:49:32.343 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:32.342+0000 7fdf9f399180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T00:49:32.569 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:32.567+0000 7f6d5c45f180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T00:49:32.876 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:32.874+0000 7fdf9f399180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T00:49:32.985 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:32.982+0000 7f9bd0ff9640 1 -- 172.21.15.162:0/853795325 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f9bcc0c3460 con 0x7f9bb4003b20 2024-04-25T00:49:32.986 INFO:teuthology.orchestra.run.smithi162.stderr:adjusted tunables profile to default 2024-04-25T00:49:32.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:32.986+0000 7f9bda581640 1 -- 172.21.15.162:0/853795325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4003b20 msgr2=0x7f9bd4152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:32.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:32.986+0000 7f9bda581640 1 --2- 172.21.15.162:0/853795325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4003b20 0x7f9bd4152f00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc0987b0 tx=0x7f9bcc005040 comp rx=0 tx=0).stop 2024-04-25T00:49:32.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:32.986+0000 7f9bda581640 1 -- 172.21.15.162:0/853795325 shutdown_connections 2024-04-25T00:49:32.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:32.986+0000 7f9bda581640 1 --2- 172.21.15.162:0/853795325 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bb400d0c0 0x7f9bd40cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:32.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:32.986+0000 7f9bda581640 1 --2- 172.21.15.162:0/853795325 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bb400a2e0 0x7f9bd4151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:32.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:32.986+0000 7f9bda581640 1 --2- 172.21.15.162:0/853795325 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4003b20 0x7f9bd4152f00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:32.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:32.986+0000 7f9bda581640 1 -- 172.21.15.162:0/853795325 >> 172.21.15.162:0/853795325 conn(0x7f9bd4070280 msgr2=0x7f9bd41565e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:32.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:32.986+0000 7f9bda581640 1 -- 172.21.15.162:0/853795325 shutdown_connections 2024-04-25T00:49:32.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:32.986+0000 7f9bda581640 1 -- 172.21.15.162:0/853795325 wait complete. 2024-04-25T00:49:33.008 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T00:49:33.008 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T00:49:33.008 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:49:33.009 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T00:49:33.020 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:49:33.020 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T00:49:33.055 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:33.051+0000 7f6d5c45f180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T00:49:33.057 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:33.054+0000 7fdf9f399180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T00:49:33.068 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:49:33.068 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T00:49:33.120 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:49:33.120 DEBUG:teuthology.orchestra.run.smithi162:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T00:49:33.173 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:49:33.173 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T00:49:33.186 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:49:33.186 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T00:49:33.239 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:49:33.239 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T00:49:33.266 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:33.263+0000 7f6d5c45f180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T00:49:33.278 DEBUG:teuthology.orchestra.run.smithi179:> set -ex 2024-04-25T00:49:33.278 DEBUG:teuthology.orchestra.run.smithi179:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T00:49:33.331 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new e20986cc-3664-4988-959c-c0b02e380775 0 2024-04-25T00:49:33.494 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.491+0000 7fcb65006640 1 Processor -- start 2024-04-25T00:49:33.495 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.491+0000 7fcb65006640 1 -- start start 2024-04-25T00:49:33.496 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.491+0000 7fcb65006640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcb601523e0 0x7fcb600cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:33.496 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.491+0000 7fcb65006640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcb6015c230 0x7fcb60071380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:33.496 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.491+0000 7fcb65006640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb6015b790 con 0x7fcb600cd440 2024-04-25T00:49:33.496 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.491+0000 7fcb65006640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcb6015c6a0 con 0x7fcb6015c230 2024-04-25T00:49:33.496 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.491+0000 7fcb65006640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fcb60158a60 con 0x7fcb601523e0 2024-04-25T00:49:33.497 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.495+0000 7fcb5ed9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcb601523e0 0x7fcb600cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:33.497 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.495+0000 7fcb5ed9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcb601523e0 0x7fcb600cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:56966/0 (socket says 172.21.15.179:56966) 2024-04-25T00:49:33.497 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.495+0000 7fcb5ed9d640 1 -- 172.21.15.179:0/2559510258 learned_addr learned my addr 172.21.15.179:0/2559510258 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-25T00:49:33.497 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.495+0000 7fcb5f59e640 1 --2- 172.21.15.179:0/2559510258 >> v2:172.21.15.162:3300/0 conn(0x7fcb6015c230 0x7fcb60071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:33.499 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.495+0000 7fcb5ed9d640 1 -- 172.21.15.179:0/2559510258 >> v2:172.21.15.162:3300/0 conn(0x7fcb6015c230 msgr2=0x7fcb60071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:33.499 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.495+0000 7fcb5ed9d640 1 --2- 172.21.15.179:0/2559510258 >> v2:172.21.15.162:3300/0 conn(0x7fcb6015c230 0x7fcb60071380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:33.499 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.495+0000 7fcb5ed9d640 1 -- 172.21.15.179:0/2559510258 >> v1:172.21.15.179:6789/0 conn(0x7fcb600cd440 legacy=0x7fcb601581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:33.499 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.495+0000 7fcb5ed9d640 1 -- 172.21.15.179:0/2559510258 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb60158d40 con 0x7fcb601523e0 2024-04-25T00:49:33.504 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.503+0000 7fcb5ed9d640 1 --2- 172.21.15.179:0/2559510258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb601523e0 0x7fcb600cb830 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcb60070fe0 tx=0x7fcb5001ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7562517c3e200424 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:33.508 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb5dd9b640 1 -- 172.21.15.179:0/2559510258 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb500b5070 con 0x7fcb601523e0 2024-04-25T00:49:33.508 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb5dd9b640 1 -- 172.21.15.179:0/2559510258 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb500a89d0 con 0x7fcb601523e0 2024-04-25T00:49:33.508 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb5dd9b640 1 -- 172.21.15.179:0/2559510258 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb500a8da0 con 0x7fcb601523e0 2024-04-25T00:49:33.509 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb65006640 1 -- 172.21.15.179:0/2559510258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb601523e0 msgr2=0x7fcb600cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:33.509 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb65006640 1 --2- 172.21.15.179:0/2559510258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb601523e0 0x7fcb600cb830 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcb60070fe0 tx=0x7fcb5001ecd0 comp rx=0 tx=0).stop 2024-04-25T00:49:33.509 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb65006640 1 -- 172.21.15.179:0/2559510258 shutdown_connections 2024-04-25T00:49:33.509 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb65006640 1 --2- 172.21.15.179:0/2559510258 >> v2:172.21.15.162:3300/0 conn(0x7fcb6015c230 0x7fcb60071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:33.509 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb65006640 1 --2- 172.21.15.179:0/2559510258 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb601523e0 0x7fcb600cb830 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:33.509 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb65006640 1 -- 172.21.15.179:0/2559510258 >> 172.21.15.179:0/2559510258 conn(0x7fcb6006b810 msgr2=0x7fcb6006f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:33.510 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb65006640 1 -- 172.21.15.179:0/2559510258 shutdown_connections 2024-04-25T00:49:33.510 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb65006640 1 -- 172.21.15.179:0/2559510258 wait complete. 2024-04-25T00:49:33.511 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb65006640 1 Processor -- start 2024-04-25T00:49:33.511 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb65006640 1 -- start start 2024-04-25T00:49:33.513 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb65006640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb600cd440 0x7fcb601580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:33.513 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb65006640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb601523e0 0x7fcb600c6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:33.513 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb65006640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb6015c230 0x7fcb60152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:33.513 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb65006640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6015bd10 con 0x7fcb600cd440 2024-04-25T00:49:33.513 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb65006640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6015ba30 con 0x7fcb601523e0 2024-04-25T00:49:33.513 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.507+0000 7fcb65006640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcb601527c0 con 0x7fcb6015c230 2024-04-25T00:49:33.514 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.511+0000 7fcb5f59e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb6015c230 0x7fcb60152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:33.514 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.511+0000 7fcb5f59e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb6015c230 0x7fcb60152c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:53582/0 (socket says 172.21.15.179:53582) 2024-04-25T00:49:33.514 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.511+0000 7fcb5f59e640 1 -- 172.21.15.179:0/466506519 learned_addr learned my addr 172.21.15.179:0/466506519 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-25T00:49:33.514 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.511+0000 7fcb5e59c640 1 --2- 172.21.15.179:0/466506519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb601523e0 0x7fcb600c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:33.514 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.511+0000 7fcb5ed9d640 1 --2- 172.21.15.179:0/466506519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb600cd440 0x7fcb601580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:33.516 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.515+0000 7fcb5f59e640 1 -- 172.21.15.179:0/466506519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb601523e0 msgr2=0x7fcb600c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:33.516 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.515+0000 7fcb5f59e640 1 --2- 172.21.15.179:0/466506519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb601523e0 0x7fcb600c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:33.516 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.515+0000 7fcb5f59e640 1 -- 172.21.15.179:0/466506519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb600cd440 msgr2=0x7fcb601580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:33.516 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.515+0000 7fcb5f59e640 1 --2- 172.21.15.179:0/466506519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb600cd440 0x7fcb601580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:33.516 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.515+0000 7fcb5f59e640 1 -- 172.21.15.179:0/466506519 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb601f1db0 con 0x7fcb6015c230 2024-04-25T00:49:33.518 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.515+0000 7fcb5f59e640 1 --2- 172.21.15.179:0/466506519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb6015c230 0x7fcb60152c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcb58007e60 tx=0x7fcb5800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:33.523 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.519+0000 7fcb477fe640 1 -- 172.21.15.179:0/466506519 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb58014420 con 0x7fcb6015c230 2024-04-25T00:49:33.524 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.519+0000 7fcb477fe640 1 -- 172.21.15.179:0/466506519 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb58019070 con 0x7fcb6015c230 2024-04-25T00:49:33.524 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.519+0000 7fcb477fe640 1 -- 172.21.15.179:0/466506519 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb58014820 con 0x7fcb6015c230 2024-04-25T00:49:33.524 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.519+0000 7fcb65006640 1 -- 172.21.15.179:0/466506519 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb601f2090 con 0x7fcb6015c230 2024-04-25T00:49:33.524 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.519+0000 7fcb65006640 1 -- 172.21.15.179:0/466506519 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb601f2650 con 0x7fcb6015c230 2024-04-25T00:49:33.524 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.523+0000 7fcb65006640 1 -- 172.21.15.179:0/466506519 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb60075110 con 0x7fcb6015c230 2024-04-25T00:49:33.617 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:33.614+0000 7fdf9f399180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T00:49:33.671 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:33.670+0000 7fdf9f399180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T00:49:33.727 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:33.726+0000 7fdf9f399180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T00:49:33.731 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.727+0000 7fcb477fe640 1 -- 172.21.15.179:0/466506519 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcb580149c0 con 0x7fcb6015c230 2024-04-25T00:49:33.732 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.727+0000 7fcb477fe640 1 -- 172.21.15.179:0/466506519 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fcb580273d0 con 0x7fcb6015c230 2024-04-25T00:49:33.732 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.727+0000 7fcb477fe640 1 -- 172.21.15.179:0/466506519 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fcb580276e0 con 0x7fcb6015c230 2024-04-25T00:49:33.813 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:33.811+0000 7fcb65006640 1 -- 172.21.15.179:0/466506519 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e20986cc-3664-4988-959c-c0b02e380775", "id": 0} v 0) -- 0x7fcb600b2b10 con 0x7fcb6015c230 2024-04-25T00:49:33.820 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:33.818+0000 7fdf9f399180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T00:49:33.873 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:33.870+0000 7fdf9f399180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T00:49:33.891 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:33.887+0000 7f6d5c45f180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T00:49:33.945 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:33.943+0000 7f6d5c45f180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T00:49:33.950 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:33.950+0000 7fdf9f399180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T00:49:33.997 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:33.995+0000 7f6d5c45f180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T00:49:34.003 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:34.002+0000 7fdf9f399180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T00:49:34.077 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:34.075+0000 7f6d5c45f180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T00:49:34.159 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:34.155+0000 7f6d5c45f180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T00:49:34.163 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.159+0000 7fcb477fe640 1 -- 172.21.15.179:0/466506519 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e20986cc-3664-4988-959c-c0b02e380775", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fcb58014df0 con 0x7fcb6015c230 2024-04-25T00:49:34.163 INFO:teuthology.orchestra.run.smithi179.stdout:0 2024-04-25T00:49:34.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.163+0000 7fcb65006640 1 -- 172.21.15.179:0/466506519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb6015c230 msgr2=0x7fcb60152c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:34.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.163+0000 7fcb65006640 1 --2- 172.21.15.179:0/466506519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb6015c230 0x7fcb60152c40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fcb58007e60 tx=0x7fcb5800e4b0 comp rx=0 tx=0).stop 2024-04-25T00:49:34.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.163+0000 7fcb65006640 1 -- 172.21.15.179:0/466506519 shutdown_connections 2024-04-25T00:49:34.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.163+0000 7fcb65006640 1 --2- 172.21.15.179:0/466506519 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcb6015c230 0x7fcb60152c40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:34.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.163+0000 7fcb65006640 1 --2- 172.21.15.179:0/466506519 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcb601523e0 0x7fcb600c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:34.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.163+0000 7fcb65006640 1 --2- 172.21.15.179:0/466506519 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcb600cd440 0x7fcb601580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:34.166 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.163+0000 7fcb65006640 1 -- 172.21.15.179:0/466506519 >> 172.21.15.179:0/466506519 conn(0x7fcb6006b810 msgr2=0x7fcb600c3390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:34.166 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.163+0000 7fcb65006640 1 -- 172.21.15.179:0/466506519 shutdown_connections 2024-04-25T00:49:34.166 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.163+0000 7fcb65006640 1 -- 172.21.15.179:0/466506519 wait complete. 2024-04-25T00:49:34.175 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:34.174+0000 7fdf9f399180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T00:49:34.178 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:49:34.181 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:49:34.184 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 60f1608a-ecb7-4978-b816-ce6f419e275d 1 2024-04-25T00:49:34.238 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:34.238+0000 7fdf9f399180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T00:49:34.246 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:34.243+0000 7f6d5c45f180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T00:49:34.307 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:34.303+0000 7f6d5c45f180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T00:49:34.349 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.347+0000 7fef3d8d8640 1 Processor -- start 2024-04-25T00:49:34.349 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.347+0000 7fef3d8d8640 1 -- start start 2024-04-25T00:49:34.349 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.347+0000 7fef3d8d8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef38154400 0x7fef380cb9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:34.349 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.347+0000 7fef3d8d8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fef3806c9e0 0x7fef3806ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:34.350 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.347+0000 7fef3d8d8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef380cd380 con 0x7fef3815ad40 2024-04-25T00:49:34.350 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.347+0000 7fef3d8d8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fef3806c550 con 0x7fef3806c9e0 2024-04-25T00:49:34.350 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.347+0000 7fef3d8d8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fef3806d350 con 0x7fef38154400 2024-04-25T00:49:34.350 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.347+0000 7fef36ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef38154400 0x7fef380cb9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:34.350 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.347+0000 7fef377fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fef3806c9e0 0x7fef3806ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:34.350 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.347+0000 7fef36ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef38154400 0x7fef380cb9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:41674/0 (socket says 172.21.15.179:41674) 2024-04-25T00:49:34.350 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.347+0000 7fef36ffd640 1 -- 172.21.15.179:0/4180015856 learned_addr learned my addr 172.21.15.179:0/4180015856 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-25T00:49:34.352 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.351+0000 7fef36ffd640 1 -- 172.21.15.179:0/4180015856 >> v2:172.21.15.179:3300/0 conn(0x7fef3806c9e0 msgr2=0x7fef3806ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:34.353 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.351+0000 7fef36ffd640 1 --2- 172.21.15.179:0/4180015856 >> v2:172.21.15.179:3300/0 conn(0x7fef3806c9e0 0x7fef3806ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:34.353 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.351+0000 7fef36ffd640 1 -- 172.21.15.179:0/4180015856 >> v1:172.21.15.162:6789/0 conn(0x7fef3815ad40 legacy=0x7fef38071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:34.353 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.351+0000 7fef36ffd640 1 -- 172.21.15.179:0/4180015856 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef380caef0 con 0x7fef38154400 2024-04-25T00:49:34.356 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.355+0000 7fef36ffd640 1 --2- 172.21.15.179:0/4180015856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef38154400 0x7fef380cb9c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fef3806c6d0 tx=0x7fef2801ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e06efa9faa70ea8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:34.361 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.359+0000 7fef367fc640 1 -- 172.21.15.179:0/4180015856 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef280b5070 con 0x7fef38154400 2024-04-25T00:49:34.361 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.359+0000 7fef367fc640 1 -- 172.21.15.179:0/4180015856 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef280a8a30 con 0x7fef38154400 2024-04-25T00:49:34.361 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.359+0000 7fef367fc640 1 -- 172.21.15.179:0/4180015856 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef280a8e00 con 0x7fef38154400 2024-04-25T00:49:34.362 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.359+0000 7fef3d8d8640 1 -- 172.21.15.179:0/4180015856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef38154400 msgr2=0x7fef380cb9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:34.362 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.359+0000 7fef3d8d8640 1 --2- 172.21.15.179:0/4180015856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef38154400 0x7fef380cb9c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fef3806c6d0 tx=0x7fef2801ed30 comp rx=0 tx=0).stop 2024-04-25T00:49:34.362 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.359+0000 7fef3d8d8640 1 -- 172.21.15.179:0/4180015856 shutdown_connections 2024-04-25T00:49:34.362 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.359+0000 7fef3d8d8640 1 --2- 172.21.15.179:0/4180015856 >> v2:172.21.15.179:3300/0 conn(0x7fef3806c9e0 0x7fef3806ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:34.362 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.359+0000 7fef3d8d8640 1 --2- 172.21.15.179:0/4180015856 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef38154400 0x7fef380cb9c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:34.362 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.359+0000 7fef3d8d8640 1 -- 172.21.15.179:0/4180015856 >> 172.21.15.179:0/4180015856 conn(0x7fef3806b810 msgr2=0x7fef3806f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:34.363 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.359+0000 7fef3d8d8640 1 -- 172.21.15.179:0/4180015856 shutdown_connections 2024-04-25T00:49:34.363 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.359+0000 7fef3d8d8640 1 -- 172.21.15.179:0/4180015856 wait complete. 2024-04-25T00:49:34.363 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.359+0000 7fef3d8d8640 1 Processor -- start 2024-04-25T00:49:34.363 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.359+0000 7fef3d8d8640 1 -- start start 2024-04-25T00:49:34.364 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.363+0000 7fef3d8d8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef3806c9e0 0x7fef38152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:34.364 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.363+0000 7fef3d8d8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef38154400 0x7fef38154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:34.364 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.363+0000 7fef3d8d8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef3815ad40 0x7fef381f06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:34.365 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.363+0000 7fef3d8d8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fef380cc8e0 con 0x7fef3806c9e0 2024-04-25T00:49:34.365 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.363+0000 7fef3d8d8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fef380cb1b0 con 0x7fef38154400 2024-04-25T00:49:34.365 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.363+0000 7fef3d8d8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fef3815b140 con 0x7fef3815ad40 2024-04-25T00:49:34.365 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.363+0000 7fef377fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef3815ad40 0x7fef381f06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:34.365 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.363+0000 7fef2ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef38154400 0x7fef38154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:34.365 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.363+0000 7fef377fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef3815ad40 0x7fef381f06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:41682/0 (socket says 172.21.15.179:41682) 2024-04-25T00:49:34.365 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.363+0000 7fef377fe640 1 -- 172.21.15.179:0/3357681864 learned_addr learned my addr 172.21.15.179:0/3357681864 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-25T00:49:34.366 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.363+0000 7fef36ffd640 1 --2- 172.21.15.179:0/3357681864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef3806c9e0 0x7fef38152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:34.368 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.367+0000 7fef377fe640 1 -- 172.21.15.179:0/3357681864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef38154400 msgr2=0x7fef38154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:34.369 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.367+0000 7fef377fe640 1 --2- 172.21.15.179:0/3357681864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef38154400 0x7fef38154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:34.369 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.367+0000 7fef377fe640 1 -- 172.21.15.179:0/3357681864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef3806c9e0 msgr2=0x7fef38152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:34.369 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.367+0000 7fef377fe640 1 --2- 172.21.15.179:0/3357681864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef3806c9e0 0x7fef38152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:34.369 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.367+0000 7fef377fe640 1 -- 172.21.15.179:0/3357681864 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef381f3980 con 0x7fef3815ad40 2024-04-25T00:49:34.371 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.367+0000 7fef377fe640 1 --2- 172.21.15.179:0/3357681864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef3815ad40 0x7fef381f06e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fef30009d30 tx=0x7fef3000c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:34.374 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.371+0000 7fef34ff9640 1 -- 172.21.15.179:0/3357681864 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef30018020 con 0x7fef3815ad40 2024-04-25T00:49:34.374 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.371+0000 7fef34ff9640 1 -- 172.21.15.179:0/3357681864 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef30014480 con 0x7fef3815ad40 2024-04-25T00:49:34.374 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.371+0000 7fef34ff9640 1 -- 172.21.15.179:0/3357681864 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef30014870 con 0x7fef3815ad40 2024-04-25T00:49:34.375 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.371+0000 7fef3d8d8640 1 -- 172.21.15.179:0/3357681864 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef381f3c60 con 0x7fef3815ad40 2024-04-25T00:49:34.375 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.371+0000 7fef3d8d8640 1 -- 172.21.15.179:0/3357681864 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fef381f4220 con 0x7fef3815ad40 2024-04-25T00:49:34.375 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.371+0000 7fef3d8d8640 1 -- 172.21.15.179:0/3357681864 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef38075110 con 0x7fef3815ad40 2024-04-25T00:49:34.476 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:34.475+0000 7f6d5c45f180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T00:49:34.488 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.487+0000 7fef34ff9640 1 -- 172.21.15.179:0/3357681864 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fef3001b020 con 0x7fef3815ad40 2024-04-25T00:49:34.488 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.487+0000 7fef34ff9640 1 -- 172.21.15.179:0/3357681864 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fef300267a0 con 0x7fef3815ad40 2024-04-25T00:49:34.488 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.487+0000 7fef34ff9640 1 -- 172.21.15.179:0/3357681864 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fef30022030 con 0x7fef3815ad40 2024-04-25T00:49:34.542 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:34.539+0000 7f6d5c45f180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T00:49:34.557 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.555+0000 7fef3d8d8640 1 -- 172.21.15.179:0/3357681864 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "60f1608a-ecb7-4978-b816-ce6f419e275d", "id": 1} v 0) -- 0x7fef380ca0f0 con 0x7fef3815ad40 2024-04-25T00:49:34.733 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.731+0000 7fef34ff9640 1 -- 172.21.15.179:0/3357681864 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "60f1608a-ecb7-4978-b816-ce6f419e275d", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fef30010040 con 0x7fef3815ad40 2024-04-25T00:49:34.734 INFO:teuthology.orchestra.run.smithi179.stdout:1 2024-04-25T00:49:34.735 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.731+0000 7fef3d8d8640 1 -- 172.21.15.179:0/3357681864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef3815ad40 msgr2=0x7fef381f06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:34.735 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.731+0000 7fef3d8d8640 1 --2- 172.21.15.179:0/3357681864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef3815ad40 0x7fef381f06e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fef30009d30 tx=0x7fef3000c490 comp rx=0 tx=0).stop 2024-04-25T00:49:34.735 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.731+0000 7fef3d8d8640 1 -- 172.21.15.179:0/3357681864 shutdown_connections 2024-04-25T00:49:34.736 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.731+0000 7fef3d8d8640 1 --2- 172.21.15.179:0/3357681864 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fef3815ad40 0x7fef381f06e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:34.736 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.731+0000 7fef3d8d8640 1 --2- 172.21.15.179:0/3357681864 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fef38154400 0x7fef38154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:34.736 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.731+0000 7fef3d8d8640 1 --2- 172.21.15.179:0/3357681864 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fef3806c9e0 0x7fef38152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:34.736 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.731+0000 7fef3d8d8640 1 -- 172.21.15.179:0/3357681864 >> 172.21.15.179:0/3357681864 conn(0x7fef3806b810 msgr2=0x7fef3815a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:34.736 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.731+0000 7fef3d8d8640 1 -- 172.21.15.179:0/3357681864 shutdown_connections 2024-04-25T00:49:34.736 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.731+0000 7fef3d8d8640 1 -- 172.21.15.179:0/3357681864 wait complete. 2024-04-25T00:49:34.755 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 77552061-8e19-4f49-bc3f-1300955a07b8 2 2024-04-25T00:49:34.908 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.903+0000 7fa4395c1640 1 Processor -- start 2024-04-25T00:49:34.910 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.907+0000 7fa4395c1640 1 -- start start 2024-04-25T00:49:34.910 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.907+0000 7fa4395c1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4341505b0 0x7fa434156c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:34.910 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.907+0000 7fa4395c1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa4340c8070 0x7fa4340c8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:34.910 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.907+0000 7fa4395c1640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4340cb680 con 0x7fa434071bd0 2024-04-25T00:49:34.910 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.907+0000 7fa4395c1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa4340c8b70 con 0x7fa4340c8070 2024-04-25T00:49:34.910 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.907+0000 7fa4395c1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa4340cb960 con 0x7fa4341505b0 2024-04-25T00:49:34.911 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.907+0000 7fa4337fe640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fa434071bd0 0x7fa4340c4070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:41872/0 (socket says 172.21.15.179:41872) 2024-04-25T00:49:34.911 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.907+0000 7fa4337fe640 1 -- 172.21.15.179:0/2647264107 learned_addr learned my addr 172.21.15.179:0/2647264107 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-04-25T00:49:34.911 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.907+0000 7fa4327fc640 1 --2- 172.21.15.179:0/2647264107 >> v2:172.21.15.162:3300/0 conn(0x7fa4340c8070 0x7fa4340c8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:34.911 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.907+0000 7fa432ffd640 1 --2- 172.21.15.179:0/2647264107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4341505b0 0x7fa434156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:34.914 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.911+0000 7fa432ffd640 1 -- 172.21.15.179:0/2647264107 >> v2:172.21.15.162:3300/0 conn(0x7fa4340c8070 msgr2=0x7fa4340c8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:34.914 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.911+0000 7fa432ffd640 1 --2- 172.21.15.179:0/2647264107 >> v2:172.21.15.162:3300/0 conn(0x7fa4340c8070 0x7fa4340c8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:34.915 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.911+0000 7fa432ffd640 1 -- 172.21.15.179:0/2647264107 >> v1:172.21.15.179:6789/0 conn(0x7fa434071bd0 legacy=0x7fa4340c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:34.915 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.911+0000 7fa432ffd640 1 -- 172.21.15.179:0/2647264107 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4340cbc40 con 0x7fa4341505b0 2024-04-25T00:49:34.919 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.919+0000 7fa432ffd640 1 --2- 172.21.15.179:0/2647264107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4341505b0 0x7fa434156c30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa4240071d0 tx=0x7fa42401d4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdca46735e894e59 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:34.923 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.919+0000 7fa431ffb640 1 -- 172.21.15.179:0/2647264107 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4240b1070 con 0x7fa4341505b0 2024-04-25T00:49:34.923 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.919+0000 7fa431ffb640 1 -- 172.21.15.179:0/2647264107 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4240a8070 con 0x7fa4341505b0 2024-04-25T00:49:34.923 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.919+0000 7fa431ffb640 1 -- 172.21.15.179:0/2647264107 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa424008e40 con 0x7fa4341505b0 2024-04-25T00:49:34.924 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa4395c1640 1 -- 172.21.15.179:0/2647264107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4341505b0 msgr2=0x7fa434156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:34.924 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa4395c1640 1 --2- 172.21.15.179:0/2647264107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4341505b0 0x7fa434156c30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa4240071d0 tx=0x7fa42401d4d0 comp rx=0 tx=0).stop 2024-04-25T00:49:34.924 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa4395c1640 1 -- 172.21.15.179:0/2647264107 shutdown_connections 2024-04-25T00:49:34.925 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa4395c1640 1 --2- 172.21.15.179:0/2647264107 >> v2:172.21.15.162:3300/0 conn(0x7fa4340c8070 0x7fa4340c8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:34.925 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa4395c1640 1 --2- 172.21.15.179:0/2647264107 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4341505b0 0x7fa434156c30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:34.925 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa4395c1640 1 -- 172.21.15.179:0/2647264107 >> 172.21.15.179:0/2647264107 conn(0x7fa43406d7f0 msgr2=0x7fa43406b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:34.925 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa4395c1640 1 -- 172.21.15.179:0/2647264107 shutdown_connections 2024-04-25T00:49:34.925 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa4395c1640 1 -- 172.21.15.179:0/2647264107 wait complete. 2024-04-25T00:49:34.925 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa4395c1640 1 Processor -- start 2024-04-25T00:49:34.926 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa4395c1640 1 -- start start 2024-04-25T00:49:34.926 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa4395c1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa434071bd0 0x7fa4341587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:34.927 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa4395c1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4340c8070 0x7fa434158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:34.927 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa4395c1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4341505b0 0x7fa4341550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:34.927 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa4395c1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa4340723f0 con 0x7fa4340c8070 2024-04-25T00:49:34.927 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa4395c1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa434072270 con 0x7fa4341505b0 2024-04-25T00:49:34.927 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa4395c1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa4341632c0 con 0x7fa434071bd0 2024-04-25T00:49:34.927 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa4337fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4341505b0 0x7fa4341550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:34.928 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa432ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa434071bd0 0x7fa4341587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:34.928 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa432ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa434071bd0 0x7fa4341587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:41708/0 (socket says 172.21.15.179:41708) 2024-04-25T00:49:34.928 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.923+0000 7fa432ffd640 1 -- 172.21.15.179:0/2611006541 learned_addr learned my addr 172.21.15.179:0/2611006541 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-25T00:49:34.928 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.927+0000 7fa4327fc640 1 --2- 172.21.15.179:0/2611006541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4340c8070 0x7fa434158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:34.931 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.927+0000 7fa432ffd640 1 -- 172.21.15.179:0/2611006541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4341505b0 msgr2=0x7fa4341550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:34.931 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.927+0000 7fa432ffd640 1 --2- 172.21.15.179:0/2611006541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4341505b0 0x7fa4341550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:34.931 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.927+0000 7fa432ffd640 1 -- 172.21.15.179:0/2611006541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4340c8070 msgr2=0x7fa434158110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:34.931 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.927+0000 7fa432ffd640 1 --2- 172.21.15.179:0/2611006541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4340c8070 0x7fa434158110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:34.931 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.927+0000 7fa432ffd640 1 -- 172.21.15.179:0/2611006541 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4341464a0 con 0x7fa434071bd0 2024-04-25T00:49:34.933 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.931+0000 7fa432ffd640 1 --2- 172.21.15.179:0/2611006541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa434071bd0 0x7fa4341587c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa4240af040 tx=0x7fa42401a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:34.937 INFO:tasks.ceph.mgr.y.smithi162.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T00:49:34.937 INFO:tasks.ceph.mgr.y.smithi162.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T00:49:34.937 INFO:tasks.ceph.mgr.y.smithi162.stderr: from numpy import show_config as show_numpy_config 2024-04-25T00:49:34.938 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.935+0000 7fa41b7fe640 1 -- 172.21.15.179:0/2611006541 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4240b1040 con 0x7fa434071bd0 2024-04-25T00:49:34.938 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.935+0000 7fa41b7fe640 1 -- 172.21.15.179:0/2611006541 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa42400a2e0 con 0x7fa434071bd0 2024-04-25T00:49:34.938 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.935+0000 7fa41b7fe640 1 -- 172.21.15.179:0/2611006541 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42400a6d0 con 0x7fa434071bd0 2024-04-25T00:49:34.938 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.935+0000 7fa4395c1640 1 -- 172.21.15.179:0/2611006541 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa434158ff0 con 0x7fa434071bd0 2024-04-25T00:49:34.938 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.935+0000 7fa4395c1640 1 -- 172.21.15.179:0/2611006541 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa434146760 con 0x7fa434071bd0 2024-04-25T00:49:34.938 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.935+0000 7fa4395c1640 1 -- 172.21.15.179:0/2611006541 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa43404f510 con 0x7fa434071bd0 2024-04-25T00:49:34.940 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.939+0000 7fa41b7fe640 1 -- 172.21.15.179:0/2611006541 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa4240c0020 con 0x7fa434071bd0 2024-04-25T00:49:34.940 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:34.939+0000 7fa41b7fe640 1 -- 172.21.15.179:0/2611006541 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fa4240acd50 con 0x7fa434071bd0 2024-04-25T00:49:34.981 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:34.978+0000 7fdf9f399180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T00:49:35.048 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.047+0000 7fa41b7fe640 1 -- 172.21.15.179:0/2611006541 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa4240c7020 con 0x7fa434071bd0 2024-04-25T00:49:35.112 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.111+0000 7fa4395c1640 1 -- 172.21.15.179:0/2611006541 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "77552061-8e19-4f49-bc3f-1300955a07b8", "id": 2} v 0) -- 0x7fa43414fdb0 con 0x7fa434071bd0 2024-04-25T00:49:35.132 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:35.130+0000 7fdf9f399180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T00:49:35.199 INFO:tasks.ceph.mgr.x.smithi179.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T00:49:35.199 INFO:tasks.ceph.mgr.x.smithi179.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T00:49:35.199 INFO:tasks.ceph.mgr.x.smithi179.stderr: from numpy import show_config as show_numpy_config 2024-04-25T00:49:35.274 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:35.271+0000 7f6d5c45f180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T00:49:35.288 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.287+0000 7fa41b7fe640 1 -- 172.21.15.179:0/2611006541 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "77552061-8e19-4f49-bc3f-1300955a07b8", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fa4240170c0 con 0x7fa434071bd0 2024-04-25T00:49:35.288 INFO:teuthology.orchestra.run.smithi179.stdout:2 2024-04-25T00:49:35.291 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.287+0000 7fa4395c1640 1 -- 172.21.15.179:0/2611006541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa434071bd0 msgr2=0x7fa4341587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:35.291 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.287+0000 7fa4395c1640 1 --2- 172.21.15.179:0/2611006541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa434071bd0 0x7fa4341587c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa4240af040 tx=0x7fa42401a270 comp rx=0 tx=0).stop 2024-04-25T00:49:35.291 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.287+0000 7fa4395c1640 1 -- 172.21.15.179:0/2611006541 shutdown_connections 2024-04-25T00:49:35.291 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.287+0000 7fa4395c1640 1 --2- 172.21.15.179:0/2611006541 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4341505b0 0x7fa4341550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:35.291 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.287+0000 7fa4395c1640 1 --2- 172.21.15.179:0/2611006541 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4340c8070 0x7fa434158110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:35.291 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.287+0000 7fa4395c1640 1 --2- 172.21.15.179:0/2611006541 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa434071bd0 0x7fa4341587c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:35.291 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.287+0000 7fa4395c1640 1 -- 172.21.15.179:0/2611006541 >> 172.21.15.179:0/2611006541 conn(0x7fa43406d7f0 msgr2=0x7fa4340c9420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:35.291 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.287+0000 7fa4395c1640 1 -- 172.21.15.179:0/2611006541 shutdown_connections 2024-04-25T00:49:35.291 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.287+0000 7fa4395c1640 1 -- 172.21.15.179:0/2611006541 wait complete. 2024-04-25T00:49:35.309 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:35.306+0000 7fdf9f399180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T00:49:35.313 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 5b105720-6e6d-4143-b5c4-0a3b1e4a687c 3 2024-04-25T00:49:35.380 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:35.378+0000 7fdf9f399180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T00:49:35.435 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.431+0000 7f9e1b436640 1 Processor -- start 2024-04-25T00:49:35.435 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.431+0000 7f9e1b436640 1 -- start start 2024-04-25T00:49:35.436 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.435+0000 7f9e1b436640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e140c9950 0x7f9e140cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:35.436 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.435+0000 7f9e1b436640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9e14072840 0x7f9e1415aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:35.436 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.435+0000 7f9e1b436640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e1415dc90 con 0x7f9e14154730 2024-04-25T00:49:35.436 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.435+0000 7f9e1b436640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9e1415da40 con 0x7f9e14072840 2024-04-25T00:49:35.436 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.435+0000 7f9e1b436640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9e1415e8a0 con 0x7f9e140c9950 2024-04-25T00:49:35.436 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.435+0000 7f9e191d2640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9e14154730 0x7f9e140c9240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.179:41876/0 (socket says 172.21.15.179:41876) 2024-04-25T00:49:35.437 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.435+0000 7f9e189d1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e140c9950 0x7f9e140cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:35.437 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.435+0000 7f9e191d2640 1 -- 172.21.15.179:0/3908145760 learned_addr learned my addr 172.21.15.179:0/3908145760 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-04-25T00:49:35.440 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.439+0000 7f9e189d1640 1 -- 172.21.15.179:0/3908145760 >> v2:172.21.15.162:3300/0 conn(0x7f9e14072840 msgr2=0x7f9e1415aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:35.440 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.439+0000 7f9e189d1640 1 --2- 172.21.15.179:0/3908145760 >> v2:172.21.15.162:3300/0 conn(0x7f9e14072840 0x7f9e1415aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:35.440 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.439+0000 7f9e189d1640 1 -- 172.21.15.179:0/3908145760 >> v1:172.21.15.179:6789/0 conn(0x7f9e14154730 legacy=0x7f9e140c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:35.440 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.439+0000 7f9e189d1640 1 -- 172.21.15.179:0/3908145760 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e1415df70 con 0x7f9e140c9950 2024-04-25T00:49:35.443 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.439+0000 7f9e189d1640 1 --2- 172.21.15.179:0/3908145760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e140c9950 0x7f9e140cd190 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9e040097c0 tx=0x7f9e0401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e976ba7c3dc31d74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:35.447 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.443+0000 7f9e0bfff640 1 -- 172.21.15.179:0/3908145760 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e040b2070 con 0x7f9e140c9950 2024-04-25T00:49:35.447 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.443+0000 7f9e0bfff640 1 -- 172.21.15.179:0/3908145760 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e040ad640 con 0x7f9e140c9950 2024-04-25T00:49:35.447 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.443+0000 7f9e0bfff640 1 -- 172.21.15.179:0/3908145760 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e040ada10 con 0x7f9e140c9950 2024-04-25T00:49:35.448 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e1b436640 1 -- 172.21.15.179:0/3908145760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e140c9950 msgr2=0x7f9e140cd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:35.448 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e1b436640 1 --2- 172.21.15.179:0/3908145760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e140c9950 0x7f9e140cd190 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9e040097c0 tx=0x7f9e0401c4a0 comp rx=0 tx=0).stop 2024-04-25T00:49:35.448 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e1b436640 1 -- 172.21.15.179:0/3908145760 shutdown_connections 2024-04-25T00:49:35.448 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e1b436640 1 --2- 172.21.15.179:0/3908145760 >> v2:172.21.15.162:3300/0 conn(0x7f9e14072840 0x7f9e1415aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:35.448 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e1b436640 1 --2- 172.21.15.179:0/3908145760 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e140c9950 0x7f9e140cd190 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:35.449 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e1b436640 1 -- 172.21.15.179:0/3908145760 >> 172.21.15.179:0/3908145760 conn(0x7f9e14070370 msgr2=0x7f9e14070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:35.449 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e1b436640 1 -- 172.21.15.179:0/3908145760 shutdown_connections 2024-04-25T00:49:35.449 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e1b436640 1 -- 172.21.15.179:0/3908145760 wait complete. 2024-04-25T00:49:35.449 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e1b436640 1 Processor -- start 2024-04-25T00:49:35.449 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e1b436640 1 -- start start 2024-04-25T00:49:35.450 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e1b436640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e14072840 0x7f9e141f75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:35.450 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e1b436640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e140c9950 0x7f9e14162de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:35.450 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e1b436640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e14154730 0x7f9e141f3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:35.450 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e1b436640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9e14166f60 con 0x7f9e140c9950 2024-04-25T00:49:35.450 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e1b436640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9e14166de0 con 0x7f9e14154730 2024-04-25T00:49:35.450 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e1b436640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9e141670e0 con 0x7f9e14072840 2024-04-25T00:49:35.451 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e191d2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e14072840 0x7f9e141f75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:35.451 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e199d3640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e14154730 0x7f9e141f3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:35.451 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e191d2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e14072840 0x7f9e141f75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:41726/0 (socket says 172.21.15.179:41726) 2024-04-25T00:49:35.451 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.447+0000 7f9e191d2640 1 -- 172.21.15.179:0/2368006885 learned_addr learned my addr 172.21.15.179:0/2368006885 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-25T00:49:35.452 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:35.451+0000 7f6d5c45f180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T00:49:35.454 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.451+0000 7f9e191d2640 1 -- 172.21.15.179:0/2368006885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e14154730 msgr2=0x7f9e141f3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:35.454 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.451+0000 7f9e191d2640 1 --2- 172.21.15.179:0/2368006885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e14154730 0x7f9e141f3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:35.455 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.451+0000 7f9e191d2640 1 -- 172.21.15.179:0/2368006885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e140c9950 msgr2=0x7f9e14162de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:35.455 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.451+0000 7f9e191d2640 1 --2- 172.21.15.179:0/2368006885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e140c9950 0x7f9e14162de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:35.455 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.451+0000 7f9e191d2640 1 -- 172.21.15.179:0/2368006885 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e14159db0 con 0x7f9e14072840 2024-04-25T00:49:35.457 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.455+0000 7f9e191d2640 1 --2- 172.21.15.179:0/2368006885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e14072840 0x7f9e141f75c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00caa0 tx=0x7f9e0c00cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:35.462 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.459+0000 7f9e09ffb640 1 -- 172.21.15.179:0/2368006885 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c017070 con 0x7f9e14072840 2024-04-25T00:49:35.462 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.459+0000 7f9e09ffb640 1 -- 172.21.15.179:0/2368006885 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e0c00ac00 con 0x7f9e14072840 2024-04-25T00:49:35.462 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.459+0000 7f9e09ffb640 1 -- 172.21.15.179:0/2368006885 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c012400 con 0x7f9e14072840 2024-04-25T00:49:35.462 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.459+0000 7f9e1b436640 1 -- 172.21.15.179:0/2368006885 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e14159520 con 0x7f9e14072840 2024-04-25T00:49:35.462 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.459+0000 7f9e1b436640 1 -- 172.21.15.179:0/2368006885 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e14159ad0 con 0x7f9e14072840 2024-04-25T00:49:35.463 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.459+0000 7f9e1b436640 1 -- 172.21.15.179:0/2368006885 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e14075110 con 0x7f9e14072840 2024-04-25T00:49:35.465 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.463+0000 7f9e09ffb640 1 -- 172.21.15.179:0/2368006885 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9e0c01a070 con 0x7f9e14072840 2024-04-25T00:49:35.518 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:35.518+0000 7fdf9f399180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T00:49:35.641 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.639+0000 7f9e09ffb640 1 -- 172.21.15.179:0/2368006885 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f9e0c012a30 con 0x7f9e14072840 2024-04-25T00:49:35.641 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.639+0000 7f9e09ffb640 1 -- 172.21.15.179:0/2368006885 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f9e0c021020 con 0x7f9e14072840 2024-04-25T00:49:35.648 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:35.647+0000 7f6d5c45f180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T00:49:35.718 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:35.715+0000 7f6d5c45f180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T00:49:35.719 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.715+0000 7f9e1b436640 1 -- 172.21.15.179:0/2368006885 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5b105720-6e6d-4143-b5c4-0a3b1e4a687c", "id": 3} v 0) -- 0x7f9e140cc620 con 0x7f9e14072840 2024-04-25T00:49:35.866 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:35.863+0000 7f6d5c45f180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T00:49:35.928 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.923+0000 7f9e09ffb640 1 -- 172.21.15.179:0/2368006885 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5b105720-6e6d-4143-b5c4-0a3b1e4a687c", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f9e0c0125a0 con 0x7f9e14072840 2024-04-25T00:49:35.928 INFO:teuthology.orchestra.run.smithi179.stdout:3 2024-04-25T00:49:35.930 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.927+0000 7f9e1b436640 1 -- 172.21.15.179:0/2368006885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e14072840 msgr2=0x7f9e141f75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:35.930 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.927+0000 7f9e1b436640 1 --2- 172.21.15.179:0/2368006885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e14072840 0x7f9e141f75c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c00caa0 tx=0x7f9e0c00cf60 comp rx=0 tx=0).stop 2024-04-25T00:49:35.930 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.927+0000 7f9e1b436640 1 -- 172.21.15.179:0/2368006885 shutdown_connections 2024-04-25T00:49:35.931 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.927+0000 7f9e1b436640 1 --2- 172.21.15.179:0/2368006885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9e14154730 0x7f9e141f3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:35.931 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.927+0000 7f9e1b436640 1 --2- 172.21.15.179:0/2368006885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9e140c9950 0x7f9e14162de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:35.931 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.927+0000 7f9e1b436640 1 --2- 172.21.15.179:0/2368006885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9e14072840 0x7f9e141f75c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:35.931 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.927+0000 7f9e1b436640 1 -- 172.21.15.179:0/2368006885 >> 172.21.15.179:0/2368006885 conn(0x7f9e14070370 msgr2=0x7f9e14070750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:35.931 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.927+0000 7f9e1b436640 1 -- 172.21.15.179:0/2368006885 shutdown_connections 2024-04-25T00:49:35.931 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:35.927+0000 7f9e1b436640 1 -- 172.21.15.179:0/2368006885 wait complete. 2024-04-25T00:49:35.951 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 611eafc5-2fe0-4c96-ba8c-b1efc3930de1 4 2024-04-25T00:49:36.075 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.071+0000 7f244132d640 1 Processor -- start 2024-04-25T00:49:36.075 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.071+0000 7f244132d640 1 -- start start 2024-04-25T00:49:36.076 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.075+0000 7f244132d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f243c14da50 0x7f243c0c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:36.076 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.075+0000 7f244132d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f243c0c6c60 0x7f243c072f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:36.076 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.075+0000 7f244132d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f243c14de30 con 0x7f243c0c7ba0 2024-04-25T00:49:36.076 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.075+0000 7f244132d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f243c0c3f10 con 0x7f243c0c6c60 2024-04-25T00:49:36.076 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.075+0000 7f244132d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f243c0c41f0 con 0x7f243c14da50 2024-04-25T00:49:36.077 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.075+0000 7f243affd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f243c14da50 0x7f243c0c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:36.077 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.075+0000 7f243b7fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f243c0c7ba0 0x7f243c157430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.179:32932/0 (socket says 172.21.15.179:32932) 2024-04-25T00:49:36.077 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.075+0000 7f243b7fe640 1 -- 172.21.15.179:0/1487672488 learned_addr learned my addr 172.21.15.179:0/1487672488 (peer_addr_for_me v1:172.21.15.179:0/0) 2024-04-25T00:49:36.077 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.075+0000 7f2433fff640 1 --2- 172.21.15.179:0/1487672488 >> v2:172.21.15.162:3300/0 conn(0x7f243c0c6c60 0x7f243c072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:36.079 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.075+0000 7f243affd640 1 -- 172.21.15.179:0/1487672488 >> v2:172.21.15.162:3300/0 conn(0x7f243c0c6c60 msgr2=0x7f243c072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:36.080 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.075+0000 7f243affd640 1 --2- 172.21.15.179:0/1487672488 >> v2:172.21.15.162:3300/0 conn(0x7f243c0c6c60 0x7f243c072f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:36.080 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.075+0000 7f243affd640 1 -- 172.21.15.179:0/1487672488 >> v1:172.21.15.162:6789/0 conn(0x7f243c0c7ba0 legacy=0x7f243c157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:36.080 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.075+0000 7f243affd640 1 -- 172.21.15.179:0/1487672488 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243c0c44d0 con 0x7f243c14da50 2024-04-25T00:49:36.082 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.079+0000 7f243affd640 1 --2- 172.21.15.179:0/1487672488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243c14da50 0x7f243c0c7660 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f243c0729f0 tx=0x7f242c01c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f68a49b007c3ddb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:36.086 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.083+0000 7f243a7fc640 1 -- 172.21.15.179:0/1487672488 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c0b0070 con 0x7f243c14da50 2024-04-25T00:49:36.086 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.083+0000 7f243a7fc640 1 -- 172.21.15.179:0/1487672488 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f242c0ab600 con 0x7f243c14da50 2024-04-25T00:49:36.086 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.083+0000 7f243a7fc640 1 -- 172.21.15.179:0/1487672488 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242c0ab9d0 con 0x7f243c14da50 2024-04-25T00:49:36.087 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.083+0000 7f244132d640 1 -- 172.21.15.179:0/1487672488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243c14da50 msgr2=0x7f243c0c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:36.088 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.083+0000 7f244132d640 1 --2- 172.21.15.179:0/1487672488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243c14da50 0x7f243c0c7660 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f243c0729f0 tx=0x7f242c01c3f0 comp rx=0 tx=0).stop 2024-04-25T00:49:36.088 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.083+0000 7f244132d640 1 -- 172.21.15.179:0/1487672488 shutdown_connections 2024-04-25T00:49:36.088 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.083+0000 7f244132d640 1 --2- 172.21.15.179:0/1487672488 >> v2:172.21.15.162:3300/0 conn(0x7f243c0c6c60 0x7f243c072f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:36.088 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.083+0000 7f244132d640 1 --2- 172.21.15.179:0/1487672488 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243c14da50 0x7f243c0c7660 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:36.088 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.083+0000 7f244132d640 1 -- 172.21.15.179:0/1487672488 >> 172.21.15.179:0/1487672488 conn(0x7f243c070370 msgr2=0x7f243c070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:36.088 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.083+0000 7f244132d640 1 -- 172.21.15.179:0/1487672488 shutdown_connections 2024-04-25T00:49:36.088 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.083+0000 7f244132d640 1 -- 172.21.15.179:0/1487672488 wait complete. 2024-04-25T00:49:36.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.087+0000 7f244132d640 1 Processor -- start 2024-04-25T00:49:36.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.087+0000 7f244132d640 1 -- start start 2024-04-25T00:49:36.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.087+0000 7f244132d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f243c0c6c60 0x7f243c156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:36.089 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.087+0000 7f244132d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243c0c7ba0 0x7f243c143ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:36.090 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.087+0000 7f244132d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f243c14da50 0x7f243c1f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:36.090 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.087+0000 7f244132d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f243c164300 con 0x7f243c0c6c60 2024-04-25T00:49:36.090 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.087+0000 7f244132d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f243c164180 con 0x7f243c0c7ba0 2024-04-25T00:49:36.090 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.087+0000 7f244132d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f243c164480 con 0x7f243c14da50 2024-04-25T00:49:36.090 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.087+0000 7f2433fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243c0c7ba0 0x7f243c143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:36.091 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.087+0000 7f243b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f243c14da50 0x7f243c1f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:36.091 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.087+0000 7f2433fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243c0c7ba0 0x7f243c143ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:44966/0 (socket says 172.21.15.179:44966) 2024-04-25T00:49:36.091 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.087+0000 7f2433fff640 1 -- 172.21.15.179:0/1882221757 learned_addr learned my addr 172.21.15.179:0/1882221757 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-25T00:49:36.091 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.087+0000 7f243affd640 1 --2- 172.21.15.179:0/1882221757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f243c0c6c60 0x7f243c156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:36.094 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.091+0000 7f2433fff640 1 -- 172.21.15.179:0/1882221757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f243c14da50 msgr2=0x7f243c1f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:36.094 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.091+0000 7f2433fff640 1 --2- 172.21.15.179:0/1882221757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f243c14da50 0x7f243c1f4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:36.094 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.091+0000 7f2433fff640 1 -- 172.21.15.179:0/1882221757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f243c0c6c60 msgr2=0x7f243c156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:36.094 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.091+0000 7f2433fff640 1 --2- 172.21.15.179:0/1882221757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f243c0c6c60 0x7f243c156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:36.094 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.091+0000 7f2433fff640 1 -- 172.21.15.179:0/1882221757 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f243c1437f0 con 0x7f243c0c7ba0 2024-04-25T00:49:36.094 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.091+0000 7f243b7fe640 1 --2- 172.21.15.179:0/1882221757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f243c14da50 0x7f243c1f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T00:49:36.096 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.095+0000 7f2433fff640 1 --2- 172.21.15.179:0/1882221757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243c0c7ba0 0x7f243c143ee0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f242400d650 tx=0x7f242400db10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:36.099 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.095+0000 7f24337fe640 1 -- 172.21.15.179:0/1882221757 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242400b6c0 con 0x7f243c0c7ba0 2024-04-25T00:49:36.099 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.095+0000 7f244132d640 1 -- 172.21.15.179:0/1882221757 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f243c147430 con 0x7f243c0c7ba0 2024-04-25T00:49:36.099 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.095+0000 7f244132d640 1 -- 172.21.15.179:0/1882221757 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f243c1431a0 con 0x7f243c0c7ba0 2024-04-25T00:49:36.099 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.095+0000 7f244132d640 1 -- 172.21.15.179:0/1882221757 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f243c075110 con 0x7f243c0c7ba0 2024-04-25T00:49:36.100 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.099+0000 7f24337fe640 1 -- 172.21.15.179:0/1882221757 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2424019070 con 0x7f243c0c7ba0 2024-04-25T00:49:36.100 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.099+0000 7f24337fe640 1 -- 172.21.15.179:0/1882221757 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f242400ba60 con 0x7f243c0c7ba0 2024-04-25T00:49:36.158 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:36.158+0000 7fdf9f399180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T00:49:36.219 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.215+0000 7f24337fe640 1 -- 172.21.15.179:0/1882221757 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f242400bce0 con 0x7f243c0c7ba0 2024-04-25T00:49:36.219 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.215+0000 7f24337fe640 1 -- 172.21.15.179:0/1882221757 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f2424028940 con 0x7f243c0c7ba0 2024-04-25T00:49:36.219 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.215+0000 7f24337fe640 1 -- 172.21.15.179:0/1882221757 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f2424028c30 con 0x7f243c0c7ba0 2024-04-25T00:49:36.240 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:36.238+0000 7fdf9f399180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T00:49:36.288 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.283+0000 7f244132d640 1 -- 172.21.15.179:0/1882221757 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "611eafc5-2fe0-4c96-ba8c-b1efc3930de1", "id": 4} v 0) -- 0x7f243c1f4a50 con 0x7f243c0c7ba0 2024-04-25T00:49:36.442 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.439+0000 7f24337fe640 1 -- 172.21.15.179:0/1882221757 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "611eafc5-2fe0-4c96-ba8c-b1efc3930de1", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f2424028e10 con 0x7f243c0c7ba0 2024-04-25T00:49:36.442 INFO:teuthology.orchestra.run.smithi179.stdout:4 2024-04-25T00:49:36.443 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:36.442+0000 7fdf9f399180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T00:49:36.444 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.439+0000 7f244132d640 1 -- 172.21.15.179:0/1882221757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243c0c7ba0 msgr2=0x7f243c143ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:36.444 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.439+0000 7f244132d640 1 --2- 172.21.15.179:0/1882221757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243c0c7ba0 0x7f243c143ee0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f242400d650 tx=0x7f242400db10 comp rx=0 tx=0).stop 2024-04-25T00:49:36.444 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.439+0000 7f244132d640 1 -- 172.21.15.179:0/1882221757 shutdown_connections 2024-04-25T00:49:36.444 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.439+0000 7f244132d640 1 --2- 172.21.15.179:0/1882221757 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f243c14da50 0x7f243c1f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:36.444 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.439+0000 7f244132d640 1 --2- 172.21.15.179:0/1882221757 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f243c0c7ba0 0x7f243c143ee0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:36.444 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.439+0000 7f244132d640 1 --2- 172.21.15.179:0/1882221757 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f243c0c6c60 0x7f243c156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:36.445 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.439+0000 7f244132d640 1 -- 172.21.15.179:0/1882221757 >> 172.21.15.179:0/1882221757 conn(0x7f243c070370 msgr2=0x7f243c0c81a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:36.445 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.439+0000 7f244132d640 1 -- 172.21.15.179:0/1882221757 shutdown_connections 2024-04-25T00:49:36.445 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.443+0000 7f244132d640 1 -- 172.21.15.179:0/1882221757 wait complete. 2024-04-25T00:49:36.462 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new b39487f5-c314-4026-90bd-02e30ecca04f 5 2024-04-25T00:49:36.517 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:36.514+0000 7fdf9f399180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T00:49:36.526 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:36.523+0000 7f6d5c45f180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T00:49:36.580 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.579+0000 7fbdf608c640 1 Processor -- start 2024-04-25T00:49:36.580 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.579+0000 7fbdf608c640 1 -- start start 2024-04-25T00:49:36.581 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.579+0000 7fbdf608c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fbdf0070490 0x7fbdf006c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:36.581 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.579+0000 7fbdf608c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbdf0070870 0x7fbdf0157390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:36.581 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.579+0000 7fbdf608c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdf00c60e0 con 0x7fbdf00c47f0 2024-04-25T00:49:36.581 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.579+0000 7fbdf608c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fbdf00c63c0 con 0x7fbdf0070490 2024-04-25T00:49:36.581 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.579+0000 7fbdf608c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fbdf00c66a0 con 0x7fbdf0070870 2024-04-25T00:49:36.582 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.579+0000 7fbdeeffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbdf0070870 0x7fbdf0157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:36.582 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.579+0000 7fbdeeffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbdf0070870 0x7fbdf0157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:44974/0 (socket says 172.21.15.179:44974) 2024-04-25T00:49:36.582 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.579+0000 7fbdeeffd640 1 -- 172.21.15.179:0/229037457 learned_addr learned my addr 172.21.15.179:0/229037457 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-25T00:49:36.583 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.579+0000 7fbdef7fe640 1 --2- 172.21.15.179:0/229037457 >> v2:172.21.15.162:3300/0 conn(0x7fbdf0070490 0x7fbdf006c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:36.585 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.583+0000 7fbdeeffd640 1 -- 172.21.15.179:0/229037457 >> v2:172.21.15.162:3300/0 conn(0x7fbdf0070490 msgr2=0x7fbdf006c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:36.585 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.583+0000 7fbdeeffd640 1 --2- 172.21.15.179:0/229037457 >> v2:172.21.15.162:3300/0 conn(0x7fbdf0070490 0x7fbdf006c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:36.585 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.583+0000 7fbdeeffd640 1 -- 172.21.15.179:0/229037457 >> v1:172.21.15.162:6789/0 conn(0x7fbdf00c47f0 legacy=0x7fbdf014d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:36.585 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.583+0000 7fbdeeffd640 1 -- 172.21.15.179:0/229037457 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf00c6980 con 0x7fbdf0070870 2024-04-25T00:49:36.589 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.587+0000 7fbdeeffd640 1 --2- 172.21.15.179:0/229037457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdf0070870 0x7fbdf0157390 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00c30e0 tx=0x7fbde401c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=249c3fc609cd6a16 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:36.594 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.591+0000 7fbdee7fc640 1 -- 172.21.15.179:0/229037457 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde40b0070 con 0x7fbdf0070870 2024-04-25T00:49:36.594 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.591+0000 7fbdee7fc640 1 -- 172.21.15.179:0/229037457 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde40ab600 con 0x7fbdf0070870 2024-04-25T00:49:36.595 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.591+0000 7fbdee7fc640 1 -- 172.21.15.179:0/229037457 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde40ab9d0 con 0x7fbdf0070870 2024-04-25T00:49:36.595 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.591+0000 7fbdf608c640 1 -- 172.21.15.179:0/229037457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdf0070870 msgr2=0x7fbdf0157390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:36.596 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.591+0000 7fbdf608c640 1 --2- 172.21.15.179:0/229037457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdf0070870 0x7fbdf0157390 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00c30e0 tx=0x7fbde401c520 comp rx=0 tx=0).stop 2024-04-25T00:49:36.596 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.591+0000 7fbdf608c640 1 -- 172.21.15.179:0/229037457 shutdown_connections 2024-04-25T00:49:36.596 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.591+0000 7fbdf608c640 1 --2- 172.21.15.179:0/229037457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdf0070870 0x7fbdf0157390 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:36.596 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.591+0000 7fbdf608c640 1 --2- 172.21.15.179:0/229037457 >> v2:172.21.15.162:3300/0 conn(0x7fbdf0070490 0x7fbdf006c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:36.596 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.591+0000 7fbdf608c640 1 -- 172.21.15.179:0/229037457 >> 172.21.15.179:0/229037457 conn(0x7fbdf00cc940 msgr2=0x7fbdf00ccd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:36.596 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.591+0000 7fbdf608c640 1 -- 172.21.15.179:0/229037457 shutdown_connections 2024-04-25T00:49:36.596 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.591+0000 7fbdf608c640 1 -- 172.21.15.179:0/229037457 wait complete. 2024-04-25T00:49:36.597 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.595+0000 7fbdf608c640 1 Processor -- start 2024-04-25T00:49:36.597 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.595+0000 7fbdf608c640 1 -- start start 2024-04-25T00:49:36.598 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.595+0000 7fbdf608c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdf0070490 0x7fbdf015fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:36.598 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.595+0000 7fbdf608c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbdf0070870 0x7fbdf015ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:36.598 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.595+0000 7fbdf608c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdf00c47f0 0x7fbdf0135200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:36.598 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.595+0000 7fbdf608c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf006c990 con 0x7fbdf0070870 2024-04-25T00:49:36.598 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.595+0000 7fbdf608c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbdf006c810 con 0x7fbdf00c47f0 2024-04-25T00:49:36.598 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.595+0000 7fbdf608c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbdf01620f0 con 0x7fbdf0070490 2024-04-25T00:49:36.599 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.595+0000 7fbdef7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdf0070490 0x7fbdf015fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:36.599 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.595+0000 7fbdeffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdf00c47f0 0x7fbdf0135200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:36.599 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.595+0000 7fbdeffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdf00c47f0 0x7fbdf0135200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:44988/0 (socket says 172.21.15.179:44988) 2024-04-25T00:49:36.599 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.595+0000 7fbdeffff640 1 -- 172.21.15.179:0/3727195706 learned_addr learned my addr 172.21.15.179:0/3727195706 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-25T00:49:36.599 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.595+0000 7fbdeeffd640 1 --2- 172.21.15.179:0/3727195706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbdf0070870 0x7fbdf015ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:36.602 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.599+0000 7fbdeffff640 1 -- 172.21.15.179:0/3727195706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdf0070490 msgr2=0x7fbdf015fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:36.602 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.599+0000 7fbdeffff640 1 --2- 172.21.15.179:0/3727195706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdf0070490 0x7fbdf015fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:36.602 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.599+0000 7fbdeffff640 1 -- 172.21.15.179:0/3727195706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbdf0070870 msgr2=0x7fbdf015ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:36.602 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.599+0000 7fbdeffff640 1 --2- 172.21.15.179:0/3727195706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbdf0070870 0x7fbdf015ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:36.603 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.599+0000 7fbdeffff640 1 -- 172.21.15.179:0/3727195706 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdf00c8b30 con 0x7fbdf00c47f0 2024-04-25T00:49:36.604 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.603+0000 7fbdeffff640 1 --2- 172.21.15.179:0/3727195706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdf00c47f0 0x7fbdf0135200 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbde800c730 tx=0x7fbde800cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:36.608 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:36.607+0000 7f6d5c45f180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T00:49:36.608 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.607+0000 7fbdd7fff640 1 -- 172.21.15.179:0/3727195706 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde8003b80 con 0x7fbdf00c47f0 2024-04-25T00:49:36.608 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.607+0000 7fbdd7fff640 1 -- 172.21.15.179:0/3727195706 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbde8003d20 con 0x7fbdf00c47f0 2024-04-25T00:49:36.609 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.607+0000 7fbdd7fff640 1 -- 172.21.15.179:0/3727195706 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbde800aa30 con 0x7fbdf00c47f0 2024-04-25T00:49:36.609 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.607+0000 7fbdf608c640 1 -- 172.21.15.179:0/3727195706 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdf00c33b0 con 0x7fbdf00c47f0 2024-04-25T00:49:36.609 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.607+0000 7fbdf608c640 1 -- 172.21.15.179:0/3727195706 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdf00c7100 con 0x7fbdf00c47f0 2024-04-25T00:49:36.610 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.607+0000 7fbdf608c640 1 -- 172.21.15.179:0/3727195706 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdf0068310 con 0x7fbdf00c47f0 2024-04-25T00:49:36.725 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.723+0000 7fbdd7fff640 1 -- 172.21.15.179:0/3727195706 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbde800abd0 con 0x7fbdf00c47f0 2024-04-25T00:49:36.725 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.723+0000 7fbdd7fff640 1 -- 172.21.15.179:0/3727195706 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fbde8025ad0 con 0x7fbdf00c47f0 2024-04-25T00:49:36.725 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.723+0000 7fbdd7fff640 1 -- 172.21.15.179:0/3727195706 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fbde8025d10 con 0x7fbdf00c47f0 2024-04-25T00:49:36.791 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:36.787+0000 7f6d5c45f180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T00:49:36.801 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.799+0000 7fbdf608c640 1 -- 172.21.15.179:0/3727195706 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b39487f5-c314-4026-90bd-02e30ecca04f", "id": 5} v 0) -- 0x7fbdf01616c0 con 0x7fbdf00c47f0 2024-04-25T00:49:36.807 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:36.806+0000 7fdf9f399180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T00:49:36.867 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:36.863+0000 7f6d5c45f180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T00:49:36.870 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:36.870+0000 7fdf9f399180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T00:49:36.983 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.979+0000 7fbdd7fff640 1 -- 172.21.15.179:0/3727195706 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b39487f5-c314-4026-90bd-02e30ecca04f", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fbde8025510 con 0x7fbdf00c47f0 2024-04-25T00:49:36.983 INFO:teuthology.orchestra.run.smithi179.stdout:5 2024-04-25T00:49:36.985 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.983+0000 7fbdf608c640 1 -- 172.21.15.179:0/3727195706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdf00c47f0 msgr2=0x7fbdf0135200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:36.985 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.983+0000 7fbdf608c640 1 --2- 172.21.15.179:0/3727195706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdf00c47f0 0x7fbdf0135200 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fbde800c730 tx=0x7fbde800cbf0 comp rx=0 tx=0).stop 2024-04-25T00:49:36.985 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.983+0000 7fbdf608c640 1 -- 172.21.15.179:0/3727195706 shutdown_connections 2024-04-25T00:49:36.985 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.983+0000 7fbdf608c640 1 --2- 172.21.15.179:0/3727195706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbdf00c47f0 0x7fbdf0135200 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:36.985 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.983+0000 7fbdf608c640 1 --2- 172.21.15.179:0/3727195706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbdf0070870 0x7fbdf015ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:36.985 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.983+0000 7fbdf608c640 1 --2- 172.21.15.179:0/3727195706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbdf0070490 0x7fbdf015fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:36.985 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.983+0000 7fbdf608c640 1 -- 172.21.15.179:0/3727195706 >> 172.21.15.179:0/3727195706 conn(0x7fbdf00cc940 msgr2=0x7fbdf013b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:36.985 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.983+0000 7fbdf608c640 1 -- 172.21.15.179:0/3727195706 shutdown_connections 2024-04-25T00:49:36.985 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:36.983+0000 7fbdf608c640 1 -- 172.21.15.179:0/3727195706 wait complete. 2024-04-25T00:49:37.003 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new 1d902755-f992-4070-b30e-e79f5fb22d7f 6 2024-04-25T00:49:37.119 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.115+0000 7f2a02527640 1 Processor -- start 2024-04-25T00:49:37.119 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.115+0000 7f2a02527640 1 -- start start 2024-04-25T00:49:37.120 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.115+0000 7f2a02527640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29fc06b920 0x7f29fc06e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:37.120 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.115+0000 7f2a02527640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f29fc15d8e0 0x7f29fc15dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:37.120 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.115+0000 7f2a02527640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29fc06e230 con 0x7f29fc154830 2024-04-25T00:49:37.120 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.119+0000 7f2a02527640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f29fc06ebb0 con 0x7f29fc15d8e0 2024-04-25T00:49:37.120 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.119+0000 7f2a02527640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f29fc0c84f0 con 0x7f29fc06b920 2024-04-25T00:49:37.121 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.119+0000 7f29fb7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29fc06b920 0x7f29fc06e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:37.121 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.119+0000 7f29fb7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29fc06b920 0x7f29fc06e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.179:41752/0 (socket says 172.21.15.179:41752) 2024-04-25T00:49:37.121 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.119+0000 7f29fb7fe640 1 -- 172.21.15.179:0/1215030222 learned_addr learned my addr 172.21.15.179:0/1215030222 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-25T00:49:37.123 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.119+0000 7f29fb7fe640 1 -- 172.21.15.179:0/1215030222 >> v2:172.21.15.162:3300/0 conn(0x7f29fc15d8e0 msgr2=0x7f29fc15dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:37.123 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.119+0000 7f29fb7fe640 1 --2- 172.21.15.179:0/1215030222 >> v2:172.21.15.162:3300/0 conn(0x7f29fc15d8e0 0x7f29fc15dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:37.123 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.119+0000 7f29fb7fe640 1 -- 172.21.15.179:0/1215030222 >> v1:172.21.15.162:6789/0 conn(0x7f29fc154830 legacy=0x7f29fc06b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:37.123 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.119+0000 7f29fb7fe640 1 -- 172.21.15.179:0/1215030222 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29fc06df50 con 0x7f29fc06b920 2024-04-25T00:49:37.127 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.123+0000 7f29fb7fe640 1 --2- 172.21.15.179:0/1215030222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29fc06b920 0x7f29fc06e670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009870 tx=0x7f29f001c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32e041fc7697fff9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:37.132 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f29faffd640 1 -- 172.21.15.179:0/1215030222 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f00ab5f0 con 0x7f29fc06b920 2024-04-25T00:49:37.132 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f29faffd640 1 -- 172.21.15.179:0/1215030222 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f00b0070 con 0x7f29fc06b920 2024-04-25T00:49:37.132 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f29faffd640 1 -- 172.21.15.179:0/1215030222 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f00ab9b0 con 0x7f29fc06b920 2024-04-25T00:49:37.133 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f2a02527640 1 -- 172.21.15.179:0/1215030222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29fc06b920 msgr2=0x7f29fc06e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:37.133 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f2a02527640 1 --2- 172.21.15.179:0/1215030222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29fc06b920 0x7f29fc06e670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f29f0009870 tx=0x7f29f001c520 comp rx=0 tx=0).stop 2024-04-25T00:49:37.133 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f2a02527640 1 -- 172.21.15.179:0/1215030222 shutdown_connections 2024-04-25T00:49:37.133 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f2a02527640 1 --2- 172.21.15.179:0/1215030222 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29fc06b920 0x7f29fc06e670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:37.133 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f2a02527640 1 --2- 172.21.15.179:0/1215030222 >> v2:172.21.15.162:3300/0 conn(0x7f29fc15d8e0 0x7f29fc15dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:37.133 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f2a02527640 1 -- 172.21.15.179:0/1215030222 >> 172.21.15.179:0/1215030222 conn(0x7f29fc070290 msgr2=0x7f29fc0c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:37.133 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f2a02527640 1 -- 172.21.15.179:0/1215030222 shutdown_connections 2024-04-25T00:49:37.134 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f2a02527640 1 -- 172.21.15.179:0/1215030222 wait complete. 2024-04-25T00:49:37.134 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f2a02527640 1 Processor -- start 2024-04-25T00:49:37.134 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f2a02527640 1 -- start start 2024-04-25T00:49:37.135 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f2a02527640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29fc06b920 0x7f29fc15caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:37.135 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f2a02527640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29fc154830 0x7f29fc1f38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:37.135 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f2a02527640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29fc15d8e0 0x7f29fc147d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:37.135 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f2a02527640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f29fc06dd00 con 0x7f29fc06b920 2024-04-25T00:49:37.135 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f2a02527640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f29fc06db80 con 0x7f29fc15d8e0 2024-04-25T00:49:37.135 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.131+0000 7f2a02527640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f29fc1674e0 con 0x7f29fc154830 2024-04-25T00:49:37.136 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.135+0000 7f2a00ac4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29fc15d8e0 0x7f29fc147d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:37.136 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.135+0000 7f29fb7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29fc154830 0x7f29fc1f38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:37.136 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.135+0000 7f2a00ac4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29fc15d8e0 0x7f29fc147d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:44996/0 (socket says 172.21.15.179:44996) 2024-04-25T00:49:37.136 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.135+0000 7f2a00ac4640 1 -- 172.21.15.179:0/2274945848 learned_addr learned my addr 172.21.15.179:0/2274945848 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-25T00:49:37.140 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.135+0000 7f29fb7fe640 1 -- 172.21.15.179:0/2274945848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29fc15d8e0 msgr2=0x7f29fc147d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:37.140 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.135+0000 7f29fb7fe640 1 --2- 172.21.15.179:0/2274945848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29fc15d8e0 0x7f29fc147d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:37.140 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.139+0000 7f29fb7fe640 1 -- 172.21.15.179:0/2274945848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29fc06b920 msgr2=0x7f29fc15caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:37.140 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.139+0000 7f29fb7fe640 1 --2- 172.21.15.179:0/2274945848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29fc06b920 0x7f29fc15caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:37.140 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.139+0000 7f29fb7fe640 1 -- 172.21.15.179:0/2274945848 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29fc149a70 con 0x7f29fc154830 2024-04-25T00:49:37.142 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.139+0000 7f29fb7fe640 1 --2- 172.21.15.179:0/2274945848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29fc154830 0x7f29fc1f38b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0c66d0 tx=0x7f29f001ad60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:37.144 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.143+0000 7f29f8ff9640 1 -- 172.21.15.179:0/2274945848 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f00be640 con 0x7f29fc154830 2024-04-25T00:49:37.144 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.143+0000 7f2a02527640 1 -- 172.21.15.179:0/2274945848 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29fc0cc7f0 con 0x7f29fc154830 2024-04-25T00:49:37.145 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.143+0000 7f2a02527640 1 -- 172.21.15.179:0/2274945848 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f29fc0ccdb0 con 0x7f29fc154830 2024-04-25T00:49:37.145 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.143+0000 7f2a02527640 1 -- 172.21.15.179:0/2274945848 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29fc075110 con 0x7f29fc154830 2024-04-25T00:49:37.145 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.143+0000 7f29f8ff9640 1 -- 172.21.15.179:0/2274945848 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29f00b0070 con 0x7f29fc154830 2024-04-25T00:49:37.146 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.143+0000 7f29f8ff9640 1 -- 172.21.15.179:0/2274945848 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29f00c3060 con 0x7f29fc154830 2024-04-25T00:49:37.203 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:37.199+0000 7f6d5c45f180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T00:49:37.263 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.259+0000 7f29f8ff9640 1 -- 172.21.15.179:0/2274945848 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f29f00c8430 con 0x7f29fc154830 2024-04-25T00:49:37.263 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.259+0000 7f29f8ff9640 1 -- 172.21.15.179:0/2274945848 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f29f00b49e0 con 0x7f29fc154830 2024-04-25T00:49:37.263 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.259+0000 7f29f8ff9640 1 -- 172.21.15.179:0/2274945848 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f29f0016110 con 0x7f29fc154830 2024-04-25T00:49:37.265 INFO:tasks.ceph.mgr.x.smithi179.stderr:2024-04-25T00:49:37.263+0000 7f6d5c45f180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T00:49:37.361 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.359+0000 7f2a02527640 1 -- 172.21.15.179:0/2274945848 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1d902755-f992-4070-b30e-e79f5fb22d7f", "id": 6} v 0) -- 0x7f29fc157d60 con 0x7f29fc154830 2024-04-25T00:49:37.881 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:37.879+0000 7f29f8ff9640 1 -- 172.21.15.179:0/2274945848 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mgrmap(e 2) ==== 43764+0+0 (secure 0 0 0) 0x7f29f00b4cb0 con 0x7f29fc154830 2024-04-25T00:49:38.560 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.559+0000 7f29f8ff9640 1 -- 172.21.15.179:0/2274945848 <== mon.2 v2:172.21.15.179:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1d902755-f992-4070-b30e-e79f5fb22d7f", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f29f00c4a80 con 0x7f29fc154830 2024-04-25T00:49:38.561 INFO:teuthology.orchestra.run.smithi179.stdout:6 2024-04-25T00:49:38.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.559+0000 7f2a02527640 1 -- 172.21.15.179:0/2274945848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29fc154830 msgr2=0x7f29fc1f38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:38.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.559+0000 7f2a02527640 1 --2- 172.21.15.179:0/2274945848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29fc154830 0x7f29fc1f38b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0c66d0 tx=0x7f29f001ad60 comp rx=0 tx=0).stop 2024-04-25T00:49:38.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.559+0000 7f2a02527640 1 -- 172.21.15.179:0/2274945848 shutdown_connections 2024-04-25T00:49:38.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.559+0000 7f2a02527640 1 --2- 172.21.15.179:0/2274945848 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f29fc15d8e0 0x7f29fc147d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:38.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.559+0000 7f2a02527640 1 --2- 172.21.15.179:0/2274945848 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f29fc154830 0x7f29fc1f38b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:38.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.559+0000 7f2a02527640 1 --2- 172.21.15.179:0/2274945848 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f29fc06b920 0x7f29fc15caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:38.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.559+0000 7f2a02527640 1 -- 172.21.15.179:0/2274945848 >> 172.21.15.179:0/2274945848 conn(0x7f29fc070290 msgr2=0x7f29fc0c5630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:38.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.559+0000 7f2a02527640 1 -- 172.21.15.179:0/2274945848 shutdown_connections 2024-04-25T00:49:38.562 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.559+0000 7f2a02527640 1 -- 172.21.15.179:0/2274945848 wait complete. 2024-04-25T00:49:38.581 DEBUG:teuthology.orchestra.run.smithi179:> sudo ceph --cluster ceph osd new ea529f85-28fd-4dc3-a584-314e71999061 7 2024-04-25T00:49:38.706 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.703+0000 7fdef0cc9640 1 Processor -- start 2024-04-25T00:49:38.706 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.703+0000 7fdef0cc9640 1 -- start start 2024-04-25T00:49:38.707 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.703+0000 7fdef0cc9640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdeec1526a0 0x7fdeec1581f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:38.707 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.703+0000 7fdef0cc9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdeec06b210 0x7fdeec0c6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:38.707 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.703+0000 7fdef0cc9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdeec159140 con 0x7fdeec1522c0 2024-04-25T00:49:38.707 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.703+0000 7fdef0cc9640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fdeec15c790 con 0x7fdeec1526a0 2024-04-25T00:49:38.707 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.703+0000 7fdef0cc9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fdeec1588a0 con 0x7fdeec06b210 2024-04-25T00:49:38.708 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.703+0000 7fdeead9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdeec06b210 0x7fdeec0c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:38.708 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.707+0000 7fdeead9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdeec06b210 0x7fdeec0c6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:45010/0 (socket says 172.21.15.179:45010) 2024-04-25T00:49:38.708 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.707+0000 7fdeead9d640 1 -- 172.21.15.179:0/703554896 learned_addr learned my addr 172.21.15.179:0/703554896 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-25T00:49:38.710 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.707+0000 7fdeead9d640 1 -- 172.21.15.179:0/703554896 >> v2:172.21.15.162:3300/0 conn(0x7fdeec1526a0 msgr2=0x7fdeec1581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:38.711 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.707+0000 7fdeead9d640 1 --2- 172.21.15.179:0/703554896 >> v2:172.21.15.162:3300/0 conn(0x7fdeec1526a0 0x7fdeec1581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:38.711 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.707+0000 7fdeead9d640 1 -- 172.21.15.179:0/703554896 >> v1:172.21.15.179:6789/0 conn(0x7fdeec1522c0 legacy=0x7fdeec15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:38.711 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.707+0000 7fdeead9d640 1 -- 172.21.15.179:0/703554896 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeec158b80 con 0x7fdeec06b210 2024-04-25T00:49:38.714 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.711+0000 7fdeead9d640 1 --2- 172.21.15.179:0/703554896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdeec06b210 0x7fdeec0c6330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdeec06f360 tx=0x7fdee401f1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=584f651c27b230ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:38.719 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.715+0000 7fdee959a640 1 -- 172.21.15.179:0/703554896 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee40b4070 con 0x7fdeec06b210 2024-04-25T00:49:38.719 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.715+0000 7fdee959a640 1 -- 172.21.15.179:0/703554896 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee40af400 con 0x7fdeec06b210 2024-04-25T00:49:38.719 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.715+0000 7fdee959a640 1 -- 172.21.15.179:0/703554896 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee40af7d0 con 0x7fdeec06b210 2024-04-25T00:49:38.720 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdef0cc9640 1 -- 172.21.15.179:0/703554896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdeec06b210 msgr2=0x7fdeec0c6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:38.720 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdef0cc9640 1 --2- 172.21.15.179:0/703554896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdeec06b210 0x7fdeec0c6330 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdeec06f360 tx=0x7fdee401f1a0 comp rx=0 tx=0).stop 2024-04-25T00:49:38.720 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdef0cc9640 1 -- 172.21.15.179:0/703554896 shutdown_connections 2024-04-25T00:49:38.720 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdef0cc9640 1 --2- 172.21.15.179:0/703554896 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdeec06b210 0x7fdeec0c6330 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:38.720 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdef0cc9640 1 --2- 172.21.15.179:0/703554896 >> v2:172.21.15.162:3300/0 conn(0x7fdeec1526a0 0x7fdeec1581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:38.720 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdef0cc9640 1 -- 172.21.15.179:0/703554896 >> 172.21.15.179:0/703554896 conn(0x7fdeec070280 msgr2=0x7fdeec070690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:38.720 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdef0cc9640 1 -- 172.21.15.179:0/703554896 shutdown_connections 2024-04-25T00:49:38.721 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdef0cc9640 1 -- 172.21.15.179:0/703554896 wait complete. 2024-04-25T00:49:38.721 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdef0cc9640 1 Processor -- start 2024-04-25T00:49:38.721 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdef0cc9640 1 -- start start 2024-04-25T00:49:38.722 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdef0cc9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdeec06b210 0x7fdeec0cd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:38.722 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdef0cc9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdeec1522c0 0x7fdeec150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:38.722 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdef0cc9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdeec1526a0 0x7fdeec0caeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:38.722 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdef0cc9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec15bb60 con 0x7fdeec1526a0 2024-04-25T00:49:38.722 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdef0cc9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec15b880 con 0x7fdeec06b210 2024-04-25T00:49:38.722 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdef0cc9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdeec0c7620 con 0x7fdeec1522c0 2024-04-25T00:49:38.723 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdeea59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdeec06b210 0x7fdeec0cd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:38.723 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdee9d9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdeec1522c0 0x7fdeec150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:38.723 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdeea59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdeec06b210 0x7fdeec0cd4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.179:45014/0 (socket says 172.21.15.179:45014) 2024-04-25T00:49:38.723 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.719+0000 7fdeea59c640 1 -- 172.21.15.179:0/1687653732 learned_addr learned my addr 172.21.15.179:0/1687653732 (peer_addr_for_me v2:172.21.15.179:0/0) 2024-04-25T00:49:38.726 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.723+0000 7fdeea59c640 1 -- 172.21.15.179:0/1687653732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdeec1522c0 msgr2=0x7fdeec150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:38.726 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.723+0000 7fdeea59c640 1 --2- 172.21.15.179:0/1687653732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdeec1522c0 0x7fdeec150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:38.726 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.723+0000 7fdeea59c640 1 -- 172.21.15.179:0/1687653732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdeec1526a0 msgr2=0x7fdeec0caeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:38.726 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.723+0000 7fdeea59c640 1 --2- 172.21.15.179:0/1687653732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdeec1526a0 0x7fdeec0caeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:38.727 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.723+0000 7fdeea59c640 1 -- 172.21.15.179:0/1687653732 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeec0ca410 con 0x7fdeec06b210 2024-04-25T00:49:38.729 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.727+0000 7fdeea59c640 1 --2- 172.21.15.179:0/1687653732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdeec06b210 0x7fdeec0cd4b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00c490 tx=0x7fdedc001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:38.732 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.731+0000 7fdedaffd640 1 -- 172.21.15.179:0/1687653732 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc017070 con 0x7fdeec06b210 2024-04-25T00:49:38.732 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.731+0000 7fdef0cc9640 1 -- 172.21.15.179:0/1687653732 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeec1ee060 con 0x7fdeec06b210 2024-04-25T00:49:38.732 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.731+0000 7fdef0cc9640 1 -- 172.21.15.179:0/1687653732 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeec1ee620 con 0x7fdeec06b210 2024-04-25T00:49:38.733 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.731+0000 7fdef0cc9640 1 -- 172.21.15.179:0/1687653732 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeec075110 con 0x7fdeec06b210 2024-04-25T00:49:38.734 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.731+0000 7fdedaffd640 1 -- 172.21.15.179:0/1687653732 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdedc007030 con 0x7fdeec06b210 2024-04-25T00:49:38.734 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.731+0000 7fdedaffd640 1 -- 172.21.15.179:0/1687653732 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc021060 con 0x7fdeec06b210 2024-04-25T00:49:38.879 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.875+0000 7fdedaffd640 1 -- 172.21.15.179:0/1687653732 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 2) ==== 43764+0+0 (secure 0 0 0) 0x7fdedc01a070 con 0x7fdeec06b210 2024-04-25T00:49:38.889 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.887+0000 7fdedaffd640 1 -- 172.21.15.179:0/1687653732 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fdedc01b570 con 0x7fdeec06b210 2024-04-25T00:49:38.889 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.887+0000 7fdedaffd640 1 -- 172.21.15.179:0/1687653732 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fdedc0075e0 con 0x7fdeec06b210 2024-04-25T00:49:38.967 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:38.963+0000 7fdef0cc9640 1 -- 172.21.15.179:0/1687653732 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ea529f85-28fd-4dc3-a584-314e71999061", "id": 7} v 0) -- 0x7fdeec0b7f30 con 0x7fdeec06b210 2024-04-25T00:49:39.519 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:39.515+0000 7fdedaffd640 1 -- 172.21.15.179:0/1687653732 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mgrmap(e 3) ==== 87283+0+0 (secure 0 0 0) 0x7fdedc006cc0 con 0x7fdeec06b210 2024-04-25T00:49:39.520 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:39.519+0000 7fdedaffd640 1 --2- 172.21.15.179:0/1687653732 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdecc0679d0 0x7fdecc069dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:39.521 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:39.519+0000 7fdee9d9b640 1 --2- 172.21.15.179:0/1687653732 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdecc0679d0 0x7fdecc069dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:39.522 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:39.519+0000 7fdee9d9b640 1 --2- 172.21.15.179:0/1687653732 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdecc0679d0 0x7fdecc069dc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdeec158790 tx=0x7fdee0006f90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:39.653 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:39.654+0000 7fdf467e1640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T00:49:39.972 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T00:49:39.970+0000 7fdf467e1640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T00:49:40.165 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:40.163+0000 7fdedaffd640 1 -- 172.21.15.179:0/1687653732 <== mon.1 v2:172.21.15.179:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ea529f85-28fd-4dc3-a584-314e71999061", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fdedc00d150 con 0x7fdeec06b210 2024-04-25T00:49:40.165 INFO:teuthology.orchestra.run.smithi179.stdout:7 2024-04-25T00:49:40.167 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:40.163+0000 7fdef0cc9640 1 -- 172.21.15.179:0/1687653732 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdecc0679d0 msgr2=0x7fdecc069dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:40.167 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:40.163+0000 7fdef0cc9640 1 --2- 172.21.15.179:0/1687653732 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdecc0679d0 0x7fdecc069dc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdeec158790 tx=0x7fdee0006f90 comp rx=0 tx=0).stop 2024-04-25T00:49:40.167 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:40.163+0000 7fdef0cc9640 1 -- 172.21.15.179:0/1687653732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdeec06b210 msgr2=0x7fdeec0cd4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:40.167 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:40.163+0000 7fdef0cc9640 1 --2- 172.21.15.179:0/1687653732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdeec06b210 0x7fdeec0cd4b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00c490 tx=0x7fdedc001e80 comp rx=0 tx=0).stop 2024-04-25T00:49:40.167 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:40.163+0000 7fdef0cc9640 1 -- 172.21.15.179:0/1687653732 shutdown_connections 2024-04-25T00:49:40.167 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:40.163+0000 7fdef0cc9640 1 --2- 172.21.15.179:0/1687653732 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdecc0679d0 0x7fdecc069dc0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:40.167 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:40.163+0000 7fdef0cc9640 1 --2- 172.21.15.179:0/1687653732 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdeec1526a0 0x7fdeec0caeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:40.167 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:40.163+0000 7fdef0cc9640 1 --2- 172.21.15.179:0/1687653732 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdeec1522c0 0x7fdeec150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:40.167 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:40.163+0000 7fdef0cc9640 1 --2- 172.21.15.179:0/1687653732 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdeec06b210 0x7fdeec0cd4b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:40.168 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:40.163+0000 7fdef0cc9640 1 -- 172.21.15.179:0/1687653732 >> 172.21.15.179:0/1687653732 conn(0x7fdeec070280 msgr2=0x7fdeec0c7890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:40.168 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:40.163+0000 7fdef0cc9640 1 -- 172.21.15.179:0/1687653732 shutdown_connections 2024-04-25T00:49:40.168 INFO:teuthology.orchestra.run.smithi179.stderr:2024-04-25T00:49:40.163+0000 7fdef0cc9640 1 -- 172.21.15.179:0/1687653732 wait complete. 2024-04-25T00:49:40.188 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T00:49:40.188 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 0 2024-04-25T00:49:40.191 INFO:tasks.ceph.osd.0:Started 2024-04-25T00:49:40.191 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T00:49:40.191 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 1 2024-04-25T00:49:40.193 INFO:tasks.ceph.osd.1:Started 2024-04-25T00:49:40.193 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T00:49:40.193 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 2 2024-04-25T00:49:40.196 INFO:tasks.ceph.osd.2:Started 2024-04-25T00:49:40.196 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T00:49:40.196 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 3 2024-04-25T00:49:40.198 INFO:tasks.ceph.osd.3:Started 2024-04-25T00:49:40.198 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T00:49:40.199 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 4 2024-04-25T00:49:40.201 INFO:tasks.ceph.osd.4:Started 2024-04-25T00:49:40.201 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T00:49:40.201 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 5 2024-04-25T00:49:40.203 INFO:tasks.ceph.osd.5:Started 2024-04-25T00:49:40.203 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T00:49:40.203 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 6 2024-04-25T00:49:40.205 INFO:tasks.ceph.osd.6:Started 2024-04-25T00:49:40.205 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T00:49:40.205 DEBUG:teuthology.orchestra.run.smithi179:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-osd -f --cluster ceph -i 7 2024-04-25T00:49:40.207 INFO:tasks.ceph.osd.7:Started 2024-04-25T00:49:40.208 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T00:49:40.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.338+0000 7fc642a88640 1 Processor -- start 2024-04-25T00:49:40.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.338+0000 7fc642a88640 1 -- start start 2024-04-25T00:49:40.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.338+0000 7fc642a88640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc63c152370 0x7fc63c0c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:40.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.338+0000 7fc642a88640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc63c0c3570 0x7fc63c0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:40.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.338+0000 7fc642a88640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc63c152750 con 0x7fc63c070840 2024-04-25T00:49:40.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.338+0000 7fc642a88640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc63c0c3a40 con 0x7fc63c152370 2024-04-25T00:49:40.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.338+0000 7fc642a88640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fc63c06f5b0 con 0x7fc63c0c3570 2024-04-25T00:49:40.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.338+0000 7fc63bfff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc63c0c3570 0x7fc63c0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:40.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.338+0000 7fc63bfff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc63c0c3570 0x7fc63c0c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:45292/0 (socket says 172.21.15.162:45292) 2024-04-25T00:49:40.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.338+0000 7fc63bfff640 1 -- 172.21.15.162:0/3623220410 learned_addr learned my addr 172.21.15.162:0/3623220410 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:49:40.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.342+0000 7fc63bfff640 1 -- 172.21.15.162:0/3623220410 >> v2:172.21.15.162:3300/0 conn(0x7fc63c152370 msgr2=0x7fc63c0c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:40.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.342+0000 7fc63bfff640 1 --2- 172.21.15.162:0/3623220410 >> v2:172.21.15.162:3300/0 conn(0x7fc63c152370 0x7fc63c0c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:40.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.342+0000 7fc63bfff640 1 -- 172.21.15.162:0/3623220410 >> v1:172.21.15.179:6789/0 conn(0x7fc63c070840 legacy=0x7fc63c158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:40.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.342+0000 7fc63bfff640 1 -- 172.21.15.162:0/3623220410 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63c06f890 con 0x7fc63c0c3570 2024-04-25T00:49:40.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.346+0000 7fc63bfff640 1 --2- 172.21.15.162:0/3623220410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc63c0c3570 0x7fc63c0c96a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0cb1f0 tx=0x7fc63001f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a612493f5cc720bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:40.361 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.358+0000 7fc63b7fe640 1 -- 172.21.15.162:0/3623220410 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6300b4070 con 0x7fc63c0c3570 2024-04-25T00:49:40.361 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.358+0000 7fc63b7fe640 1 -- 172.21.15.162:0/3623220410 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6300af400 con 0x7fc63c0c3570 2024-04-25T00:49:40.361 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.358+0000 7fc63b7fe640 1 -- 172.21.15.162:0/3623220410 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6300af7d0 con 0x7fc63c0c3570 2024-04-25T00:49:40.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.362+0000 7fc642a88640 1 -- 172.21.15.162:0/3623220410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc63c0c3570 msgr2=0x7fc63c0c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:40.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.362+0000 7fc642a88640 1 --2- 172.21.15.162:0/3623220410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc63c0c3570 0x7fc63c0c96a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc63c0cb1f0 tx=0x7fc63001f1e0 comp rx=0 tx=0).stop 2024-04-25T00:49:40.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.362+0000 7fc642a88640 1 -- 172.21.15.162:0/3623220410 shutdown_connections 2024-04-25T00:49:40.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.362+0000 7fc642a88640 1 --2- 172.21.15.162:0/3623220410 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc63c0c3570 0x7fc63c0c96a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:40.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.362+0000 7fc642a88640 1 --2- 172.21.15.162:0/3623220410 >> v2:172.21.15.162:3300/0 conn(0x7fc63c152370 0x7fc63c0c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:40.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.362+0000 7fc642a88640 1 -- 172.21.15.162:0/3623220410 >> 172.21.15.162:0/3623220410 conn(0x7fc63c0675c0 msgr2=0x7fc63c0714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:40.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.362+0000 7fc642a88640 1 -- 172.21.15.162:0/3623220410 shutdown_connections 2024-04-25T00:49:40.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.362+0000 7fc642a88640 1 -- 172.21.15.162:0/3623220410 wait complete. 2024-04-25T00:49:40.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.362+0000 7fc642a88640 1 Processor -- start 2024-04-25T00:49:40.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.362+0000 7fc642a88640 1 -- start start 2024-04-25T00:49:40.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.362+0000 7fc642a88640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc63c070840 0x7fc63c1ef490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:40.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.362+0000 7fc642a88640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc63c0c3570 0x7fc63c155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:40.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.362+0000 7fc642a88640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc63c152370 0x7fc63c0c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:40.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.362+0000 7fc642a88640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c070130 con 0x7fc63c070840 2024-04-25T00:49:40.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.362+0000 7fc642a88640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c06fe50 con 0x7fc63c152370 2024-04-25T00:49:40.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.362+0000 7fc642a88640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc63c158760 con 0x7fc63c0c3570 2024-04-25T00:49:40.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.362+0000 7fc63bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc63c0c3570 0x7fc63c155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:40.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.366+0000 7fc63bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc63c0c3570 0x7fc63c155ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:46348/0 (socket says 172.21.15.162:46348) 2024-04-25T00:49:40.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.366+0000 7fc63bfff640 1 -- 172.21.15.162:0/4230568233 learned_addr learned my addr 172.21.15.162:0/4230568233 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:49:40.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.374+0000 7fc640824640 1 --2- 172.21.15.162:0/4230568233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc63c070840 0x7fc63c1ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:40.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.378+0000 7fc63bfff640 1 -- 172.21.15.162:0/4230568233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc63c152370 msgr2=0x7fc63c0c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:40.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.378+0000 7fc63bfff640 1 --2- 172.21.15.162:0/4230568233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc63c152370 0x7fc63c0c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:40.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.378+0000 7fc63bfff640 1 -- 172.21.15.162:0/4230568233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc63c070840 msgr2=0x7fc63c1ef490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:40.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.378+0000 7fc63bfff640 1 --2- 172.21.15.162:0/4230568233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc63c070840 0x7fc63c1ef490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:40.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.378+0000 7fc63bfff640 1 -- 172.21.15.162:0/4230568233 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63c1de4d0 con 0x7fc63c0c3570 2024-04-25T00:49:40.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.458+0000 7fc63bfff640 1 --2- 172.21.15.162:0/4230568233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc63c0c3570 0x7fc63c155ec0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc6300b2040 tx=0x7fc63001bf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:40.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.466+0000 7fc6397fa640 1 -- 172.21.15.162:0/4230568233 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6300b4040 con 0x7fc63c0c3570 2024-04-25T00:49:40.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.466+0000 7fc6397fa640 1 -- 172.21.15.162:0/4230568233 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6300c0070 con 0x7fc63c0c3570 2024-04-25T00:49:40.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.466+0000 7fc6397fa640 1 -- 172.21.15.162:0/4230568233 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc630009510 con 0x7fc63c0c3570 2024-04-25T00:49:40.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.466+0000 7fc642a88640 1 -- 172.21.15.162:0/4230568233 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc63c1de7b0 con 0x7fc63c0c3570 2024-04-25T00:49:40.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.466+0000 7fc642a88640 1 -- 172.21.15.162:0/4230568233 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc63c1eec90 con 0x7fc63c0c3570 2024-04-25T00:49:40.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.466+0000 7fc642a88640 1 -- 172.21.15.162:0/4230568233 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc63c068520 con 0x7fc63c0c3570 2024-04-25T00:49:40.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.774+0000 7fc6397fa640 1 -- 172.21.15.162:0/4230568233 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 3) ==== 87283+0+0 (secure 0 0 0) 0x7fc6300ba660 con 0x7fc63c0c3570 2024-04-25T00:49:40.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.774+0000 7fc6397fa640 1 --2- 172.21.15.162:0/4230568233 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc628067760 0x7fc628069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:40.777 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.774+0000 7fc640824640 1 --2- 172.21.15.162:0/4230568233 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc628067760 0x7fc628069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:40.777 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.778+0000 7fc640824640 1 --2- 172.21.15.162:0/4230568233 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc628067760 0x7fc628069c20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc634006fd0 tx=0x7fc634008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:40.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.802+0000 7fc6397fa640 1 -- 172.21.15.162:0/4230568233 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fc6300f3140 con 0x7fc63c0c3570 2024-04-25T00:49:40.825 INFO:tasks.ceph.osd.1.smithi162.stderr:2024-04-25T00:49:40.822+0000 7f37533b27c0 -1 Falling back to public interface 2024-04-25T00:49:40.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:40.838+0000 7fc6397fa640 1 -- 172.21.15.162:0/4230568233 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc630018d40 con 0x7fc63c0c3570 2024-04-25T00:49:40.858 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-04-25T00:49:40.855+0000 7f100e1767c0 -1 Falling back to public interface 2024-04-25T00:49:40.858 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-04-25T00:49:40.855+0000 7f8edc8ff7c0 -1 Falling back to public interface 2024-04-25T00:49:40.867 INFO:tasks.ceph.osd.0.smithi162.stderr:2024-04-25T00:49:40.866+0000 7fd23a92d7c0 -1 Falling back to public interface 2024-04-25T00:49:40.868 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-04-25T00:49:40.867+0000 7fad89e777c0 -1 Falling back to public interface 2024-04-25T00:49:40.871 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-04-25T00:49:40.870+0000 7f660b95b7c0 -1 Falling back to public interface 2024-04-25T00:49:40.904 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-04-25T00:49:40.903+0000 7f17053b47c0 -1 Falling back to public interface 2024-04-25T00:49:40.922 INFO:tasks.ceph.osd.3.smithi162.stderr:2024-04-25T00:49:40.922+0000 7f5e18e907c0 -1 Falling back to public interface 2024-04-25T00:49:41.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:41.014+0000 7fc642a88640 1 -- 172.21.15.162:0/4230568233 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc63c155a70 con 0x7fc63c0c3570 2024-04-25T00:49:41.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:41.018+0000 7fc6397fa640 1 -- 172.21.15.162:0/4230568233 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7fc6300f1710 con 0x7fc63c0c3570 2024-04-25T00:49:41.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:41.134+0000 7fc6397fa640 1 -- 172.21.15.162:0/4230568233 <== mon.2 v2:172.21.15.179:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fc6300f57a0 con 0x7fc63c0c3570 2024-04-25T00:49:41.136 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:49:41.136 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":10,"fsid":"e141deed-4794-4a17-83c9-f6e6e8875f5e","created":"2024-04-25T00:49:29.904605+0000","modified":"2024-04-25T00:49:39.898293+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T00:49:39.898293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e20986cc-3664-4988-959c-c0b02e380775","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"60f1608a-ecb7-4978-b816-ce6f419e275d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"77552061-8e19-4f49-bc3f-1300955a07b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5b105720-6e6d-4143-b5c4-0a3b1e4a687c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"611eafc5-2fe0-4c96-ba8c-b1efc3930de1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b39487f5-c314-4026-90bd-02e30ecca04f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1d902755-f992-4070-b30e-e79f5fb22d7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ea529f85-28fd-4dc3-a584-314e71999061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T00:49:41.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:41.138+0000 7fc642a88640 1 -- 172.21.15.162:0/4230568233 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc628067760 msgr2=0x7fc628069c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:41.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:41.138+0000 7fc642a88640 1 --2- 172.21.15.162:0/4230568233 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc628067760 0x7fc628069c20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc634006fd0 tx=0x7fc634008040 comp rx=0 tx=0).stop 2024-04-25T00:49:41.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:41.138+0000 7fc642a88640 1 -- 172.21.15.162:0/4230568233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc63c0c3570 msgr2=0x7fc63c155ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:41.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:41.138+0000 7fc642a88640 1 --2- 172.21.15.162:0/4230568233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc63c0c3570 0x7fc63c155ec0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc6300b2040 tx=0x7fc63001bf80 comp rx=0 tx=0).stop 2024-04-25T00:49:41.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:41.138+0000 7fc642a88640 1 -- 172.21.15.162:0/4230568233 shutdown_connections 2024-04-25T00:49:41.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:41.138+0000 7fc642a88640 1 --2- 172.21.15.162:0/4230568233 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc63c152370 0x7fc63c0c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:41.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:41.138+0000 7fc642a88640 1 --2- 172.21.15.162:0/4230568233 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc63c0c3570 0x7fc63c155ec0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:41.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:41.138+0000 7fc642a88640 1 --2- 172.21.15.162:0/4230568233 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc628067760 0x7fc628069c20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:41.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:41.138+0000 7fc642a88640 1 --2- 172.21.15.162:0/4230568233 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc63c070840 0x7fc63c1ef490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:41.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:41.138+0000 7fc642a88640 1 -- 172.21.15.162:0/4230568233 >> 172.21.15.162:0/4230568233 conn(0x7fc63c0675c0 msgr2=0x7fc63c150a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:41.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:41.138+0000 7fc642a88640 1 -- 172.21.15.162:0/4230568233 shutdown_connections 2024-04-25T00:49:41.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:49:41.138+0000 7fc642a88640 1 -- 172.21.15.162:0/4230568233 wait complete. 2024-04-25T00:49:41.161 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T00:49:41.161 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T00:49:41.967 DEBUG:teuthology.orchestra.run.smithi162:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T00:49:42.130 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.130+0000 7f4be857b640 1 Processor -- start 2024-04-25T00:49:42.130 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.130+0000 7f4be857b640 1 -- start start 2024-04-25T00:49:42.131 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.130+0000 7f4be857b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4be00c8420 0x7f4be0157090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:42.131 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.130+0000 7f4be857b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4be00c5560 0x7f4be00c30d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:42.131 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.130+0000 7f4be857b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4be00c3610 0x7f4be00c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:42.131 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.130+0000 7f4be857b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4be00c6050 con 0x7f4be00c5560 2024-04-25T00:49:42.131 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.130+0000 7f4be857b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f4be013c240 con 0x7f4be00c8420 2024-04-25T00:49:42.131 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.130+0000 7f4be857b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4be00c3b10 con 0x7f4be00c3610 2024-04-25T00:49:42.132 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.130+0000 7f4be6317640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4be00c8420 0x7f4be0157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:42.132 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.130+0000 7f4be5b16640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4be00c5560 0x7f4be00c30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:42.132 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.130+0000 7f4be6b18640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4be00c3610 0x7f4be00c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:42.132 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.130+0000 7f4be5b16640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4be00c5560 0x7f4be00c30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:59026/0 (socket says 172.21.15.162:59026) 2024-04-25T00:49:42.132 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.130+0000 7f4be5b16640 1 -- 172.21.15.162:0/2143041394 learned_addr learned my addr 172.21.15.162:0/2143041394 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:49:42.135 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.134+0000 7f4be5b16640 1 -- 172.21.15.162:0/2143041394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4be00c3610 msgr2=0x7f4be00c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:42.135 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.134+0000 7f4be5b16640 1 --2- 172.21.15.162:0/2143041394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4be00c3610 0x7f4be00c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:42.135 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.134+0000 7f4be5b16640 1 -- 172.21.15.162:0/2143041394 >> v2:172.21.15.179:3300/0 conn(0x7f4be00c8420 msgr2=0x7f4be0157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:42.135 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.134+0000 7f4be5b16640 1 --2- 172.21.15.162:0/2143041394 >> v2:172.21.15.179:3300/0 conn(0x7f4be00c8420 0x7f4be0157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:42.135 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.134+0000 7f4be5b16640 1 -- 172.21.15.162:0/2143041394 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be00c3df0 con 0x7f4be00c5560 2024-04-25T00:49:42.138 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.138+0000 7f4be5b16640 1 --2- 172.21.15.162:0/2143041394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be00c5560 0x7f4be00c30d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4be0070250 tx=0x7f4bd001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e50cc97bc0e63b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:42.142 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be5315640 1 -- 172.21.15.162:0/2143041394 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00b0070 con 0x7f4be00c5560 2024-04-25T00:49:42.142 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be5315640 1 -- 172.21.15.162:0/2143041394 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd00ab600 con 0x7f4be00c5560 2024-04-25T00:49:42.142 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be5315640 1 -- 172.21.15.162:0/2143041394 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00ab9d0 con 0x7f4be00c5560 2024-04-25T00:49:42.143 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be857b640 1 -- 172.21.15.162:0/2143041394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be00c5560 msgr2=0x7f4be00c30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:42.143 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be857b640 1 --2- 172.21.15.162:0/2143041394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be00c5560 0x7f4be00c30d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4be0070250 tx=0x7f4bd001c4f0 comp rx=0 tx=0).stop 2024-04-25T00:49:42.143 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be857b640 1 -- 172.21.15.162:0/2143041394 shutdown_connections 2024-04-25T00:49:42.143 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be857b640 1 --2- 172.21.15.162:0/2143041394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4be00c3610 0x7f4be00c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:42.144 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be857b640 1 --2- 172.21.15.162:0/2143041394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be00c5560 0x7f4be00c30d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:42.144 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be857b640 1 --2- 172.21.15.162:0/2143041394 >> v2:172.21.15.179:3300/0 conn(0x7f4be00c8420 0x7f4be0157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:42.144 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be857b640 1 -- 172.21.15.162:0/2143041394 >> 172.21.15.162:0/2143041394 conn(0x7f4be006f470 msgr2=0x7f4be006f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:42.144 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be857b640 1 -- 172.21.15.162:0/2143041394 shutdown_connections 2024-04-25T00:49:42.144 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be857b640 1 -- 172.21.15.162:0/2143041394 wait complete. 2024-04-25T00:49:42.145 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be857b640 1 Processor -- start 2024-04-25T00:49:42.145 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be857b640 1 -- start start 2024-04-25T00:49:42.145 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be857b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4be00c3610 0x7f4be01f0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:42.145 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be857b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be00c5560 0x7f4be0136100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:42.145 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be857b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4be00c8420 0x7f4be0136640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:42.145 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be857b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4be013cfe0 con 0x7f4be00c5560 2024-04-25T00:49:42.145 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be857b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4be01575d0 con 0x7f4be00c3610 2024-04-25T00:49:42.145 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.142+0000 7f4be857b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4be0139a90 con 0x7f4be00c8420 2024-04-25T00:49:42.146 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.146+0000 7f4be5b16640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be00c5560 0x7f4be0136100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:42.146 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.146+0000 7f4be5b16640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be00c5560 0x7f4be0136100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:59038/0 (socket says 172.21.15.162:59038) 2024-04-25T00:49:42.146 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.146+0000 7f4be5b16640 1 -- 172.21.15.162:0/3557485589 learned_addr learned my addr 172.21.15.162:0/3557485589 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:49:42.146 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.146+0000 7f4be6b18640 1 --2- 172.21.15.162:0/3557485589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4be00c8420 0x7f4be0136640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:42.146 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.146+0000 7f4be6317640 1 --2- 172.21.15.162:0/3557485589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4be00c3610 0x7f4be01f0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:42.149 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.150+0000 7f4be5b16640 1 -- 172.21.15.162:0/3557485589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4be00c8420 msgr2=0x7f4be0136640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:42.149 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.150+0000 7f4be5b16640 1 --2- 172.21.15.162:0/3557485589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4be00c8420 0x7f4be0136640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:42.149 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.150+0000 7f4be5b16640 1 -- 172.21.15.162:0/3557485589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4be00c3610 msgr2=0x7f4be01f0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:42.150 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.150+0000 7f4be5b16640 1 --2- 172.21.15.162:0/3557485589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4be00c3610 0x7f4be01f0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:42.150 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.150+0000 7f4be5b16640 1 -- 172.21.15.162:0/3557485589 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be013d770 con 0x7f4be00c5560 2024-04-25T00:49:42.155 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.154+0000 7f4be5b16640 1 --2- 172.21.15.162:0/3557485589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be00c5560 0x7f4be0136100 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4bd001cd90 tx=0x7f4bd0019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:42.160 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.158+0000 7f4bd6ffd640 1 -- 172.21.15.162:0/3557485589 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00bb070 con 0x7f4be00c5560 2024-04-25T00:49:42.160 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.158+0000 7f4bd6ffd640 1 -- 172.21.15.162:0/3557485589 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd00abe50 con 0x7f4be00c5560 2024-04-25T00:49:42.160 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.158+0000 7f4bd6ffd640 1 -- 172.21.15.162:0/3557485589 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bd00b0070 con 0x7f4be00c5560 2024-04-25T00:49:42.161 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.158+0000 7f4be857b640 1 -- 172.21.15.162:0/3557485589 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4be0138cd0 con 0x7f4be00c5560 2024-04-25T00:49:42.161 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.162+0000 7f4be857b640 1 -- 172.21.15.162:0/3557485589 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4be0139290 con 0x7f4be00c5560 2024-04-25T00:49:42.162 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.162+0000 7f4be857b640 1 -- 172.21.15.162:0/3557485589 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4be0068300 con 0x7f4be00c5560 2024-04-25T00:49:42.180 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.178+0000 7f4bd6ffd640 1 -- 172.21.15.162:0/3557485589 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f4bd00aa7f0 con 0x7f4be00c5560 2024-04-25T00:49:42.181 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.178+0000 7f4bd6ffd640 1 --2- 172.21.15.162:0/3557485589 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4bc4067830 0x7f4bc4069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:42.181 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.178+0000 7f4be6317640 1 --2- 172.21.15.162:0/3557485589 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4bc4067830 0x7f4bc4069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:42.181 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.182+0000 7f4be6317640 1 --2- 172.21.15.162:0/3557485589 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4bc4067830 0x7f4bc4069cf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc011340 tx=0x7f4bdc00b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:42.459 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.458+0000 7f4bd6ffd640 1 -- 172.21.15.162:0/3557485589 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f4bd00ee270 con 0x7f4be00c5560 2024-04-25T00:49:42.462 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.458+0000 7f4bd6ffd640 1 -- 172.21.15.162:0/3557485589 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f4bd0016110 con 0x7f4be00c5560 2024-04-25T00:49:42.627 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.626+0000 7f4be857b640 1 -- 172.21.15.162:0/3557485589 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4be00736a0 con 0x7f4be00c5560 2024-04-25T00:49:42.720 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.718+0000 7f4bd6ffd640 1 -- 172.21.15.162:0/3557485589 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f4bd00ef5e0 con 0x7f4be00c5560 2024-04-25T00:49:42.720 INFO:teuthology.misc.health.smithi162.stdout: 2024-04-25T00:49:42.721 INFO:teuthology.misc.health.smithi162.stdout:{"epoch":10,"fsid":"e141deed-4794-4a17-83c9-f6e6e8875f5e","created":"2024-04-25T00:49:29.904605+0000","modified":"2024-04-25T00:49:39.898293+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T00:49:39.898293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e20986cc-3664-4988-959c-c0b02e380775","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"60f1608a-ecb7-4978-b816-ce6f419e275d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"77552061-8e19-4f49-bc3f-1300955a07b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5b105720-6e6d-4143-b5c4-0a3b1e4a687c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"611eafc5-2fe0-4c96-ba8c-b1efc3930de1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b39487f5-c314-4026-90bd-02e30ecca04f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1d902755-f992-4070-b30e-e79f5fb22d7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ea529f85-28fd-4dc3-a584-314e71999061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T00:49:42.723 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.722+0000 7f4be857b640 1 -- 172.21.15.162:0/3557485589 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4bc4067830 msgr2=0x7f4bc4069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:42.723 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.722+0000 7f4be857b640 1 --2- 172.21.15.162:0/3557485589 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4bc4067830 0x7f4bc4069cf0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4bdc011340 tx=0x7f4bdc00b040 comp rx=0 tx=0).stop 2024-04-25T00:49:42.723 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.722+0000 7f4be857b640 1 -- 172.21.15.162:0/3557485589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be00c5560 msgr2=0x7f4be0136100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:42.723 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.722+0000 7f4be857b640 1 --2- 172.21.15.162:0/3557485589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be00c5560 0x7f4be0136100 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4bd001cd90 tx=0x7f4bd0019290 comp rx=0 tx=0).stop 2024-04-25T00:49:42.723 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.722+0000 7f4be857b640 1 -- 172.21.15.162:0/3557485589 shutdown_connections 2024-04-25T00:49:42.723 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.722+0000 7f4be857b640 1 --2- 172.21.15.162:0/3557485589 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4be00c8420 0x7f4be0136640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:42.723 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.722+0000 7f4be857b640 1 --2- 172.21.15.162:0/3557485589 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4bc4067830 0x7f4bc4069cf0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:42.724 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.722+0000 7f4be857b640 1 --2- 172.21.15.162:0/3557485589 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4be00c5560 0x7f4be0136100 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:42.724 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.722+0000 7f4be857b640 1 --2- 172.21.15.162:0/3557485589 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4be00c3610 0x7f4be01f0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:42.724 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.722+0000 7f4be857b640 1 -- 172.21.15.162:0/3557485589 >> 172.21.15.162:0/3557485589 conn(0x7f4be006f470 msgr2=0x7f4be006b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:42.724 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.722+0000 7f4be857b640 1 -- 172.21.15.162:0/3557485589 shutdown_connections 2024-04-25T00:49:42.724 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:42.722+0000 7f4be857b640 1 -- 172.21.15.162:0/3557485589 wait complete. 2024-04-25T00:49:42.739 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T00:49:44.536 INFO:tasks.ceph.osd.1.smithi162.stderr:2024-04-25T00:49:44.534+0000 7f37533b27c0 -1 osd.1 0 log_to_monitors true 2024-04-25T00:49:44.648 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-04-25T00:49:44.647+0000 7f100e1767c0 -1 osd.6 0 log_to_monitors true 2024-04-25T00:49:44.663 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-04-25T00:49:44.662+0000 7f660b95b7c0 -1 osd.2 0 log_to_monitors true 2024-04-25T00:49:44.679 INFO:tasks.ceph.osd.0.smithi162.stderr:2024-04-25T00:49:44.678+0000 7fd23a92d7c0 -1 osd.0 0 log_to_monitors true 2024-04-25T00:49:44.697 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-04-25T00:49:44.695+0000 7f8edc8ff7c0 -1 osd.7 0 log_to_monitors true 2024-04-25T00:49:44.773 INFO:tasks.ceph.osd.3.smithi162.stderr:2024-04-25T00:49:44.770+0000 7f5e18e907c0 -1 osd.3 0 log_to_monitors true 2024-04-25T00:49:44.794 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-04-25T00:49:44.791+0000 7fad89e777c0 -1 osd.4 0 log_to_monitors true 2024-04-25T00:49:44.858 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-04-25T00:49:44.855+0000 7f17053b47c0 -1 osd.5 0 log_to_monitors true 2024-04-25T00:49:46.836 INFO:tasks.ceph.osd.1.smithi162.stderr:2024-04-25T00:49:46.834+0000 7f375036e640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T00:49:47.257 INFO:tasks.ceph.osd.1.smithi162.stderr:2024-04-25T00:49:47.254+0000 7f374717f640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T00:49:48.625 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-04-25T00:49:48.626+0000 7f66070e1640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T00:49:48.673 INFO:tasks.ceph.osd.0.smithi162.stderr:2024-04-25T00:49:48.670+0000 7fd2360b3640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T00:49:48.713 INFO:tasks.ceph.osd.3.smithi162.stderr:2024-04-25T00:49:48.710+0000 7f5e15e4c640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T00:49:48.742 INFO:tasks.ceph.osd.0.smithi162.stderr:2024-04-25T00:49:48.742+0000 7fd22e6fa640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T00:49:48.754 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-04-25T00:49:48.754+0000 7f65ff728640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T00:49:48.782 INFO:tasks.ceph.osd.3.smithi162.stderr:2024-04-25T00:49:48.782+0000 7f5e0cc5d640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T00:49:49.215 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-04-25T00:49:49.211+0000 7fad855fd640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T00:49:49.223 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-04-25T00:49:49.219+0000 7f10098fc640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T00:49:49.244 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-04-25T00:49:49.243+0000 7f1702370640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T00:49:49.265 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-04-25T00:49:49.263+0000 7f8ed98bb640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T00:49:49.284 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-04-25T00:49:49.283+0000 7f1001f43640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T00:49:49.292 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-04-25T00:49:49.291+0000 7fad7dc44640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T00:49:49.308 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-04-25T00:49:49.307+0000 7f16f9181640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T00:49:49.316 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-04-25T00:49:49.315+0000 7f8ed06cc640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T00:49:49.544 DEBUG:teuthology.orchestra.run.smithi162:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T00:49:49.665 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.662+0000 7f52b7013640 1 Processor -- start 2024-04-25T00:49:49.665 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.662+0000 7f52b7013640 1 -- start start 2024-04-25T00:49:49.666 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.666+0000 7f52b7013640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f52b00c8420 0x7f52b0157090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:49.666 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.666+0000 7f52b7013640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f52b00c8cd0 0x7f52b00c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:49.666 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.666+0000 7f52b7013640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52b00c6050 con 0x7f52b00c5560 2024-04-25T00:49:49.666 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.666+0000 7f52b7013640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f52b013c240 con 0x7f52b00c8420 2024-04-25T00:49:49.666 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.666+0000 7f52b7013640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f52b00c3b10 con 0x7f52b00c8cd0 2024-04-25T00:49:49.666 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.666+0000 7f52b4daf640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f52b00c8420 0x7f52b0157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:49.667 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.666+0000 7f52affff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f52b00c5560 0x7f52b00c30d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:59940/0 (socket says 172.21.15.162:59940) 2024-04-25T00:49:49.667 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.666+0000 7f52affff640 1 -- 172.21.15.162:0/1811125459 learned_addr learned my addr 172.21.15.162:0/1811125459 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:49:49.671 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.670+0000 7f52b4daf640 1 -- 172.21.15.162:0/1811125459 >> v2:172.21.15.179:3300/0 conn(0x7f52b00c8cd0 msgr2=0x7f52b00c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:49.671 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.670+0000 7f52b4daf640 1 --2- 172.21.15.162:0/1811125459 >> v2:172.21.15.179:3300/0 conn(0x7f52b00c8cd0 0x7f52b00c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:49.671 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.670+0000 7f52b4daf640 1 -- 172.21.15.162:0/1811125459 >> v1:172.21.15.162:6789/0 conn(0x7f52b00c5560 legacy=0x7f52b00c30d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:49.671 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.670+0000 7f52b4daf640 1 -- 172.21.15.162:0/1811125459 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b00c3df0 con 0x7f52b00c8420 2024-04-25T00:49:49.677 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.678+0000 7f52b4daf640 1 --2- 172.21.15.162:0/1811125459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52b00c8420 0x7f52b0157090 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f52b00c5480 tx=0x7f529801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2da7c24b8aeb7e74 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:49.682 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52af7fe640 1 -- 172.21.15.162:0/1811125459 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52980b0070 con 0x7f52b00c8420 2024-04-25T00:49:49.682 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52af7fe640 1 -- 172.21.15.162:0/1811125459 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52980ab600 con 0x7f52b00c8420 2024-04-25T00:49:49.682 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52af7fe640 1 -- 172.21.15.162:0/1811125459 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52980ab9d0 con 0x7f52b00c8420 2024-04-25T00:49:49.683 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52b7013640 1 -- 172.21.15.162:0/1811125459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52b00c8420 msgr2=0x7f52b0157090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:49.683 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52b7013640 1 --2- 172.21.15.162:0/1811125459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52b00c8420 0x7f52b0157090 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f52b00c5480 tx=0x7f529801c480 comp rx=0 tx=0).stop 2024-04-25T00:49:49.683 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52b7013640 1 -- 172.21.15.162:0/1811125459 shutdown_connections 2024-04-25T00:49:49.683 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52b7013640 1 --2- 172.21.15.162:0/1811125459 >> v2:172.21.15.179:3300/0 conn(0x7f52b00c8cd0 0x7f52b00c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:49.683 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52b7013640 1 --2- 172.21.15.162:0/1811125459 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52b00c8420 0x7f52b0157090 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:49.683 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52b7013640 1 -- 172.21.15.162:0/1811125459 >> 172.21.15.162:0/1811125459 conn(0x7f52b006f470 msgr2=0x7f52b006f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:49.683 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52b7013640 1 -- 172.21.15.162:0/1811125459 shutdown_connections 2024-04-25T00:49:49.683 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52b7013640 1 -- 172.21.15.162:0/1811125459 wait complete. 2024-04-25T00:49:49.684 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52b7013640 1 Processor -- start 2024-04-25T00:49:49.684 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52b7013640 1 -- start start 2024-04-25T00:49:49.685 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52b7013640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52b00c5560 0x7f52b0154160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:49.685 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52b7013640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b00c8420 0x7f52b01556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:49.685 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52b7013640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52b00c8cd0 0x7f52b0150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:49.685 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52b7013640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f52b013cfe0 con 0x7f52b00c5560 2024-04-25T00:49:49.685 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52b7013640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f52b00c37e0 con 0x7f52b00c8cd0 2024-04-25T00:49:49.685 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.682+0000 7f52b7013640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f52b01551e0 con 0x7f52b00c8420 2024-04-25T00:49:49.685 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.686+0000 7f52b4daf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52b00c5560 0x7f52b0154160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:49.686 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.686+0000 7f52b4daf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52b00c5560 0x7f52b0154160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:59084/0 (socket says 172.21.15.162:59084) 2024-04-25T00:49:49.686 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.686+0000 7f52b4daf640 1 -- 172.21.15.162:0/440869444 learned_addr learned my addr 172.21.15.162:0/440869444 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:49:49.689 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.686+0000 7f52b4daf640 1 -- 172.21.15.162:0/440869444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b00c8420 msgr2=0x7f52b01556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:49.689 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.686+0000 7f52b4daf640 1 --2- 172.21.15.162:0/440869444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b00c8420 0x7f52b01556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:49.689 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.686+0000 7f52b4daf640 1 -- 172.21.15.162:0/440869444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52b00c8cd0 msgr2=0x7f52b0150890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:49.689 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.686+0000 7f52b4daf640 1 --2- 172.21.15.162:0/440869444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52b00c8cd0 0x7f52b0150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:49.689 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.686+0000 7f52b4daf640 1 -- 172.21.15.162:0/440869444 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52b015cbc0 con 0x7f52b00c5560 2024-04-25T00:49:49.693 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.694+0000 7f52b4daf640 1 --2- 172.21.15.162:0/440869444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52b00c5560 0x7f52b0154160 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5298019090 tx=0x7f5298019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:49.698 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.698+0000 7f52ad7fa640 1 -- 172.21.15.162:0/440869444 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52980b9070 con 0x7f52b00c5560 2024-04-25T00:49:49.698 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.698+0000 7f52ad7fa640 1 -- 172.21.15.162:0/440869444 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52980b5680 con 0x7f52b00c5560 2024-04-25T00:49:49.698 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.698+0000 7f52ad7fa640 1 -- 172.21.15.162:0/440869444 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52980b0040 con 0x7f52b00c5560 2024-04-25T00:49:49.698 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.698+0000 7f52b7013640 1 -- 172.21.15.162:0/440869444 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52b015bbf0 con 0x7f52b00c5560 2024-04-25T00:49:49.698 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.698+0000 7f52b7013640 1 -- 172.21.15.162:0/440869444 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52b0154ec0 con 0x7f52b00c5560 2024-04-25T00:49:49.698 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.698+0000 7f52b7013640 1 -- 172.21.15.162:0/440869444 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52b0068300 con 0x7f52b00c5560 2024-04-25T00:49:49.983 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.982+0000 7f52ad7fa640 1 -- 172.21.15.162:0/440869444 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f52980bc070 con 0x7f52b00c5560 2024-04-25T00:49:49.984 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.982+0000 7f52ad7fa640 1 --2- 172.21.15.162:0/440869444 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f5290067880 0x7f5290069d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:49.984 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.982+0000 7f52affff640 1 --2- 172.21.15.162:0/440869444 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f5290067880 0x7f5290069d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:49.985 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:49.986+0000 7f52affff640 1 --2- 172.21.15.162:0/440869444 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f5290067880 0x7f5290069d40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f52a0000f70 tx=0x7f52a0007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:49:50.026 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:50.026+0000 7f52ad7fa640 1 -- 172.21.15.162:0/440869444 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2511+0+0 (secure 0 0 0) 0x7f52980ab5a0 con 0x7f52b00c5560 2024-04-25T00:49:50.039 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:50.038+0000 7f52ad7fa640 1 -- 172.21.15.162:0/440869444 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f52980c3030 con 0x7f52b00c5560 2024-04-25T00:49:50.221 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:50.218+0000 7f52b7013640 1 -- 172.21.15.162:0/440869444 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f52b0139cf0 con 0x7f52b00c5560 2024-04-25T00:49:50.402 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:50.402+0000 7f52ad7fa640 1 -- 172.21.15.162:0/440869444 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+8562 (secure 0 0 0) 0x7f5298016070 con 0x7f52b00c5560 2024-04-25T00:49:50.402 INFO:teuthology.misc.health.smithi162.stdout: 2024-04-25T00:49:50.402 INFO:teuthology.misc.health.smithi162.stdout:{"epoch":15,"fsid":"e141deed-4794-4a17-83c9-f6e6e8875f5e","created":"2024-04-25T00:49:29.904605+0000","modified":"2024-04-25T00:49:49.338122+0000","last_up_change":"2024-04-25T00:49:49.338122+0000","last_in_change":"2024-04-25T00:49:39.898293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e20986cc-3664-4988-959c-c0b02e380775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6811","nonce":2734546478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6813","nonce":2734546478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6817","nonce":2734546478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6815","nonce":2734546478}]},"public_addr":"172.21.15.162:6811/2734546478","cluster_addr":"172.21.15.162:6813/2734546478","heartbeat_back_addr":"172.21.15.162:6817/2734546478","heartbeat_front_addr":"172.21.15.162:6815/2734546478","state":["exists","up"]},{"osd":1,"uuid":"60f1608a-ecb7-4978-b816-ce6f419e275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6803","nonce":3488816098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6805","nonce":3488816098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6809","nonce":3488816098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6807","nonce":3488816098}]},"public_addr":"172.21.15.162:6803/3488816098","cluster_addr":"172.21.15.162:6805/3488816098","heartbeat_back_addr":"172.21.15.162:6809/3488816098","heartbeat_front_addr":"172.21.15.162:6807/3488816098","state":["exists","up"]},{"osd":2,"uuid":"77552061-8e19-4f49-bc3f-1300955a07b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5b105720-6e6d-4143-b5c4-0a3b1e4a687c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6827","nonce":1726903362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6829","nonce":1726903362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6833","nonce":1726903362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6831","nonce":1726903362}]},"public_addr":"172.21.15.162:6827/1726903362","cluster_addr":"172.21.15.162:6829/1726903362","heartbeat_back_addr":"172.21.15.162:6833/1726903362","heartbeat_front_addr":"172.21.15.162:6831/1726903362","state":["exists","up"]},{"osd":4,"uuid":"611eafc5-2fe0-4c96-ba8c-b1efc3930de1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b39487f5-c314-4026-90bd-02e30ecca04f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1d902755-f992-4070-b30e-e79f5fb22d7f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"ea529f85-28fd-4dc3-a584-314e71999061","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.583123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T00:49:50.404 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:50.402+0000 7f52b7013640 1 -- 172.21.15.162:0/440869444 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f5290067880 msgr2=0x7f5290069d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:50.404 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:50.402+0000 7f52b7013640 1 --2- 172.21.15.162:0/440869444 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f5290067880 0x7f5290069d40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f52a0000f70 tx=0x7f52a0007a90 comp rx=0 tx=0).stop 2024-04-25T00:49:50.405 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:50.402+0000 7f52b7013640 1 -- 172.21.15.162:0/440869444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52b00c5560 msgr2=0x7f52b0154160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:49:50.405 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:50.402+0000 7f52b7013640 1 --2- 172.21.15.162:0/440869444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52b00c5560 0x7f52b0154160 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5298019090 tx=0x7f5298019220 comp rx=0 tx=0).stop 2024-04-25T00:49:50.405 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:50.402+0000 7f52b7013640 1 -- 172.21.15.162:0/440869444 shutdown_connections 2024-04-25T00:49:50.405 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:50.402+0000 7f52b7013640 1 --2- 172.21.15.162:0/440869444 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f52b00c8cd0 0x7f52b0150890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:50.405 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:50.402+0000 7f52b7013640 1 --2- 172.21.15.162:0/440869444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f52b00c8420 0x7f52b01556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:50.405 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:50.402+0000 7f52b7013640 1 --2- 172.21.15.162:0/440869444 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f5290067880 0x7f5290069d40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:50.405 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:50.402+0000 7f52b7013640 1 --2- 172.21.15.162:0/440869444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f52b00c5560 0x7f52b0154160 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:50.405 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:50.402+0000 7f52b7013640 1 -- 172.21.15.162:0/440869444 >> 172.21.15.162:0/440869444 conn(0x7f52b006f470 msgr2=0x7f52b00c9d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:49:50.405 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:50.402+0000 7f52b7013640 1 -- 172.21.15.162:0/440869444 shutdown_connections 2024-04-25T00:49:50.405 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:50.402+0000 7f52b7013640 1 -- 172.21.15.162:0/440869444 wait complete. 2024-04-25T00:49:50.423 DEBUG:teuthology.misc:3 of 8 OSDs are up 2024-04-25T00:49:57.230 DEBUG:teuthology.orchestra.run.smithi162:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T00:49:57.354 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.354+0000 7f00edea1640 1 Processor -- start 2024-04-25T00:49:57.354 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.354+0000 7f00edea1640 1 -- start start 2024-04-25T00:49:57.355 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.354+0000 7f00edea1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00e813df60 0x7f00e80c7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:57.355 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.354+0000 7f00edea1640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f00e80c5990 0x7f00e806fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:57.355 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.354+0000 7f00edea1640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f00e80701e0 0x7f00e815b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:49:57.355 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.354+0000 7f00edea1640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f00e80c7bd0 con 0x7f00e80701e0 2024-04-25T00:49:57.355 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.354+0000 7f00edea1640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f00e80c6160 con 0x7f00e80c5990 2024-04-25T00:49:57.356 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.354+0000 7f00edea1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f00e81584c0 con 0x7f00e813df60 2024-04-25T00:49:57.357 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.354+0000 7f00e6ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f00e80c5990 0x7f00e806fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:57.357 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.354+0000 7f00e7fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f00e80701e0 0x7f00e815b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:57.357 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.354+0000 7f00e77fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00e813df60 0x7f00e80c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:49:57.357 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.358+0000 7f00e7fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f00e80701e0 0x7f00e815b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:41438/0 (socket says 172.21.15.162:41438) 2024-04-25T00:49:57.357 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.358+0000 7f00e7fff640 1 -- 172.21.15.162:0/1521627495 learned_addr learned my addr 172.21.15.162:0/1521627495 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:49:57.363 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.362+0000 7f00e7fff640 1 -- 172.21.15.162:0/1521627495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00e813df60 msgr2=0x7f00e80c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:57.363 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.362+0000 7f00e7fff640 1 --2- 172.21.15.162:0/1521627495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00e813df60 0x7f00e80c7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:57.363 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.362+0000 7f00e7fff640 1 -- 172.21.15.162:0/1521627495 >> v2:172.21.15.179:3300/0 conn(0x7f00e80c5990 msgr2=0x7f00e806fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:49:57.363 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.362+0000 7f00e7fff640 1 --2- 172.21.15.162:0/1521627495 >> v2:172.21.15.179:3300/0 conn(0x7f00e80c5990 0x7f00e806fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:49:57.364 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.362+0000 7f00e7fff640 1 -- 172.21.15.162:0/1521627495 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e81587a0 con 0x7f00e80701e0 2024-04-25T00:49:57.364 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.362+0000 7f00e77fe640 1 --2- 172.21.15.162:0/1521627495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00e813df60 0x7f00e80c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T00:49:57.367 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:49:57.366+0000 7f00e7fff640 1 --2- 172.21.15.162:0/1521627495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00e80701e0 0x7f00e815b780 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f00e8070840 tx=0x7f00e001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e95311baf69e85 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:02.704 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.702+0000 7f00e67fc640 1 -- 172.21.15.162:0/1521627495 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e00a5670 con 0x7f00e80701e0 2024-04-25T00:50:02.705 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.702+0000 7f00e67fc640 1 -- 172.21.15.162:0/1521627495 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e00a5830 con 0x7f00e80701e0 2024-04-25T00:50:02.705 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.702+0000 7f00e67fc640 1 -- 172.21.15.162:0/1521627495 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e00a5c60 con 0x7f00e80701e0 2024-04-25T00:50:02.706 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.706+0000 7f00edea1640 1 -- 172.21.15.162:0/1521627495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00e80701e0 msgr2=0x7f00e815b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:02.706 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.706+0000 7f00edea1640 1 --2- 172.21.15.162:0/1521627495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00e80701e0 0x7f00e815b780 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f00e8070840 tx=0x7f00e001c9f0 comp rx=0 tx=0).stop 2024-04-25T00:50:02.706 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.706+0000 7f00edea1640 1 -- 172.21.15.162:0/1521627495 shutdown_connections 2024-04-25T00:50:02.706 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.706+0000 7f00edea1640 1 --2- 172.21.15.162:0/1521627495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00e80701e0 0x7f00e815b780 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:02.706 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.706+0000 7f00edea1640 1 --2- 172.21.15.162:0/1521627495 >> v2:172.21.15.179:3300/0 conn(0x7f00e80c5990 0x7f00e806fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:02.706 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.706+0000 7f00edea1640 1 --2- 172.21.15.162:0/1521627495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00e813df60 0x7f00e80c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:02.706 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.706+0000 7f00edea1640 1 -- 172.21.15.162:0/1521627495 >> 172.21.15.162:0/1521627495 conn(0x7f00e80cc680 msgr2=0x7f00e80cca90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:02.706 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.706+0000 7f00edea1640 1 -- 172.21.15.162:0/1521627495 shutdown_connections 2024-04-25T00:50:02.706 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.706+0000 7f00edea1640 1 -- 172.21.15.162:0/1521627495 wait complete. 2024-04-25T00:50:02.709 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.706+0000 7f00edea1640 1 Processor -- start 2024-04-25T00:50:02.709 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.706+0000 7f00edea1640 1 -- start start 2024-04-25T00:50:02.711 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.710+0000 7f00edea1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e80701e0 0x7f00e8133c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:02.711 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.710+0000 7f00edea1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00e80c5990 0x7f00e81f17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:02.711 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.710+0000 7f00edea1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00e813df60 0x7f00e8137fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:02.711 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.710+0000 7f00edea1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f00e8158190 con 0x7f00e80c5990 2024-04-25T00:50:02.711 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.710+0000 7f00edea1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f00e815c0d0 con 0x7f00e80701e0 2024-04-25T00:50:02.711 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.710+0000 7f00edea1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f00e80c5d70 con 0x7f00e813df60 2024-04-25T00:50:02.712 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.710+0000 7f00e6ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00e80c5990 0x7f00e81f17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:02.712 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.710+0000 7f00e77fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e80701e0 0x7f00e8133c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:02.713 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.710+0000 7f00e7fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00e813df60 0x7f00e8137fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:02.713 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.714+0000 7f00e6ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00e80c5990 0x7f00e81f17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:33978/0 (socket says 172.21.15.162:33978) 2024-04-25T00:50:02.713 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.714+0000 7f00e6ffd640 1 -- 172.21.15.162:0/1712461712 learned_addr learned my addr 172.21.15.162:0/1712461712 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:02.723 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.722+0000 7f00e7fff640 1 -- 172.21.15.162:0/1712461712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e80701e0 msgr2=0x7f00e8133c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:02.723 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.722+0000 7f00e7fff640 1 --2- 172.21.15.162:0/1712461712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e80701e0 0x7f00e8133c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:02.723 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.722+0000 7f00e7fff640 1 -- 172.21.15.162:0/1712461712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00e80c5990 msgr2=0x7f00e81f17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:02.723 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.722+0000 7f00e7fff640 1 --2- 172.21.15.162:0/1712461712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00e80c5990 0x7f00e81f17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:02.723 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.722+0000 7f00e7fff640 1 -- 172.21.15.162:0/1712461712 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e80ca6e0 con 0x7f00e813df60 2024-04-25T00:50:02.729 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.730+0000 7f00e7fff640 1 --2- 172.21.15.162:0/1712461712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00e813df60 0x7f00e8137fa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f00e00ab000 tx=0x7f00e0019790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:02.739 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.738+0000 7f00cffff640 1 -- 172.21.15.162:0/1712461712 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e00a5670 con 0x7f00e813df60 2024-04-25T00:50:02.739 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.738+0000 7f00cffff640 1 -- 172.21.15.162:0/1712461712 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e00039a0 con 0x7f00e813df60 2024-04-25T00:50:02.740 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.738+0000 7f00edea1640 1 -- 172.21.15.162:0/1712461712 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e80ca120 con 0x7f00e813df60 2024-04-25T00:50:02.740 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.738+0000 7f00cffff640 1 -- 172.21.15.162:0/1712461712 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e0003d90 con 0x7f00e813df60 2024-04-25T00:50:02.740 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.738+0000 7f00edea1640 1 -- 172.21.15.162:0/1712461712 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e81f0ff0 con 0x7f00e813df60 2024-04-25T00:50:02.741 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:02.738+0000 7f00edea1640 1 -- 172.21.15.162:0/1712461712 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00e8068a10 con 0x7f00e813df60 2024-04-25T00:50:03.066 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:03.066+0000 7f00cffff640 1 -- 172.21.15.162:0/1712461712 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f00e00c1020 con 0x7f00e813df60 2024-04-25T00:50:03.067 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:03.066+0000 7f00cffff640 1 --2- 172.21.15.162:0/1712461712 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f00d4067830 0x7f00d4069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:03.067 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:03.066+0000 7f00e77fe640 1 --2- 172.21.15.162:0/1712461712 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f00d4067830 0x7f00d4069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:03.067 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:03.066+0000 7f00e77fe640 1 --2- 172.21.15.162:0/1712461712 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f00d4067830 0x7f00d4069cf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009580 tx=0x7f00d8009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:03.068 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:03.066+0000 7f00cffff640 1 -- 172.21.15.162:0/1712461712 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4857+0+0 (secure 0 0 0) 0x7f00e00f6bd0 con 0x7f00e813df60 2024-04-25T00:50:03.083 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:03.082+0000 7f00cffff640 1 -- 172.21.15.162:0/1712461712 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f00e00c8020 con 0x7f00e813df60 2024-04-25T00:50:03.260 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:03.258+0000 7f00edea1640 1 -- 172.21.15.162:0/1712461712 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f00e80c6460 con 0x7f00e813df60 2024-04-25T00:50:04.231 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:50:04.234 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:50:09.249 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:09.249+0000 7f00cffff640 1 -- 172.21.15.162:0/1712461712 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f00e00eca50 con 0x7f00e813df60 2024-04-25T00:50:09.477 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:09.477+0000 7f00cffff640 1 -- 172.21.15.162:0/1712461712 <== mon.2 v2:172.21.15.179:3301/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+12920 (secure 0 0 0) 0x7f00e00165e0 con 0x7f00e813df60 2024-04-25T00:50:09.478 INFO:teuthology.misc.health.smithi162.stdout: 2024-04-25T00:50:09.478 INFO:teuthology.misc.health.smithi162.stdout:{"epoch":20,"fsid":"e141deed-4794-4a17-83c9-f6e6e8875f5e","created":"2024-04-25T00:49:29.904605+0000","modified":"2024-04-25T00:49:56.302280+0000","last_up_change":"2024-04-25T00:49:51.119342+0000","last_in_change":"2024-04-25T00:49:39.898293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T00:49:52.297093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e20986cc-3664-4988-959c-c0b02e380775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6811","nonce":2734546478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6813","nonce":2734546478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6817","nonce":2734546478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6815","nonce":2734546478}]},"public_addr":"172.21.15.162:6811/2734546478","cluster_addr":"172.21.15.162:6813/2734546478","heartbeat_back_addr":"172.21.15.162:6817/2734546478","heartbeat_front_addr":"172.21.15.162:6815/2734546478","state":["exists","up"]},{"osd":1,"uuid":"60f1608a-ecb7-4978-b816-ce6f419e275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6803","nonce":3488816098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6805","nonce":3488816098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6809","nonce":3488816098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6807","nonce":3488816098}]},"public_addr":"172.21.15.162:6803/3488816098","cluster_addr":"172.21.15.162:6805/3488816098","heartbeat_back_addr":"172.21.15.162:6809/3488816098","heartbeat_front_addr":"172.21.15.162:6807/3488816098","state":["exists","up"]},{"osd":2,"uuid":"77552061-8e19-4f49-bc3f-1300955a07b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6819","nonce":234337516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6821","nonce":234337516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6825","nonce":234337516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6823","nonce":234337516}]},"public_addr":"172.21.15.162:6819/234337516","cluster_addr":"172.21.15.162:6821/234337516","heartbeat_back_addr":"172.21.15.162:6825/234337516","heartbeat_front_addr":"172.21.15.162:6823/234337516","state":["exists","up"]},{"osd":3,"uuid":"5b105720-6e6d-4143-b5c4-0a3b1e4a687c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6827","nonce":1726903362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6829","nonce":1726903362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6833","nonce":1726903362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6831","nonce":1726903362}]},"public_addr":"172.21.15.162:6827/1726903362","cluster_addr":"172.21.15.162:6829/1726903362","heartbeat_back_addr":"172.21.15.162:6833/1726903362","heartbeat_front_addr":"172.21.15.162:6831/1726903362","state":["exists","up"]},{"osd":4,"uuid":"611eafc5-2fe0-4c96-ba8c-b1efc3930de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6817","nonce":3338082657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6819","nonce":3338082657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6823","nonce":3338082657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6821","nonce":3338082657}]},"public_addr":"172.21.15.179:6817/3338082657","cluster_addr":"172.21.15.179:6819/3338082657","heartbeat_back_addr":"172.21.15.179:6823/3338082657","heartbeat_front_addr":"172.21.15.179:6821/3338082657","state":["exists","up"]},{"osd":5,"uuid":"b39487f5-c314-4026-90bd-02e30ecca04f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6825","nonce":4129338239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6827","nonce":4129338239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6831","nonce":4129338239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6829","nonce":4129338239}]},"public_addr":"172.21.15.179:6825/4129338239","cluster_addr":"172.21.15.179:6827/4129338239","heartbeat_back_addr":"172.21.15.179:6831/4129338239","heartbeat_front_addr":"172.21.15.179:6829/4129338239","state":["exists","up"]},{"osd":6,"uuid":"1d902755-f992-4070-b30e-e79f5fb22d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6801","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6802","nonce":823843016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6806","nonce":823843016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6815","nonce":823843016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6810","nonce":823843016}]},"public_addr":"172.21.15.179:6802/823843016","cluster_addr":"172.21.15.179:6806/823843016","heartbeat_back_addr":"172.21.15.179:6815/823843016","heartbeat_front_addr":"172.21.15.179:6810/823843016","state":["exists","up"]},{"osd":7,"uuid":"ea529f85-28fd-4dc3-a584-314e71999061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6803","nonce":3403659125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6807","nonce":3403659125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6814","nonce":3403659125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6811","nonce":3403659125}]},"public_addr":"172.21.15.179:6803/3403659125","cluster_addr":"172.21.15.179:6807/3403659125","heartbeat_back_addr":"172.21.15.179:6814/3403659125","heartbeat_front_addr":"172.21.15.179:6811/3403659125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.684518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.583123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.644576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.815957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.787155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.814409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.657210+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.676697+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T00:50:09.480 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:09.477+0000 7f00edea1640 1 -- 172.21.15.162:0/1712461712 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f00d4067830 msgr2=0x7f00d4069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:09.481 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:09.477+0000 7f00edea1640 1 --2- 172.21.15.162:0/1712461712 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f00d4067830 0x7f00d4069cf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00d8009580 tx=0x7f00d8009190 comp rx=0 tx=0).stop 2024-04-25T00:50:09.481 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:09.477+0000 7f00edea1640 1 -- 172.21.15.162:0/1712461712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00e813df60 msgr2=0x7f00e8137fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:09.481 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:09.477+0000 7f00edea1640 1 --2- 172.21.15.162:0/1712461712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00e813df60 0x7f00e8137fa0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f00e00ab000 tx=0x7f00e0019790 comp rx=0 tx=0).stop 2024-04-25T00:50:09.481 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:09.477+0000 7f00edea1640 1 -- 172.21.15.162:0/1712461712 shutdown_connections 2024-04-25T00:50:09.481 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:09.477+0000 7f00edea1640 1 --2- 172.21.15.162:0/1712461712 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00e813df60 0x7f00e8137fa0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:09.481 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:09.477+0000 7f00edea1640 1 --2- 172.21.15.162:0/1712461712 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f00d4067830 0x7f00d4069cf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:09.481 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:09.477+0000 7f00edea1640 1 --2- 172.21.15.162:0/1712461712 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00e80c5990 0x7f00e81f17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:09.481 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:09.477+0000 7f00edea1640 1 --2- 172.21.15.162:0/1712461712 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00e80701e0 0x7f00e8133c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:09.481 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:09.477+0000 7f00edea1640 1 -- 172.21.15.162:0/1712461712 >> 172.21.15.162:0/1712461712 conn(0x7f00e80cc680 msgr2=0x7f00e80cca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:09.481 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:09.477+0000 7f00edea1640 1 -- 172.21.15.162:0/1712461712 shutdown_connections 2024-04-25T00:50:09.481 INFO:teuthology.misc.health.smithi162.stderr:2024-04-25T00:50:09.477+0000 7f00edea1640 1 -- 172.21.15.162:0/1712461712 wait complete. 2024-04-25T00:50:09.499 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T00:50:09.499 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T00:50:09.499 DEBUG:tasks.ceph_manager:running mds.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.a.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-04-25T00:50:09.499 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T00:50:09.499 DEBUG:teuthology.orchestra.run.smithi162:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.a.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i a 2024-04-25T00:50:09.501 INFO:tasks.ceph.mds.a:Started 2024-04-25T00:50:09.502 DEBUG:tasks.ceph_manager:running mds.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.c.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-04-25T00:50:09.502 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T00:50:09.502 DEBUG:teuthology.orchestra.run.smithi162:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.c.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i c 2024-04-25T00:50:09.504 INFO:tasks.ceph.mds.c:Started 2024-04-25T00:50:09.504 DEBUG:tasks.ceph_manager:running mds.e under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.e.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-04-25T00:50:09.504 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-25T00:50:09.504 DEBUG:teuthology.orchestra.run.smithi162:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.e.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i e 2024-04-25T00:50:09.506 INFO:tasks.ceph.mds.e:Started 2024-04-25T00:50:09.506 DEBUG:tasks.ceph_manager:running mds.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.b.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-04-25T00:50:09.506 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T00:50:09.506 DEBUG:teuthology.orchestra.run.smithi179:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.b.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i b 2024-04-25T00:50:09.508 INFO:tasks.ceph.mds.b:Started 2024-04-25T00:50:09.509 DEBUG:tasks.ceph_manager:running mds.d under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.d.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-04-25T00:50:09.509 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T00:50:09.509 DEBUG:teuthology.orchestra.run.smithi179:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d 2024-04-25T00:50:09.511 INFO:tasks.ceph.mds.d:Started 2024-04-25T00:50:09.511 DEBUG:tasks.ceph_manager:running mds.f under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mds.f.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck'] 2024-04-25T00:50:09.511 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-25T00:50:09.511 DEBUG:teuthology.orchestra.run.smithi179:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.f.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i f 2024-04-25T00:50:09.513 INFO:tasks.ceph.mds.f:Started 2024-04-25T00:50:09.513 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T00:50:09.513 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T00:50:09.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.629+0000 7fa379f6a640 1 Processor -- start 2024-04-25T00:50:09.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.629+0000 7fa379f6a640 1 -- start start 2024-04-25T00:50:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.633+0000 7fa379f6a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa3740c9500 0x7fa374158a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.633+0000 7fa379f6a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa3740c6ab0 0x7fa374140ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.633+0000 7fa379f6a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3740c6fa0 con 0x7fa3740c88e0 2024-04-25T00:50:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.633+0000 7fa379f6a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa3740c7280 con 0x7fa3740c6ab0 2024-04-25T00:50:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.633+0000 7fa379f6a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fa3740c7560 con 0x7fa3740c9500 2024-04-25T00:50:09.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.633+0000 7fa3737fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa3740c9500 0x7fa374158a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:09.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.633+0000 7fa373fff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fa3740c88e0 0x7fa3740c57c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:53658/0 (socket says 172.21.15.162:53658) 2024-04-25T00:50:09.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.633+0000 7fa373fff640 1 -- 172.21.15.162:0/568370064 learned_addr learned my addr 172.21.15.162:0/568370064 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:09.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.633+0000 7fa372ffd640 1 --2- 172.21.15.162:0/568370064 >> v2:172.21.15.162:3300/0 conn(0x7fa3740c6ab0 0x7fa374140ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:09.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.641+0000 7fa372ffd640 1 -- 172.21.15.162:0/568370064 >> v2:172.21.15.179:3300/0 conn(0x7fa3740c9500 msgr2=0x7fa374158a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:09.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.641+0000 7fa372ffd640 1 --2- 172.21.15.162:0/568370064 >> v2:172.21.15.179:3300/0 conn(0x7fa3740c9500 0x7fa374158a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:09.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.641+0000 7fa372ffd640 1 -- 172.21.15.162:0/568370064 >> v1:172.21.15.179:6789/0 conn(0x7fa3740c88e0 legacy=0x7fa3740c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:09.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.641+0000 7fa372ffd640 1 -- 172.21.15.162:0/568370064 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa374158230 con 0x7fa3740c6ab0 2024-04-25T00:50:09.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.645+0000 7fa372ffd640 1 --2- 172.21.15.162:0/568370064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3740c6ab0 0x7fa374140ca0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa3740c6450 tx=0x7fa36801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f418587906a3ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:09.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.653+0000 7fa3727fc640 1 -- 172.21.15.162:0/568370064 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3680b5070 con 0x7fa3740c6ab0 2024-04-25T00:50:09.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.653+0000 7fa3727fc640 1 -- 172.21.15.162:0/568370064 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3680a8970 con 0x7fa3740c6ab0 2024-04-25T00:50:09.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.653+0000 7fa3727fc640 1 -- 172.21.15.162:0/568370064 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3680a8d40 con 0x7fa3740c6ab0 2024-04-25T00:50:09.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.657+0000 7fa379f6a640 1 -- 172.21.15.162:0/568370064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3740c6ab0 msgr2=0x7fa374140ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:09.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.657+0000 7fa379f6a640 1 --2- 172.21.15.162:0/568370064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3740c6ab0 0x7fa374140ca0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa3740c6450 tx=0x7fa36801ec70 comp rx=0 tx=0).stop 2024-04-25T00:50:09.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.657+0000 7fa379f6a640 1 -- 172.21.15.162:0/568370064 shutdown_connections 2024-04-25T00:50:09.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.657+0000 7fa379f6a640 1 --2- 172.21.15.162:0/568370064 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3740c6ab0 0x7fa374140ca0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:09.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.657+0000 7fa379f6a640 1 --2- 172.21.15.162:0/568370064 >> v2:172.21.15.179:3300/0 conn(0x7fa3740c9500 0x7fa374158a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:09.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.657+0000 7fa379f6a640 1 -- 172.21.15.162:0/568370064 >> 172.21.15.162:0/568370064 conn(0x7fa37406fab0 msgr2=0x7fa37406fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:09.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.657+0000 7fa379f6a640 1 -- 172.21.15.162:0/568370064 shutdown_connections 2024-04-25T00:50:09.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.657+0000 7fa379f6a640 1 -- 172.21.15.162:0/568370064 wait complete. 2024-04-25T00:50:09.660 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.657+0000 7fa379f6a640 1 Processor -- start 2024-04-25T00:50:09.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.657+0000 7fa379f6a640 1 -- start start 2024-04-25T00:50:09.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.661+0000 7fa379f6a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3740c6ab0 0x7fa37413d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:09.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.661+0000 7fa379f6a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3740c88e0 0x7fa3741ee930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:09.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.661+0000 7fa379f6a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3740c9500 0x7fa3741e2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:09.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.661+0000 7fa379f6a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa3740c98e0 con 0x7fa3740c88e0 2024-04-25T00:50:09.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.661+0000 7fa379f6a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa374158f70 con 0x7fa3740c9500 2024-04-25T00:50:09.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.661+0000 7fa379f6a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa3740c5ed0 con 0x7fa3740c6ab0 2024-04-25T00:50:09.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.661+0000 7fa3737fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3740c6ab0 0x7fa37413d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:09.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.661+0000 7fa372ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3740c88e0 0x7fa3741ee930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:09.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.661+0000 7fa373fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3740c9500 0x7fa3741e2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:09.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.661+0000 7fa3737fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3740c6ab0 0x7fa37413d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:58274/0 (socket says 172.21.15.162:58274) 2024-04-25T00:50:09.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.661+0000 7fa3737fe640 1 -- 172.21.15.162:0/97698495 learned_addr learned my addr 172.21.15.162:0/97698495 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:09.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.669+0000 7fa372ffd640 1 -- 172.21.15.162:0/97698495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3740c6ab0 msgr2=0x7fa37413d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:09.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.669+0000 7fa372ffd640 1 --2- 172.21.15.162:0/97698495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3740c6ab0 0x7fa37413d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:09.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.669+0000 7fa372ffd640 1 -- 172.21.15.162:0/97698495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3740c9500 msgr2=0x7fa3741e2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:09.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.669+0000 7fa372ffd640 1 --2- 172.21.15.162:0/97698495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3740c9500 0x7fa3741e2c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:09.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.669+0000 7fa372ffd640 1 -- 172.21.15.162:0/97698495 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3741eee70 con 0x7fa3740c88e0 2024-04-25T00:50:09.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.673+0000 7fa372ffd640 1 --2- 172.21.15.162:0/97698495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3740c88e0 0x7fa3741ee930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa3740c9c70 tx=0x7fa36801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:09.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.681+0000 7fa35bfff640 1 -- 172.21.15.162:0/97698495 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3680bf070 con 0x7fa3740c88e0 2024-04-25T00:50:09.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.681+0000 7fa35bfff640 1 -- 172.21.15.162:0/97698495 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3680b0720 con 0x7fa3740c88e0 2024-04-25T00:50:09.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.681+0000 7fa379f6a640 1 -- 172.21.15.162:0/97698495 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3741e31c0 con 0x7fa3740c88e0 2024-04-25T00:50:09.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.681+0000 7fa35bfff640 1 -- 172.21.15.162:0/97698495 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3680b5040 con 0x7fa3740c88e0 2024-04-25T00:50:09.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.681+0000 7fa379f6a640 1 -- 172.21.15.162:0/97698495 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3741e1be0 con 0x7fa3740c88e0 2024-04-25T00:50:09.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.681+0000 7fa359ffb640 1 -- 172.21.15.162:0/97698495 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa34c0052a0 con 0x7fa3740c88e0 2024-04-25T00:50:09.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.993+0000 7fa35bfff640 1 -- 172.21.15.162:0/97698495 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa3680c2070 con 0x7fa3740c88e0 2024-04-25T00:50:09.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.993+0000 7fa35bfff640 1 --2- 172.21.15.162:0/97698495 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa360067910 0x7fa360069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:09.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.993+0000 7fa3737fe640 1 --2- 172.21.15.162:0/97698495 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa360067910 0x7fa360069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:09.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:09.993+0000 7fa3737fe640 1 --2- 172.21.15.162:0/97698495 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa360067910 0x7fa360069dd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa364009c20 tx=0x7fa364009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:10.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.017+0000 7fa35bfff640 1 -- 172.21.15.162:0/97698495 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4857+0+0 (secure 0 0 0) 0x7fa3680f90e0 con 0x7fa3740c88e0 2024-04-25T00:50:10.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.017+0000 7fa35bfff640 1 -- 172.21.15.162:0/97698495 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa3680187d0 con 0x7fa3740c88e0 2024-04-25T00:50:10.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.189+0000 7fa359ffb640 1 -- 172.21.15.162:0/97698495 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa34c005860 con 0x7fa3740c88e0 2024-04-25T00:50:10.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.277+0000 7fa35bfff640 1 -- 172.21.15.162:0/97698495 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+12920 (secure 0 0 0) 0x7fa3680f28f0 con 0x7fa3740c88e0 2024-04-25T00:50:10.278 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:10.279 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":20,"fsid":"e141deed-4794-4a17-83c9-f6e6e8875f5e","created":"2024-04-25T00:49:29.904605+0000","modified":"2024-04-25T00:49:56.302280+0000","last_up_change":"2024-04-25T00:49:51.119342+0000","last_in_change":"2024-04-25T00:49:39.898293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T00:49:52.297093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e20986cc-3664-4988-959c-c0b02e380775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6811","nonce":2734546478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6813","nonce":2734546478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6817","nonce":2734546478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6815","nonce":2734546478}]},"public_addr":"172.21.15.162:6811/2734546478","cluster_addr":"172.21.15.162:6813/2734546478","heartbeat_back_addr":"172.21.15.162:6817/2734546478","heartbeat_front_addr":"172.21.15.162:6815/2734546478","state":["exists","up"]},{"osd":1,"uuid":"60f1608a-ecb7-4978-b816-ce6f419e275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6803","nonce":3488816098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6805","nonce":3488816098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6809","nonce":3488816098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6807","nonce":3488816098}]},"public_addr":"172.21.15.162:6803/3488816098","cluster_addr":"172.21.15.162:6805/3488816098","heartbeat_back_addr":"172.21.15.162:6809/3488816098","heartbeat_front_addr":"172.21.15.162:6807/3488816098","state":["exists","up"]},{"osd":2,"uuid":"77552061-8e19-4f49-bc3f-1300955a07b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6819","nonce":234337516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6821","nonce":234337516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6825","nonce":234337516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6823","nonce":234337516}]},"public_addr":"172.21.15.162:6819/234337516","cluster_addr":"172.21.15.162:6821/234337516","heartbeat_back_addr":"172.21.15.162:6825/234337516","heartbeat_front_addr":"172.21.15.162:6823/234337516","state":["exists","up"]},{"osd":3,"uuid":"5b105720-6e6d-4143-b5c4-0a3b1e4a687c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6827","nonce":1726903362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6829","nonce":1726903362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6833","nonce":1726903362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6831","nonce":1726903362}]},"public_addr":"172.21.15.162:6827/1726903362","cluster_addr":"172.21.15.162:6829/1726903362","heartbeat_back_addr":"172.21.15.162:6833/1726903362","heartbeat_front_addr":"172.21.15.162:6831/1726903362","state":["exists","up"]},{"osd":4,"uuid":"611eafc5-2fe0-4c96-ba8c-b1efc3930de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6817","nonce":3338082657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6819","nonce":3338082657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6823","nonce":3338082657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6821","nonce":3338082657}]},"public_addr":"172.21.15.179:6817/3338082657","cluster_addr":"172.21.15.179:6819/3338082657","heartbeat_back_addr":"172.21.15.179:6823/3338082657","heartbeat_front_addr":"172.21.15.179:6821/3338082657","state":["exists","up"]},{"osd":5,"uuid":"b39487f5-c314-4026-90bd-02e30ecca04f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6825","nonce":4129338239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6827","nonce":4129338239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6831","nonce":4129338239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6829","nonce":4129338239}]},"public_addr":"172.21.15.179:6825/4129338239","cluster_addr":"172.21.15.179:6827/4129338239","heartbeat_back_addr":"172.21.15.179:6831/4129338239","heartbeat_front_addr":"172.21.15.179:6829/4129338239","state":["exists","up"]},{"osd":6,"uuid":"1d902755-f992-4070-b30e-e79f5fb22d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6801","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6802","nonce":823843016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6806","nonce":823843016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6815","nonce":823843016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6810","nonce":823843016}]},"public_addr":"172.21.15.179:6802/823843016","cluster_addr":"172.21.15.179:6806/823843016","heartbeat_back_addr":"172.21.15.179:6815/823843016","heartbeat_front_addr":"172.21.15.179:6810/823843016","state":["exists","up"]},{"osd":7,"uuid":"ea529f85-28fd-4dc3-a584-314e71999061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6803","nonce":3403659125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6807","nonce":3403659125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6814","nonce":3403659125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6811","nonce":3403659125}]},"public_addr":"172.21.15.179:6803/3403659125","cluster_addr":"172.21.15.179:6807/3403659125","heartbeat_back_addr":"172.21.15.179:6814/3403659125","heartbeat_front_addr":"172.21.15.179:6811/3403659125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.684518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.583123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.644576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.815957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.787155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.814409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.657210+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.676697+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T00:50:10.280 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.277+0000 7fa359ffb640 1 -- 172.21.15.162:0/97698495 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa360067910 msgr2=0x7fa360069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:10.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.277+0000 7fa359ffb640 1 --2- 172.21.15.162:0/97698495 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa360067910 0x7fa360069dd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa364009c20 tx=0x7fa364009190 comp rx=0 tx=0).stop 2024-04-25T00:50:10.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.277+0000 7fa359ffb640 1 -- 172.21.15.162:0/97698495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3740c88e0 msgr2=0x7fa3741ee930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:10.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.277+0000 7fa359ffb640 1 --2- 172.21.15.162:0/97698495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3740c88e0 0x7fa3741ee930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa3740c9c70 tx=0x7fa36801ba10 comp rx=0 tx=0).stop 2024-04-25T00:50:10.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.277+0000 7fa359ffb640 1 -- 172.21.15.162:0/97698495 shutdown_connections 2024-04-25T00:50:10.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.277+0000 7fa359ffb640 1 --2- 172.21.15.162:0/97698495 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa3740c9500 0x7fa3741e2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:10.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.277+0000 7fa359ffb640 1 --2- 172.21.15.162:0/97698495 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa360067910 0x7fa360069dd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:10.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.277+0000 7fa359ffb640 1 --2- 172.21.15.162:0/97698495 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa3740c88e0 0x7fa3741ee930 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:10.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.277+0000 7fa359ffb640 1 --2- 172.21.15.162:0/97698495 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa3740c6ab0 0x7fa37413d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:10.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.277+0000 7fa359ffb640 1 -- 172.21.15.162:0/97698495 >> 172.21.15.162:0/97698495 conn(0x7fa37406fab0 msgr2=0x7fa374156880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:10.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.277+0000 7fa359ffb640 1 -- 172.21.15.162:0/97698495 shutdown_connections 2024-04-25T00:50:10.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.277+0000 7fa359ffb640 1 -- 172.21.15.162:0/97698495 wait complete. 2024-04-25T00:50:10.301 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T00:49:52.297093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T00:50:10.301 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T00:50:10.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.417+0000 7f1ba755f640 1 Processor -- start 2024-04-25T00:50:10.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.417+0000 7f1ba755f640 1 -- start start 2024-04-25T00:50:10.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.421+0000 7f1ba755f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1ba00c65b0 0x7f1ba00c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:10.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.421+0000 7f1ba755f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ba01576f0 0x7f1ba0157b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:10.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.421+0000 7f1ba755f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ba015a750 con 0x7f1ba01515b0 2024-04-25T00:50:10.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.421+0000 7f1ba755f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1ba015a9f0 con 0x7f1ba00c65b0 2024-04-25T00:50:10.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.421+0000 7f1ba755f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba015acd0 con 0x7f1ba01576f0 2024-04-25T00:50:10.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.421+0000 7f1ba5afc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ba01576f0 0x7f1ba0157b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:10.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.421+0000 7f1ba52fb640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f1ba01515b0 0x7f1ba013fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:40208/0 (socket says 172.21.15.162:40208) 2024-04-25T00:50:10.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.421+0000 7f1ba52fb640 1 -- 172.21.15.162:0/3077525480 learned_addr learned my addr 172.21.15.162:0/3077525480 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:10.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.421+0000 7f1ba4afa640 1 --2- 172.21.15.162:0/3077525480 >> v2:172.21.15.162:3300/0 conn(0x7f1ba00c65b0 0x7f1ba00c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:10.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.425+0000 7f1ba5afc640 1 -- 172.21.15.162:0/3077525480 >> v2:172.21.15.162:3300/0 conn(0x7f1ba00c65b0 msgr2=0x7f1ba00c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:10.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.425+0000 7f1ba5afc640 1 --2- 172.21.15.162:0/3077525480 >> v2:172.21.15.162:3300/0 conn(0x7f1ba00c65b0 0x7f1ba00c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:10.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.425+0000 7f1ba5afc640 1 -- 172.21.15.162:0/3077525480 >> v1:172.21.15.162:6789/0 conn(0x7f1ba01515b0 legacy=0x7f1ba013fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:10.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.425+0000 7f1ba5afc640 1 -- 172.21.15.162:0/3077525480 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba015afb0 con 0x7f1ba01576f0 2024-04-25T00:50:10.430 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.429+0000 7f1ba5afc640 1 --2- 172.21.15.162:0/3077525480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ba01576f0 0x7f1ba0157b00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1b98009d90 tx=0x7f1b9801c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93cd76e4dd3df059 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:10.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.433+0000 7f1b97fff640 1 -- 172.21.15.162:0/3077525480 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b980b2070 con 0x7f1ba01576f0 2024-04-25T00:50:10.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.433+0000 7f1b97fff640 1 -- 172.21.15.162:0/3077525480 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b980a5830 con 0x7f1ba01576f0 2024-04-25T00:50:10.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.433+0000 7f1b97fff640 1 -- 172.21.15.162:0/3077525480 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b980a5c00 con 0x7f1ba01576f0 2024-04-25T00:50:10.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.433+0000 7f1ba755f640 1 -- 172.21.15.162:0/3077525480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ba01576f0 msgr2=0x7f1ba0157b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:10.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.433+0000 7f1ba755f640 1 --2- 172.21.15.162:0/3077525480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ba01576f0 0x7f1ba0157b00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1b98009d90 tx=0x7f1b9801c970 comp rx=0 tx=0).stop 2024-04-25T00:50:10.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.433+0000 7f1ba755f640 1 -- 172.21.15.162:0/3077525480 shutdown_connections 2024-04-25T00:50:10.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.433+0000 7f1ba755f640 1 --2- 172.21.15.162:0/3077525480 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ba01576f0 0x7f1ba0157b00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:10.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.433+0000 7f1ba755f640 1 --2- 172.21.15.162:0/3077525480 >> v2:172.21.15.162:3300/0 conn(0x7f1ba00c65b0 0x7f1ba00c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:10.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.433+0000 7f1ba755f640 1 -- 172.21.15.162:0/3077525480 >> 172.21.15.162:0/3077525480 conn(0x7f1ba0070280 msgr2=0x7f1ba0070690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:10.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.433+0000 7f1ba755f640 1 -- 172.21.15.162:0/3077525480 shutdown_connections 2024-04-25T00:50:10.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.433+0000 7f1ba755f640 1 -- 172.21.15.162:0/3077525480 wait complete. 2024-04-25T00:50:10.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.437+0000 7f1ba755f640 1 Processor -- start 2024-04-25T00:50:10.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.437+0000 7f1ba755f640 1 -- start start 2024-04-25T00:50:10.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.437+0000 7f1ba755f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ba00c65b0 0x7f1ba0134490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:10.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.437+0000 7f1ba755f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ba01515b0 0x7f1ba013f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:10.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.437+0000 7f1ba755f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ba01576f0 0x7f1ba0150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:10.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.437+0000 7f1ba755f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba0140490 con 0x7f1ba01576f0 2024-04-25T00:50:10.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.437+0000 7f1ba755f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1ba0157160 con 0x7f1ba01515b0 2024-04-25T00:50:10.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.437+0000 7f1ba755f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1ba0140610 con 0x7f1ba00c65b0 2024-04-25T00:50:10.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.437+0000 7f1ba52fb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ba00c65b0 0x7f1ba0134490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:10.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.437+0000 7f1ba4afa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ba01515b0 0x7f1ba013f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:10.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.437+0000 7f1ba5afc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ba01576f0 0x7f1ba0150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:10.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.437+0000 7f1ba52fb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ba00c65b0 0x7f1ba0134490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:58288/0 (socket says 172.21.15.162:58288) 2024-04-25T00:50:10.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.437+0000 7f1ba52fb640 1 -- 172.21.15.162:0/678152524 learned_addr learned my addr 172.21.15.162:0/678152524 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:10.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.445+0000 7f1ba52fb640 1 -- 172.21.15.162:0/678152524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ba01515b0 msgr2=0x7f1ba013f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:10.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.445+0000 7f1ba52fb640 1 --2- 172.21.15.162:0/678152524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ba01515b0 0x7f1ba013f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:10.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.445+0000 7f1ba52fb640 1 -- 172.21.15.162:0/678152524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ba01576f0 msgr2=0x7f1ba0150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:10.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.445+0000 7f1ba52fb640 1 --2- 172.21.15.162:0/678152524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ba01576f0 0x7f1ba0150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:10.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.445+0000 7f1ba52fb640 1 -- 172.21.15.162:0/678152524 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ba00cd920 con 0x7f1ba00c65b0 2024-04-25T00:50:10.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.445+0000 7f1ba52fb640 1 --2- 172.21.15.162:0/678152524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ba00c65b0 0x7f1ba0134490 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c00c450 tx=0x7f1b9c00c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:10.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.453+0000 7f1b95ffb640 1 -- 172.21.15.162:0/678152524 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c017070 con 0x7f1ba00c65b0 2024-04-25T00:50:10.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.453+0000 7f1b95ffb640 1 -- 172.21.15.162:0/678152524 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b9c005cf0 con 0x7f1ba00c65b0 2024-04-25T00:50:10.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.453+0000 7f1ba755f640 1 -- 172.21.15.162:0/678152524 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ba01374d0 con 0x7f1ba00c65b0 2024-04-25T00:50:10.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.453+0000 7f1b95ffb640 1 -- 172.21.15.162:0/678152524 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c0072f0 con 0x7f1ba00c65b0 2024-04-25T00:50:10.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.453+0000 7f1ba755f640 1 -- 172.21.15.162:0/678152524 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ba013d210 con 0x7f1ba00c65b0 2024-04-25T00:50:10.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.453+0000 7f1ba755f640 1 -- 172.21.15.162:0/678152524 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ba0075110 con 0x7f1ba00c65b0 2024-04-25T00:50:10.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.485+0000 7f1b95ffb640 1 -- 172.21.15.162:0/678152524 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1b9c01a070 con 0x7f1ba00c65b0 2024-04-25T00:50:10.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.485+0000 7f1b95ffb640 1 --2- 172.21.15.162:0/678152524 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1b84067910 0x7f1b84069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:10.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.485+0000 7f1ba4afa640 1 --2- 172.21.15.162:0/678152524 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1b84067910 0x7f1b84069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:10.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.485+0000 7f1ba4afa640 1 --2- 172.21.15.162:0/678152524 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1b84067910 0x7f1b84069dd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00c5100 tx=0x7f1b90009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:10.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.493+0000 7f1b95ffb640 1 -- 172.21.15.162:0/678152524 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4857+0+0 (secure 0 0 0) 0x7f1b9c05c140 con 0x7f1ba00c65b0 2024-04-25T00:50:10.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:10.933+0000 7f1b95ffb640 1 -- 172.21.15.162:0/678152524 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f1b9c021020 con 0x7f1ba00c65b0 2024-04-25T00:50:11.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:11.201+0000 7f1ba755f640 1 -- 172.21.15.162:0/678152524 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1ba0154db0 con 0x7f1ba00c65b0 2024-04-25T00:50:13.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:13.909+0000 7f1b95ffb640 1 -- 172.21.15.162:0/678152524 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f1b9c055950 con 0x7f1ba00c65b0 2024-04-25T00:50:13.910 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-04-25T00:50:13.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:13.909+0000 7f1ba755f640 1 -- 172.21.15.162:0/678152524 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1b84067910 msgr2=0x7f1b84069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:13.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:13.909+0000 7f1ba755f640 1 --2- 172.21.15.162:0/678152524 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1b84067910 0x7f1b84069dd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1ba00c5100 tx=0x7f1b90009190 comp rx=0 tx=0).stop 2024-04-25T00:50:13.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:13.909+0000 7f1ba755f640 1 -- 172.21.15.162:0/678152524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ba00c65b0 msgr2=0x7f1ba0134490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:13.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:13.909+0000 7f1ba755f640 1 --2- 172.21.15.162:0/678152524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ba00c65b0 0x7f1ba0134490 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c00c450 tx=0x7f1b9c00c910 comp rx=0 tx=0).stop 2024-04-25T00:50:13.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:13.909+0000 7f1ba755f640 1 -- 172.21.15.162:0/678152524 shutdown_connections 2024-04-25T00:50:13.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:13.909+0000 7f1ba755f640 1 --2- 172.21.15.162:0/678152524 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1b84067910 0x7f1b84069dd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:13.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:13.909+0000 7f1ba755f640 1 --2- 172.21.15.162:0/678152524 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ba01576f0 0x7f1ba0150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:13.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:13.909+0000 7f1ba755f640 1 --2- 172.21.15.162:0/678152524 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ba01515b0 0x7f1ba013f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:13.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:13.909+0000 7f1ba755f640 1 --2- 172.21.15.162:0/678152524 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ba00c65b0 0x7f1ba0134490 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:13.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:13.909+0000 7f1ba755f640 1 -- 172.21.15.162:0/678152524 >> 172.21.15.162:0/678152524 conn(0x7f1ba0070280 msgr2=0x7f1ba0070660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:13.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:13.909+0000 7f1ba755f640 1 -- 172.21.15.162:0/678152524 shutdown_connections 2024-04-25T00:50:13.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:13.909+0000 7f1ba755f640 1 -- 172.21.15.162:0/678152524 wait complete. 2024-04-25T00:50:13.931 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T00:50:14.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.029+0000 7f72d4b12640 1 Processor -- start 2024-04-25T00:50:14.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.029+0000 7f72d4b12640 1 -- start start 2024-04-25T00:50:14.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.033+0000 7f72d4b12640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d0157100 0x7f72d0072f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:14.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.033+0000 7f72d4b12640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f72d0073460 0x7f72d00cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:14.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.033+0000 7f72d4b12640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72d00c6550 con 0x7f72d014da30 2024-04-25T00:50:14.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.033+0000 7f72d4b12640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f72d00c5ea0 con 0x7f72d0073460 2024-04-25T00:50:14.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.033+0000 7f72d4b12640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f72d00c6810 con 0x7f72d0157100 2024-04-25T00:50:14.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.033+0000 7f72cdd9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d0157100 0x7f72d0072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:14.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.033+0000 7f72ce59c640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f72d014da30 0x7f72d00c4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:57306/0 (socket says 172.21.15.162:57306) 2024-04-25T00:50:14.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.033+0000 7f72ce59c640 1 -- 172.21.15.162:0/3425723703 learned_addr learned my addr 172.21.15.162:0/3425723703 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:14.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.033+0000 7f72ced9d640 1 --2- 172.21.15.162:0/3425723703 >> v2:172.21.15.162:3300/0 conn(0x7f72d0073460 0x7f72d00cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:14.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.037+0000 7f72cdd9b640 1 -- 172.21.15.162:0/3425723703 >> v2:172.21.15.162:3300/0 conn(0x7f72d0073460 msgr2=0x7f72d00cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:14.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.037+0000 7f72cdd9b640 1 --2- 172.21.15.162:0/3425723703 >> v2:172.21.15.162:3300/0 conn(0x7f72d0073460 0x7f72d00cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:14.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.037+0000 7f72cdd9b640 1 -- 172.21.15.162:0/3425723703 >> v1:172.21.15.162:6789/0 conn(0x7f72d014da30 legacy=0x7f72d00c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:14.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.037+0000 7f72cdd9b640 1 -- 172.21.15.162:0/3425723703 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d00c6af0 con 0x7f72d0157100 2024-04-25T00:50:14.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.041+0000 7f72cdd9b640 1 --2- 172.21.15.162:0/3425723703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d0157100 0x7f72d0072f20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f72c40097c0 tx=0x7f72c401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff9e2097ce68549 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:14.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.045+0000 7f72cd59a640 1 -- 172.21.15.162:0/3425723703 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c40b0070 con 0x7f72d0157100 2024-04-25T00:50:14.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.045+0000 7f72cd59a640 1 -- 172.21.15.162:0/3425723703 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c40ab600 con 0x7f72d0157100 2024-04-25T00:50:14.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.045+0000 7f72cd59a640 1 -- 172.21.15.162:0/3425723703 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c40ab9d0 con 0x7f72d0157100 2024-04-25T00:50:14.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.049+0000 7f72d4b12640 1 -- 172.21.15.162:0/3425723703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d0157100 msgr2=0x7f72d0072f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:14.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.049+0000 7f72d4b12640 1 --2- 172.21.15.162:0/3425723703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d0157100 0x7f72d0072f20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f72c40097c0 tx=0x7f72c401c4a0 comp rx=0 tx=0).stop 2024-04-25T00:50:14.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.049+0000 7f72d4b12640 1 -- 172.21.15.162:0/3425723703 shutdown_connections 2024-04-25T00:50:14.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.049+0000 7f72d4b12640 1 --2- 172.21.15.162:0/3425723703 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d0157100 0x7f72d0072f20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:14.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.049+0000 7f72d4b12640 1 --2- 172.21.15.162:0/3425723703 >> v2:172.21.15.162:3300/0 conn(0x7f72d0073460 0x7f72d00cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:14.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.049+0000 7f72d4b12640 1 -- 172.21.15.162:0/3425723703 >> 172.21.15.162:0/3425723703 conn(0x7f72d0070350 msgr2=0x7f72d0070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:14.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.049+0000 7f72d4b12640 1 -- 172.21.15.162:0/3425723703 shutdown_connections 2024-04-25T00:50:14.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.049+0000 7f72d4b12640 1 -- 172.21.15.162:0/3425723703 wait complete. 2024-04-25T00:50:14.052 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.049+0000 7f72d4b12640 1 Processor -- start 2024-04-25T00:50:14.052 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.049+0000 7f72d4b12640 1 -- start start 2024-04-25T00:50:14.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.053+0000 7f72d4b12640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d0073460 0x7f72d0146c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:14.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.053+0000 7f72d4b12640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72d014da30 0x7f72d0142500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:14.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.053+0000 7f72d4b12640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72d0157100 0x7f72d0141030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:14.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.053+0000 7f72d4b12640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f72d00c6dd0 con 0x7f72d014da30 2024-04-25T00:50:14.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.053+0000 7f72d4b12640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f72d0151710 con 0x7f72d0157100 2024-04-25T00:50:14.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.053+0000 7f72d4b12640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f72d014de10 con 0x7f72d0073460 2024-04-25T00:50:14.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.053+0000 7f72ce59c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d0073460 0x7f72d0146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:14.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.053+0000 7f72cdd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72d014da30 0x7f72d0142500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:14.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.053+0000 7f72ce59c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d0073460 0x7f72d0146c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:36926/0 (socket says 172.21.15.162:36926) 2024-04-25T00:50:14.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.053+0000 7f72ce59c640 1 -- 172.21.15.162:0/3962680016 learned_addr learned my addr 172.21.15.162:0/3962680016 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:14.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.053+0000 7f72ced9d640 1 --2- 172.21.15.162:0/3962680016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72d0157100 0x7f72d0141030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:14.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.057+0000 7f72ce59c640 1 -- 172.21.15.162:0/3962680016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72d0157100 msgr2=0x7f72d0141030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:14.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.057+0000 7f72ce59c640 1 --2- 172.21.15.162:0/3962680016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72d0157100 0x7f72d0141030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:14.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.057+0000 7f72ce59c640 1 -- 172.21.15.162:0/3962680016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72d014da30 msgr2=0x7f72d0142500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:14.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.057+0000 7f72ce59c640 1 --2- 172.21.15.162:0/3962680016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72d014da30 0x7f72d0142500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:14.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.057+0000 7f72ce59c640 1 -- 172.21.15.162:0/3962680016 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d01f1300 con 0x7f72d0073460 2024-04-25T00:50:14.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.061+0000 7f72ce59c640 1 --2- 172.21.15.162:0/3962680016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d0073460 0x7f72d0146c90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f72c000c420 tx=0x7f72c000c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:14.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.065+0000 7f72beffd640 1 -- 172.21.15.162:0/3962680016 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0017070 con 0x7f72d0073460 2024-04-25T00:50:14.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.065+0000 7f72d4b12640 1 -- 172.21.15.162:0/3962680016 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72d01f15e0 con 0x7f72d0073460 2024-04-25T00:50:14.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.065+0000 7f72d4b12640 1 -- 172.21.15.162:0/3962680016 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f72d01f1ba0 con 0x7f72d0073460 2024-04-25T00:50:14.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.065+0000 7f72d4b12640 1 -- 172.21.15.162:0/3962680016 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72d0161860 con 0x7f72d0073460 2024-04-25T00:50:14.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.069+0000 7f72beffd640 1 -- 172.21.15.162:0/3962680016 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72c0005cf0 con 0x7f72d0073460 2024-04-25T00:50:14.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.113+0000 7f72beffd640 1 -- 172.21.15.162:0/3962680016 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72c0021060 con 0x7f72d0073460 2024-04-25T00:50:14.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.209+0000 7f72beffd640 1 -- 172.21.15.162:0/3962680016 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f72c001a070 con 0x7f72d0073460 2024-04-25T00:50:14.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.209+0000 7f72beffd640 1 --2- 172.21.15.162:0/3962680016 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f72b00678c0 0x7f72b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:14.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.209+0000 7f72cdd9b640 1 --2- 172.21.15.162:0/3962680016 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f72b00678c0 0x7f72b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:14.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.209+0000 7f72cdd9b640 1 --2- 172.21.15.162:0/3962680016 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f72b00678c0 0x7f72b0069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f72c40ad000 tx=0x7f72c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:14.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.533+0000 7f72beffd640 1 -- 172.21.15.162:0/3962680016 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4857+0+0 (secure 0 0 0) 0x7f72c0053db0 con 0x7f72d0073460 2024-04-25T00:50:14.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.553+0000 7f72beffd640 1 -- 172.21.15.162:0/3962680016 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f72c0055d10 con 0x7f72d0073460 2024-04-25T00:50:14.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:14.749+0000 7f72d4b12640 1 -- 172.21.15.162:0/3962680016 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72d004f5f0 con 0x7f72d0073460 2024-04-25T00:50:17.244 INFO:tasks.ceph.mds.e.smithi162.stdout:starting mds.e at 2024-04-25T00:50:17.586 INFO:tasks.ceph.mds.d.smithi179.stdout:starting mds.d at 2024-04-25T00:50:18.773 INFO:tasks.ceph.mds.b.smithi179.stdout:starting mds.b at 2024-04-25T00:50:18.859 INFO:tasks.ceph.mds.a.smithi162.stdout:starting mds.a at 2024-04-25T00:50:20.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:20.849+0000 7f72beffd640 1 -- 172.21.15.162:0/3962680016 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f72c005a010 con 0x7f72d0073460 2024-04-25T00:50:20.852 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:20.852 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-04-25T00:50:20.852 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 1 2024-04-25T00:50:20.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:20.853+0000 7f72d4b12640 1 -- 172.21.15.162:0/3962680016 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f72b00678c0 msgr2=0x7f72b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:20.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:20.853+0000 7f72d4b12640 1 --2- 172.21.15.162:0/3962680016 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f72b00678c0 0x7f72b0069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f72c40ad000 tx=0x7f72c4008040 comp rx=0 tx=0).stop 2024-04-25T00:50:20.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:20.853+0000 7f72d4b12640 1 -- 172.21.15.162:0/3962680016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d0073460 msgr2=0x7f72d0146c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:20.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:20.853+0000 7f72d4b12640 1 --2- 172.21.15.162:0/3962680016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d0073460 0x7f72d0146c90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f72c000c420 tx=0x7f72c000c8e0 comp rx=0 tx=0).stop 2024-04-25T00:50:20.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:20.853+0000 7f72d4b12640 1 -- 172.21.15.162:0/3962680016 shutdown_connections 2024-04-25T00:50:20.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:20.853+0000 7f72d4b12640 1 --2- 172.21.15.162:0/3962680016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f72d0157100 0x7f72d0141030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:20.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:20.853+0000 7f72d4b12640 1 --2- 172.21.15.162:0/3962680016 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f72b00678c0 0x7f72b0069d80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:20.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:20.853+0000 7f72d4b12640 1 --2- 172.21.15.162:0/3962680016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f72d014da30 0x7f72d0142500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:20.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:20.853+0000 7f72d4b12640 1 --2- 172.21.15.162:0/3962680016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f72d0073460 0x7f72d0146c90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:20.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:20.853+0000 7f72d4b12640 1 -- 172.21.15.162:0/3962680016 >> 172.21.15.162:0/3962680016 conn(0x7f72d0070350 msgr2=0x7f72d014bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:20.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:20.853+0000 7f72d4b12640 1 -- 172.21.15.162:0/3962680016 shutdown_connections 2024-04-25T00:50:20.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:20.853+0000 7f72d4b12640 1 -- 172.21.15.162:0/3962680016 wait complete. 2024-04-25T00:50:21.145 INFO:tasks.ceph.mds.c.smithi162.stdout:starting mds.c at 2024-04-25T00:50:21.230 INFO:tasks.ceph.mds.f.smithi179.stdout:starting mds.f at 2024-04-25T00:50:22.885 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T00:50:23.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.017+0000 7fbd02540640 1 Processor -- start 2024-04-25T00:50:23.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.017+0000 7fbd02540640 1 -- start start 2024-04-25T00:50:23.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.017+0000 7fbd02540640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fbcfc0c1890 0x7fbcfc0c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:23.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.017+0000 7fbd02540640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc0c8ee0 0x7fbcfc0c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:23.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.017+0000 7fbd02540640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcfc0c5630 con 0x7fbcfc15c310 2024-04-25T00:50:23.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.017+0000 7fbd02540640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fbcfc15be80 con 0x7fbcfc0c1890 2024-04-25T00:50:23.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.017+0000 7fbd02540640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbcfc0c58f0 con 0x7fbcfc0c8ee0 2024-04-25T00:50:23.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.017+0000 7fbcfb7fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fbcfc15c310 0x7fbcfc1580a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:56568/0 (socket says 172.21.15.162:56568) 2024-04-25T00:50:23.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.017+0000 7fbcfb7fe640 1 -- 172.21.15.162:0/2108347581 learned_addr learned my addr 172.21.15.162:0/2108347581 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:23.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.021+0000 7fbcfbfff640 1 --2- 172.21.15.162:0/2108347581 >> v2:172.21.15.179:3300/0 conn(0x7fbcfc0c1890 0x7fbcfc0c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:23.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.021+0000 7fbd00add640 1 --2- 172.21.15.162:0/2108347581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc0c8ee0 0x7fbcfc0c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:23.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.021+0000 7fbcfaffd640 1 -- 172.21.15.162:0/2108347581 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3258306709 0 0) 0x7fbcfc0c5630 con 0x7fbcfc15c310 2024-04-25T00:50:23.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.021+0000 7fbcfaffd640 1 -- 172.21.15.162:0/2108347581 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbce4003530 con 0x7fbcfc15c310 2024-04-25T00:50:23.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.025+0000 7fbcfaffd640 1 -- 172.21.15.162:0/2108347581 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2490309419 0 0) 0x7fbce4003530 con 0x7fbcfc15c310 2024-04-25T00:50:23.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.025+0000 7fbcfaffd640 1 -- 172.21.15.162:0/2108347581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc0c8ee0 msgr2=0x7fbcfc0c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:23.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.025+0000 7fbcfaffd640 1 --2- 172.21.15.162:0/2108347581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc0c8ee0 0x7fbcfc0c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:23.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.025+0000 7fbcfaffd640 1 -- 172.21.15.162:0/2108347581 >> v2:172.21.15.179:3300/0 conn(0x7fbcfc0c1890 msgr2=0x7fbcfc0c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:23.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.025+0000 7fbcfaffd640 1 --2- 172.21.15.162:0/2108347581 >> v2:172.21.15.179:3300/0 conn(0x7fbcfc0c1890 0x7fbcfc0c1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:23.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.025+0000 7fbcfaffd640 1 -- 172.21.15.162:0/2108347581 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcfc0c5bd0 con 0x7fbcfc15c310 2024-04-25T00:50:23.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.025+0000 7fbcfaffd640 1 -- 172.21.15.162:0/2108347581 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7fbcf0001680 con 0x7fbcfc15c310 2024-04-25T00:50:23.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.025+0000 7fbcfaffd640 1 -- 172.21.15.162:0/2108347581 >> v1:172.21.15.162:6789/0 conn(0x7fbcfc15c310 legacy=0x7fbcfc1580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:23.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.025+0000 7fbcfaffd640 1 --2- 172.21.15.162:0/2108347581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce40039c0 0x7fbce4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:23.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.025+0000 7fbcfaffd640 1 --2- 172.21.15.162:0/2108347581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc0c8ee0 0x7fbce4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:23.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.025+0000 7fbcfaffd640 1 --2- 172.21.15.162:0/2108347581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce4004d50 0x7fbce40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:23.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.025+0000 7fbcfaffd640 1 -- 172.21.15.162:0/2108347581 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc15be80 con 0x7fbce4004d50 2024-04-25T00:50:23.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.025+0000 7fbcfaffd640 1 -- 172.21.15.162:0/2108347581 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc0c58f0 con 0x7fbce40039c0 2024-04-25T00:50:23.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.025+0000 7fbcfaffd640 1 -- 172.21.15.162:0/2108347581 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbce400b9d0 con 0x7fbcfc0c8ee0 2024-04-25T00:50:23.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.029+0000 7fbd00add640 1 --2- 172.21.15.162:0/2108347581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce4004d50 0x7fbce40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:23.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.033+0000 7fbcfbfff640 1 --2- 172.21.15.162:0/2108347581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce40039c0 0x7fbce4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:23.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.033+0000 7fbd00add640 1 -- 172.21.15.162:0/2108347581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc0c8ee0 msgr2=0x7fbce4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:23.036 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.033+0000 7fbd00add640 1 --2- 172.21.15.162:0/2108347581 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc0c8ee0 0x7fbce4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:23.036 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.033+0000 7fbd00add640 1 -- 172.21.15.162:0/2108347581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce40039c0 msgr2=0x7fbce4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:23.036 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.033+0000 7fbd00add640 1 --2- 172.21.15.162:0/2108347581 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce40039c0 0x7fbce4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:23.036 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.033+0000 7fbd00add640 1 -- 172.21.15.162:0/2108347581 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce4003530 con 0x7fbce4004d50 2024-04-25T00:50:23.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.037+0000 7fbd00add640 1 --2- 172.21.15.162:0/2108347581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce4004d50 0x7fbce40051d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009fc0 tx=0x7fbcf401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04e3006792ff76a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:23.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.041+0000 7fbcfaffd640 1 -- 172.21.15.162:0/2108347581 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf40b2070 con 0x7fbce4004d50 2024-04-25T00:50:23.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.041+0000 7fbcfaffd640 1 -- 172.21.15.162:0/2108347581 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf40a5c90 con 0x7fbce4004d50 2024-04-25T00:50:23.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.041+0000 7fbcfaffd640 1 -- 172.21.15.162:0/2108347581 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf4009c10 con 0x7fbce4004d50 2024-04-25T00:50:23.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.045+0000 7fbd02540640 1 -- 172.21.15.162:0/2108347581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce4004d50 msgr2=0x7fbce40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:23.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.045+0000 7fbd02540640 1 --2- 172.21.15.162:0/2108347581 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbce4004d50 0x7fbce40051d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fbcf4009fc0 tx=0x7fbcf401cc80 comp rx=0 tx=0).stop 2024-04-25T00:50:23.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.045+0000 7fbd00add640 1 -- 172.21.15.162:0/2108347581 reap_dead start 2024-04-25T00:50:23.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.045+0000 7fbd02540640 1 -- 172.21.15.162:0/2108347581 shutdown_connections 2024-04-25T00:50:23.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.045+0000 7fbd02540640 1 -- 172.21.15.162:0/2108347581 >> 172.21.15.162:0/2108347581 conn(0x7fbcfc0c83c0 msgr2=0x7fbcfc0c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:23.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.045+0000 7fbd02540640 1 -- 172.21.15.162:0/2108347581 shutdown_connections 2024-04-25T00:50:23.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.045+0000 7fbd02540640 1 -- 172.21.15.162:0/2108347581 wait complete. 2024-04-25T00:50:23.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.045+0000 7fbd02540640 1 Processor -- start 2024-04-25T00:50:23.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.045+0000 7fbd02540640 1 -- start start 2024-04-25T00:50:23.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.045+0000 7fbd02540640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce4004d50 0x7fbcfc1f4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:23.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.045+0000 7fbd02540640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc0c2460 0x7fbcfc1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:23.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.045+0000 7fbd02540640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcfc137fc0 0x7fbcfc138440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:23.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.045+0000 7fbd02540640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc0c6ee0 con 0x7fbcfc137fc0 2024-04-25T00:50:23.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.045+0000 7fbd02540640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fbcfc15bb10 con 0x7fbce4004d50 2024-04-25T00:50:23.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.045+0000 7fbd02540640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fbcfc0c7060 con 0x7fbcfc0c2460 2024-04-25T00:50:23.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.049+0000 7fbcfbfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce4004d50 0x7fbcfc1f4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:23.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.049+0000 7fbcfb7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc0c2460 0x7fbcfc1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:23.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.049+0000 7fbcfb7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc0c2460 0x7fbcfc1555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:40650/0 (socket says 172.21.15.162:40650) 2024-04-25T00:50:23.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.049+0000 7fbcfb7fe640 1 -- 172.21.15.162:0/3812338293 learned_addr learned my addr 172.21.15.162:0/3812338293 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:23.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.053+0000 7fbd00add640 1 --2- 172.21.15.162:0/3812338293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcfc137fc0 0x7fbcfc138440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:23.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.053+0000 7fbcfb7fe640 1 -- 172.21.15.162:0/3812338293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce4004d50 msgr2=0x7fbcfc1f4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:23.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.053+0000 7fbcfb7fe640 1 --2- 172.21.15.162:0/3812338293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce4004d50 0x7fbcfc1f4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:23.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.053+0000 7fbcfb7fe640 1 -- 172.21.15.162:0/3812338293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcfc137fc0 msgr2=0x7fbcfc138440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:23.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.053+0000 7fbcfb7fe640 1 --2- 172.21.15.162:0/3812338293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcfc137fc0 0x7fbcfc138440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:23.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.053+0000 7fbcfb7fe640 1 -- 172.21.15.162:0/3812338293 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcfc138980 con 0x7fbcfc0c2460 2024-04-25T00:50:23.058 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:23.057+0000 7fbcfb7fe640 1 --2- 172.21.15.162:0/3812338293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc0c2460 0x7fbcfc1555f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000c790 tx=0x7fbcf000cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:25.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.205+0000 7fbcf8ff9640 1 -- 172.21.15.162:0/3812338293 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0018070 con 0x7fbcfc0c2460 2024-04-25T00:50:25.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.205+0000 7fbcf8ff9640 1 -- 172.21.15.162:0/3812338293 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcf00074e0 con 0x7fbcfc0c2460 2024-04-25T00:50:25.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.205+0000 7fbcf8ff9640 1 -- 172.21.15.162:0/3812338293 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcf0004a30 con 0x7fbcfc0c2460 2024-04-25T00:50:25.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.205+0000 7fbd02540640 1 -- 172.21.15.162:0/3812338293 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcfc1f4770 con 0x7fbcfc0c2460 2024-04-25T00:50:25.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.205+0000 7fbd02540640 1 -- 172.21.15.162:0/3812338293 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcfc154830 con 0x7fbcfc0c2460 2024-04-25T00:50:25.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.209+0000 7fbd02540640 1 -- 172.21.15.162:0/3812338293 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcfc161800 con 0x7fbcfc0c2460 2024-04-25T00:50:25.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.525+0000 7fbcf8ff9640 1 -- 172.21.15.162:0/3812338293 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbcf001b070 con 0x7fbcfc0c2460 2024-04-25T00:50:25.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.529+0000 7fbcf8ff9640 1 --2- 172.21.15.162:0/3812338293 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fbce8067910 0x7fbce8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:25.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.529+0000 7fbcfbfff640 1 --2- 172.21.15.162:0/3812338293 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fbce8067910 0x7fbce8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:25.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.529+0000 7fbcfbfff640 1 --2- 172.21.15.162:0/3812338293 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fbce8067910 0x7fbce8069dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbcec009b60 tx=0x7fbcec008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:25.540 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.537+0000 7fbcf8ff9640 1 -- 172.21.15.162:0/3812338293 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(20..20 src has 1..20) ==== 4857+0+0 (secure 0 0 0) 0x7fbcf005c470 con 0x7fbcfc0c2460 2024-04-25T00:50:25.572 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.569+0000 7fbcf8ff9640 1 -- 172.21.15.162:0/3812338293 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fbcf0022020 con 0x7fbcfc0c2460 2024-04-25T00:50:25.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.773+0000 7fbd02540640 1 -- 172.21.15.162:0/3812338293 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbcfc04f5f0 con 0x7fbcfc0c2460 2024-04-25T00:50:25.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.973+0000 7fbcf8ff9640 1 -- 172.21.15.162:0/3812338293 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3046 (secure 0 0 0) 0x7fbcf0055c80 con 0x7fbcfc0c2460 2024-04-25T00:50:25.976 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:25.976 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1339390327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1339390327},{"type":"v1","addr":"172.21.15.179:6835","nonce":1339390327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4240,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/191105979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":191105979},{"type":"v1","addr":"172.21.15.162:6835","nonce":191105979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4246,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1743481688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1743481688},{"type":"v1","addr":"172.21.15.162:6837","nonce":1743481688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T00:50:25.976 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 3 2024-04-25T00:50:25.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.977+0000 7fbd02540640 1 -- 172.21.15.162:0/3812338293 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fbce8067910 msgr2=0x7fbce8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:25.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.977+0000 7fbd02540640 1 --2- 172.21.15.162:0/3812338293 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fbce8067910 0x7fbce8069dd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbcec009b60 tx=0x7fbcec008040 comp rx=0 tx=0).stop 2024-04-25T00:50:25.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.977+0000 7fbd02540640 1 -- 172.21.15.162:0/3812338293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc0c2460 msgr2=0x7fbcfc1555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:25.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.977+0000 7fbd02540640 1 --2- 172.21.15.162:0/3812338293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc0c2460 0x7fbcfc1555f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbcf000c790 tx=0x7fbcf000cc50 comp rx=0 tx=0).stop 2024-04-25T00:50:25.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.977+0000 7fbd02540640 1 -- 172.21.15.162:0/3812338293 shutdown_connections 2024-04-25T00:50:25.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.977+0000 7fbd02540640 1 --2- 172.21.15.162:0/3812338293 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fbce8067910 0x7fbce8069dd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:25.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.977+0000 7fbd02540640 1 --2- 172.21.15.162:0/3812338293 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fbcfc137fc0 0x7fbcfc138440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:25.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.977+0000 7fbd02540640 1 --2- 172.21.15.162:0/3812338293 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fbcfc0c2460 0x7fbcfc1555f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:25.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.977+0000 7fbd02540640 1 --2- 172.21.15.162:0/3812338293 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fbce4004d50 0x7fbcfc1f4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:25.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.977+0000 7fbd02540640 1 -- 172.21.15.162:0/3812338293 >> 172.21.15.162:0/3812338293 conn(0x7fbcfc0c83c0 msgr2=0x7fbcfc074880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:25.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.977+0000 7fbd02540640 1 -- 172.21.15.162:0/3812338293 shutdown_connections 2024-04-25T00:50:25.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:25.977+0000 7fbd02540640 1 -- 172.21.15.162:0/3812338293 wait complete. 2024-04-25T00:50:28.007 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T00:50:28.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.137+0000 7f8a564ef640 1 Processor -- start 2024-04-25T00:50:28.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.137+0000 7f8a564ef640 1 -- start start 2024-04-25T00:50:28.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.137+0000 7f8a564ef640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a50157100 0x7f8a50072f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:28.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.137+0000 7f8a564ef640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8a50073460 0x7f8a500cc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:28.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.137+0000 7f8a564ef640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a500c6550 con 0x7f8a5014da30 2024-04-25T00:50:28.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.141+0000 7f8a564ef640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f8a500c5ea0 con 0x7f8a50073460 2024-04-25T00:50:28.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.141+0000 7f8a564ef640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8a500c6810 con 0x7f8a50157100 2024-04-25T00:50:28.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.141+0000 7f8a4ffff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8a5014da30 0x7f8a500c4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:56578/0 (socket says 172.21.15.162:56578) 2024-04-25T00:50:28.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.141+0000 7f8a4ffff640 1 -- 172.21.15.162:0/1153294527 learned_addr learned my addr 172.21.15.162:0/1153294527 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:28.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.141+0000 7f8a4f7fe640 1 --2- 172.21.15.162:0/1153294527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a50157100 0x7f8a50072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:28.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.141+0000 7f8a54a8c640 1 --2- 172.21.15.162:0/1153294527 >> v2:172.21.15.179:3300/0 conn(0x7f8a50073460 0x7f8a500cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:28.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.141+0000 7f8a4effd640 1 -- 172.21.15.162:0/1153294527 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 941050014 0 0) 0x7f8a500c6550 con 0x7f8a5014da30 2024-04-25T00:50:28.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.141+0000 7f8a4effd640 1 -- 172.21.15.162:0/1153294527 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a38003530 con 0x7f8a5014da30 2024-04-25T00:50:28.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.149+0000 7f8a4effd640 1 -- 172.21.15.162:0/1153294527 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 431187742 0 0) 0x7f8a38003530 con 0x7f8a5014da30 2024-04-25T00:50:28.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.149+0000 7f8a4effd640 1 -- 172.21.15.162:0/1153294527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a50157100 msgr2=0x7f8a50072f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:28.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.149+0000 7f8a4effd640 1 --2- 172.21.15.162:0/1153294527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a50157100 0x7f8a50072f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:28.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.149+0000 7f8a4effd640 1 -- 172.21.15.162:0/1153294527 >> v2:172.21.15.179:3300/0 conn(0x7f8a50073460 msgr2=0x7f8a500cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:28.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.149+0000 7f8a4effd640 1 --2- 172.21.15.162:0/1153294527 >> v2:172.21.15.179:3300/0 conn(0x7f8a50073460 0x7f8a500cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:28.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.149+0000 7f8a4effd640 1 -- 172.21.15.162:0/1153294527 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a500c6af0 con 0x7f8a5014da30 2024-04-25T00:50:28.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.149+0000 7f8a4effd640 1 -- 172.21.15.162:0/1153294527 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7f8a40001680 con 0x7f8a5014da30 2024-04-25T00:50:28.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.149+0000 7f8a4effd640 1 -- 172.21.15.162:0/1153294527 >> v1:172.21.15.162:6789/0 conn(0x7f8a5014da30 legacy=0x7f8a500c4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:28.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.149+0000 7f8a4effd640 1 --2- 172.21.15.162:0/1153294527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a380039c0 0x7f8a38003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:28.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.149+0000 7f8a4effd640 1 --2- 172.21.15.162:0/1153294527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a38004810 0x7f8a38004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:28.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.149+0000 7f8a4effd640 1 --2- 172.21.15.162:0/1153294527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a50157100 0x7f8a380051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:28.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.149+0000 7f8a4effd640 1 -- 172.21.15.162:0/1153294527 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a500c6810 con 0x7f8a380039c0 2024-04-25T00:50:28.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.149+0000 7f8a4effd640 1 -- 172.21.15.162:0/1153294527 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3800b9d0 con 0x7f8a38004810 2024-04-25T00:50:28.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.149+0000 7f8a4effd640 1 -- 172.21.15.162:0/1153294527 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3800bb50 con 0x7f8a50157100 2024-04-25T00:50:28.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.153+0000 7f8a4ffff640 1 --2- 172.21.15.162:0/1153294527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a380039c0 0x7f8a38003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:28.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.153+0000 7f8a4ffff640 1 -- 172.21.15.162:0/1153294527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a50157100 msgr2=0x7f8a380051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:28.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.153+0000 7f8a4ffff640 1 --2- 172.21.15.162:0/1153294527 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a50157100 0x7f8a380051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:28.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.153+0000 7f8a4ffff640 1 -- 172.21.15.162:0/1153294527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a38004810 msgr2=0x7f8a38004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:28.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.153+0000 7f8a4ffff640 1 --2- 172.21.15.162:0/1153294527 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a38004810 0x7f8a38004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:28.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.153+0000 7f8a4ffff640 1 -- 172.21.15.162:0/1153294527 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a38003530 con 0x7f8a380039c0 2024-04-25T00:50:28.160 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.157+0000 7f8a4ffff640 1 --2- 172.21.15.162:0/1153294527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a380039c0 0x7f8a38003de0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000c190 tx=0x7f8a4001cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9acdd51e13c5f79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:28.164 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.161+0000 7f8a4effd640 1 -- 172.21.15.162:0/1153294527 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40007c70 con 0x7f8a380039c0 2024-04-25T00:50:28.164 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.161+0000 7f8a4effd640 1 -- 172.21.15.162:0/1153294527 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a400a9020 con 0x7f8a380039c0 2024-04-25T00:50:28.164 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.161+0000 7f8a4effd640 1 -- 172.21.15.162:0/1153294527 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40005ae0 con 0x7f8a380039c0 2024-04-25T00:50:28.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a564ef640 1 -- 172.21.15.162:0/1153294527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a380039c0 msgr2=0x7f8a38003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:28.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a564ef640 1 --2- 172.21.15.162:0/1153294527 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a380039c0 0x7f8a38003de0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000c190 tx=0x7f8a4001cb80 comp rx=0 tx=0).stop 2024-04-25T00:50:28.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a54a8c640 1 -- 172.21.15.162:0/1153294527 reap_dead start 2024-04-25T00:50:28.165 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a564ef640 1 -- 172.21.15.162:0/1153294527 shutdown_connections 2024-04-25T00:50:28.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a564ef640 1 -- 172.21.15.162:0/1153294527 >> 172.21.15.162:0/1153294527 conn(0x7f8a50070350 msgr2=0x7f8a50070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:28.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a564ef640 1 -- 172.21.15.162:0/1153294527 shutdown_connections 2024-04-25T00:50:28.166 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a564ef640 1 -- 172.21.15.162:0/1153294527 wait complete. 2024-04-25T00:50:28.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a564ef640 1 Processor -- start 2024-04-25T00:50:28.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a564ef640 1 -- start start 2024-04-25T00:50:28.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a564ef640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a5006c4c0 0x7f8a501f2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:28.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a564ef640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a500cb370 0x7f8a501f2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:28.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a564ef640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a5006c8a0 0x7f8a501412d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:28.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a564ef640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8a500c6dd0 con 0x7f8a5006c8a0 2024-04-25T00:50:28.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a564ef640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8a50151710 con 0x7f8a500cb370 2024-04-25T00:50:28.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a564ef640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8a5014de10 con 0x7f8a5006c4c0 2024-04-25T00:50:28.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a54a8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a5006c8a0 0x7f8a501412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:28.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a54a8c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a5006c8a0 0x7f8a501412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:53870/0 (socket says 172.21.15.162:53870) 2024-04-25T00:50:28.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a54a8c640 1 -- 172.21.15.162:0/843504693 learned_addr learned my addr 172.21.15.162:0/843504693 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:28.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.165+0000 7f8a4f7fe640 1 --2- 172.21.15.162:0/843504693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a500cb370 0x7f8a501f2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:28.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.169+0000 7f8a4ffff640 1 --2- 172.21.15.162:0/843504693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a5006c4c0 0x7f8a501f2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:28.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.169+0000 7f8a54a8c640 1 -- 172.21.15.162:0/843504693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a5006c4c0 msgr2=0x7f8a501f2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:28.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.169+0000 7f8a54a8c640 1 --2- 172.21.15.162:0/843504693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a5006c4c0 0x7f8a501f2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:28.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.169+0000 7f8a54a8c640 1 -- 172.21.15.162:0/843504693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a500cb370 msgr2=0x7f8a501f2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:28.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.169+0000 7f8a54a8c640 1 --2- 172.21.15.162:0/843504693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a500cb370 0x7f8a501f2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:28.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.169+0000 7f8a54a8c640 1 -- 172.21.15.162:0/843504693 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a500c9b70 con 0x7f8a5006c8a0 2024-04-25T00:50:28.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.173+0000 7f8a54a8c640 1 --2- 172.21.15.162:0/843504693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a5006c8a0 0x7f8a501412d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8a500cdaf0 tx=0x7f8a4800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:28.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.177+0000 7f8a4cff9640 1 -- 172.21.15.162:0/843504693 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4800bae0 con 0x7f8a5006c8a0 2024-04-25T00:50:28.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.177+0000 7f8a4cff9640 1 -- 172.21.15.162:0/843504693 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4801a070 con 0x7f8a5006c8a0 2024-04-25T00:50:28.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.177+0000 7f8a564ef640 1 -- 172.21.15.162:0/843504693 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a500c9e50 con 0x7f8a5006c8a0 2024-04-25T00:50:28.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.177+0000 7f8a4cff9640 1 -- 172.21.15.162:0/843504693 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a48014400 con 0x7f8a5006c8a0 2024-04-25T00:50:28.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.177+0000 7f8a564ef640 1 -- 172.21.15.162:0/843504693 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a500cab70 con 0x7f8a5006c8a0 2024-04-25T00:50:28.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.177+0000 7f8a564ef640 1 -- 172.21.15.162:0/843504693 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a5004f5f0 con 0x7f8a5006c8a0 2024-04-25T00:50:28.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.197+0000 7f8a4cff9640 1 -- 172.21.15.162:0/843504693 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8a48013070 con 0x7f8a5006c8a0 2024-04-25T00:50:28.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.197+0000 7f8a4cff9640 1 --2- 172.21.15.162:0/843504693 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8a3c067850 0x7f8a3c069d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:28.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.197+0000 7f8a4ffff640 1 --2- 172.21.15.162:0/843504693 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8a3c067850 0x7f8a3c069d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:28.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.197+0000 7f8a4ffff640 1 --2- 172.21.15.162:0/843504693 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8a3c067850 0x7f8a3c069d10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8a400aa000 tx=0x7f8a500c80d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:28.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.201+0000 7f8a4cff9640 1 -- 172.21.15.162:0/843504693 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4857+0+0 (secure 0 0 0) 0x7f8a48055040 con 0x7f8a5006c8a0 2024-04-25T00:50:28.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.505+0000 7f8a4cff9640 1 -- 172.21.15.162:0/843504693 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8a48024020 con 0x7f8a5006c8a0 2024-04-25T00:50:28.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.713+0000 7f8a564ef640 1 -- 172.21.15.162:0/843504693 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a500c7440 con 0x7f8a5006c8a0 2024-04-25T00:50:28.766 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.765+0000 7f8a4cff9640 1 -- 172.21.15.162:0/843504693 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+5524 (secure 0 0 0) 0x7f8a48056fa0 con 0x7f8a5006c8a0 2024-04-25T00:50:28.767 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:28.767 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/560649188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":560649188},{"type":"v1","addr":"172.21.15.179:6833","nonce":560649188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":4233,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1339390327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1339390327},{"type":"v1","addr":"172.21.15.179:6835","nonce":1339390327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4240,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/191105979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":191105979},{"type":"v1","addr":"172.21.15.162:6835","nonce":191105979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/2357127318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2357127318},{"type":"v1","addr":"172.21.15.162:6839","nonce":2357127318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":4244,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6837/2607965795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2607965795},{"type":"v1","addr":"172.21.15.179:6837","nonce":2607965795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":4246,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6837/1743481688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1743481688},{"type":"v1","addr":"172.21.15.162:6837","nonce":1743481688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T00:50:28.767 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 4 2024-04-25T00:50:28.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.769+0000 7f8a564ef640 1 -- 172.21.15.162:0/843504693 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8a3c067850 msgr2=0x7f8a3c069d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:28.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.769+0000 7f8a564ef640 1 --2- 172.21.15.162:0/843504693 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8a3c067850 0x7f8a3c069d10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8a400aa000 tx=0x7f8a500c80d0 comp rx=0 tx=0).stop 2024-04-25T00:50:28.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.769+0000 7f8a564ef640 1 -- 172.21.15.162:0/843504693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a5006c8a0 msgr2=0x7f8a501412d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:28.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.769+0000 7f8a564ef640 1 --2- 172.21.15.162:0/843504693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a5006c8a0 0x7f8a501412d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8a500cdaf0 tx=0x7f8a4800b480 comp rx=0 tx=0).stop 2024-04-25T00:50:28.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.769+0000 7f8a564ef640 1 -- 172.21.15.162:0/843504693 shutdown_connections 2024-04-25T00:50:28.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.769+0000 7f8a564ef640 1 --2- 172.21.15.162:0/843504693 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8a3c067850 0x7f8a3c069d10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:28.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.769+0000 7f8a564ef640 1 --2- 172.21.15.162:0/843504693 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8a5006c8a0 0x7f8a501412d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:28.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.769+0000 7f8a564ef640 1 --2- 172.21.15.162:0/843504693 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8a500cb370 0x7f8a501f2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:28.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.769+0000 7f8a564ef640 1 --2- 172.21.15.162:0/843504693 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8a5006c4c0 0x7f8a501f2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:28.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.769+0000 7f8a564ef640 1 -- 172.21.15.162:0/843504693 >> 172.21.15.162:0/843504693 conn(0x7f8a50070350 msgr2=0x7f8a501494f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:28.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.769+0000 7f8a564ef640 1 -- 172.21.15.162:0/843504693 shutdown_connections 2024-04-25T00:50:28.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.769+0000 7f8a564ef640 1 -- 172.21.15.162:0/843504693 wait complete. 2024-04-25T00:50:28.788 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T00:50:28.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.905+0000 7f2267a6c640 1 Processor -- start 2024-04-25T00:50:28.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.905+0000 7f2267a6c640 1 -- start start 2024-04-25T00:50:28.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.909+0000 7f2267a6c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f226015bac0 0x7f226015bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:28.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.909+0000 7f2267a6c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f226006c150 0x7f226006c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:28.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.909+0000 7f2267a6c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22600cd9e0 con 0x7f2260154650 2024-04-25T00:50:28.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.909+0000 7f2267a6c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f22600cdcc0 con 0x7f226006c150 2024-04-25T00:50:28.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.909+0000 7f2267a6c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f22600cdfa0 con 0x7f226015bac0 2024-04-25T00:50:28.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.909+0000 7f2266009640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f226006c150 0x7f226006c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:28.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.909+0000 7f2265808640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f2260154650 0x7f22600cf010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:56586/0 (socket says 172.21.15.162:56586) 2024-04-25T00:50:28.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.909+0000 7f2265808640 1 -- 172.21.15.162:0/402519699 learned_addr learned my addr 172.21.15.162:0/402519699 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:28.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.913+0000 7f2266009640 1 -- 172.21.15.162:0/402519699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f226015bac0 msgr2=0x7f226015bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:28.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.913+0000 7f2266009640 1 --2- 172.21.15.162:0/402519699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f226015bac0 0x7f226015bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:28.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.913+0000 7f2266009640 1 -- 172.21.15.162:0/402519699 >> v1:172.21.15.162:6789/0 conn(0x7f2260154650 legacy=0x7f22600cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:28.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.913+0000 7f2266009640 1 -- 172.21.15.162:0/402519699 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22600ce280 con 0x7f226006c150 2024-04-25T00:50:28.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.917+0000 7f2266009640 1 --2- 172.21.15.162:0/402519699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f226006c150 0x7f226006c5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f224c0097c0 tx=0x7f224c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92ca98f59ad83994 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:28.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.921+0000 7f2264806640 1 -- 172.21.15.162:0/402519699 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c0b5070 con 0x7f226006c150 2024-04-25T00:50:28.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.921+0000 7f2264806640 1 -- 172.21.15.162:0/402519699 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f224c0a8990 con 0x7f226006c150 2024-04-25T00:50:28.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.921+0000 7f2264806640 1 -- 172.21.15.162:0/402519699 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f224c0a8d60 con 0x7f226006c150 2024-04-25T00:50:28.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.921+0000 7f2267a6c640 1 -- 172.21.15.162:0/402519699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f226006c150 msgr2=0x7f226006c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:28.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.925+0000 7f2267a6c640 1 --2- 172.21.15.162:0/402519699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f226006c150 0x7f226006c5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f224c0097c0 tx=0x7f224c01ec90 comp rx=0 tx=0).stop 2024-04-25T00:50:28.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.925+0000 7f2267a6c640 1 -- 172.21.15.162:0/402519699 shutdown_connections 2024-04-25T00:50:28.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.925+0000 7f2267a6c640 1 --2- 172.21.15.162:0/402519699 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f226015bac0 0x7f226015bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:28.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.925+0000 7f2267a6c640 1 --2- 172.21.15.162:0/402519699 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f226006c150 0x7f226006c5e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:28.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.925+0000 7f2267a6c640 1 -- 172.21.15.162:0/402519699 >> 172.21.15.162:0/402519699 conn(0x7f22600b1710 msgr2=0x7f22600b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:28.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.925+0000 7f2267a6c640 1 -- 172.21.15.162:0/402519699 shutdown_connections 2024-04-25T00:50:28.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.925+0000 7f2267a6c640 1 -- 172.21.15.162:0/402519699 wait complete. 2024-04-25T00:50:28.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.925+0000 7f2267a6c640 1 Processor -- start 2024-04-25T00:50:28.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.925+0000 7f2267a6c640 1 -- start start 2024-04-25T00:50:28.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.925+0000 7f2267a6c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f226006c150 0x7f22600c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:28.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.925+0000 7f2267a6c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2260154650 0x7f2260155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:28.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.925+0000 7f2267a6c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f226015bac0 0x7f22601560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:28.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.925+0000 7f2267a6c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f226015c400 con 0x7f2260154650 2024-04-25T00:50:28.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.925+0000 7f2267a6c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f22600ce840 con 0x7f226006c150 2024-04-25T00:50:28.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.925+0000 7f2267a6c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f226006cb20 con 0x7f226015bac0 2024-04-25T00:50:28.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.925+0000 7f2265007640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2260154650 0x7f2260155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:28.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.925+0000 7f2265007640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2260154650 0x7f2260155b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:53878/0 (socket says 172.21.15.162:53878) 2024-04-25T00:50:28.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.925+0000 7f2265007640 1 -- 172.21.15.162:0/4240578887 learned_addr learned my addr 172.21.15.162:0/4240578887 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:28.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.929+0000 7f2265007640 1 -- 172.21.15.162:0/4240578887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f226015bac0 msgr2=0x7f22601560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:28.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.929+0000 7f2265007640 1 --2- 172.21.15.162:0/4240578887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f226015bac0 0x7f22601560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:28.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.929+0000 7f2265007640 1 -- 172.21.15.162:0/4240578887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f226006c150 msgr2=0x7f22600c82c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:28.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.929+0000 7f2265007640 1 --2- 172.21.15.162:0/4240578887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f226006c150 0x7f22600c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:28.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.929+0000 7f2265007640 1 -- 172.21.15.162:0/4240578887 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22601f0850 con 0x7f2260154650 2024-04-25T00:50:28.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.933+0000 7f2265007640 1 --2- 172.21.15.162:0/4240578887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2260154650 0x7f2260155b80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f225400ba50 tx=0x7f225400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:28.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.937+0000 7f225e7fc640 1 -- 172.21.15.162:0/4240578887 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2254019070 con 0x7f2260154650 2024-04-25T00:50:28.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.937+0000 7f225e7fc640 1 -- 172.21.15.162:0/4240578887 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f225400cb80 con 0x7f2260154650 2024-04-25T00:50:28.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.937+0000 7f225e7fc640 1 -- 172.21.15.162:0/4240578887 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2254014440 con 0x7f2260154650 2024-04-25T00:50:28.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.937+0000 7f2267a6c640 1 -- 172.21.15.162:0/4240578887 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22601f0b30 con 0x7f2260154650 2024-04-25T00:50:28.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.937+0000 7f2267a6c640 1 -- 172.21.15.162:0/4240578887 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22601f10f0 con 0x7f2260154650 2024-04-25T00:50:28.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:28.941+0000 7f2267a6c640 1 -- 172.21.15.162:0/4240578887 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2260068a20 con 0x7f2260154650 2024-04-25T00:50:29.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.225+0000 7f225e7fc640 1 -- 172.21.15.162:0/4240578887 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f225401c070 con 0x7f2260154650 2024-04-25T00:50:29.228 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.225+0000 7f225e7fc640 1 --2- 172.21.15.162:0/4240578887 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2244067910 0x7f2244069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:29.228 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.225+0000 7f2265808640 1 --2- 172.21.15.162:0/4240578887 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2244067910 0x7f2244069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:29.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.229+0000 7f2265808640 1 --2- 172.21.15.162:0/4240578887 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2244067910 0x7f2244069dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2258000f70 tx=0x7f2258007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:29.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.265+0000 7f225e7fc640 1 -- 172.21.15.162:0/4240578887 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4857+0+0 (secure 0 0 0) 0x7f225405cb10 con 0x7f2260154650 2024-04-25T00:50:29.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.265+0000 7f225e7fc640 1 -- 172.21.15.162:0/4240578887 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f2254023020 con 0x7f2260154650 2024-04-25T00:50:29.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.433+0000 7f2267a6c640 1 -- 172.21.15.162:0/4240578887 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2260153e80 con 0x7f2260154650 2024-04-25T00:50:29.466 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.465+0000 7f225e7fc640 1 -- 172.21.15.162:0/4240578887 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+12920 (secure 0 0 0) 0x7f2254056970 con 0x7f2260154650 2024-04-25T00:50:29.466 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:29.466 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":20,"fsid":"e141deed-4794-4a17-83c9-f6e6e8875f5e","created":"2024-04-25T00:49:29.904605+0000","modified":"2024-04-25T00:49:56.302280+0000","last_up_change":"2024-04-25T00:49:51.119342+0000","last_in_change":"2024-04-25T00:49:39.898293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T00:49:52.297093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e20986cc-3664-4988-959c-c0b02e380775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6811","nonce":2734546478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6813","nonce":2734546478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6817","nonce":2734546478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6815","nonce":2734546478}]},"public_addr":"172.21.15.162:6811/2734546478","cluster_addr":"172.21.15.162:6813/2734546478","heartbeat_back_addr":"172.21.15.162:6817/2734546478","heartbeat_front_addr":"172.21.15.162:6815/2734546478","state":["exists","up"]},{"osd":1,"uuid":"60f1608a-ecb7-4978-b816-ce6f419e275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6803","nonce":3488816098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6805","nonce":3488816098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6809","nonce":3488816098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6807","nonce":3488816098}]},"public_addr":"172.21.15.162:6803/3488816098","cluster_addr":"172.21.15.162:6805/3488816098","heartbeat_back_addr":"172.21.15.162:6809/3488816098","heartbeat_front_addr":"172.21.15.162:6807/3488816098","state":["exists","up"]},{"osd":2,"uuid":"77552061-8e19-4f49-bc3f-1300955a07b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6819","nonce":234337516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6821","nonce":234337516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6825","nonce":234337516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6823","nonce":234337516}]},"public_addr":"172.21.15.162:6819/234337516","cluster_addr":"172.21.15.162:6821/234337516","heartbeat_back_addr":"172.21.15.162:6825/234337516","heartbeat_front_addr":"172.21.15.162:6823/234337516","state":["exists","up"]},{"osd":3,"uuid":"5b105720-6e6d-4143-b5c4-0a3b1e4a687c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6827","nonce":1726903362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6829","nonce":1726903362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6833","nonce":1726903362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6831","nonce":1726903362}]},"public_addr":"172.21.15.162:6827/1726903362","cluster_addr":"172.21.15.162:6829/1726903362","heartbeat_back_addr":"172.21.15.162:6833/1726903362","heartbeat_front_addr":"172.21.15.162:6831/1726903362","state":["exists","up"]},{"osd":4,"uuid":"611eafc5-2fe0-4c96-ba8c-b1efc3930de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6817","nonce":3338082657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6819","nonce":3338082657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6823","nonce":3338082657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6821","nonce":3338082657}]},"public_addr":"172.21.15.179:6817/3338082657","cluster_addr":"172.21.15.179:6819/3338082657","heartbeat_back_addr":"172.21.15.179:6823/3338082657","heartbeat_front_addr":"172.21.15.179:6821/3338082657","state":["exists","up"]},{"osd":5,"uuid":"b39487f5-c314-4026-90bd-02e30ecca04f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6825","nonce":4129338239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6827","nonce":4129338239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6831","nonce":4129338239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6829","nonce":4129338239}]},"public_addr":"172.21.15.179:6825/4129338239","cluster_addr":"172.21.15.179:6827/4129338239","heartbeat_back_addr":"172.21.15.179:6831/4129338239","heartbeat_front_addr":"172.21.15.179:6829/4129338239","state":["exists","up"]},{"osd":6,"uuid":"1d902755-f992-4070-b30e-e79f5fb22d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6801","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6802","nonce":823843016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6806","nonce":823843016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6815","nonce":823843016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6810","nonce":823843016}]},"public_addr":"172.21.15.179:6802/823843016","cluster_addr":"172.21.15.179:6806/823843016","heartbeat_back_addr":"172.21.15.179:6815/823843016","heartbeat_front_addr":"172.21.15.179:6810/823843016","state":["exists","up"]},{"osd":7,"uuid":"ea529f85-28fd-4dc3-a584-314e71999061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6803","nonce":3403659125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6807","nonce":3403659125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6814","nonce":3403659125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6811","nonce":3403659125}]},"public_addr":"172.21.15.179:6803/3403659125","cluster_addr":"172.21.15.179:6807/3403659125","heartbeat_back_addr":"172.21.15.179:6814/3403659125","heartbeat_front_addr":"172.21.15.179:6811/3403659125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.684518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.583123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.644576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.815957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.787155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.814409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.657210+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.676697+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T00:50:29.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.469+0000 7f2267a6c640 1 -- 172.21.15.162:0/4240578887 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2244067910 msgr2=0x7f2244069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:29.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.469+0000 7f2267a6c640 1 --2- 172.21.15.162:0/4240578887 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2244067910 0x7f2244069dd0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2258000f70 tx=0x7f2258007a90 comp rx=0 tx=0).stop 2024-04-25T00:50:29.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.469+0000 7f2267a6c640 1 -- 172.21.15.162:0/4240578887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2260154650 msgr2=0x7f2260155b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:29.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.469+0000 7f2267a6c640 1 --2- 172.21.15.162:0/4240578887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2260154650 0x7f2260155b80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f225400ba50 tx=0x7f225400bf10 comp rx=0 tx=0).stop 2024-04-25T00:50:29.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.469+0000 7f2267a6c640 1 -- 172.21.15.162:0/4240578887 shutdown_connections 2024-04-25T00:50:29.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.469+0000 7f2267a6c640 1 --2- 172.21.15.162:0/4240578887 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f226015bac0 0x7f22601560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:29.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.469+0000 7f2267a6c640 1 --2- 172.21.15.162:0/4240578887 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2244067910 0x7f2244069dd0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:29.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.469+0000 7f2267a6c640 1 --2- 172.21.15.162:0/4240578887 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2260154650 0x7f2260155b80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:29.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.469+0000 7f2267a6c640 1 --2- 172.21.15.162:0/4240578887 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f226006c150 0x7f22600c82c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:29.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.469+0000 7f2267a6c640 1 -- 172.21.15.162:0/4240578887 >> 172.21.15.162:0/4240578887 conn(0x7f22600b1710 msgr2=0x7f22600d0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:29.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.469+0000 7f2267a6c640 1 -- 172.21.15.162:0/4240578887 shutdown_connections 2024-04-25T00:50:29.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.469+0000 7f2267a6c640 1 -- 172.21.15.162:0/4240578887 wait complete. 2024-04-25T00:50:29.489 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T00:49:52.297093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T00:50:29.489 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T00:50:29.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.609+0000 7f8adc241640 1 Processor -- start 2024-04-25T00:50:29.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.609+0000 7f8adc241640 1 -- start start 2024-04-25T00:50:29.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.609+0000 7f8adc241640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8ad4151410 0x7f8ad41570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:29.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.609+0000 7f8adc241640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad415b1d0 0x7f8ad40c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:29.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.609+0000 7f8adc241640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad415a760 con 0x7f8ad40c65c0 2024-04-25T00:50:29.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.609+0000 7f8adc241640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f8ad40c3200 con 0x7f8ad4151410 2024-04-25T00:50:29.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.609+0000 7f8adc241640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad415b5f0 con 0x7f8ad415b1d0 2024-04-25T00:50:29.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.609+0000 7f8ada7de640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8ad40c65c0 0x7f8ad4072c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:56596/0 (socket says 172.21.15.162:56596) 2024-04-25T00:50:29.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.609+0000 7f8ada7de640 1 -- 172.21.15.162:0/2440165095 learned_addr learned my addr 172.21.15.162:0/2440165095 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:29.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.609+0000 7f8ad97dc640 1 --2- 172.21.15.162:0/2440165095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad415b1d0 0x7f8ad40c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:29.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.609+0000 7f8ad9fdd640 1 --2- 172.21.15.162:0/2440165095 >> v2:172.21.15.179:3300/0 conn(0x7f8ad4151410 0x7f8ad41570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:29.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.613+0000 7f8ad8fdb640 1 -- 172.21.15.162:0/2440165095 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2841454657 0 0) 0x7f8ad415a760 con 0x7f8ad40c65c0 2024-04-25T00:50:29.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.613+0000 7f8ad8fdb640 1 -- 172.21.15.162:0/2440165095 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ac0003530 con 0x7f8ad40c65c0 2024-04-25T00:50:29.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.617+0000 7f8ad9fdd640 1 -- 172.21.15.162:0/2440165095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad415b1d0 msgr2=0x7f8ad40c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:29.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.617+0000 7f8ad9fdd640 1 --2- 172.21.15.162:0/2440165095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad415b1d0 0x7f8ad40c2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:29.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.617+0000 7f8ad9fdd640 1 -- 172.21.15.162:0/2440165095 >> v1:172.21.15.162:6789/0 conn(0x7f8ad40c65c0 legacy=0x7f8ad4072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:29.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.617+0000 7f8ad9fdd640 1 -- 172.21.15.162:0/2440165095 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad41517f0 con 0x7f8ad4151410 2024-04-25T00:50:29.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.617+0000 7f8ad97dc640 1 --2- 172.21.15.162:0/2440165095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad415b1d0 0x7f8ad40c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T00:50:29.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.625+0000 7f8ad9fdd640 1 --2- 172.21.15.162:0/2440165095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ad4151410 0x7f8ad41570d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00097c0 tx=0x7f8ad001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=808b1012516e2a99 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:29.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.633+0000 7f8ad8fdb640 1 -- 172.21.15.162:0/2440165095 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00b2070 con 0x7f8ad4151410 2024-04-25T00:50:29.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.633+0000 7f8ad8fdb640 1 -- 172.21.15.162:0/2440165095 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad00ad680 con 0x7f8ad4151410 2024-04-25T00:50:29.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.633+0000 7f8ad8fdb640 1 -- 172.21.15.162:0/2440165095 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00ada50 con 0x7f8ad4151410 2024-04-25T00:50:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.633+0000 7f8adc241640 1 -- 172.21.15.162:0/2440165095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ad4151410 msgr2=0x7f8ad41570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.633+0000 7f8adc241640 1 --2- 172.21.15.162:0/2440165095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ad4151410 0x7f8ad41570d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00097c0 tx=0x7f8ad001c470 comp rx=0 tx=0).stop 2024-04-25T00:50:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.633+0000 7f8adc241640 1 -- 172.21.15.162:0/2440165095 shutdown_connections 2024-04-25T00:50:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.633+0000 7f8adc241640 1 --2- 172.21.15.162:0/2440165095 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad415b1d0 0x7f8ad40c2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.633+0000 7f8adc241640 1 --2- 172.21.15.162:0/2440165095 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ad4151410 0x7f8ad41570d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.633+0000 7f8adc241640 1 -- 172.21.15.162:0/2440165095 >> 172.21.15.162:0/2440165095 conn(0x7f8ad406b210 msgr2=0x7f8ad406b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.633+0000 7f8adc241640 1 -- 172.21.15.162:0/2440165095 shutdown_connections 2024-04-25T00:50:29.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.633+0000 7f8adc241640 1 -- 172.21.15.162:0/2440165095 wait complete. 2024-04-25T00:50:29.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.637+0000 7f8adc241640 1 Processor -- start 2024-04-25T00:50:29.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.637+0000 7f8adc241640 1 -- start start 2024-04-25T00:50:29.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.637+0000 7f8adc241640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ad40c65c0 0x7f8ad41f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:29.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.637+0000 7f8adc241640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad4151410 0x7f8ad4145530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:29.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.637+0000 7f8adc241640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ad415b1d0 0x7f8ad414fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:29.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.637+0000 7f8adc241640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad40c39f0 con 0x7f8ad40c65c0 2024-04-25T00:50:29.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.637+0000 7f8adc241640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8ad415acb0 con 0x7f8ad415b1d0 2024-04-25T00:50:29.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.637+0000 7f8adc241640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8ad40c3b70 con 0x7f8ad4151410 2024-04-25T00:50:29.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.637+0000 7f8ad9fdd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ad40c65c0 0x7f8ad41f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:29.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.637+0000 7f8ad9fdd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ad40c65c0 0x7f8ad41f4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:53884/0 (socket says 172.21.15.162:53884) 2024-04-25T00:50:29.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.637+0000 7f8ad9fdd640 1 -- 172.21.15.162:0/3804710292 learned_addr learned my addr 172.21.15.162:0/3804710292 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:29.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.637+0000 7f8ad97dc640 1 --2- 172.21.15.162:0/3804710292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad4151410 0x7f8ad4145530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:29.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.637+0000 7f8ada7de640 1 --2- 172.21.15.162:0/3804710292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ad415b1d0 0x7f8ad414fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:29.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.641+0000 7f8ad9fdd640 1 -- 172.21.15.162:0/3804710292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad4151410 msgr2=0x7f8ad4145530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:29.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.641+0000 7f8ad9fdd640 1 --2- 172.21.15.162:0/3804710292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad4151410 0x7f8ad4145530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:29.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.641+0000 7f8ad9fdd640 1 -- 172.21.15.162:0/3804710292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ad415b1d0 msgr2=0x7f8ad414fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:29.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.641+0000 7f8ad9fdd640 1 --2- 172.21.15.162:0/3804710292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ad415b1d0 0x7f8ad414fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:29.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.641+0000 7f8ad9fdd640 1 -- 172.21.15.162:0/3804710292 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad41450d0 con 0x7f8ad40c65c0 2024-04-25T00:50:29.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.641+0000 7f8ad9fdd640 1 --2- 172.21.15.162:0/3804710292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ad40c65c0 0x7f8ad41f4ea0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00097c0 tx=0x7f8ad001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:29.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.645+0000 7f8aca7fc640 1 -- 172.21.15.162:0/3804710292 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00b2040 con 0x7f8ad40c65c0 2024-04-25T00:50:29.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.645+0000 7f8aca7fc640 1 -- 172.21.15.162:0/3804710292 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ad00bd070 con 0x7f8ad40c65c0 2024-04-25T00:50:29.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.645+0000 7f8aca7fc640 1 -- 172.21.15.162:0/3804710292 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ad00add50 con 0x7f8ad40c65c0 2024-04-25T00:50:29.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.645+0000 7f8adc241640 1 -- 172.21.15.162:0/3804710292 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad4155f40 con 0x7f8ad40c65c0 2024-04-25T00:50:29.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.645+0000 7f8adc241640 1 -- 172.21.15.162:0/3804710292 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ad4156500 con 0x7f8ad40c65c0 2024-04-25T00:50:29.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.649+0000 7f8adc241640 1 -- 172.21.15.162:0/3804710292 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ad4156740 con 0x7f8ad40c65c0 2024-04-25T00:50:29.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.673+0000 7f8aca7fc640 1 -- 172.21.15.162:0/3804710292 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8ad00c2460 con 0x7f8ad40c65c0 2024-04-25T00:50:29.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.673+0000 7f8aca7fc640 1 --2- 172.21.15.162:0/3804710292 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8ab80678f0 0x7f8ab8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:29.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.673+0000 7f8ad97dc640 1 --2- 172.21.15.162:0/3804710292 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8ab80678f0 0x7f8ab8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:29.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.673+0000 7f8ad97dc640 1 --2- 172.21.15.162:0/3804710292 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8ab80678f0 0x7f8ab8069db0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009580 tx=0x7f8ac4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:29.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.677+0000 7f8aca7fc640 1 -- 172.21.15.162:0/3804710292 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4857+0+0 (secure 0 0 0) 0x7f8ad00f7520 con 0x7f8ad40c65c0 2024-04-25T00:50:29.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:29.965+0000 7f8aca7fc640 1 -- 172.21.15.162:0/3804710292 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8ad4156740 con 0x7f8ad40c65c0 2024-04-25T00:50:30.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.133+0000 7f8adc241640 1 -- 172.21.15.162:0/3804710292 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8ad40c26c0 con 0x7f8ad40c65c0 2024-04-25T00:50:30.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.181+0000 7f8aca7fc640 1 -- 172.21.15.162:0/3804710292 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) ==== 93+0+10 (secure 0 0 0) 0x7f8ad0016090 con 0x7f8ad40c65c0 2024-04-25T00:50:30.183 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-04-25T00:50:30.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.185+0000 7f8adc241640 1 -- 172.21.15.162:0/3804710292 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8ab80678f0 msgr2=0x7f8ab8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:30.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.185+0000 7f8adc241640 1 --2- 172.21.15.162:0/3804710292 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8ab80678f0 0x7f8ab8069db0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4009580 tx=0x7f8ac4009190 comp rx=0 tx=0).stop 2024-04-25T00:50:30.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.185+0000 7f8adc241640 1 -- 172.21.15.162:0/3804710292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ad40c65c0 msgr2=0x7f8ad41f4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:30.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.185+0000 7f8adc241640 1 --2- 172.21.15.162:0/3804710292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ad40c65c0 0x7f8ad41f4ea0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8ad00097c0 tx=0x7f8ad001acb0 comp rx=0 tx=0).stop 2024-04-25T00:50:30.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.185+0000 7f8adc241640 1 -- 172.21.15.162:0/3804710292 shutdown_connections 2024-04-25T00:50:30.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.185+0000 7f8adc241640 1 --2- 172.21.15.162:0/3804710292 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8ad415b1d0 0x7f8ad414fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:30.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.185+0000 7f8adc241640 1 --2- 172.21.15.162:0/3804710292 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8ad4151410 0x7f8ad4145530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:30.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.185+0000 7f8adc241640 1 --2- 172.21.15.162:0/3804710292 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8ab80678f0 0x7f8ab8069db0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:30.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.185+0000 7f8adc241640 1 --2- 172.21.15.162:0/3804710292 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8ad40c65c0 0x7f8ad41f4ea0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:30.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.185+0000 7f8adc241640 1 -- 172.21.15.162:0/3804710292 >> 172.21.15.162:0/3804710292 conn(0x7f8ad406b210 msgr2=0x7f8ad40c6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:30.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.185+0000 7f8adc241640 1 -- 172.21.15.162:0/3804710292 shutdown_connections 2024-04-25T00:50:30.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.185+0000 7f8adc241640 1 -- 172.21.15.162:0/3804710292 wait complete. 2024-04-25T00:50:30.206 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T00:50:30.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.329+0000 7f3c13001640 1 Processor -- start 2024-04-25T00:50:30.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.329+0000 7f3c13001640 1 -- start start 2024-04-25T00:50:30.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.329+0000 7f3c13001640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c0c15b0a0 0x7f3c0c06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:30.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.329+0000 7f3c13001640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3c0c06d930 0x7f3c0c15bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:30.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.329+0000 7f3c13001640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c0c0cc360 con 0x7f3c0c1547d0 2024-04-25T00:50:30.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.329+0000 7f3c13001640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3c0c0cc5d0 con 0x7f3c0c06d930 2024-04-25T00:50:30.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.329+0000 7f3c13001640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0c0cc8b0 con 0x7f3c0c15b0a0 2024-04-25T00:50:30.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.329+0000 7f3c10d9d640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f3c0c1547d0 0x7f3c0c0ca650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:44872/0 (socket says 172.21.15.162:44872) 2024-04-25T00:50:30.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.329+0000 7f3c10d9d640 1 -- 172.21.15.162:0/2742637386 learned_addr learned my addr 172.21.15.162:0/2742637386 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:30.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.329+0000 7f3c0bfff640 1 --2- 172.21.15.162:0/2742637386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c0c15b0a0 0x7f3c0c06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:30.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.337+0000 7f3c0bfff640 1 -- 172.21.15.162:0/2742637386 >> v2:172.21.15.162:3300/0 conn(0x7f3c0c06d930 msgr2=0x7f3c0c15bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:30.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.337+0000 7f3c0bfff640 1 --2- 172.21.15.162:0/2742637386 >> v2:172.21.15.162:3300/0 conn(0x7f3c0c06d930 0x7f3c0c15bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:30.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.337+0000 7f3c0bfff640 1 -- 172.21.15.162:0/2742637386 >> v1:172.21.15.179:6789/0 conn(0x7f3c0c1547d0 legacy=0x7f3c0c0ca650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:30.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.337+0000 7f3c0bfff640 1 -- 172.21.15.162:0/2742637386 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c0ccb90 con 0x7f3c0c15b0a0 2024-04-25T00:50:30.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.341+0000 7f3c0bfff640 1 --2- 172.21.15.162:0/2742637386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c0c15b0a0 0x7f3c0c06d3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80097c0 tx=0x7f3bf801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3365b127e50d6595 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:30.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c0b7fe640 1 -- 172.21.15.162:0/2742637386 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf80b5070 con 0x7f3c0c15b0a0 2024-04-25T00:50:30.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c0b7fe640 1 -- 172.21.15.162:0/2742637386 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf80a8990 con 0x7f3c0c15b0a0 2024-04-25T00:50:30.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c0b7fe640 1 -- 172.21.15.162:0/2742637386 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf80a8d60 con 0x7f3c0c15b0a0 2024-04-25T00:50:30.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c13001640 1 -- 172.21.15.162:0/2742637386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c0c15b0a0 msgr2=0x7f3c0c06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:30.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c13001640 1 --2- 172.21.15.162:0/2742637386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c0c15b0a0 0x7f3c0c06d3f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80097c0 tx=0x7f3bf801ec90 comp rx=0 tx=0).stop 2024-04-25T00:50:30.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c13001640 1 -- 172.21.15.162:0/2742637386 shutdown_connections 2024-04-25T00:50:30.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c13001640 1 --2- 172.21.15.162:0/2742637386 >> v2:172.21.15.162:3300/0 conn(0x7f3c0c06d930 0x7f3c0c15bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:30.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c13001640 1 --2- 172.21.15.162:0/2742637386 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c0c15b0a0 0x7f3c0c06d3f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:30.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c13001640 1 -- 172.21.15.162:0/2742637386 >> 172.21.15.162:0/2742637386 conn(0x7f3c0c08c1c0 msgr2=0x7f3c0c066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:30.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c13001640 1 -- 172.21.15.162:0/2742637386 shutdown_connections 2024-04-25T00:50:30.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c13001640 1 -- 172.21.15.162:0/2742637386 wait complete. 2024-04-25T00:50:30.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c13001640 1 Processor -- start 2024-04-25T00:50:30.356 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c13001640 1 -- start start 2024-04-25T00:50:30.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c13001640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c0c06d930 0x7f3c0c0cf430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:30.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c13001640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c0c1547d0 0x7f3c0c155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:30.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c13001640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c0c15b0a0 0x7f3c0c155580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:30.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c13001640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c0cd430 con 0x7f3c0c06d930 2024-04-25T00:50:30.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c13001640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c0cd150 con 0x7f3c0c1547d0 2024-04-25T00:50:30.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.353+0000 7f3c13001640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0c154bb0 con 0x7f3c0c15b0a0 2024-04-25T00:50:30.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.357+0000 7f3c0bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c0c1547d0 0x7f3c0c155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:30.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.357+0000 7f3c0bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c0c1547d0 0x7f3c0c155040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:45612/0 (socket says 172.21.15.162:45612) 2024-04-25T00:50:30.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.357+0000 7f3c0bfff640 1 -- 172.21.15.162:0/2580122298 learned_addr learned my addr 172.21.15.162:0/2580122298 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:30.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.357+0000 7f3c1159e640 1 --2- 172.21.15.162:0/2580122298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c0c15b0a0 0x7f3c0c155580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:30.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.365+0000 7f3c0bfff640 1 -- 172.21.15.162:0/2580122298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c0c15b0a0 msgr2=0x7f3c0c155580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:30.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.365+0000 7f3c0bfff640 1 --2- 172.21.15.162:0/2580122298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c0c15b0a0 0x7f3c0c155580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:30.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.365+0000 7f3c0bfff640 1 -- 172.21.15.162:0/2580122298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c0c06d930 msgr2=0x7f3c0c0cf430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:30.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.365+0000 7f3c0bfff640 1 --2- 172.21.15.162:0/2580122298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c0c06d930 0x7f3c0c0cf430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:30.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.365+0000 7f3c0bfff640 1 -- 172.21.15.162:0/2580122298 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c153b10 con 0x7f3c0c1547d0 2024-04-25T00:50:30.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.373+0000 7f3c0bfff640 1 --2- 172.21.15.162:0/2580122298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c0c1547d0 0x7f3c0c155040 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80097c0 tx=0x7f3bf801ba30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:30.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.385+0000 7f3c097fa640 1 -- 172.21.15.162:0/2580122298 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf80bf070 con 0x7f3c0c1547d0 2024-04-25T00:50:30.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.385+0000 7f3c097fa640 1 -- 172.21.15.162:0/2580122298 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bf80b0920 con 0x7f3c0c1547d0 2024-04-25T00:50:30.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.385+0000 7f3c097fa640 1 -- 172.21.15.162:0/2580122298 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bf80b5040 con 0x7f3c0c1547d0 2024-04-25T00:50:30.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.385+0000 7f3c13001640 1 -- 172.21.15.162:0/2580122298 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c0c15dc20 con 0x7f3c0c1547d0 2024-04-25T00:50:30.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.385+0000 7f3c13001640 1 -- 172.21.15.162:0/2580122298 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c0c156f70 con 0x7f3c0c1547d0 2024-04-25T00:50:30.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.385+0000 7f3c13001640 1 -- 172.21.15.162:0/2580122298 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c0c068520 con 0x7f3c0c1547d0 2024-04-25T00:50:30.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.705+0000 7f3c097fa640 1 -- 172.21.15.162:0/2580122298 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3bf80c2070 con 0x7f3c0c1547d0 2024-04-25T00:50:30.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.705+0000 7f3c097fa640 1 --2- 172.21.15.162:0/2580122298 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3bf0067910 0x7f3bf0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:30.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.709+0000 7f3c10d9d640 1 --2- 172.21.15.162:0/2580122298 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3bf0067910 0x7f3bf0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:30.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.709+0000 7f3c10d9d640 1 --2- 172.21.15.162:0/2580122298 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3bf0067910 0x7f3bf0069dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3c00000f70 tx=0x7f3c00007a90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:30.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.709+0000 7f3c097fa640 1 -- 172.21.15.162:0/2580122298 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4857+0+0 (secure 0 0 0) 0x7f3bf80f9620 con 0x7f3c0c1547d0 2024-04-25T00:50:30.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.721+0000 7f3c097fa640 1 -- 172.21.15.162:0/2580122298 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f3bf80c9080 con 0x7f3c0c1547d0 2024-04-25T00:50:30.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.897+0000 7f3c13001640 1 -- 172.21.15.162:0/2580122298 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f3c0c04f5f0 con 0x7f3c0c1547d0 2024-04-25T00:50:30.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.917+0000 7f3c097fa640 1 -- 172.21.15.162:0/2580122298 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) ==== 84+0+65 (secure 0 0 0) 0x7f3bf80187f0 con 0x7f3c0c1547d0 2024-04-25T00:50:30.919 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:30.919 INFO:teuthology.orchestra.run.smithi162.stdout:[ 2024-04-25T00:50:30.919 INFO:teuthology.orchestra.run.smithi162.stdout: { 2024-04-25T00:50:30.919 INFO:teuthology.orchestra.run.smithi162.stdout: "poolnum": 1, 2024-04-25T00:50:30.919 INFO:teuthology.orchestra.run.smithi162.stdout: "poolname": ".mgr" 2024-04-25T00:50:30.919 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-04-25T00:50:30.919 INFO:teuthology.orchestra.run.smithi162.stdout:] 2024-04-25T00:50:30.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.921+0000 7f3c13001640 1 -- 172.21.15.162:0/2580122298 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3bf0067910 msgr2=0x7f3bf0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:30.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.921+0000 7f3c13001640 1 --2- 172.21.15.162:0/2580122298 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3bf0067910 0x7f3bf0069dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3c00000f70 tx=0x7f3c00007a90 comp rx=0 tx=0).stop 2024-04-25T00:50:30.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.921+0000 7f3c13001640 1 -- 172.21.15.162:0/2580122298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c0c1547d0 msgr2=0x7f3c0c155040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:30.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.921+0000 7f3c13001640 1 --2- 172.21.15.162:0/2580122298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c0c1547d0 0x7f3c0c155040 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3bf80097c0 tx=0x7f3bf801ba30 comp rx=0 tx=0).stop 2024-04-25T00:50:30.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.921+0000 7f3c13001640 1 -- 172.21.15.162:0/2580122298 shutdown_connections 2024-04-25T00:50:30.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.921+0000 7f3c13001640 1 --2- 172.21.15.162:0/2580122298 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c0c15b0a0 0x7f3c0c155580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:30.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.921+0000 7f3c13001640 1 --2- 172.21.15.162:0/2580122298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c0c1547d0 0x7f3c0c155040 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:30.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.921+0000 7f3c13001640 1 --2- 172.21.15.162:0/2580122298 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3bf0067910 0x7f3bf0069dd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:30.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.921+0000 7f3c13001640 1 --2- 172.21.15.162:0/2580122298 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c0c06d930 0x7f3c0c0cf430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:30.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.921+0000 7f3c13001640 1 -- 172.21.15.162:0/2580122298 >> 172.21.15.162:0/2580122298 conn(0x7f3c0c08c1c0 msgr2=0x7f3c0c158b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:30.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.921+0000 7f3c13001640 1 -- 172.21.15.162:0/2580122298 shutdown_connections 2024-04-25T00:50:30.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:30.921+0000 7f3c13001640 1 -- 172.21.15.162:0/2580122298 wait complete. 2024-04-25T00:50:30.939 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T00:50:30.939 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T00:50:31.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.065+0000 7f88695e0640 1 Processor -- start 2024-04-25T00:50:31.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.065+0000 7f88695e0640 1 -- start start 2024-04-25T00:50:31.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.065+0000 7f88695e0640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8864151410 0x7f88641570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:31.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.065+0000 7f88695e0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f886415b1d0 0x7f88640c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:31.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.065+0000 7f88695e0640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f886415a760 con 0x7f88640c65c0 2024-04-25T00:50:31.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.065+0000 7f88695e0640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f88640c3200 con 0x7f8864151410 2024-04-25T00:50:31.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.065+0000 7f88695e0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f886415b5f0 con 0x7f886415b1d0 2024-04-25T00:50:31.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.065+0000 7f8862ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8864151410 0x7f88641570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:31.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.065+0000 7f88627fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f886415b1d0 0x7f88640c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:31.069 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.069+0000 7f8862ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8864151410 0x7f88641570d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:45618/0 (socket says 172.21.15.162:45618) 2024-04-25T00:50:31.069 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.069+0000 7f8862ffd640 1 -- 172.21.15.162:0/2168830258 learned_addr learned my addr 172.21.15.162:0/2168830258 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:31.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.073+0000 7f88627fc640 1 -- 172.21.15.162:0/2168830258 >> v2:172.21.15.179:3300/0 conn(0x7f8864151410 msgr2=0x7f88641570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:31.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.073+0000 7f88627fc640 1 --2- 172.21.15.162:0/2168830258 >> v2:172.21.15.179:3300/0 conn(0x7f8864151410 0x7f88641570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:31.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.073+0000 7f88627fc640 1 -- 172.21.15.162:0/2168830258 >> v1:172.21.15.179:6789/0 conn(0x7f88640c65c0 legacy=0x7f8864072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:31.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.073+0000 7f88627fc640 1 -- 172.21.15.162:0/2168830258 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88641517f0 con 0x7f886415b1d0 2024-04-25T00:50:31.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.077+0000 7f88627fc640 1 --2- 172.21.15.162:0/2168830258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f886415b1d0 0x7f88640c2cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f88540097c0 tx=0x7f885401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c33144d22278b369 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:31.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.089+0000 7f8861ffb640 1 -- 172.21.15.162:0/2168830258 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88540b2070 con 0x7f886415b1d0 2024-04-25T00:50:31.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.089+0000 7f8861ffb640 1 -- 172.21.15.162:0/2168830258 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88540ad680 con 0x7f886415b1d0 2024-04-25T00:50:31.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.089+0000 7f8861ffb640 1 -- 172.21.15.162:0/2168830258 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88540ada50 con 0x7f886415b1d0 2024-04-25T00:50:31.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88695e0640 1 -- 172.21.15.162:0/2168830258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f886415b1d0 msgr2=0x7f88640c2cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:31.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88695e0640 1 --2- 172.21.15.162:0/2168830258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f886415b1d0 0x7f88640c2cc0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f88540097c0 tx=0x7f885401c470 comp rx=0 tx=0).stop 2024-04-25T00:50:31.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88695e0640 1 -- 172.21.15.162:0/2168830258 shutdown_connections 2024-04-25T00:50:31.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88695e0640 1 --2- 172.21.15.162:0/2168830258 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f886415b1d0 0x7f88640c2cc0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:31.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88695e0640 1 --2- 172.21.15.162:0/2168830258 >> v2:172.21.15.179:3300/0 conn(0x7f8864151410 0x7f88641570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:31.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88695e0640 1 -- 172.21.15.162:0/2168830258 >> 172.21.15.162:0/2168830258 conn(0x7f886406b210 msgr2=0x7f886406b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:31.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88695e0640 1 -- 172.21.15.162:0/2168830258 shutdown_connections 2024-04-25T00:50:31.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88695e0640 1 -- 172.21.15.162:0/2168830258 wait complete. 2024-04-25T00:50:31.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88695e0640 1 Processor -- start 2024-04-25T00:50:31.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88695e0640 1 -- start start 2024-04-25T00:50:31.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88695e0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88640c65c0 0x7f88641558e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:31.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88695e0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8864151410 0x7f886414e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:31.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88695e0640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f886415b1d0 0x7f88641562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:31.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88695e0640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f88640c39f0 con 0x7f8864151410 2024-04-25T00:50:31.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88695e0640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f886415acb0 con 0x7f886415b1d0 2024-04-25T00:50:31.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88695e0640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f88640c3b70 con 0x7f88640c65c0 2024-04-25T00:50:31.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88627fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8864151410 0x7f886414e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:31.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88627fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8864151410 0x7f886414e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:53908/0 (socket says 172.21.15.162:53908) 2024-04-25T00:50:31.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88627fc640 1 -- 172.21.15.162:0/1177566670 learned_addr learned my addr 172.21.15.162:0/1177566670 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:31.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.093+0000 7f88637fe640 1 --2- 172.21.15.162:0/1177566670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f886415b1d0 0x7f88641562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:31.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.097+0000 7f88627fc640 1 -- 172.21.15.162:0/1177566670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88640c65c0 msgr2=0x7f88641558e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:31.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.097+0000 7f88627fc640 1 --2- 172.21.15.162:0/1177566670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88640c65c0 0x7f88641558e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:31.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.101+0000 7f88627fc640 1 -- 172.21.15.162:0/1177566670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f886415b1d0 msgr2=0x7f88641562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:31.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.101+0000 7f88627fc640 1 --2- 172.21.15.162:0/1177566670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f886415b1d0 0x7f88641562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:31.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.101+0000 7f88627fc640 1 -- 172.21.15.162:0/1177566670 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88641f3cb0 con 0x7f8864151410 2024-04-25T00:50:31.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.101+0000 7f88627fc640 1 --2- 172.21.15.162:0/1177566670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8864151410 0x7f886414e520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8854019080 tx=0x7f8854019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:31.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.105+0000 7f884b7fe640 1 -- 172.21.15.162:0/1177566670 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88540b2040 con 0x7f8864151410 2024-04-25T00:50:31.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.105+0000 7f884b7fe640 1 -- 172.21.15.162:0/1177566670 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88540bc070 con 0x7f8864151410 2024-04-25T00:50:31.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.105+0000 7f884b7fe640 1 -- 172.21.15.162:0/1177566670 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88540b6410 con 0x7f8864151410 2024-04-25T00:50:31.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.105+0000 7f88695e0640 1 -- 172.21.15.162:0/1177566670 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88641f3f50 con 0x7f8864151410 2024-04-25T00:50:31.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.105+0000 7f88695e0640 1 -- 172.21.15.162:0/1177566670 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f886406d1b0 con 0x7f8864151410 2024-04-25T00:50:31.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.109+0000 7f88695e0640 1 -- 172.21.15.162:0/1177566670 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8864068310 con 0x7f8864151410 2024-04-25T00:50:31.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.401+0000 7f884b7fe640 1 -- 172.21.15.162:0/1177566670 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f88540b65b0 con 0x7f8864151410 2024-04-25T00:50:31.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.401+0000 7f884b7fe640 1 --2- 172.21.15.162:0/1177566670 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8850067940 0x7f8850069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:31.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.405+0000 7f8862ffd640 1 --2- 172.21.15.162:0/1177566670 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8850067940 0x7f8850069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:31.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.405+0000 7f8862ffd640 1 --2- 172.21.15.162:0/1177566670 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8850067940 0x7f8850069e00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8858006f50 tx=0x7f8858006ea0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:31.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.445+0000 7f884b7fe640 1 -- 172.21.15.162:0/1177566670 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 4857+0+0 (secure 0 0 0) 0x7f88540ad610 con 0x7f8864151410 2024-04-25T00:50:31.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.445+0000 7f884b7fe640 1 -- 172.21.15.162:0/1177566670 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8854016090 con 0x7f8864151410 2024-04-25T00:50:31.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:31.621+0000 7f88695e0640 1 -- 172.21.15.162:0/1177566670 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f88640c26c0 con 0x7f8864151410 2024-04-25T00:50:32.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.257+0000 7f884b7fe640 1 -- 172.21.15.162:0/1177566670 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) ==== 138+0+0 (secure 0 0 0) 0x7f88540f0b10 con 0x7f8864151410 2024-04-25T00:50:32.257 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'cephfs_metadata' created 2024-04-25T00:50:32.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.257+0000 7f88695e0640 1 -- 172.21.15.162:0/1177566670 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8850067940 msgr2=0x7f8850069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:32.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.257+0000 7f88695e0640 1 --2- 172.21.15.162:0/1177566670 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8850067940 0x7f8850069e00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f8858006f50 tx=0x7f8858006ea0 comp rx=0 tx=0).stop 2024-04-25T00:50:32.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.257+0000 7f88695e0640 1 -- 172.21.15.162:0/1177566670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8864151410 msgr2=0x7f886414e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:32.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.257+0000 7f88695e0640 1 --2- 172.21.15.162:0/1177566670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8864151410 0x7f886414e520 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8854019080 tx=0x7f8854019210 comp rx=0 tx=0).stop 2024-04-25T00:50:32.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.257+0000 7f88695e0640 1 -- 172.21.15.162:0/1177566670 shutdown_connections 2024-04-25T00:50:32.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.257+0000 7f88695e0640 1 --2- 172.21.15.162:0/1177566670 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f886415b1d0 0x7f88641562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:32.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.257+0000 7f88695e0640 1 --2- 172.21.15.162:0/1177566670 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8850067940 0x7f8850069e00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:32.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.257+0000 7f88695e0640 1 --2- 172.21.15.162:0/1177566670 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8864151410 0x7f886414e520 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:32.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.257+0000 7f88695e0640 1 --2- 172.21.15.162:0/1177566670 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f88640c65c0 0x7f88641558e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:32.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.257+0000 7f88695e0640 1 -- 172.21.15.162:0/1177566670 >> 172.21.15.162:0/1177566670 conn(0x7f886406b210 msgr2=0x7f88640c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:32.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.261+0000 7f88695e0640 1 -- 172.21.15.162:0/1177566670 shutdown_connections 2024-04-25T00:50:32.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.261+0000 7f88695e0640 1 -- 172.21.15.162:0/1177566670 wait complete. 2024-04-25T00:50:32.288 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T00:50:32.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.421+0000 7f59c247f640 1 Processor -- start 2024-04-25T00:50:32.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.421+0000 7f59c247f640 1 -- start start 2024-04-25T00:50:32.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.421+0000 7f59c247f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59bc141380 0x7f59bc15c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:32.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.421+0000 7f59c247f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f59bc141760 0x7f59bc06dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:32.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.421+0000 7f59c247f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59bc0c8640 con 0x7f59bc0c8190 2024-04-25T00:50:32.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.421+0000 7f59c247f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f59bc0c7040 con 0x7f59bc141760 2024-04-25T00:50:32.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.421+0000 7f59c247f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f59bc15c050 con 0x7f59bc141380 2024-04-25T00:50:32.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.425+0000 7f59bb7fe640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f59bc141760 0x7f59bc06dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:32.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.425+0000 7f59c0a1c640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f59bc0c8190 0x7f59bc0c6240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:38878/0 (socket says 172.21.15.162:38878) 2024-04-25T00:50:32.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.425+0000 7f59c0a1c640 1 -- 172.21.15.162:0/1220982432 learned_addr learned my addr 172.21.15.162:0/1220982432 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:32.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.425+0000 7f59bbfff640 1 --2- 172.21.15.162:0/1220982432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59bc141380 0x7f59bc15c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:32.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.433+0000 7f59bb7fe640 1 -- 172.21.15.162:0/1220982432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59bc141380 msgr2=0x7f59bc15c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:32.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.433+0000 7f59bb7fe640 1 --2- 172.21.15.162:0/1220982432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59bc141380 0x7f59bc15c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:32.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.433+0000 7f59bb7fe640 1 -- 172.21.15.162:0/1220982432 >> v1:172.21.15.179:6789/0 conn(0x7f59bc0c8190 legacy=0x7f59bc0c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:32.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.433+0000 7f59bb7fe640 1 -- 172.21.15.162:0/1220982432 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59bc0c6a80 con 0x7f59bc141760 2024-04-25T00:50:32.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.441+0000 7f59bb7fe640 1 --2- 172.21.15.162:0/1220982432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59bc141760 0x7f59bc06dbd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f59b00097c0 tx=0x7f59b001c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e647e6c35be71b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:32.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.449+0000 7f59baffd640 1 -- 172.21.15.162:0/1220982432 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b00b1070 con 0x7f59bc141760 2024-04-25T00:50:32.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.521+0000 7f59baffd640 1 -- 172.21.15.162:0/1220982432 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b00a8050 con 0x7f59bc141760 2024-04-25T00:50:32.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.521+0000 7f59baffd640 1 -- 172.21.15.162:0/1220982432 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b00ac860 con 0x7f59bc141760 2024-04-25T00:50:32.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.525+0000 7f59c247f640 1 -- 172.21.15.162:0/1220982432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59bc141760 msgr2=0x7f59bc06dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:32.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.525+0000 7f59c247f640 1 --2- 172.21.15.162:0/1220982432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59bc141760 0x7f59bc06dbd0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f59b00097c0 tx=0x7f59b001c3e0 comp rx=0 tx=0).stop 2024-04-25T00:50:32.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.525+0000 7f59c247f640 1 -- 172.21.15.162:0/1220982432 shutdown_connections 2024-04-25T00:50:32.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.525+0000 7f59c247f640 1 --2- 172.21.15.162:0/1220982432 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59bc141760 0x7f59bc06dbd0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:32.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.525+0000 7f59c247f640 1 --2- 172.21.15.162:0/1220982432 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59bc141380 0x7f59bc15c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:32.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.525+0000 7f59c247f640 1 -- 172.21.15.162:0/1220982432 >> 172.21.15.162:0/1220982432 conn(0x7f59bc06b210 msgr2=0x7f59bc06b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:32.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.525+0000 7f59c247f640 1 -- 172.21.15.162:0/1220982432 shutdown_connections 2024-04-25T00:50:32.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.525+0000 7f59c247f640 1 -- 172.21.15.162:0/1220982432 wait complete. 2024-04-25T00:50:32.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.525+0000 7f59c247f640 1 Processor -- start 2024-04-25T00:50:32.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.525+0000 7f59c247f640 1 -- start start 2024-04-25T00:50:32.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.525+0000 7f59c247f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59bc0c8190 0x7f59bc0c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:32.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.525+0000 7f59c247f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59bc141380 0x7f59bc072dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:32.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.525+0000 7f59c247f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59bc141760 0x7f59bc1607f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:32.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.525+0000 7f59c247f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f59bc164c70 con 0x7f59bc141380 2024-04-25T00:50:32.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.525+0000 7f59c247f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f59bc06d8e0 con 0x7f59bc0c8190 2024-04-25T00:50:32.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.525+0000 7f59c247f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f59bc164df0 con 0x7f59bc141760 2024-04-25T00:50:32.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.529+0000 7f59bb7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59bc141380 0x7f59bc072dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:32.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.529+0000 7f59bb7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59bc141380 0x7f59bc072dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51180/0 (socket says 172.21.15.162:51180) 2024-04-25T00:50:32.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.529+0000 7f59bb7fe640 1 -- 172.21.15.162:0/1415233137 learned_addr learned my addr 172.21.15.162:0/1415233137 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:32.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.533+0000 7f59bbfff640 1 --2- 172.21.15.162:0/1415233137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59bc0c8190 0x7f59bc0c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:32.543 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.541+0000 7f59bbfff640 1 -- 172.21.15.162:0/1415233137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59bc141760 msgr2=0x7f59bc1607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:32.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.541+0000 7f59bbfff640 1 --2- 172.21.15.162:0/1415233137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59bc141760 0x7f59bc1607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:32.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.541+0000 7f59bbfff640 1 -- 172.21.15.162:0/1415233137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59bc141380 msgr2=0x7f59bc072dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:32.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.541+0000 7f59bbfff640 1 --2- 172.21.15.162:0/1415233137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59bc141380 0x7f59bc072dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:32.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.541+0000 7f59bbfff640 1 -- 172.21.15.162:0/1415233137 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59bc0c4c90 con 0x7f59bc0c8190 2024-04-25T00:50:32.549 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.549+0000 7f59bbfff640 1 --2- 172.21.15.162:0/1415233137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59bc0c8190 0x7f59bc0c4250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00e8a0 tx=0x7f59ac00ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:32.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.553+0000 7f59b8ff9640 1 -- 172.21.15.162:0/1415233137 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac017070 con 0x7f59bc0c8190 2024-04-25T00:50:32.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.557+0000 7f59b8ff9640 1 -- 172.21.15.162:0/1415233137 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59ac00c940 con 0x7f59bc0c8190 2024-04-25T00:50:32.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.557+0000 7f59c247f640 1 -- 172.21.15.162:0/1415233137 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59bc0c49b0 con 0x7f59bc0c8190 2024-04-25T00:50:32.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.557+0000 7f59b8ff9640 1 -- 172.21.15.162:0/1415233137 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ac00cd10 con 0x7f59bc0c8190 2024-04-25T00:50:32.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.557+0000 7f59c247f640 1 -- 172.21.15.162:0/1415233137 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59bc1f6620 con 0x7f59bc0c8190 2024-04-25T00:50:32.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.557+0000 7f59c247f640 1 -- 172.21.15.162:0/1415233137 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59bc068310 con 0x7f59bc0c8190 2024-04-25T00:50:32.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.857+0000 7f59b8ff9640 1 -- 172.21.15.162:0/1415233137 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f59ac01a070 con 0x7f59bc0c8190 2024-04-25T00:50:32.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.857+0000 7f59b8ff9640 1 --2- 172.21.15.162:0/1415233137 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f59a8067910 0x7f59a8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:32.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.861+0000 7f59bb7fe640 1 --2- 172.21.15.162:0/1415233137 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f59a8067910 0x7f59a8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:32.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.861+0000 7f59bb7fe640 1 --2- 172.21.15.162:0/1415233137 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f59a8067910 0x7f59a8069dd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f59b001aa90 tx=0x7f59b00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:32.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.865+0000 7f59b8ff9640 1 -- 172.21.15.162:0/1415233137 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5227+0+0 (secure 0 0 0) 0x7f59ac0547a0 con 0x7f59bc0c8190 2024-04-25T00:50:32.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:32.897+0000 7f59b8ff9640 1 -- 172.21.15.162:0/1415233137 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f59ac056700 con 0x7f59bc0c8190 2024-04-25T00:50:33.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:33.117+0000 7f59c247f640 1 -- 172.21.15.162:0/1415233137 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f59bc072650 con 0x7f59bc0c8190 2024-04-25T00:50:34.324 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:50:34.327 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:50:34.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.501+0000 7f59b8ff9640 1 -- 172.21.15.162:0/1415233137 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v23) ==== 170+0+0 (secure 0 0 0) 0x7f59ac05aa00 con 0x7f59bc0c8190 2024-04-25T00:50:34.504 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'cephfs_data' created 2024-04-25T00:50:34.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.505+0000 7f59c247f640 1 -- 172.21.15.162:0/1415233137 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f59a8067910 msgr2=0x7f59a8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:34.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.505+0000 7f59c247f640 1 --2- 172.21.15.162:0/1415233137 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f59a8067910 0x7f59a8069dd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f59b001aa90 tx=0x7f59b00a7000 comp rx=0 tx=0).stop 2024-04-25T00:50:34.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.505+0000 7f59c247f640 1 -- 172.21.15.162:0/1415233137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59bc0c8190 msgr2=0x7f59bc0c4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:34.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.505+0000 7f59c247f640 1 --2- 172.21.15.162:0/1415233137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59bc0c8190 0x7f59bc0c4250 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f59ac00e8a0 tx=0x7f59ac00ed60 comp rx=0 tx=0).stop 2024-04-25T00:50:34.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.505+0000 7f59c247f640 1 -- 172.21.15.162:0/1415233137 shutdown_connections 2024-04-25T00:50:34.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.505+0000 7f59c247f640 1 --2- 172.21.15.162:0/1415233137 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59bc141760 0x7f59bc1607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:34.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.505+0000 7f59c247f640 1 --2- 172.21.15.162:0/1415233137 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f59a8067910 0x7f59a8069dd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:34.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.505+0000 7f59c247f640 1 --2- 172.21.15.162:0/1415233137 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59bc141380 0x7f59bc072dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:34.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.505+0000 7f59c247f640 1 --2- 172.21.15.162:0/1415233137 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59bc0c8190 0x7f59bc0c4250 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:34.507 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.505+0000 7f59c247f640 1 -- 172.21.15.162:0/1415233137 >> 172.21.15.162:0/1415233137 conn(0x7f59bc06b210 msgr2=0x7f59bc0c98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:34.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.505+0000 7f59c247f640 1 -- 172.21.15.162:0/1415233137 shutdown_connections 2024-04-25T00:50:34.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.505+0000 7f59c247f640 1 -- 172.21.15.162:0/1415233137 wait complete. 2024-04-25T00:50:34.528 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T00:50:34.660 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.657+0000 7f386bc45640 1 Processor -- start 2024-04-25T00:50:34.660 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.657+0000 7f386bc45640 1 -- start start 2024-04-25T00:50:34.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.661+0000 7f386bc45640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38640c65b0 0x7f38640c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:34.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.661+0000 7f386bc45640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f386415a750 con 0x7f38641515b0 2024-04-25T00:50:34.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.661+0000 7f386bc45640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f386415a9f0 con 0x7f38641576f0 2024-04-25T00:50:34.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.661+0000 7f386bc45640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f386415acd0 con 0x7f38640c65b0 2024-04-25T00:50:34.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.661+0000 7f38691e0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38640c65b0 0x7f38640c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:34.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.661+0000 7f386a1e2640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f38641576f0 0x7f3864157b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:38888/0 (socket says 172.21.15.162:38888) 2024-04-25T00:50:34.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.661+0000 7f386a1e2640 1 -- 172.21.15.162:0/3467556309 learned_addr learned my addr 172.21.15.162:0/3467556309 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:34.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.669+0000 7f38691e0640 1 -- 172.21.15.162:0/3467556309 >> v1:172.21.15.179:6789/0 conn(0x7f38641576f0 legacy=0x7f3864157b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:34.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.669+0000 7f38691e0640 1 -- 172.21.15.162:0/3467556309 >> v1:172.21.15.162:6789/0 conn(0x7f38641515b0 legacy=0x7f386413fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:34.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.669+0000 7f38691e0640 1 -- 172.21.15.162:0/3467556309 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386415afb0 con 0x7f38640c65b0 2024-04-25T00:50:34.676 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.673+0000 7f38691e0640 1 --2- 172.21.15.162:0/3467556309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38640c65b0 0x7f38640c69f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f38580097f0 tx=0x7f385801e6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=591c7bbe558fa292 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:34.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.685+0000 7f38689df640 1 -- 172.21.15.162:0/3467556309 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38580b3070 con 0x7f38640c65b0 2024-04-25T00:50:34.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.685+0000 7f38689df640 1 -- 172.21.15.162:0/3467556309 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38580ae620 con 0x7f38640c65b0 2024-04-25T00:50:34.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.685+0000 7f38689df640 1 -- 172.21.15.162:0/3467556309 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38580ae9f0 con 0x7f38640c65b0 2024-04-25T00:50:34.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.685+0000 7f386bc45640 1 -- 172.21.15.162:0/3467556309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38640c65b0 msgr2=0x7f38640c69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:34.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.685+0000 7f386bc45640 1 --2- 172.21.15.162:0/3467556309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38640c65b0 0x7f38640c69f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f38580097f0 tx=0x7f385801e6b0 comp rx=0 tx=0).stop 2024-04-25T00:50:34.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.685+0000 7f386bc45640 1 -- 172.21.15.162:0/3467556309 shutdown_connections 2024-04-25T00:50:34.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.685+0000 7f386bc45640 1 --2- 172.21.15.162:0/3467556309 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38640c65b0 0x7f38640c69f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:34.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.685+0000 7f386bc45640 1 -- 172.21.15.162:0/3467556309 >> 172.21.15.162:0/3467556309 conn(0x7f3864070280 msgr2=0x7f3864070690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:34.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.685+0000 7f386bc45640 1 -- 172.21.15.162:0/3467556309 shutdown_connections 2024-04-25T00:50:34.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.685+0000 7f386bc45640 1 -- 172.21.15.162:0/3467556309 wait complete. 2024-04-25T00:50:34.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.685+0000 7f386bc45640 1 Processor -- start 2024-04-25T00:50:34.688 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.685+0000 7f386bc45640 1 -- start start 2024-04-25T00:50:34.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.689+0000 7f386bc45640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38640c65b0 0x7f386414d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:34.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.689+0000 7f386bc45640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38641515b0 0x7f3864137330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:34.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.689+0000 7f386bc45640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38641576f0 0x7f3864137870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:34.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.689+0000 7f386bc45640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3864140610 con 0x7f38640c65b0 2024-04-25T00:50:34.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.689+0000 7f386bc45640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3864140490 con 0x7f38641576f0 2024-04-25T00:50:34.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.689+0000 7f386bc45640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f386413d070 con 0x7f38641515b0 2024-04-25T00:50:34.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.689+0000 7f386a1e2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38641576f0 0x7f3864137870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:34.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.689+0000 7f386a1e2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38641576f0 0x7f3864137870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:37964/0 (socket says 172.21.15.162:37964) 2024-04-25T00:50:34.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.689+0000 7f386a1e2640 1 -- 172.21.15.162:0/2295539569 learned_addr learned my addr 172.21.15.162:0/2295539569 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:34.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.693+0000 7f38691e0640 1 --2- 172.21.15.162:0/2295539569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38641515b0 0x7f3864137330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:34.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.701+0000 7f386a1e2640 1 -- 172.21.15.162:0/2295539569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38641515b0 msgr2=0x7f3864137330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:34.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.701+0000 7f386a1e2640 1 --2- 172.21.15.162:0/2295539569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38641515b0 0x7f3864137330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:34.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.701+0000 7f386a1e2640 1 -- 172.21.15.162:0/2295539569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38640c65b0 msgr2=0x7f386414d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:34.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.701+0000 7f386a1e2640 1 --2- 172.21.15.162:0/2295539569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38640c65b0 0x7f386414d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:34.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.701+0000 7f386a1e2640 1 -- 172.21.15.162:0/2295539569 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3864068c00 con 0x7f38641576f0 2024-04-25T00:50:34.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.705+0000 7f386a1e2640 1 --2- 172.21.15.162:0/2295539569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38641576f0 0x7f3864137870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f385400cae0 tx=0x7f385400a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:34.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.717+0000 7f38627fc640 1 -- 172.21.15.162:0/2295539569 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3854017070 con 0x7f38641576f0 2024-04-25T00:50:34.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.717+0000 7f38627fc640 1 -- 172.21.15.162:0/2295539569 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f385400ac40 con 0x7f38641576f0 2024-04-25T00:50:34.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.717+0000 7f38627fc640 1 -- 172.21.15.162:0/2295539569 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3854012400 con 0x7f38641576f0 2024-04-25T00:50:34.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.717+0000 7f386bc45640 1 -- 172.21.15.162:0/2295539569 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3864158c10 con 0x7f38641576f0 2024-04-25T00:50:34.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.717+0000 7f386bc45640 1 -- 172.21.15.162:0/2295539569 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3864131d30 con 0x7f38641576f0 2024-04-25T00:50:34.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:34.721+0000 7f386bc45640 1 -- 172.21.15.162:0/2295539569 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3864075110 con 0x7f38641576f0 2024-04-25T00:50:35.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:35.065+0000 7f38627fc640 1 -- 172.21.15.162:0/2295539569 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f385401a070 con 0x7f38641576f0 2024-04-25T00:50:35.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:35.065+0000 7f38627fc640 1 --2- 172.21.15.162:0/2295539569 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3850067910 0x7f3850069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:35.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:35.065+0000 7f38699e1640 1 --2- 172.21.15.162:0/2295539569 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3850067910 0x7f3850069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:35.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:35.065+0000 7f38699e1640 1 --2- 172.21.15.162:0/2295539569 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3850067910 0x7f3850069dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f385c007fd0 tx=0x7f385c0079a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:35.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:35.069+0000 7f38627fc640 1 -- 172.21.15.162:0/2295539569 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5609+0+0 (secure 0 0 0) 0x7f3854054370 con 0x7f38641576f0 2024-04-25T00:50:35.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:35.097+0000 7f38627fc640 1 -- 172.21.15.162:0/2295539569 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f38540562d0 con 0x7f38641576f0 2024-04-25T00:50:35.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:35.309+0000 7f386bc45640 1 -- 172.21.15.162:0/2295539569 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f38640c77d0 con 0x7f38641576f0 2024-04-25T00:50:37.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.185+0000 7f38627fc640 1 -- 172.21.15.162:0/2295539569 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v5) ==== 172+0+0 (secure 0 0 0) 0x7f385405a5d0 con 0x7f38641576f0 2024-04-25T00:50:37.186 INFO:teuthology.orchestra.run.smithi162.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T00:50:37.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.189+0000 7f386bc45640 1 -- 172.21.15.162:0/2295539569 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3850067910 msgr2=0x7f3850069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:37.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.189+0000 7f386bc45640 1 --2- 172.21.15.162:0/2295539569 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3850067910 0x7f3850069dd0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f385c007fd0 tx=0x7f385c0079a0 comp rx=0 tx=0).stop 2024-04-25T00:50:37.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.189+0000 7f386bc45640 1 -- 172.21.15.162:0/2295539569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38641576f0 msgr2=0x7f3864137870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:37.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.189+0000 7f386bc45640 1 --2- 172.21.15.162:0/2295539569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38641576f0 0x7f3864137870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f385400cae0 tx=0x7f385400a060 comp rx=0 tx=0).stop 2024-04-25T00:50:37.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.189+0000 7f386bc45640 1 -- 172.21.15.162:0/2295539569 shutdown_connections 2024-04-25T00:50:37.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.189+0000 7f386bc45640 1 --2- 172.21.15.162:0/2295539569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f38641576f0 0x7f3864137870 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:37.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.189+0000 7f386bc45640 1 --2- 172.21.15.162:0/2295539569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38641515b0 0x7f3864137330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:37.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.189+0000 7f386bc45640 1 --2- 172.21.15.162:0/2295539569 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3850067910 0x7f3850069dd0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:37.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.189+0000 7f386bc45640 1 --2- 172.21.15.162:0/2295539569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f38640c65b0 0x7f386414d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:37.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.189+0000 7f386bc45640 1 -- 172.21.15.162:0/2295539569 >> 172.21.15.162:0/2295539569 conn(0x7f3864070280 msgr2=0x7f386413b2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:37.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.189+0000 7f386bc45640 1 -- 172.21.15.162:0/2295539569 shutdown_connections 2024-04-25T00:50:37.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.189+0000 7f386bc45640 1 -- 172.21.15.162:0/2295539569 wait complete. 2024-04-25T00:50:37.213 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T00:50:37.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.345+0000 7f9f81184640 1 Processor -- start 2024-04-25T00:50:37.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.345+0000 7f9f81184640 1 -- start start 2024-04-25T00:50:37.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.345+0000 7f9f81184640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9f7c152550 0x7f9f7c0c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:37.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.345+0000 7f9f81184640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9f7c0c8460 0x7f9f7c0c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:37.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.345+0000 7f9f81184640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f7c1583b0 con 0x7f9f7c152170 2024-04-25T00:50:37.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.345+0000 7f9f81184640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9f7c158690 con 0x7f9f7c0c8460 2024-04-25T00:50:37.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.345+0000 7f9f81184640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f9f7c158970 con 0x7f9f7c152550 2024-04-25T00:50:37.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.349+0000 7f9f7b59e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9f7c0c8460 0x7f9f7c0c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:37.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.349+0000 7f9f7b59e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9f7c0c8460 0x7f9f7c0c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51194/0 (socket says 172.21.15.162:51194) 2024-04-25T00:50:37.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.349+0000 7f9f7b59e640 1 -- 172.21.15.162:0/3949118251 learned_addr learned my addr 172.21.15.162:0/3949118251 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:37.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.349+0000 7f9f7a59c640 1 --2- 172.21.15.162:0/3949118251 >> v2:172.21.15.179:3300/0 conn(0x7f9f7c152550 0x7f9f7c0c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:37.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.353+0000 7f9f7b59e640 1 -- 172.21.15.162:0/3949118251 >> v2:172.21.15.179:3300/0 conn(0x7f9f7c152550 msgr2=0x7f9f7c0c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:37.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.353+0000 7f9f7b59e640 1 --2- 172.21.15.162:0/3949118251 >> v2:172.21.15.179:3300/0 conn(0x7f9f7c152550 0x7f9f7c0c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:37.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.353+0000 7f9f7b59e640 1 -- 172.21.15.162:0/3949118251 >> v1:172.21.15.162:6789/0 conn(0x7f9f7c152170 legacy=0x7f9f7c0c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:37.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.353+0000 7f9f7b59e640 1 -- 172.21.15.162:0/3949118251 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7c158c50 con 0x7f9f7c0c8460 2024-04-25T00:50:37.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.357+0000 7f9f7b59e640 1 --2- 172.21.15.162:0/3949118251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f7c0c8460 0x7f9f7c0c9930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c067e40 tx=0x7f9f6c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e09fd8d6ba365ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:37.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.361+0000 7f9f79d9b640 1 -- 172.21.15.162:0/3949118251 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c0aa650 con 0x7f9f7c0c8460 2024-04-25T00:50:37.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.361+0000 7f9f79d9b640 1 -- 172.21.15.162:0/3949118251 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f6c0af070 con 0x7f9f7c0c8460 2024-04-25T00:50:37.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.361+0000 7f9f79d9b640 1 -- 172.21.15.162:0/3949118251 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c0aaa10 con 0x7f9f7c0c8460 2024-04-25T00:50:37.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.361+0000 7f9f81184640 1 -- 172.21.15.162:0/3949118251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f7c0c8460 msgr2=0x7f9f7c0c9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:37.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.361+0000 7f9f81184640 1 --2- 172.21.15.162:0/3949118251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f7c0c8460 0x7f9f7c0c9930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c067e40 tx=0x7f9f6c01c4f0 comp rx=0 tx=0).stop 2024-04-25T00:50:37.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.361+0000 7f9f81184640 1 -- 172.21.15.162:0/3949118251 shutdown_connections 2024-04-25T00:50:37.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.361+0000 7f9f81184640 1 --2- 172.21.15.162:0/3949118251 >> v2:172.21.15.179:3300/0 conn(0x7f9f7c152550 0x7f9f7c0c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:37.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.361+0000 7f9f81184640 1 --2- 172.21.15.162:0/3949118251 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f7c0c8460 0x7f9f7c0c9930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:37.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.361+0000 7f9f81184640 1 -- 172.21.15.162:0/3949118251 >> 172.21.15.162:0/3949118251 conn(0x7f9f7c06fe00 msgr2=0x7f9f7c066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:37.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.361+0000 7f9f81184640 1 -- 172.21.15.162:0/3949118251 shutdown_connections 2024-04-25T00:50:37.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.361+0000 7f9f81184640 1 -- 172.21.15.162:0/3949118251 wait complete. 2024-04-25T00:50:37.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.365+0000 7f9f81184640 1 Processor -- start 2024-04-25T00:50:37.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.365+0000 7f9f81184640 1 -- start start 2024-04-25T00:50:37.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.365+0000 7f9f81184640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f7c0c8460 0x7f9f7c1f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:37.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.365+0000 7f9f81184640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f7c152170 0x7f9f7c14a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:37.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.365+0000 7f9f81184640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f7c152550 0x7f9f7c149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:37.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.365+0000 7f9f81184640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c164b90 con 0x7f9f7c152170 2024-04-25T00:50:37.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.365+0000 7f9f81184640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c164a10 con 0x7f9f7c0c8460 2024-04-25T00:50:37.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.365+0000 7f9f81184640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9f7c164d10 con 0x7f9f7c152550 2024-04-25T00:50:37.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.365+0000 7f9f7a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f7c152170 0x7f9f7c14a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:37.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.365+0000 7f9f7a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f7c152170 0x7f9f7c14a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51206/0 (socket says 172.21.15.162:51206) 2024-04-25T00:50:37.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.365+0000 7f9f7a59c640 1 -- 172.21.15.162:0/2878715061 learned_addr learned my addr 172.21.15.162:0/2878715061 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:37.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.365+0000 7f9f7ad9d640 1 --2- 172.21.15.162:0/2878715061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f7c0c8460 0x7f9f7c1f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:37.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.365+0000 7f9f7b59e640 1 --2- 172.21.15.162:0/2878715061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f7c152550 0x7f9f7c149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:37.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.369+0000 7f9f7a59c640 1 -- 172.21.15.162:0/2878715061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f7c152550 msgr2=0x7f9f7c149240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:37.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.369+0000 7f9f7a59c640 1 --2- 172.21.15.162:0/2878715061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f7c152550 0x7f9f7c149240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:37.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.369+0000 7f9f7a59c640 1 -- 172.21.15.162:0/2878715061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f7c0c8460 msgr2=0x7f9f7c1f75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:37.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.369+0000 7f9f7a59c640 1 --2- 172.21.15.162:0/2878715061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f7c0c8460 0x7f9f7c1f75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:37.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.369+0000 7f9f7a59c640 1 -- 172.21.15.162:0/2878715061 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7c15aa30 con 0x7f9f7c152170 2024-04-25T00:50:37.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.373+0000 7f9f7a59c640 1 --2- 172.21.15.162:0/2878715061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f7c152170 0x7f9f7c14a300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000e8a0 tx=0x7f9f7000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:37.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.377+0000 7f9f637fe640 1 -- 172.21.15.162:0/2878715061 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f70017070 con 0x7f9f7c152170 2024-04-25T00:50:37.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.377+0000 7f9f637fe640 1 -- 172.21.15.162:0/2878715061 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f7000c940 con 0x7f9f7c152170 2024-04-25T00:50:37.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.377+0000 7f9f81184640 1 -- 172.21.15.162:0/2878715061 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f7c15ad10 con 0x7f9f7c152170 2024-04-25T00:50:37.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.377+0000 7f9f637fe640 1 -- 172.21.15.162:0/2878715061 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f7000ccf0 con 0x7f9f7c152170 2024-04-25T00:50:37.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.377+0000 7f9f81184640 1 -- 172.21.15.162:0/2878715061 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f7c1f6df0 con 0x7f9f7c152170 2024-04-25T00:50:37.378 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.377+0000 7f9f81184640 1 -- 172.21.15.162:0/2878715061 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f7c068520 con 0x7f9f7c152170 2024-04-25T00:50:37.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.397+0000 7f9f637fe640 1 -- 172.21.15.162:0/2878715061 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9f7001a070 con 0x7f9f7c152170 2024-04-25T00:50:37.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.397+0000 7f9f637fe640 1 --2- 172.21.15.162:0/2878715061 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9f680678f0 0x7f9f68069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:37.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.397+0000 7f9f7ad9d640 1 --2- 172.21.15.162:0/2878715061 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9f680678f0 0x7f9f68069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:37.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.397+0000 7f9f7ad9d640 1 --2- 172.21.15.162:0/2878715061 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9f680678f0 0x7f9f68069db0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f74001ea0 tx=0x7f9f74009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:37.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.677+0000 7f9f637fe640 1 -- 172.21.15.162:0/2878715061 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f9f70054840 con 0x7f9f7c152170 2024-04-25T00:50:37.680 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.677+0000 7f9f637fe640 1 -- 172.21.15.162:0/2878715061 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f9f700567a0 con 0x7f9f7c152170 2024-04-25T00:50:37.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.849+0000 7f9f81184640 1 -- 172.21.15.162:0/2878715061 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f7c04f5f0 con 0x7f9f7c152170 2024-04-25T00:50:37.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.957+0000 7f9f637fe640 1 -- 172.21.15.162:0/2878715061 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+16641 (secure 0 0 0) 0x7f9f7005aaa0 con 0x7f9f7c152170 2024-04-25T00:50:37.959 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:37.959 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":26,"fsid":"e141deed-4794-4a17-83c9-f6e6e8875f5e","created":"2024-04-25T00:49:29.904605+0000","modified":"2024-04-25T00:50:37.007717+0000","last_up_change":"2024-04-25T00:49:51.119342+0000","last_in_change":"2024-04-25T00:49:39.898293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T00:49:52.297093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T00:50:31.644475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T00:50:33.242786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e20986cc-3664-4988-959c-c0b02e380775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6811","nonce":2734546478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6813","nonce":2734546478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6817","nonce":2734546478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6815","nonce":2734546478}]},"public_addr":"172.21.15.162:6811/2734546478","cluster_addr":"172.21.15.162:6813/2734546478","heartbeat_back_addr":"172.21.15.162:6817/2734546478","heartbeat_front_addr":"172.21.15.162:6815/2734546478","state":["exists","up"]},{"osd":1,"uuid":"60f1608a-ecb7-4978-b816-ce6f419e275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6803","nonce":3488816098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6805","nonce":3488816098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6809","nonce":3488816098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6807","nonce":3488816098}]},"public_addr":"172.21.15.162:6803/3488816098","cluster_addr":"172.21.15.162:6805/3488816098","heartbeat_back_addr":"172.21.15.162:6809/3488816098","heartbeat_front_addr":"172.21.15.162:6807/3488816098","state":["exists","up"]},{"osd":2,"uuid":"77552061-8e19-4f49-bc3f-1300955a07b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6819","nonce":234337516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6821","nonce":234337516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6825","nonce":234337516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6823","nonce":234337516}]},"public_addr":"172.21.15.162:6819/234337516","cluster_addr":"172.21.15.162:6821/234337516","heartbeat_back_addr":"172.21.15.162:6825/234337516","heartbeat_front_addr":"172.21.15.162:6823/234337516","state":["exists","up"]},{"osd":3,"uuid":"5b105720-6e6d-4143-b5c4-0a3b1e4a687c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6827","nonce":1726903362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6829","nonce":1726903362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6833","nonce":1726903362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6831","nonce":1726903362}]},"public_addr":"172.21.15.162:6827/1726903362","cluster_addr":"172.21.15.162:6829/1726903362","heartbeat_back_addr":"172.21.15.162:6833/1726903362","heartbeat_front_addr":"172.21.15.162:6831/1726903362","state":["exists","up"]},{"osd":4,"uuid":"611eafc5-2fe0-4c96-ba8c-b1efc3930de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6817","nonce":3338082657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6819","nonce":3338082657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6823","nonce":3338082657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6821","nonce":3338082657}]},"public_addr":"172.21.15.179:6817/3338082657","cluster_addr":"172.21.15.179:6819/3338082657","heartbeat_back_addr":"172.21.15.179:6823/3338082657","heartbeat_front_addr":"172.21.15.179:6821/3338082657","state":["exists","up"]},{"osd":5,"uuid":"b39487f5-c314-4026-90bd-02e30ecca04f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6825","nonce":4129338239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6827","nonce":4129338239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6831","nonce":4129338239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6829","nonce":4129338239}]},"public_addr":"172.21.15.179:6825/4129338239","cluster_addr":"172.21.15.179:6827/4129338239","heartbeat_back_addr":"172.21.15.179:6831/4129338239","heartbeat_front_addr":"172.21.15.179:6829/4129338239","state":["exists","up"]},{"osd":6,"uuid":"1d902755-f992-4070-b30e-e79f5fb22d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6801","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6802","nonce":823843016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6806","nonce":823843016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6815","nonce":823843016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6810","nonce":823843016}]},"public_addr":"172.21.15.179:6802/823843016","cluster_addr":"172.21.15.179:6806/823843016","heartbeat_back_addr":"172.21.15.179:6815/823843016","heartbeat_front_addr":"172.21.15.179:6810/823843016","state":["exists","up"]},{"osd":7,"uuid":"ea529f85-28fd-4dc3-a584-314e71999061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6803","nonce":3403659125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6807","nonce":3403659125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6814","nonce":3403659125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6811","nonce":3403659125}]},"public_addr":"172.21.15.179:6803/3403659125","cluster_addr":"172.21.15.179:6807/3403659125","heartbeat_back_addr":"172.21.15.179:6814/3403659125","heartbeat_front_addr":"172.21.15.179:6811/3403659125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.684518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.583123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.644576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.815957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.787155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.814409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.657210+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.676697+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T00:50:37.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.961+0000 7f9f81184640 1 -- 172.21.15.162:0/2878715061 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9f680678f0 msgr2=0x7f9f68069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:37.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.961+0000 7f9f81184640 1 --2- 172.21.15.162:0/2878715061 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9f680678f0 0x7f9f68069db0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9f74001ea0 tx=0x7f9f74009040 comp rx=0 tx=0).stop 2024-04-25T00:50:37.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.961+0000 7f9f81184640 1 -- 172.21.15.162:0/2878715061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f7c152170 msgr2=0x7f9f7c14a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:37.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.961+0000 7f9f81184640 1 --2- 172.21.15.162:0/2878715061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f7c152170 0x7f9f7c14a300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9f7000e8a0 tx=0x7f9f7000eca0 comp rx=0 tx=0).stop 2024-04-25T00:50:37.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.961+0000 7f9f81184640 1 -- 172.21.15.162:0/2878715061 shutdown_connections 2024-04-25T00:50:37.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.961+0000 7f9f81184640 1 --2- 172.21.15.162:0/2878715061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9f7c152550 0x7f9f7c149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:37.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.961+0000 7f9f81184640 1 --2- 172.21.15.162:0/2878715061 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9f680678f0 0x7f9f68069db0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:37.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.961+0000 7f9f81184640 1 --2- 172.21.15.162:0/2878715061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9f7c152170 0x7f9f7c14a300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:37.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.961+0000 7f9f81184640 1 --2- 172.21.15.162:0/2878715061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9f7c0c8460 0x7f9f7c1f75f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:37.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.961+0000 7f9f81184640 1 -- 172.21.15.162:0/2878715061 >> 172.21.15.162:0/2878715061 conn(0x7f9f7c06fe00 msgr2=0x7f9f7c0c2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:37.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.961+0000 7f9f81184640 1 -- 172.21.15.162:0/2878715061 shutdown_connections 2024-04-25T00:50:37.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:37.961+0000 7f9f81184640 1 -- 172.21.15.162:0/2878715061 wait complete. 2024-04-25T00:50:37.980 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T00:50:38.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.093+0000 7f47125b9640 1 Processor -- start 2024-04-25T00:50:38.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.093+0000 7f47125b9640 1 -- start start 2024-04-25T00:50:38.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.097+0000 7f47125b9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f470c06e410 0x7f470c0c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:38.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.097+0000 7f47125b9640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f470c06bdd0 0x7f470c0c8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:38.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.097+0000 7f47125b9640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f470c06b9e0 con 0x7f470c1544f0 2024-04-25T00:50:38.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.097+0000 7f47125b9640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f470c06cad0 con 0x7f470c06bdd0 2024-04-25T00:50:38.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.097+0000 7f47125b9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f470c06d870 con 0x7f470c06e410 2024-04-25T00:50:38.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.097+0000 7f4703fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f470c06e410 0x7f470c0c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:38.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.097+0000 7f4703fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f470c06e410 0x7f470c0c6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:55840/0 (socket says 172.21.15.162:55840) 2024-04-25T00:50:38.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.097+0000 7f4703fff640 1 -- 172.21.15.162:0/63635317 learned_addr learned my addr 172.21.15.162:0/63635317 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:38.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.105+0000 7f470b7fe640 1 -- 172.21.15.162:0/63635317 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4176259387 0 0) 0x7f470c06b9e0 con 0x7f470c1544f0 2024-04-25T00:50:38.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.105+0000 7f470b7fe640 1 -- 172.21.15.162:0/63635317 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46f8003530 con 0x7f470c1544f0 2024-04-25T00:50:38.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.105+0000 7f4703fff640 1 -- 172.21.15.162:0/63635317 >> v2:172.21.15.179:3300/0 conn(0x7f470c06bdd0 msgr2=0x7f470c0c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:38.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.105+0000 7f4703fff640 1 --2- 172.21.15.162:0/63635317 >> v2:172.21.15.179:3300/0 conn(0x7f470c06bdd0 0x7f470c0c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:38.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.105+0000 7f4703fff640 1 -- 172.21.15.162:0/63635317 >> v1:172.21.15.162:6789/0 conn(0x7f470c1544f0 legacy=0x7f470c06dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:38.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.105+0000 7f4703fff640 1 -- 172.21.15.162:0/63635317 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470c15b080 con 0x7f470c06e410 2024-04-25T00:50:38.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.117+0000 7f4703fff640 1 --2- 172.21.15.162:0/63635317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f470c06e410 0x7f470c0c6f70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009870 tx=0x7f46f401ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=874ba5d2d1bafcab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:38.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.129+0000 7f470b7fe640 1 -- 172.21.15.162:0/63635317 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f40b5070 con 0x7f470c06e410 2024-04-25T00:50:38.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.129+0000 7f470b7fe640 1 -- 172.21.15.162:0/63635317 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46f40a8a50 con 0x7f470c06e410 2024-04-25T00:50:38.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.129+0000 7f470b7fe640 1 -- 172.21.15.162:0/63635317 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46f40a8e20 con 0x7f470c06e410 2024-04-25T00:50:38.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.129+0000 7f47125b9640 1 -- 172.21.15.162:0/63635317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f470c06e410 msgr2=0x7f470c0c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:38.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.129+0000 7f47125b9640 1 --2- 172.21.15.162:0/63635317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f470c06e410 0x7f470c0c6f70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f46f4009870 tx=0x7f46f401ed50 comp rx=0 tx=0).stop 2024-04-25T00:50:38.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.133+0000 7f47125b9640 1 -- 172.21.15.162:0/63635317 shutdown_connections 2024-04-25T00:50:38.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.133+0000 7f47125b9640 1 --2- 172.21.15.162:0/63635317 >> v2:172.21.15.179:3300/0 conn(0x7f470c06bdd0 0x7f470c0c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:38.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.133+0000 7f47125b9640 1 --2- 172.21.15.162:0/63635317 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f470c06e410 0x7f470c0c6f70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:38.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.133+0000 7f47125b9640 1 -- 172.21.15.162:0/63635317 >> 172.21.15.162:0/63635317 conn(0x7f470c06fab0 msgr2=0x7f470c06fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:38.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.133+0000 7f47125b9640 1 -- 172.21.15.162:0/63635317 shutdown_connections 2024-04-25T00:50:38.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.133+0000 7f47125b9640 1 -- 172.21.15.162:0/63635317 wait complete. 2024-04-25T00:50:38.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.133+0000 7f47125b9640 1 Processor -- start 2024-04-25T00:50:38.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.133+0000 7f47125b9640 1 -- start start 2024-04-25T00:50:38.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.133+0000 7f47125b9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f470c06bdd0 0x7f470c0c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:38.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.133+0000 7f47125b9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f470c06e410 0x7f470c0c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:38.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.133+0000 7f47125b9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f470c1544f0 0x7f470c0c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:38.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.133+0000 7f47125b9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f470c1548d0 con 0x7f470c06bdd0 2024-04-25T00:50:38.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.133+0000 7f47125b9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f470c06b700 con 0x7f470c06e410 2024-04-25T00:50:38.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.133+0000 7f47125b9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f470c15acd0 con 0x7f470c1544f0 2024-04-25T00:50:38.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.133+0000 7f470bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f470c06bdd0 0x7f470c0c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:38.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.133+0000 7f470bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f470c06bdd0 0x7f470c0c52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51208/0 (socket says 172.21.15.162:51208) 2024-04-25T00:50:38.136 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.133+0000 7f470bfff640 1 -- 172.21.15.162:0/1489403244 learned_addr learned my addr 172.21.15.162:0/1489403244 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:38.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.137+0000 7f4710b56640 1 --2- 172.21.15.162:0/1489403244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f470c1544f0 0x7f470c0c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:38.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.137+0000 7f470bfff640 1 -- 172.21.15.162:0/1489403244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f470c1544f0 msgr2=0x7f470c0c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:38.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.137+0000 7f470bfff640 1 --2- 172.21.15.162:0/1489403244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f470c1544f0 0x7f470c0c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:38.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.137+0000 7f470bfff640 1 -- 172.21.15.162:0/1489403244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f470c06e410 msgr2=0x7f470c0c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:38.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.137+0000 7f470bfff640 1 --2- 172.21.15.162:0/1489403244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f470c06e410 0x7f470c0c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:38.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.137+0000 7f470bfff640 1 -- 172.21.15.162:0/1489403244 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f470c14e810 con 0x7f470c06bdd0 2024-04-25T00:50:38.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.141+0000 7f470bfff640 1 --2- 172.21.15.162:0/1489403244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f470c06bdd0 0x7f470c0c52c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00c430 tx=0x7f46fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:38.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.145+0000 7f47097fa640 1 -- 172.21.15.162:0/1489403244 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc017070 con 0x7f470c06bdd0 2024-04-25T00:50:38.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.145+0000 7f47097fa640 1 -- 172.21.15.162:0/1489403244 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46fc0052f0 con 0x7f470c06bdd0 2024-04-25T00:50:38.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.145+0000 7f47097fa640 1 -- 172.21.15.162:0/1489403244 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46fc003840 con 0x7f470c06bdd0 2024-04-25T00:50:38.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.145+0000 7f47125b9640 1 -- 172.21.15.162:0/1489403244 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f470c158260 con 0x7f470c06bdd0 2024-04-25T00:50:38.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.145+0000 7f47125b9640 1 -- 172.21.15.162:0/1489403244 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f470c158820 con 0x7f470c06bdd0 2024-04-25T00:50:38.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.145+0000 7f47125b9640 1 -- 172.21.15.162:0/1489403244 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f470c157c70 con 0x7f470c06bdd0 2024-04-25T00:50:38.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.445+0000 7f47097fa640 1 -- 172.21.15.162:0/1489403244 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f46fc01a070 con 0x7f470c06bdd0 2024-04-25T00:50:38.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.445+0000 7f47097fa640 1 --2- 172.21.15.162:0/1489403244 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f46ec067910 0x7f46ec069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:38.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.445+0000 7f4703fff640 1 --2- 172.21.15.162:0/1489403244 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f46ec067910 0x7f46ec069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:38.448 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.445+0000 7f4703fff640 1 --2- 172.21.15.162:0/1489403244 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f46ec067910 0x7f46ec069dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f46f40b2000 tx=0x7f46f4004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:38.483 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.481+0000 7f47097fa640 1 -- 172.21.15.162:0/1489403244 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f46fc053990 con 0x7f470c06bdd0 2024-04-25T00:50:38.484 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.481+0000 7f47097fa640 1 -- 172.21.15.162:0/1489403244 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f46fc021020 con 0x7f470c06bdd0 2024-04-25T00:50:38.654 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.653+0000 7f47125b9640 1 -- 172.21.15.162:0/1489403244 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f470c04f5f0 con 0x7f470c06bdd0 2024-04-25T00:50:38.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.737+0000 7f47097fa640 1 -- 172.21.15.162:0/1489403244 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+16641 (secure 0 0 0) 0x7f46fc0558f0 con 0x7f470c06bdd0 2024-04-25T00:50:38.737 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:38.738 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":26,"fsid":"e141deed-4794-4a17-83c9-f6e6e8875f5e","created":"2024-04-25T00:49:29.904605+0000","modified":"2024-04-25T00:50:37.007717+0000","last_up_change":"2024-04-25T00:49:51.119342+0000","last_in_change":"2024-04-25T00:49:39.898293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T00:49:52.297093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T00:50:31.644475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T00:50:33.242786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e20986cc-3664-4988-959c-c0b02e380775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6811","nonce":2734546478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6813","nonce":2734546478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6817","nonce":2734546478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6815","nonce":2734546478}]},"public_addr":"172.21.15.162:6811/2734546478","cluster_addr":"172.21.15.162:6813/2734546478","heartbeat_back_addr":"172.21.15.162:6817/2734546478","heartbeat_front_addr":"172.21.15.162:6815/2734546478","state":["exists","up"]},{"osd":1,"uuid":"60f1608a-ecb7-4978-b816-ce6f419e275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6803","nonce":3488816098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6805","nonce":3488816098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6809","nonce":3488816098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6807","nonce":3488816098}]},"public_addr":"172.21.15.162:6803/3488816098","cluster_addr":"172.21.15.162:6805/3488816098","heartbeat_back_addr":"172.21.15.162:6809/3488816098","heartbeat_front_addr":"172.21.15.162:6807/3488816098","state":["exists","up"]},{"osd":2,"uuid":"77552061-8e19-4f49-bc3f-1300955a07b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6819","nonce":234337516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6821","nonce":234337516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6825","nonce":234337516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6823","nonce":234337516}]},"public_addr":"172.21.15.162:6819/234337516","cluster_addr":"172.21.15.162:6821/234337516","heartbeat_back_addr":"172.21.15.162:6825/234337516","heartbeat_front_addr":"172.21.15.162:6823/234337516","state":["exists","up"]},{"osd":3,"uuid":"5b105720-6e6d-4143-b5c4-0a3b1e4a687c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6827","nonce":1726903362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6829","nonce":1726903362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6833","nonce":1726903362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6831","nonce":1726903362}]},"public_addr":"172.21.15.162:6827/1726903362","cluster_addr":"172.21.15.162:6829/1726903362","heartbeat_back_addr":"172.21.15.162:6833/1726903362","heartbeat_front_addr":"172.21.15.162:6831/1726903362","state":["exists","up"]},{"osd":4,"uuid":"611eafc5-2fe0-4c96-ba8c-b1efc3930de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6817","nonce":3338082657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6819","nonce":3338082657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6823","nonce":3338082657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6821","nonce":3338082657}]},"public_addr":"172.21.15.179:6817/3338082657","cluster_addr":"172.21.15.179:6819/3338082657","heartbeat_back_addr":"172.21.15.179:6823/3338082657","heartbeat_front_addr":"172.21.15.179:6821/3338082657","state":["exists","up"]},{"osd":5,"uuid":"b39487f5-c314-4026-90bd-02e30ecca04f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6825","nonce":4129338239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6827","nonce":4129338239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6831","nonce":4129338239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6829","nonce":4129338239}]},"public_addr":"172.21.15.179:6825/4129338239","cluster_addr":"172.21.15.179:6827/4129338239","heartbeat_back_addr":"172.21.15.179:6831/4129338239","heartbeat_front_addr":"172.21.15.179:6829/4129338239","state":["exists","up"]},{"osd":6,"uuid":"1d902755-f992-4070-b30e-e79f5fb22d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6801","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6802","nonce":823843016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6806","nonce":823843016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6815","nonce":823843016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6810","nonce":823843016}]},"public_addr":"172.21.15.179:6802/823843016","cluster_addr":"172.21.15.179:6806/823843016","heartbeat_back_addr":"172.21.15.179:6815/823843016","heartbeat_front_addr":"172.21.15.179:6810/823843016","state":["exists","up"]},{"osd":7,"uuid":"ea529f85-28fd-4dc3-a584-314e71999061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6803","nonce":3403659125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6807","nonce":3403659125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6814","nonce":3403659125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6811","nonce":3403659125}]},"public_addr":"172.21.15.179:6803/3403659125","cluster_addr":"172.21.15.179:6807/3403659125","heartbeat_back_addr":"172.21.15.179:6814/3403659125","heartbeat_front_addr":"172.21.15.179:6811/3403659125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.684518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.583123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.644576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.815957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.787155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.814409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.657210+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.676697+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T00:50:38.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.737+0000 7f47125b9640 1 -- 172.21.15.162:0/1489403244 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f46ec067910 msgr2=0x7f46ec069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:38.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.737+0000 7f47125b9640 1 --2- 172.21.15.162:0/1489403244 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f46ec067910 0x7f46ec069dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f46f40b2000 tx=0x7f46f4004740 comp rx=0 tx=0).stop 2024-04-25T00:50:38.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.737+0000 7f47125b9640 1 -- 172.21.15.162:0/1489403244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f470c06bdd0 msgr2=0x7f470c0c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:38.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.737+0000 7f47125b9640 1 --2- 172.21.15.162:0/1489403244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f470c06bdd0 0x7f470c0c52c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00c430 tx=0x7f46fc00c8f0 comp rx=0 tx=0).stop 2024-04-25T00:50:38.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.737+0000 7f47125b9640 1 -- 172.21.15.162:0/1489403244 shutdown_connections 2024-04-25T00:50:38.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.737+0000 7f47125b9640 1 --2- 172.21.15.162:0/1489403244 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f470c1544f0 0x7f470c0c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:38.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.737+0000 7f47125b9640 1 --2- 172.21.15.162:0/1489403244 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f470c06e410 0x7f470c0c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:38.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.737+0000 7f47125b9640 1 --2- 172.21.15.162:0/1489403244 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f46ec067910 0x7f46ec069dd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:38.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.737+0000 7f47125b9640 1 --2- 172.21.15.162:0/1489403244 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f470c06bdd0 0x7f470c0c52c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:38.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.737+0000 7f47125b9640 1 -- 172.21.15.162:0/1489403244 >> 172.21.15.162:0/1489403244 conn(0x7f470c06fab0 msgr2=0x7f470c14dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:38.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.737+0000 7f47125b9640 1 -- 172.21.15.162:0/1489403244 shutdown_connections 2024-04-25T00:50:38.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.737+0000 7f47125b9640 1 -- 172.21.15.162:0/1489403244 wait complete. 2024-04-25T00:50:38.758 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T00:50:38.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.885+0000 7fc919c63640 1 Processor -- start 2024-04-25T00:50:38.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.885+0000 7fc919c63640 1 -- start start 2024-04-25T00:50:38.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.885+0000 7fc919c63640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc914141380 0x7fc91415c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:38.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.885+0000 7fc919c63640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc914141760 0x7fc91406dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:38.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.885+0000 7fc919c63640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9140c8600 con 0x7fc9140c8190 2024-04-25T00:50:38.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.885+0000 7fc919c63640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc9140c7040 con 0x7fc914141380 2024-04-25T00:50:38.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.885+0000 7fc919c63640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fc91415c050 con 0x7fc914141760 2024-04-25T00:50:38.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.885+0000 7fc9137fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc914141380 0x7fc91415c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:38.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.885+0000 7fc9137fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc914141380 0x7fc91415c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:51214/0 (socket says 172.21.15.162:51214) 2024-04-25T00:50:38.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.885+0000 7fc9137fe640 1 -- 172.21.15.162:0/1495454121 learned_addr learned my addr 172.21.15.162:0/1495454121 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:38.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.885+0000 7fc90bfff640 1 --2- 172.21.15.162:0/1495454121 >> v2:172.21.15.179:3300/0 conn(0x7fc914141760 0x7fc91406dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:38.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.893+0000 7fc9137fe640 1 -- 172.21.15.162:0/1495454121 >> v2:172.21.15.179:3300/0 conn(0x7fc914141760 msgr2=0x7fc91406dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:38.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.893+0000 7fc9137fe640 1 --2- 172.21.15.162:0/1495454121 >> v2:172.21.15.179:3300/0 conn(0x7fc914141760 0x7fc91406dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:38.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.893+0000 7fc9137fe640 1 -- 172.21.15.162:0/1495454121 >> v1:172.21.15.162:6789/0 conn(0x7fc9140c8190 legacy=0x7fc9140c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:38.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.893+0000 7fc9137fe640 1 -- 172.21.15.162:0/1495454121 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9140c6a80 con 0x7fc914141380 2024-04-25T00:50:38.899 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.897+0000 7fc9137fe640 1 --2- 172.21.15.162:0/1495454121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc914141380 0x7fc91415c4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc91406c130 tx=0x7fc8fc01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93199bc720203ef4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:38.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.901+0000 7fc912ffd640 1 -- 172.21.15.162:0/1495454121 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc0ab660 con 0x7fc914141380 2024-04-25T00:50:38.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.901+0000 7fc912ffd640 1 -- 172.21.15.162:0/1495454121 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8fc0b0070 con 0x7fc914141380 2024-04-25T00:50:38.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.901+0000 7fc912ffd640 1 -- 172.21.15.162:0/1495454121 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8fc0aba20 con 0x7fc914141380 2024-04-25T00:50:38.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.905+0000 7fc919c63640 1 -- 172.21.15.162:0/1495454121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc914141380 msgr2=0x7fc91415c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:38.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.905+0000 7fc919c63640 1 --2- 172.21.15.162:0/1495454121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc914141380 0x7fc91415c4e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc91406c130 tx=0x7fc8fc01c460 comp rx=0 tx=0).stop 2024-04-25T00:50:38.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.905+0000 7fc919c63640 1 -- 172.21.15.162:0/1495454121 shutdown_connections 2024-04-25T00:50:38.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.905+0000 7fc919c63640 1 --2- 172.21.15.162:0/1495454121 >> v2:172.21.15.179:3300/0 conn(0x7fc914141760 0x7fc91406dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:38.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.905+0000 7fc919c63640 1 --2- 172.21.15.162:0/1495454121 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc914141380 0x7fc91415c4e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:38.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.905+0000 7fc919c63640 1 -- 172.21.15.162:0/1495454121 >> 172.21.15.162:0/1495454121 conn(0x7fc91406b210 msgr2=0x7fc91406b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:38.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.905+0000 7fc919c63640 1 -- 172.21.15.162:0/1495454121 shutdown_connections 2024-04-25T00:50:38.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.905+0000 7fc919c63640 1 -- 172.21.15.162:0/1495454121 wait complete. 2024-04-25T00:50:38.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.905+0000 7fc919c63640 1 Processor -- start 2024-04-25T00:50:38.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.905+0000 7fc919c63640 1 -- start start 2024-04-25T00:50:38.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.905+0000 7fc919c63640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9140c8190 0x7fc914161460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:38.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.905+0000 7fc919c63640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc914141380 0x7fc9141f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:38.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.905+0000 7fc919c63640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc914141760 0x7fc9141f6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:38.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.905+0000 7fc919c63640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc914164c70 con 0x7fc914141760 2024-04-25T00:50:38.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.905+0000 7fc919c63640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc91406d8e0 con 0x7fc914141380 2024-04-25T00:50:38.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.905+0000 7fc919c63640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc914164df0 con 0x7fc9140c8190 2024-04-25T00:50:38.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.909+0000 7fc9137fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9140c8190 0x7fc914161460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:38.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.909+0000 7fc90bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc914141380 0x7fc9141f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:38.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.909+0000 7fc9137fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9140c8190 0x7fc914161460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:55858/0 (socket says 172.21.15.162:55858) 2024-04-25T00:50:38.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.909+0000 7fc9137fe640 1 -- 172.21.15.162:0/3275364421 learned_addr learned my addr 172.21.15.162:0/3275364421 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:38.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.909+0000 7fc913fff640 1 --2- 172.21.15.162:0/3275364421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc914141760 0x7fc9141f6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:38.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.917+0000 7fc913fff640 1 -- 172.21.15.162:0/3275364421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9140c8190 msgr2=0x7fc914161460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:38.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.917+0000 7fc913fff640 1 --2- 172.21.15.162:0/3275364421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9140c8190 0x7fc914161460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:38.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.917+0000 7fc913fff640 1 -- 172.21.15.162:0/3275364421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc914141380 msgr2=0x7fc9141f66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:38.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.917+0000 7fc913fff640 1 --2- 172.21.15.162:0/3275364421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc914141380 0x7fc9141f66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:38.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.917+0000 7fc913fff640 1 -- 172.21.15.162:0/3275364421 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc914137900 con 0x7fc914141760 2024-04-25T00:50:38.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.917+0000 7fc913fff640 1 --2- 172.21.15.162:0/3275364421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc914141760 0x7fc9141f6c20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc90c00c700 tx=0x7fc90c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:38.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.921+0000 7fc910ff9640 1 -- 172.21.15.162:0/3275364421 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c003b80 con 0x7fc914141760 2024-04-25T00:50:38.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.921+0000 7fc910ff9640 1 -- 172.21.15.162:0/3275364421 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc90c003d20 con 0x7fc914141760 2024-04-25T00:50:38.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.921+0000 7fc910ff9640 1 -- 172.21.15.162:0/3275364421 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90c005310 con 0x7fc914141760 2024-04-25T00:50:38.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.921+0000 7fc919c63640 1 -- 172.21.15.162:0/3275364421 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc914136f50 con 0x7fc914141760 2024-04-25T00:50:38.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.925+0000 7fc919c63640 1 -- 172.21.15.162:0/3275364421 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc914160a90 con 0x7fc914141760 2024-04-25T00:50:38.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.925+0000 7fc919c63640 1 -- 172.21.15.162:0/3275364421 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc914068310 con 0x7fc914141760 2024-04-25T00:50:38.944 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.941+0000 7fc910ff9640 1 -- 172.21.15.162:0/3275364421 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc90c0054b0 con 0x7fc914141760 2024-04-25T00:50:38.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.945+0000 7fc910ff9640 1 --2- 172.21.15.162:0/3275364421 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc8f4067910 0x7fc8f4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:38.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.945+0000 7fc9137fe640 1 --2- 172.21.15.162:0/3275364421 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc8f4067910 0x7fc8f4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:38.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:38.945+0000 7fc9137fe640 1 --2- 172.21.15.162:0/3275364421 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc8f4067910 0x7fc8f4069dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc01c4a0 tx=0x7fc8fc0a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:39.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.229+0000 7fc910ff9640 1 -- 172.21.15.162:0/3275364421 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fc90c054900 con 0x7fc914141760 2024-04-25T00:50:39.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.229+0000 7fc910ff9640 1 -- 172.21.15.162:0/3275364421 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc914136f50 con 0x7fc914141760 2024-04-25T00:50:39.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.441+0000 7fc919c63640 1 -- 172.21.15.162:0/3275364421 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc9140cb2c0 con 0x7fc914141760 2024-04-25T00:50:39.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.701+0000 7fc910ff9640 1 -- 172.21.15.162:0/3275364421 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7fc90c056860 con 0x7fc914141760 2024-04-25T00:50:39.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.705+0000 7fc919c63640 1 -- 172.21.15.162:0/3275364421 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc8f4067910 msgr2=0x7fc8f4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:39.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.705+0000 7fc919c63640 1 --2- 172.21.15.162:0/3275364421 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc8f4067910 0x7fc8f4069dd0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc8fc01c4a0 tx=0x7fc8fc0a7000 comp rx=0 tx=0).stop 2024-04-25T00:50:39.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.705+0000 7fc919c63640 1 -- 172.21.15.162:0/3275364421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc914141760 msgr2=0x7fc9141f6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:39.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.705+0000 7fc919c63640 1 --2- 172.21.15.162:0/3275364421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc914141760 0x7fc9141f6c20 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc90c00c700 tx=0x7fc90c00cbc0 comp rx=0 tx=0).stop 2024-04-25T00:50:39.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.705+0000 7fc919c63640 1 -- 172.21.15.162:0/3275364421 shutdown_connections 2024-04-25T00:50:39.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.705+0000 7fc919c63640 1 --2- 172.21.15.162:0/3275364421 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc8f4067910 0x7fc8f4069dd0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:39.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.705+0000 7fc919c63640 1 --2- 172.21.15.162:0/3275364421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc914141760 0x7fc9141f6c20 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:39.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.705+0000 7fc919c63640 1 --2- 172.21.15.162:0/3275364421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc914141380 0x7fc9141f66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:39.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.705+0000 7fc919c63640 1 --2- 172.21.15.162:0/3275364421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9140c8190 0x7fc914161460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:39.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.705+0000 7fc919c63640 1 -- 172.21.15.162:0/3275364421 >> 172.21.15.162:0/3275364421 conn(0x7fc91406b210 msgr2=0x7fc914074880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:39.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.705+0000 7fc919c63640 1 -- 172.21.15.162:0/3275364421 shutdown_connections 2024-04-25T00:50:39.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.705+0000 7fc919c63640 1 -- 172.21.15.162:0/3275364421 wait complete. 2024-04-25T00:50:39.731 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300} 2024-04-25T00:50:39.731 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-25T00:50:39.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.849+0000 7f77ca4d2640 1 Processor -- start 2024-04-25T00:50:39.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.849+0000 7f77ca4d2640 1 -- start start 2024-04-25T00:50:39.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.849+0000 7f77ca4d2640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f77c40c5a20 0x7f77c40cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:39.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.849+0000 7f77ca4d2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c415dc90 con 0x7f77c40c9950 2024-04-25T00:50:39.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.849+0000 7f77ca4d2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77c415df70 con 0x7f77c4154730 2024-04-25T00:50:39.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.849+0000 7f77ca4d2640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f77c415da40 con 0x7f77c40c5a20 2024-04-25T00:50:39.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.849+0000 7f77c37fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f77c40c9950 0x7f77c40c5310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:52050/0 (socket says 172.21.15.162:52050) 2024-04-25T00:50:39.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.849+0000 7f77c37fe640 1 -- 172.21.15.162:0/1534164659 learned_addr learned my addr 172.21.15.162:0/1534164659 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:39.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.849+0000 7f77c8a6f640 1 --2- 172.21.15.162:0/1534164659 >> v2:172.21.15.179:3300/0 conn(0x7f77c40c5a20 0x7f77c40cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:39.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.853+0000 7f77c2ffd640 1 -- 172.21.15.162:0/1534164659 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4123790020 0 0) 0x7f77c415dc90 con 0x7f77c40c9950 2024-04-25T00:50:39.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.853+0000 7f77c2ffd640 1 -- 172.21.15.162:0/1534164659 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77ac003530 con 0x7f77c40c9950 2024-04-25T00:50:39.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.857+0000 7f77c2ffd640 1 -- 172.21.15.162:0/1534164659 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3705162344 0 0) 0x7f77ac003530 con 0x7f77c40c9950 2024-04-25T00:50:39.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.857+0000 7f77c2ffd640 1 -- 172.21.15.162:0/1534164659 >> v2:172.21.15.179:3300/0 conn(0x7f77c40c5a20 msgr2=0x7f77c40cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:39.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.857+0000 7f77c2ffd640 1 --2- 172.21.15.162:0/1534164659 >> v2:172.21.15.179:3300/0 conn(0x7f77c40c5a20 0x7f77c40cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:39.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.857+0000 7f77c2ffd640 1 -- 172.21.15.162:0/1534164659 >> v1:172.21.15.179:6789/0 conn(0x7f77c4154730 legacy=0x7f77c40c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:39.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.857+0000 7f77c2ffd640 1 -- 172.21.15.162:0/1534164659 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c415e250 con 0x7f77c40c9950 2024-04-25T00:50:39.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.857+0000 7f77c2ffd640 1 -- 172.21.15.162:0/1534164659 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7f77b40016a0 con 0x7f77c40c9950 2024-04-25T00:50:39.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.857+0000 7f77c2ffd640 1 -- 172.21.15.162:0/1534164659 >> v1:172.21.15.162:6789/0 conn(0x7f77c40c9950 legacy=0x7f77c40c5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:39.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.857+0000 7f77c2ffd640 1 --2- 172.21.15.162:0/1534164659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77ac003a10 0x7f77ac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:39.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.857+0000 7f77c2ffd640 1 --2- 172.21.15.162:0/1534164659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77ac004810 0x7f77ac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:39.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.857+0000 7f77c2ffd640 1 --2- 172.21.15.162:0/1534164659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77ac0051d0 0x7f77ac00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:39.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.857+0000 7f77c2ffd640 1 -- 172.21.15.162:0/1534164659 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f77c415da40 con 0x7f77ac0051d0 2024-04-25T00:50:39.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.857+0000 7f77c2ffd640 1 -- 172.21.15.162:0/1534164659 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f77ac00c0d0 con 0x7f77ac004810 2024-04-25T00:50:39.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.857+0000 7f77c2ffd640 1 -- 172.21.15.162:0/1534164659 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f77ac00c2d0 con 0x7f77ac003a10 2024-04-25T00:50:39.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.861+0000 7f77c3fff640 1 --2- 172.21.15.162:0/1534164659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77ac003a10 0x7f77ac003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:39.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.861+0000 7f77c8a6f640 1 --2- 172.21.15.162:0/1534164659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77ac0051d0 0x7f77ac00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:39.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.865+0000 7f77c37fe640 1 --2- 172.21.15.162:0/1534164659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77ac004810 0x7f77ac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:39.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.869+0000 7f77c3fff640 1 -- 172.21.15.162:0/1534164659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77ac004810 msgr2=0x7f77ac004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:39.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.869+0000 7f77c3fff640 1 --2- 172.21.15.162:0/1534164659 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77ac004810 0x7f77ac004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:39.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.869+0000 7f77c3fff640 1 -- 172.21.15.162:0/1534164659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77ac0051d0 msgr2=0x7f77ac00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:39.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.869+0000 7f77c3fff640 1 --2- 172.21.15.162:0/1534164659 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77ac0051d0 0x7f77ac00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:39.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.869+0000 7f77c3fff640 1 -- 172.21.15.162:0/1534164659 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ac003530 con 0x7f77ac003a10 2024-04-25T00:50:39.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.869+0000 7f77c8a6f640 1 -- 172.21.15.162:0/1534164659 reap_dead start 2024-04-25T00:50:39.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.873+0000 7f77c3fff640 1 --2- 172.21.15.162:0/1534164659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77ac003a10 0x7f77ac003e30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f77b8001e70 tx=0x7f77b801c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c574e75d6632d2e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:39.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.885+0000 7f77c2ffd640 1 -- 172.21.15.162:0/1534164659 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b8001a90 con 0x7f77ac003a10 2024-04-25T00:50:39.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.885+0000 7f77c2ffd640 1 -- 172.21.15.162:0/1534164659 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77b8003b80 con 0x7f77ac003a10 2024-04-25T00:50:39.885 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.885+0000 7f77c2ffd640 1 -- 172.21.15.162:0/1534164659 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b8005080 con 0x7f77ac003a10 2024-04-25T00:50:39.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.885+0000 7f77ca4d2640 1 -- 172.21.15.162:0/1534164659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77ac003a10 msgr2=0x7f77ac003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:39.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.885+0000 7f77ca4d2640 1 --2- 172.21.15.162:0/1534164659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77ac003a10 0x7f77ac003e30 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f77b8001e70 tx=0x7f77b801c760 comp rx=0 tx=0).stop 2024-04-25T00:50:39.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.885+0000 7f77ca4d2640 1 -- 172.21.15.162:0/1534164659 shutdown_connections 2024-04-25T00:50:39.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.885+0000 7f77ca4d2640 1 --2- 172.21.15.162:0/1534164659 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77ac003a10 0x7f77ac003e30 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:39.886 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.885+0000 7f77ca4d2640 1 -- 172.21.15.162:0/1534164659 >> 172.21.15.162:0/1534164659 conn(0x7f77c4070370 msgr2=0x7f77c4070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:39.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.885+0000 7f77ca4d2640 1 -- 172.21.15.162:0/1534164659 shutdown_connections 2024-04-25T00:50:39.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.885+0000 7f77ca4d2640 1 -- 172.21.15.162:0/1534164659 wait complete. 2024-04-25T00:50:39.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.885+0000 7f77ca4d2640 1 Processor -- start 2024-04-25T00:50:39.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.885+0000 7f77ca4d2640 1 -- start start 2024-04-25T00:50:39.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.885+0000 7f77ca4d2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77ac003a10 0x7f77c41f3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:39.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.885+0000 7f77ca4d2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c40caef0 0x7f77c415b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:39.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.885+0000 7f77ca4d2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77c415d380 0x7f77c414d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:39.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.885+0000 7f77ca4d2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f77c4154b10 con 0x7f77c40caef0 2024-04-25T00:50:39.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.885+0000 7f77ca4d2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f77c415e8a0 con 0x7f77c415d380 2024-04-25T00:50:39.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.885+0000 7f77ca4d2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f77c4072840 con 0x7f77ac003a10 2024-04-25T00:50:39.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.889+0000 7f77c8a6f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77c415d380 0x7f77c414d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:39.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.889+0000 7f77c3fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77ac003a10 0x7f77c41f3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:39.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.889+0000 7f77c8a6f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77c415d380 0x7f77c414d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:38036/0 (socket says 172.21.15.162:38036) 2024-04-25T00:50:39.891 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.889+0000 7f77c8a6f640 1 -- 172.21.15.162:0/910038507 learned_addr learned my addr 172.21.15.162:0/910038507 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:39.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.897+0000 7f77c37fe640 1 --2- 172.21.15.162:0/910038507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c40caef0 0x7f77c415b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:39.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.897+0000 7f77c8a6f640 1 -- 172.21.15.162:0/910038507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77ac003a10 msgr2=0x7f77c41f3750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:39.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.897+0000 7f77c8a6f640 1 --2- 172.21.15.162:0/910038507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77ac003a10 0x7f77c41f3750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:39.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.897+0000 7f77c8a6f640 1 -- 172.21.15.162:0/910038507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c40caef0 msgr2=0x7f77c415b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:39.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.897+0000 7f77c8a6f640 1 --2- 172.21.15.162:0/910038507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c40caef0 0x7f77c415b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:39.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.897+0000 7f77c8a6f640 1 -- 172.21.15.162:0/910038507 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c414e000 con 0x7f77c415d380 2024-04-25T00:50:39.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.905+0000 7f77c8a6f640 1 --2- 172.21.15.162:0/910038507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77c415d380 0x7f77c414d2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f77c406f840 tx=0x7f77bc011cf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:39.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.917+0000 7f77c0ff9640 1 -- 172.21.15.162:0/910038507 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc004240 con 0x7f77c415d380 2024-04-25T00:50:39.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.917+0000 7f77c0ff9640 1 -- 172.21.15.162:0/910038507 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77bc01b070 con 0x7f77c415d380 2024-04-25T00:50:39.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.917+0000 7f77c0ff9640 1 -- 172.21.15.162:0/910038507 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc00f710 con 0x7f77c415d380 2024-04-25T00:50:39.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.917+0000 7f77ca4d2640 1 -- 172.21.15.162:0/910038507 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c40cb3c0 con 0x7f77c415d380 2024-04-25T00:50:39.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.917+0000 7f77ca4d2640 1 -- 172.21.15.162:0/910038507 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c40cb960 con 0x7f77c415d380 2024-04-25T00:50:39.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:39.917+0000 7f77ca4d2640 1 -- 172.21.15.162:0/910038507 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77c4075110 con 0x7f77c415d380 2024-04-25T00:50:40.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:40.249+0000 7f77c0ff9640 1 -- 172.21.15.162:0/910038507 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f77bc012040 con 0x7f77c415d380 2024-04-25T00:50:40.253 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:40.253+0000 7f77c0ff9640 1 --2- 172.21.15.162:0/910038507 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f77b0067910 0x7f77b0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:40.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:40.253+0000 7f77c3fff640 1 --2- 172.21.15.162:0/910038507 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f77b0067910 0x7f77b0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:40.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:40.253+0000 7f77c3fff640 1 --2- 172.21.15.162:0/910038507 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f77b0067910 0x7f77b0069dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f77b8005000 tx=0x7f77b8001520 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:40.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:40.257+0000 7f77c0ff9640 1 -- 172.21.15.162:0/910038507 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f77bc006c00 con 0x7f77c415d380 2024-04-25T00:50:40.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:40.281+0000 7f77c0ff9640 1 -- 172.21.15.162:0/910038507 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f77bc056fe0 con 0x7f77c415d380 2024-04-25T00:50:40.493 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:40.489+0000 7f77ca4d2640 1 -- 172.21.15.162:0/910038507 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f77c4073160 con 0x7f77c415d380 2024-04-25T00:50:41.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.829+0000 7f77c0ff9640 1 -- 172.21.15.162:0/910038507 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v7) ==== 105+0+0 (secure 0 0 0) 0x7f77bc05be20 con 0x7f77c415d380 2024-04-25T00:50:41.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.833+0000 7f77ca4d2640 1 -- 172.21.15.162:0/910038507 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f77b0067910 msgr2=0x7f77b0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:41.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.833+0000 7f77ca4d2640 1 --2- 172.21.15.162:0/910038507 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f77b0067910 0x7f77b0069dd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f77b8005000 tx=0x7f77b8001520 comp rx=0 tx=0).stop 2024-04-25T00:50:41.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.833+0000 7f77ca4d2640 1 -- 172.21.15.162:0/910038507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77c415d380 msgr2=0x7f77c414d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:41.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.833+0000 7f77ca4d2640 1 --2- 172.21.15.162:0/910038507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77c415d380 0x7f77c414d2c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f77c406f840 tx=0x7f77bc011cf0 comp rx=0 tx=0).stop 2024-04-25T00:50:41.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.833+0000 7f77ca4d2640 1 -- 172.21.15.162:0/910038507 shutdown_connections 2024-04-25T00:50:41.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.833+0000 7f77ca4d2640 1 --2- 172.21.15.162:0/910038507 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f77c415d380 0x7f77c414d2c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:41.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.833+0000 7f77ca4d2640 1 --2- 172.21.15.162:0/910038507 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f77b0067910 0x7f77b0069dd0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:41.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.833+0000 7f77ca4d2640 1 --2- 172.21.15.162:0/910038507 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f77c40caef0 0x7f77c415b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:41.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.833+0000 7f77ca4d2640 1 --2- 172.21.15.162:0/910038507 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f77ac003a10 0x7f77c41f3750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:41.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.833+0000 7f77ca4d2640 1 -- 172.21.15.162:0/910038507 >> 172.21.15.162:0/910038507 conn(0x7f77c4070370 msgr2=0x7f77c406b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:41.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.833+0000 7f77ca4d2640 1 -- 172.21.15.162:0/910038507 shutdown_connections 2024-04-25T00:50:41.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.833+0000 7f77ca4d2640 1 -- 172.21.15.162:0/910038507 wait complete. 2024-04-25T00:50:41.858 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T00:50:41.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.993+0000 7f3057179640 1 Processor -- start 2024-04-25T00:50:41.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.993+0000 7f3057179640 1 -- start start 2024-04-25T00:50:41.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.993+0000 7f3057179640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3050150c10 0x7f3050159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:41.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.993+0000 7f3057179640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f30500731e0 0x7f30500c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:41.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.993+0000 7f3057179640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30500c2430 con 0x7f30500c51c0 2024-04-25T00:50:41.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.993+0000 7f3057179640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f30500c21e0 con 0x7f30500731e0 2024-04-25T00:50:41.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.993+0000 7f3057179640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f30500c29f0 con 0x7f3050150c10 2024-04-25T00:50:41.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.993+0000 7f3055716640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f30500c51c0 0x7f30500c7770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:49536/0 (socket says 172.21.15.162:49536) 2024-04-25T00:50:41.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.993+0000 7f3055716640 1 -- 172.21.15.162:0/2776208336 learned_addr learned my addr 172.21.15.162:0/2776208336 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:41.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.997+0000 7f304f7fe640 1 -- 172.21.15.162:0/2776208336 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2817367522 0 0) 0x7f30500c2430 con 0x7f30500c51c0 2024-04-25T00:50:41.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:41.997+0000 7f304f7fe640 1 -- 172.21.15.162:0/2776208336 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3038005740 con 0x7f30500c51c0 2024-04-25T00:50:42.003 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.001+0000 7f304f7fe640 1 -- 172.21.15.162:0/2776208336 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4131118746 0 0) 0x7f3038005740 con 0x7f30500c51c0 2024-04-25T00:50:42.003 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.001+0000 7f304f7fe640 1 -- 172.21.15.162:0/2776208336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3050150c10 msgr2=0x7f3050159ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:42.003 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.001+0000 7f304f7fe640 1 --2- 172.21.15.162:0/2776208336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3050150c10 0x7f3050159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:42.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.001+0000 7f304f7fe640 1 -- 172.21.15.162:0/2776208336 >> v2:172.21.15.179:3300/0 conn(0x7f30500731e0 msgr2=0x7f30500c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:42.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.001+0000 7f304f7fe640 1 --2- 172.21.15.162:0/2776208336 >> v2:172.21.15.179:3300/0 conn(0x7f30500731e0 0x7f30500c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:42.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.001+0000 7f304f7fe640 1 -- 172.21.15.162:0/2776208336 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30500c2710 con 0x7f30500c51c0 2024-04-25T00:50:42.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.001+0000 7f304f7fe640 1 -- 172.21.15.162:0/2776208336 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7f3048001a00 con 0x7f30500c51c0 2024-04-25T00:50:42.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.001+0000 7f304f7fe640 1 -- 172.21.15.162:0/2776208336 >> v1:172.21.15.162:6789/0 conn(0x7f30500c51c0 legacy=0x7f30500c7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:42.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.001+0000 7f304f7fe640 1 --2- 172.21.15.162:0/2776208336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3038005bd0 0x7f3038005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:42.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.001+0000 7f304f7fe640 1 --2- 172.21.15.162:0/2776208336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3050150c10 0x7f3038006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:42.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.001+0000 7f304f7fe640 1 --2- 172.21.15.162:0/2776208336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3038007080 0x7f303800dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:42.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.001+0000 7f304f7fe640 1 -- 172.21.15.162:0/2776208336 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f30500c21e0 con 0x7f3038005bd0 2024-04-25T00:50:42.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.001+0000 7f304f7fe640 1 -- 172.21.15.162:0/2776208336 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f30500c29f0 con 0x7f3038007080 2024-04-25T00:50:42.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.001+0000 7f304f7fe640 1 -- 172.21.15.162:0/2776208336 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f30380077b0 con 0x7f3050150c10 2024-04-25T00:50:42.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.005+0000 7f3054f15640 1 --2- 172.21.15.162:0/2776208336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3038005bd0 0x7f3038005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:42.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.009+0000 7f3054f15640 1 -- 172.21.15.162:0/2776208336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3050150c10 msgr2=0x7f3038006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:42.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.009+0000 7f3054f15640 1 --2- 172.21.15.162:0/2776208336 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3050150c10 0x7f3038006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:42.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.009+0000 7f3054f15640 1 -- 172.21.15.162:0/2776208336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3038007080 msgr2=0x7f303800dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:42.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.009+0000 7f3054f15640 1 --2- 172.21.15.162:0/2776208336 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3038007080 0x7f303800dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:42.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.009+0000 7f3054f15640 1 -- 172.21.15.162:0/2776208336 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3038005740 con 0x7f3038005bd0 2024-04-25T00:50:42.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.009+0000 7f3054f15640 1 --2- 172.21.15.162:0/2776208336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3038005bd0 0x7f3038005ff0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3044009890 tx=0x7f304401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f778e8f8684b09f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:42.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.013+0000 7f304f7fe640 1 -- 172.21.15.162:0/2776208336 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30440b0070 con 0x7f3038005bd0 2024-04-25T00:50:42.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.013+0000 7f304f7fe640 1 -- 172.21.15.162:0/2776208336 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30440ab620 con 0x7f3038005bd0 2024-04-25T00:50:42.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.013+0000 7f304f7fe640 1 -- 172.21.15.162:0/2776208336 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3044009460 con 0x7f3038005bd0 2024-04-25T00:50:42.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.017+0000 7f3057179640 1 -- 172.21.15.162:0/2776208336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3038005bd0 msgr2=0x7f3038005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:42.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.017+0000 7f3057179640 1 --2- 172.21.15.162:0/2776208336 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3038005bd0 0x7f3038005ff0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3044009890 tx=0x7f304401c3c0 comp rx=0 tx=0).stop 2024-04-25T00:50:42.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.017+0000 7f3055716640 1 -- 172.21.15.162:0/2776208336 reap_dead start 2024-04-25T00:50:42.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.017+0000 7f3057179640 1 -- 172.21.15.162:0/2776208336 shutdown_connections 2024-04-25T00:50:42.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.017+0000 7f3057179640 1 -- 172.21.15.162:0/2776208336 >> 172.21.15.162:0/2776208336 conn(0x7f305006b210 msgr2=0x7f305006b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:42.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.017+0000 7f3057179640 1 -- 172.21.15.162:0/2776208336 shutdown_connections 2024-04-25T00:50:42.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.017+0000 7f3057179640 1 -- 172.21.15.162:0/2776208336 wait complete. 2024-04-25T00:50:42.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.017+0000 7f3057179640 1 Processor -- start 2024-04-25T00:50:42.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.017+0000 7f3057179640 1 -- start start 2024-04-25T00:50:42.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.017+0000 7f3057179640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3038005bd0 0x7f30501435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:42.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.017+0000 7f3057179640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3050147900 0x7f305014fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:42.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.017+0000 7f3057179640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3050150220 0x7f30501f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:42.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.017+0000 7f3057179640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f305006dfc0 con 0x7f3038005bd0 2024-04-25T00:50:42.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.017+0000 7f3057179640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3050150ff0 con 0x7f3050147900 2024-04-25T00:50:42.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.017+0000 7f3057179640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f305006e140 con 0x7f3050150220 2024-04-25T00:50:42.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.017+0000 7f3054f15640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3038005bd0 0x7f30501435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:42.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.017+0000 7f3054f15640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3038005bd0 0x7f30501435f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35070/0 (socket says 172.21.15.162:35070) 2024-04-25T00:50:42.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.017+0000 7f3054f15640 1 -- 172.21.15.162:0/1439211617 learned_addr learned my addr 172.21.15.162:0/1439211617 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:42.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.021+0000 7f3054f15640 1 -- 172.21.15.162:0/1439211617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3050150220 msgr2=0x7f30501f22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:42.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.021+0000 7f3054f15640 1 --2- 172.21.15.162:0/1439211617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3050150220 0x7f30501f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:42.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.021+0000 7f3054f15640 1 -- 172.21.15.162:0/1439211617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3050147900 msgr2=0x7f305014fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:42.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.021+0000 7f3054f15640 1 --2- 172.21.15.162:0/1439211617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3050147900 0x7f305014fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:42.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.021+0000 7f3054f15640 1 -- 172.21.15.162:0/1439211617 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f305014f2e0 con 0x7f3038005bd0 2024-04-25T00:50:42.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.025+0000 7f3054f15640 1 --2- 172.21.15.162:0/1439211617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3038005bd0 0x7f30501435f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f304401cc60 tx=0x7f3038007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:42.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.025+0000 7f304d7fa640 1 -- 172.21.15.162:0/1439211617 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30440b0040 con 0x7f3038005bd0 2024-04-25T00:50:42.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.025+0000 7f3057179640 1 -- 172.21.15.162:0/1439211617 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3050147e40 con 0x7f3038005bd0 2024-04-25T00:50:42.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.029+0000 7f3057179640 1 -- 172.21.15.162:0/1439211617 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f305014e800 con 0x7f3038005bd0 2024-04-25T00:50:42.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.029+0000 7f3057179640 1 -- 172.21.15.162:0/1439211617 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3050068310 con 0x7f3038005bd0 2024-04-25T00:50:42.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.029+0000 7f304d7fa640 1 -- 172.21.15.162:0/1439211617 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30440bc070 con 0x7f3038005bd0 2024-04-25T00:50:42.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.029+0000 7f304d7fa640 1 -- 172.21.15.162:0/1439211617 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30440ab620 con 0x7f3038005bd0 2024-04-25T00:50:42.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.337+0000 7f304d7fa640 1 -- 172.21.15.162:0/1439211617 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f30440b3070 con 0x7f3038005bd0 2024-04-25T00:50:42.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.341+0000 7f304d7fa640 1 --2- 172.21.15.162:0/1439211617 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f303c067a60 0x7f303c069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:42.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.341+0000 7f304ffff640 1 --2- 172.21.15.162:0/1439211617 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f303c067a60 0x7f303c069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:42.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.341+0000 7f304ffff640 1 --2- 172.21.15.162:0/1439211617 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f303c067a60 0x7f303c069f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3040006fd0 tx=0x7f3040006d80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:42.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.369+0000 7f304d7fa640 1 -- 172.21.15.162:0/1439211617 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f30440ee660 con 0x7f3038005bd0 2024-04-25T00:50:42.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.369+0000 7f304d7fa640 1 -- 172.21.15.162:0/1439211617 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f30440160d0 con 0x7f3038005bd0 2024-04-25T00:50:42.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:42.589+0000 7f3057179640 1 -- 172.21.15.162:0/1439211617 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f305014aa30 con 0x7f3038005bd0 2024-04-25T00:50:43.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.749+0000 7f304d7fa640 1 -- 172.21.15.162:0/1439211617 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7f30440f0cc0 con 0x7f3038005bd0 2024-04-25T00:50:43.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.753+0000 7f3057179640 1 -- 172.21.15.162:0/1439211617 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f303c067a60 msgr2=0x7f303c069f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:43.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.753+0000 7f3057179640 1 --2- 172.21.15.162:0/1439211617 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f303c067a60 0x7f303c069f20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3040006fd0 tx=0x7f3040006d80 comp rx=0 tx=0).stop 2024-04-25T00:50:43.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.753+0000 7f3057179640 1 -- 172.21.15.162:0/1439211617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3038005bd0 msgr2=0x7f30501435f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:43.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.753+0000 7f3057179640 1 --2- 172.21.15.162:0/1439211617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3038005bd0 0x7f30501435f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f304401cc60 tx=0x7f3038007a50 comp rx=0 tx=0).stop 2024-04-25T00:50:43.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.753+0000 7f3057179640 1 -- 172.21.15.162:0/1439211617 shutdown_connections 2024-04-25T00:50:43.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.753+0000 7f3057179640 1 --2- 172.21.15.162:0/1439211617 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3050150220 0x7f30501f22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:43.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.753+0000 7f3057179640 1 --2- 172.21.15.162:0/1439211617 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3050147900 0x7f305014fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:43.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.753+0000 7f3057179640 1 --2- 172.21.15.162:0/1439211617 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f303c067a60 0x7f303c069f20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:43.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.753+0000 7f3057179640 1 --2- 172.21.15.162:0/1439211617 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3038005bd0 0x7f30501435f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:43.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.753+0000 7f3057179640 1 -- 172.21.15.162:0/1439211617 >> 172.21.15.162:0/1439211617 conn(0x7f305006b210 msgr2=0x7f30500c5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:43.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.753+0000 7f3057179640 1 -- 172.21.15.162:0/1439211617 shutdown_connections 2024-04-25T00:50:43.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.753+0000 7f3057179640 1 -- 172.21.15.162:0/1439211617 wait complete. 2024-04-25T00:50:43.776 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-25T00:50:43.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.901+0000 7f0219e2a640 1 Processor -- start 2024-04-25T00:50:43.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.901+0000 7f0219e2a640 1 -- start start 2024-04-25T00:50:43.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.905+0000 7f0219e2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02141523e0 0x7f02140cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:43.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.905+0000 7f0219e2a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f02140cd440 0x7f021415c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:43.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.905+0000 7f0219e2a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f02141581a0 0x7f0214071380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:43.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.905+0000 7f0219e2a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f021415b790 con 0x7f02141581a0 2024-04-25T00:50:43.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.905+0000 7f0219e2a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f0214158a60 con 0x7f02140cd440 2024-04-25T00:50:43.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.905+0000 7f0219e2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f0214158d40 con 0x7f02141523e0 2024-04-25T00:50:43.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.905+0000 7f02137fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02141523e0 0x7f02140cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:43.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.905+0000 7f0212ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f02140cd440 0x7f021415c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:43.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.905+0000 7f0212ffd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f02140cd440 0x7f021415c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:41590/0 (socket says 172.21.15.162:41590) 2024-04-25T00:50:43.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.905+0000 7f0212ffd640 1 -- 172.21.15.162:0/2198848087 learned_addr learned my addr 172.21.15.162:0/2198848087 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:43.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.913+0000 7f0212ffd640 1 -- 172.21.15.162:0/2198848087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02141523e0 msgr2=0x7f02140cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:43.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.913+0000 7f0212ffd640 1 --2- 172.21.15.162:0/2198848087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02141523e0 0x7f02140cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:43.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.913+0000 7f0212ffd640 1 -- 172.21.15.162:0/2198848087 >> v2:172.21.15.162:3300/0 conn(0x7f02141581a0 msgr2=0x7f0214071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:43.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.913+0000 7f0212ffd640 1 --2- 172.21.15.162:0/2198848087 >> v2:172.21.15.162:3300/0 conn(0x7f02141581a0 0x7f0214071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:43.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.913+0000 7f0212ffd640 1 -- 172.21.15.162:0/2198848087 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0214159020 con 0x7f02140cd440 2024-04-25T00:50:43.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.917+0000 7f0212ffd640 1 --2- 172.21.15.162:0/2198848087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02140cd440 0x7f021415c230 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0214070440 tx=0x7f020801ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30d3d48182fa6751 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:43.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f02127fc640 1 -- 172.21.15.162:0/2198848087 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02080b5070 con 0x7f02140cd440 2024-04-25T00:50:43.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f02127fc640 1 -- 172.21.15.162:0/2198848087 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02080a89d0 con 0x7f02140cd440 2024-04-25T00:50:43.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f02127fc640 1 -- 172.21.15.162:0/2198848087 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02080a8da0 con 0x7f02140cd440 2024-04-25T00:50:43.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f0219e2a640 1 -- 172.21.15.162:0/2198848087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02140cd440 msgr2=0x7f021415c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:43.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f0219e2a640 1 --2- 172.21.15.162:0/2198848087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02140cd440 0x7f021415c230 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0214070440 tx=0x7f020801ed10 comp rx=0 tx=0).stop 2024-04-25T00:50:43.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f0219e2a640 1 -- 172.21.15.162:0/2198848087 shutdown_connections 2024-04-25T00:50:43.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f0219e2a640 1 --2- 172.21.15.162:0/2198848087 >> v2:172.21.15.162:3300/0 conn(0x7f02141581a0 0x7f0214071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:43.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f0219e2a640 1 --2- 172.21.15.162:0/2198848087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02140cd440 0x7f021415c230 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:43.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f0219e2a640 1 --2- 172.21.15.162:0/2198848087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02141523e0 0x7f02140cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:43.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f0219e2a640 1 -- 172.21.15.162:0/2198848087 >> 172.21.15.162:0/2198848087 conn(0x7f021406b810 msgr2=0x7f021406f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:43.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f0219e2a640 1 -- 172.21.15.162:0/2198848087 shutdown_connections 2024-04-25T00:50:43.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f0219e2a640 1 -- 172.21.15.162:0/2198848087 wait complete. 2024-04-25T00:50:43.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f0219e2a640 1 Processor -- start 2024-04-25T00:50:43.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f0219e2a640 1 -- start start 2024-04-25T00:50:43.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f0219e2a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02140cd440 0x7f02140cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:43.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f0219e2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02141523e0 0x7f02141e1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:43.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f0219e2a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02141581a0 0x7f02141e1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:43.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f0219e2a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f02141527c0 con 0x7f02140cd440 2024-04-25T00:50:43.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f0219e2a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f021415bd10 con 0x7f02141581a0 2024-04-25T00:50:43.933 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.929+0000 7f0219e2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f02140caf70 con 0x7f02141523e0 2024-04-25T00:50:43.934 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.933+0000 7f0212ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02141523e0 0x7f02141e1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:43.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.933+0000 7f0212ffd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02141523e0 0x7f02141e1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:44528/0 (socket says 172.21.15.162:44528) 2024-04-25T00:50:43.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.933+0000 7f0212ffd640 1 -- 172.21.15.162:0/433193440 learned_addr learned my addr 172.21.15.162:0/433193440 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:43.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.933+0000 7f0213fff640 1 --2- 172.21.15.162:0/433193440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02141581a0 0x7f02141e1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:43.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.933+0000 7f02137fe640 1 --2- 172.21.15.162:0/433193440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02140cd440 0x7f02140cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:43.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.941+0000 7f02137fe640 1 -- 172.21.15.162:0/433193440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02141523e0 msgr2=0x7f02141e1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:43.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.941+0000 7f02137fe640 1 --2- 172.21.15.162:0/433193440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02141523e0 0x7f02141e1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:43.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.941+0000 7f02137fe640 1 -- 172.21.15.162:0/433193440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02141581a0 msgr2=0x7f02141e1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:43.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.941+0000 7f02137fe640 1 --2- 172.21.15.162:0/433193440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02141581a0 0x7f02141e1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:43.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.941+0000 7f02137fe640 1 -- 172.21.15.162:0/433193440 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02141e3220 con 0x7f02140cd440 2024-04-25T00:50:43.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.945+0000 7f02137fe640 1 --2- 172.21.15.162:0/433193440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02140cd440 0x7f02140cdc40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f020c00e8a0 tx=0x7f020c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:43.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.945+0000 7f01fbfff640 1 -- 172.21.15.162:0/433193440 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020c017070 con 0x7f02140cd440 2024-04-25T00:50:43.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.945+0000 7f0219e2a640 1 -- 172.21.15.162:0/433193440 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02141e3490 con 0x7f02140cd440 2024-04-25T00:50:43.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.945+0000 7f0219e2a640 1 -- 172.21.15.162:0/433193440 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02141e3a50 con 0x7f02140cd440 2024-04-25T00:50:43.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.949+0000 7f0219e2a640 1 -- 172.21.15.162:0/433193440 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0214075110 con 0x7f02140cd440 2024-04-25T00:50:43.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.949+0000 7f01fbfff640 1 -- 172.21.15.162:0/433193440 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f020c0059a0 con 0x7f02140cd440 2024-04-25T00:50:43.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:43.949+0000 7f01fbfff640 1 -- 172.21.15.162:0/433193440 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020c021060 con 0x7f02140cd440 2024-04-25T00:50:44.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.257+0000 7f01fbfff640 1 -- 172.21.15.162:0/433193440 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f020c01a070 con 0x7f02140cd440 2024-04-25T00:50:44.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.257+0000 7f01fbfff640 1 --2- 172.21.15.162:0/433193440 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f02000678c0 0x7f0200069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:44.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.257+0000 7f0212ffd640 1 --2- 172.21.15.162:0/433193440 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f02000678c0 0x7f0200069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:44.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.257+0000 7f0212ffd640 1 --2- 172.21.15.162:0/433193440 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f02000678c0 0x7f0200069d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f020801ed50 tx=0x7f02080aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:44.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.293+0000 7f01fbfff640 1 -- 172.21.15.162:0/433193440 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f020c054940 con 0x7f02140cd440 2024-04-25T00:50:44.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.293+0000 7f01fbfff640 1 -- 172.21.15.162:0/433193440 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f020c0568a0 con 0x7f02140cd440 2024-04-25T00:50:44.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.501+0000 7f0219e2a640 1 -- 172.21.15.162:0/433193440 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f02140b2b10 con 0x7f02140cd440 2024-04-25T00:50:44.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.949+0000 7f01fbfff640 1 -- 172.21.15.162:0/433193440 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7f020c05aba0 con 0x7f02140cd440 2024-04-25T00:50:44.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.949+0000 7f0219e2a640 1 -- 172.21.15.162:0/433193440 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f02000678c0 msgr2=0x7f0200069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:44.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.949+0000 7f0219e2a640 1 --2- 172.21.15.162:0/433193440 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f02000678c0 0x7f0200069d80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f020801ed50 tx=0x7f02080aa070 comp rx=0 tx=0).stop 2024-04-25T00:50:44.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.949+0000 7f0219e2a640 1 -- 172.21.15.162:0/433193440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02140cd440 msgr2=0x7f02140cdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:44.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.949+0000 7f0219e2a640 1 --2- 172.21.15.162:0/433193440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02140cd440 0x7f02140cdc40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f020c00e8a0 tx=0x7f020c00ed60 comp rx=0 tx=0).stop 2024-04-25T00:50:44.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.949+0000 7f0219e2a640 1 -- 172.21.15.162:0/433193440 shutdown_connections 2024-04-25T00:50:44.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.949+0000 7f0219e2a640 1 --2- 172.21.15.162:0/433193440 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f02141581a0 0x7f02141e1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:44.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.949+0000 7f0219e2a640 1 --2- 172.21.15.162:0/433193440 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f02141523e0 0x7f02141e1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:44.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.949+0000 7f0219e2a640 1 --2- 172.21.15.162:0/433193440 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f02000678c0 0x7f0200069d80 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:44.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.949+0000 7f0219e2a640 1 --2- 172.21.15.162:0/433193440 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f02140cd440 0x7f02140cdc40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:44.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.949+0000 7f0219e2a640 1 -- 172.21.15.162:0/433193440 >> 172.21.15.162:0/433193440 conn(0x7f021406b810 msgr2=0x7f02141579f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:44.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.949+0000 7f0219e2a640 1 -- 172.21.15.162:0/433193440 shutdown_connections 2024-04-25T00:50:44.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:44.949+0000 7f0219e2a640 1 -- 172.21.15.162:0/433193440 wait complete. 2024-04-25T00:50:44.974 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T00:50:44.974 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T00:50:45.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.097+0000 7fa7c23c8640 1 Processor -- start 2024-04-25T00:50:45.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.097+0000 7fa7c23c8640 1 -- start start 2024-04-25T00:50:45.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.101+0000 7fa7c23c8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fa7bc150b90 0x7fa7bc073120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:45.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.101+0000 7fa7c23c8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa7bc0c7890 0x7fa7bc0c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:45.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.101+0000 7fa7c23c8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7bc0c2dc0 con 0x7fa7bc0c6f60 2024-04-25T00:50:45.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.101+0000 7fa7c23c8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa7bc0c3360 con 0x7fa7bc0c7890 2024-04-25T00:50:45.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.101+0000 7fa7c23c8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fa7bc0c8220 con 0x7fa7bc150b90 2024-04-25T00:50:45.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.101+0000 7fa7c0965640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa7bc0c7890 0x7fa7bc0c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:45.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.101+0000 7fa7c0965640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa7bc0c7890 0x7fa7bc0c7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35096/0 (socket says 172.21.15.162:35096) 2024-04-25T00:50:45.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.101+0000 7fa7c0965640 1 -- 172.21.15.162:0/433273028 learned_addr learned my addr 172.21.15.162:0/433273028 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:45.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.101+0000 7fa7bbfff640 1 --2- 172.21.15.162:0/433273028 >> v2:172.21.15.179:3300/0 conn(0x7fa7bc150b90 0x7fa7bc073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:45.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.105+0000 7fa7c0965640 1 -- 172.21.15.162:0/433273028 >> v2:172.21.15.179:3300/0 conn(0x7fa7bc150b90 msgr2=0x7fa7bc073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:45.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.105+0000 7fa7c0965640 1 --2- 172.21.15.162:0/433273028 >> v2:172.21.15.179:3300/0 conn(0x7fa7bc150b90 0x7fa7bc073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:45.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.105+0000 7fa7c0965640 1 -- 172.21.15.162:0/433273028 >> v1:172.21.15.179:6789/0 conn(0x7fa7bc0c6f60 legacy=0x7fa7bc06daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:45.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.105+0000 7fa7c0965640 1 -- 172.21.15.162:0/433273028 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7bc0c3080 con 0x7fa7bc0c7890 2024-04-25T00:50:45.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.105+0000 7fa7c0965640 1 --2- 172.21.15.162:0/433273028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7bc0c7890 0x7fa7bc0c7ce0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009e50 tx=0x7fa7b401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0b1e400bb1b7fca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:45.111 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.109+0000 7fa7baffd640 1 -- 172.21.15.162:0/433273028 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b40a55f0 con 0x7fa7bc0c7890 2024-04-25T00:50:45.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7baffd640 1 -- 172.21.15.162:0/433273028 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b40a5790 con 0x7fa7bc0c7890 2024-04-25T00:50:45.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7baffd640 1 -- 172.21.15.162:0/433273028 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b40a5b60 con 0x7fa7bc0c7890 2024-04-25T00:50:45.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7c23c8640 1 -- 172.21.15.162:0/433273028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7bc0c7890 msgr2=0x7fa7bc0c7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:45.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7c23c8640 1 --2- 172.21.15.162:0/433273028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7bc0c7890 0x7fa7bc0c7ce0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4009e50 tx=0x7fa7b401c9b0 comp rx=0 tx=0).stop 2024-04-25T00:50:45.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7c23c8640 1 -- 172.21.15.162:0/433273028 shutdown_connections 2024-04-25T00:50:45.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7c23c8640 1 --2- 172.21.15.162:0/433273028 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7bc0c7890 0x7fa7bc0c7ce0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:45.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7c23c8640 1 --2- 172.21.15.162:0/433273028 >> v2:172.21.15.179:3300/0 conn(0x7fa7bc150b90 0x7fa7bc073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:45.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7c23c8640 1 -- 172.21.15.162:0/433273028 >> 172.21.15.162:0/433273028 conn(0x7fa7bc0c83c0 msgr2=0x7fa7bc0c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:45.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7c23c8640 1 -- 172.21.15.162:0/433273028 shutdown_connections 2024-04-25T00:50:45.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7c23c8640 1 -- 172.21.15.162:0/433273028 wait complete. 2024-04-25T00:50:45.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7c23c8640 1 Processor -- start 2024-04-25T00:50:45.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7c23c8640 1 -- start start 2024-04-25T00:50:45.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7c23c8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7bc0c6f60 0x7fa7bc13ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:45.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7c23c8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7bc0c7890 0x7fa7bc14fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:45.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7c23c8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc150b90 0x7fa7bc1f4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:45.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7c23c8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc150f70 con 0x7fa7bc0c6f60 2024-04-25T00:50:45.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7c23c8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa7bc0c62c0 con 0x7fa7bc150b90 2024-04-25T00:50:45.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7c23c8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa7bc072bf0 con 0x7fa7bc0c7890 2024-04-25T00:50:45.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.113+0000 7fa7bbfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7bc0c6f60 0x7fa7bc13ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:45.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.117+0000 7fa7bbfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7bc0c6f60 0x7fa7bc13ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35102/0 (socket says 172.21.15.162:35102) 2024-04-25T00:50:45.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.117+0000 7fa7bbfff640 1 -- 172.21.15.162:0/734188463 learned_addr learned my addr 172.21.15.162:0/734188463 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:45.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.117+0000 7fa7c0965640 1 --2- 172.21.15.162:0/734188463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc150b90 0x7fa7bc1f4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:45.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.117+0000 7fa7bb7fe640 1 --2- 172.21.15.162:0/734188463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7bc0c7890 0x7fa7bc14fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:45.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.117+0000 7fa7bbfff640 1 -- 172.21.15.162:0/734188463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7bc0c7890 msgr2=0x7fa7bc14fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:45.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.117+0000 7fa7bbfff640 1 --2- 172.21.15.162:0/734188463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7bc0c7890 0x7fa7bc14fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:45.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.117+0000 7fa7bbfff640 1 -- 172.21.15.162:0/734188463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc150b90 msgr2=0x7fa7bc1f4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:45.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.117+0000 7fa7bbfff640 1 --2- 172.21.15.162:0/734188463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc150b90 0x7fa7bc1f4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:45.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.117+0000 7fa7bbfff640 1 -- 172.21.15.162:0/734188463 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7bc13c3d0 con 0x7fa7bc0c6f60 2024-04-25T00:50:45.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.121+0000 7fa7bbfff640 1 --2- 172.21.15.162:0/734188463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7bc0c6f60 0x7fa7bc13ef80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000d5f0 tx=0x7fa7b000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:45.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.125+0000 7fa7b8ff9640 1 -- 172.21.15.162:0/734188463 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b00125f0 con 0x7fa7bc0c6f60 2024-04-25T00:50:45.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.125+0000 7fa7b8ff9640 1 -- 172.21.15.162:0/734188463 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7b0019070 con 0x7fa7bc0c6f60 2024-04-25T00:50:45.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.125+0000 7fa7b8ff9640 1 -- 172.21.15.162:0/734188463 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7b00129b0 con 0x7fa7bc0c6f60 2024-04-25T00:50:45.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.125+0000 7fa7c23c8640 1 -- 172.21.15.162:0/734188463 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7bc13c6b0 con 0x7fa7bc0c6f60 2024-04-25T00:50:45.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.125+0000 7fa7c23c8640 1 -- 172.21.15.162:0/734188463 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7bc13e0c0 con 0x7fa7bc0c6f60 2024-04-25T00:50:45.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.125+0000 7fa7c23c8640 1 -- 172.21.15.162:0/734188463 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7bc0c34f0 con 0x7fa7bc0c6f60 2024-04-25T00:50:45.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.405+0000 7fa7b8ff9640 1 -- 172.21.15.162:0/734188463 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa7b0012b50 con 0x7fa7bc0c6f60 2024-04-25T00:50:45.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.405+0000 7fa7b8ff9640 1 --2- 172.21.15.162:0/734188463 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa7a80678c0 0x7fa7a8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:45.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.405+0000 7fa7bb7fe640 1 --2- 172.21.15.162:0/734188463 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa7a80678c0 0x7fa7a8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:45.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.405+0000 7fa7bb7fe640 1 --2- 172.21.15.162:0/734188463 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa7a80678c0 0x7fa7a8069d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc1629b0 tx=0x7fa7ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:45.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.433+0000 7fa7b8ff9640 1 -- 172.21.15.162:0/734188463 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fa7b0012e40 con 0x7fa7bc0c6f60 2024-04-25T00:50:45.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.437+0000 7fa7b8ff9640 1 -- 172.21.15.162:0/734188463 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa7b0013390 con 0x7fa7bc0c6f60 2024-04-25T00:50:45.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.649+0000 7fa7c23c8640 1 -- 172.21.15.162:0/734188463 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7bc04f5f0 con 0x7fa7bc0c6f60 2024-04-25T00:50:45.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.677+0000 7fa7b8ff9640 1 -- 172.21.15.162:0/734188463 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+6854 (secure 0 0 0) 0x7fa7b0057770 con 0x7fa7bc0c6f60 2024-04-25T00:50:45.679 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:45.679 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":10,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/560649188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":560649188},{"type":"v1","addr":"172.21.15.179:6833","nonce":560649188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":4233,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6835/1339390327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1339390327},{"type":"v1","addr":"172.21.15.179:6835","nonce":1339390327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4240,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6835/191105979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":191105979},{"type":"v1","addr":"172.21.15.162:6835","nonce":191105979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4241,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.162:6839/2357127318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2357127318},{"type":"v1","addr":"172.21.15.162:6839","nonce":2357127318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":10,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T00:50:35.645685+0000","modified":"2024-04-25T00:50:44.520344+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4246,"mds_1":4244},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4244":{"gid":4244,"name":"f","rank":1,"incarnation":8,"state":"up:creating","state_seq":1,"addr":"172.21.15.179:6837/2607965795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2607965795},{"type":"v1","addr":"172.21.15.179:6837","nonce":2607965795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4246":{"gid":4246,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":6,"addr":"172.21.15.162:6837/1743481688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1743481688},{"type":"v1","addr":"172.21.15.162:6837","nonce":1743481688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4246]},"id":1}]} 2024-04-25T00:50:45.679 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 10 2024-04-25T00:50:45.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.681+0000 7fa7c23c8640 1 -- 172.21.15.162:0/734188463 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa7a80678c0 msgr2=0x7fa7a8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:45.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.681+0000 7fa7c23c8640 1 --2- 172.21.15.162:0/734188463 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa7a80678c0 0x7fa7a8069d80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc1629b0 tx=0x7fa7ac009040 comp rx=0 tx=0).stop 2024-04-25T00:50:45.681 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.681+0000 7fa7c23c8640 1 -- 172.21.15.162:0/734188463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7bc0c6f60 msgr2=0x7fa7bc13ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:45.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.681+0000 7fa7c23c8640 1 --2- 172.21.15.162:0/734188463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7bc0c6f60 0x7fa7bc13ef80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000d5f0 tx=0x7fa7b000dab0 comp rx=0 tx=0).stop 2024-04-25T00:50:45.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.681+0000 7fa7c23c8640 1 -- 172.21.15.162:0/734188463 shutdown_connections 2024-04-25T00:50:45.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.681+0000 7fa7c23c8640 1 --2- 172.21.15.162:0/734188463 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa7bc150b90 0x7fa7bc1f4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:45.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.681+0000 7fa7c23c8640 1 --2- 172.21.15.162:0/734188463 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa7bc0c7890 0x7fa7bc14fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:45.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.681+0000 7fa7c23c8640 1 --2- 172.21.15.162:0/734188463 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa7a80678c0 0x7fa7a8069d80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:45.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.681+0000 7fa7c23c8640 1 --2- 172.21.15.162:0/734188463 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa7bc0c6f60 0x7fa7bc13ef80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:45.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.681+0000 7fa7c23c8640 1 -- 172.21.15.162:0/734188463 >> 172.21.15.162:0/734188463 conn(0x7fa7bc0c83c0 msgr2=0x7fa7bc14c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:45.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.681+0000 7fa7c23c8640 1 -- 172.21.15.162:0/734188463 shutdown_connections 2024-04-25T00:50:45.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.681+0000 7fa7c23c8640 1 -- 172.21.15.162:0/734188463 wait complete. 2024-04-25T00:50:45.699 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T00:50:45.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.813+0000 7f2ea7794640 1 Processor -- start 2024-04-25T00:50:45.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.813+0000 7f2ea7794640 1 -- start start 2024-04-25T00:50:45.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.817+0000 7f2ea7794640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea01515e0 0x7f2ea00c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:45.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.817+0000 7f2ea7794640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea0072f60 con 0x7f2ea00c8ee0 2024-04-25T00:50:45.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.817+0000 7f2ea7794640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea0073200 con 0x7f2ea0151200 2024-04-25T00:50:45.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.817+0000 7f2ea7794640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea00c2f60 con 0x7f2ea01515e0 2024-04-25T00:50:45.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.817+0000 7f2ea5d31640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f2ea00c8ee0 0x7f2ea015a5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:49538/0 (socket says 172.21.15.162:49538) 2024-04-25T00:50:45.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.817+0000 7f2ea5d31640 1 -- 172.21.15.162:0/690444347 learned_addr learned my addr 172.21.15.162:0/690444347 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:45.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.821+0000 7f2e97fff640 1 -- 172.21.15.162:0/690444347 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3801779111 0 0) 0x7f2ea0072f60 con 0x7f2ea00c8ee0 2024-04-25T00:50:45.821 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.821+0000 7f2e97fff640 1 -- 172.21.15.162:0/690444347 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e8c003530 con 0x7f2ea00c8ee0 2024-04-25T00:50:45.824 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.821+0000 7f2ea4d2f640 1 --2- 172.21.15.162:0/690444347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea01515e0 0x7f2ea00c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:45.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.825+0000 7f2e97fff640 1 -- 172.21.15.162:0/690444347 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 782071506 0 0) 0x7f2e8c003530 con 0x7f2ea00c8ee0 2024-04-25T00:50:45.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.825+0000 7f2e97fff640 1 -- 172.21.15.162:0/690444347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea01515e0 msgr2=0x7f2ea00c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:45.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.825+0000 7f2e97fff640 1 --2- 172.21.15.162:0/690444347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea01515e0 0x7f2ea00c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:45.826 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.825+0000 7f2e97fff640 1 -- 172.21.15.162:0/690444347 >> v1:172.21.15.179:6789/0 conn(0x7f2ea0151200 legacy=0x7f2ea0072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:45.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.825+0000 7f2e97fff640 1 -- 172.21.15.162:0/690444347 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea00c3240 con 0x7f2ea00c8ee0 2024-04-25T00:50:45.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.825+0000 7f2e97fff640 1 -- 172.21.15.162:0/690444347 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7f2e98001a00 con 0x7f2ea00c8ee0 2024-04-25T00:50:45.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.825+0000 7f2e97fff640 1 -- 172.21.15.162:0/690444347 >> v1:172.21.15.162:6789/0 conn(0x7f2ea00c8ee0 legacy=0x7f2ea015a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:45.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.825+0000 7f2e97fff640 1 --2- 172.21.15.162:0/690444347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e8c0039f0 0x7f2e8c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:45.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.825+0000 7f2e97fff640 1 --2- 172.21.15.162:0/690444347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea01515e0 0x7f2e8c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:45.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.825+0000 7f2e97fff640 1 --2- 172.21.15.162:0/690444347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e8c004d50 0x7f2e8c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:45.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.825+0000 7f2e97fff640 1 -- 172.21.15.162:0/690444347 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea00c2f60 con 0x7f2e8c004d50 2024-04-25T00:50:45.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.825+0000 7f2e97fff640 1 -- 172.21.15.162:0/690444347 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c00bbb0 con 0x7f2e8c0039f0 2024-04-25T00:50:45.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.825+0000 7f2e97fff640 1 -- 172.21.15.162:0/690444347 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2e8c00dfc0 con 0x7f2ea01515e0 2024-04-25T00:50:45.829 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.829+0000 7f2ea5d31640 1 --2- 172.21.15.162:0/690444347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e8c004d50 0x7f2e8c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:45.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.833+0000 7f2ea5d31640 1 -- 172.21.15.162:0/690444347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea01515e0 msgr2=0x7f2e8c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:45.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.833+0000 7f2ea5d31640 1 --2- 172.21.15.162:0/690444347 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea01515e0 0x7f2e8c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:45.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.833+0000 7f2ea5d31640 1 -- 172.21.15.162:0/690444347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e8c0039f0 msgr2=0x7f2e8c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:45.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.833+0000 7f2ea5d31640 1 --2- 172.21.15.162:0/690444347 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e8c0039f0 0x7f2e8c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:45.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.833+0000 7f2ea5d31640 1 -- 172.21.15.162:0/690444347 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c003530 con 0x7f2e8c004d50 2024-04-25T00:50:45.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.837+0000 7f2ea5d31640 1 --2- 172.21.15.162:0/690444347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e8c004d50 0x7f2e8c0051d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00739f0 tx=0x7f2e9801d240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8553e2c8f74ebd68 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:45.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.841+0000 7f2e97fff640 1 -- 172.21.15.162:0/690444347 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9800a390 con 0x7f2e8c004d50 2024-04-25T00:50:45.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.841+0000 7f2e97fff640 1 -- 172.21.15.162:0/690444347 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e980ad650 con 0x7f2e8c004d50 2024-04-25T00:50:45.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.841+0000 7f2e97fff640 1 -- 172.21.15.162:0/690444347 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e980ada40 con 0x7f2e8c004d50 2024-04-25T00:50:45.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.845+0000 7f2ea7794640 1 -- 172.21.15.162:0/690444347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e8c004d50 msgr2=0x7f2e8c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:45.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.845+0000 7f2ea7794640 1 --2- 172.21.15.162:0/690444347 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2e8c004d50 0x7f2e8c0051d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2ea00739f0 tx=0x7f2e9801d240 comp rx=0 tx=0).stop 2024-04-25T00:50:45.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.845+0000 7f2ea5d31640 1 -- 172.21.15.162:0/690444347 reap_dead start 2024-04-25T00:50:45.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.845+0000 7f2ea7794640 1 -- 172.21.15.162:0/690444347 shutdown_connections 2024-04-25T00:50:45.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.845+0000 7f2ea7794640 1 -- 172.21.15.162:0/690444347 >> 172.21.15.162:0/690444347 conn(0x7f2ea00c83c0 msgr2=0x7f2ea00c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:45.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.845+0000 7f2ea7794640 1 -- 172.21.15.162:0/690444347 shutdown_connections 2024-04-25T00:50:45.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.845+0000 7f2ea7794640 1 -- 172.21.15.162:0/690444347 wait complete. 2024-04-25T00:50:45.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.845+0000 7f2ea7794640 1 Processor -- start 2024-04-25T00:50:45.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.845+0000 7f2ea7794640 1 -- start start 2024-04-25T00:50:45.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.845+0000 7f2ea7794640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e8c004d50 0x7f2ea01eecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:45.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.845+0000 7f2ea7794640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea00c5f90 0x7f2ea01444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:45.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.845+0000 7f2ea7794640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ea01ec400 0x7f2ea0150490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:45.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.845+0000 7f2ea7794640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea015acd0 con 0x7f2ea01ec400 2024-04-25T00:50:45.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.845+0000 7f2ea7794640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea00c5cf0 con 0x7f2e8c004d50 2024-04-25T00:50:45.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.845+0000 7f2ea7794640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea015ae50 con 0x7f2ea00c5f90 2024-04-25T00:50:45.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.849+0000 7f2ea5530640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e8c004d50 0x7f2ea01eecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:45.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.849+0000 7f2ea5530640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e8c004d50 0x7f2ea01eecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:41636/0 (socket says 172.21.15.162:41636) 2024-04-25T00:50:45.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.849+0000 7f2ea5530640 1 -- 172.21.15.162:0/1062247883 learned_addr learned my addr 172.21.15.162:0/1062247883 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:45.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.853+0000 7f2ea5d31640 1 --2- 172.21.15.162:0/1062247883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ea01ec400 0x7f2ea0150490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:45.854 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.853+0000 7f2ea4d2f640 1 --2- 172.21.15.162:0/1062247883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea00c5f90 0x7f2ea01444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:45.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.857+0000 7f2ea5d31640 1 -- 172.21.15.162:0/1062247883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea00c5f90 msgr2=0x7f2ea01444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:45.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.857+0000 7f2ea5d31640 1 --2- 172.21.15.162:0/1062247883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea00c5f90 0x7f2ea01444f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:45.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.857+0000 7f2ea5d31640 1 -- 172.21.15.162:0/1062247883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e8c004d50 msgr2=0x7f2ea01eecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:45.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.857+0000 7f2ea5d31640 1 --2- 172.21.15.162:0/1062247883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e8c004d50 0x7f2ea01eecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:45.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.857+0000 7f2ea5d31640 1 -- 172.21.15.162:0/1062247883 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea01ef230 con 0x7f2ea01ec400 2024-04-25T00:50:45.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.857+0000 7f2ea5d31640 1 --2- 172.21.15.162:0/1062247883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ea01ec400 0x7f2ea0150490 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0057f0 tx=0x7f2e8c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:45.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.861+0000 7f2e95ffb640 1 -- 172.21.15.162:0/1062247883 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e980ad430 con 0x7f2ea01ec400 2024-04-25T00:50:45.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.861+0000 7f2e95ffb640 1 -- 172.21.15.162:0/1062247883 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e980017c0 con 0x7f2ea01ec400 2024-04-25T00:50:45.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.861+0000 7f2e95ffb640 1 -- 172.21.15.162:0/1062247883 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e98004b70 con 0x7f2ea01ec400 2024-04-25T00:50:45.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.861+0000 7f2ea7794640 1 -- 172.21.15.162:0/1062247883 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea01450a0 con 0x7f2ea01ec400 2024-04-25T00:50:45.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.861+0000 7f2ea7794640 1 -- 172.21.15.162:0/1062247883 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea01eb920 con 0x7f2ea01ec400 2024-04-25T00:50:45.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:45.861+0000 7f2ea7794640 1 -- 172.21.15.162:0/1062247883 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea00c27c0 con 0x7f2ea01ec400 2024-04-25T00:50:46.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.137+0000 7f2e95ffb640 1 -- 172.21.15.162:0/1062247883 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2e980b5070 con 0x7f2ea01ec400 2024-04-25T00:50:46.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.137+0000 7f2e95ffb640 1 --2- 172.21.15.162:0/1062247883 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2e84067940 0x7f2e84069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:46.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.137+0000 7f2ea5530640 1 --2- 172.21.15.162:0/1062247883 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2e84067940 0x7f2e84069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:46.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.141+0000 7f2ea5530640 1 --2- 172.21.15.162:0/1062247883 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2e84067940 0x7f2e84069e00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c001930 tx=0x7f2e9c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:46.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.181+0000 7f2e95ffb640 1 -- 172.21.15.162:0/1062247883 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f2e980edf60 con 0x7f2ea01ec400 2024-04-25T00:50:46.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.181+0000 7f2e95ffb640 1 -- 172.21.15.162:0/1062247883 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f2e980bd060 con 0x7f2ea01ec400 2024-04-25T00:50:46.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.357+0000 7f2ea7794640 1 -- 172.21.15.162:0/1062247883 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2ea004f5f0 con 0x7f2ea01ec400 2024-04-25T00:50:46.452 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.449+0000 7f2e95ffb640 1 -- 172.21.15.162:0/1062247883 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+16641 (secure 0 0 0) 0x7f2e980a5e20 con 0x7f2ea01ec400 2024-04-25T00:50:46.453 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:46.453 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":26,"fsid":"e141deed-4794-4a17-83c9-f6e6e8875f5e","created":"2024-04-25T00:49:29.904605+0000","modified":"2024-04-25T00:50:37.007717+0000","last_up_change":"2024-04-25T00:49:51.119342+0000","last_in_change":"2024-04-25T00:49:39.898293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T00:49:52.297093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T00:50:31.644475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T00:50:33.242786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e20986cc-3664-4988-959c-c0b02e380775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6811","nonce":2734546478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6813","nonce":2734546478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6817","nonce":2734546478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6815","nonce":2734546478}]},"public_addr":"172.21.15.162:6811/2734546478","cluster_addr":"172.21.15.162:6813/2734546478","heartbeat_back_addr":"172.21.15.162:6817/2734546478","heartbeat_front_addr":"172.21.15.162:6815/2734546478","state":["exists","up"]},{"osd":1,"uuid":"60f1608a-ecb7-4978-b816-ce6f419e275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6803","nonce":3488816098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6805","nonce":3488816098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6809","nonce":3488816098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6807","nonce":3488816098}]},"public_addr":"172.21.15.162:6803/3488816098","cluster_addr":"172.21.15.162:6805/3488816098","heartbeat_back_addr":"172.21.15.162:6809/3488816098","heartbeat_front_addr":"172.21.15.162:6807/3488816098","state":["exists","up"]},{"osd":2,"uuid":"77552061-8e19-4f49-bc3f-1300955a07b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6819","nonce":234337516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6821","nonce":234337516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6825","nonce":234337516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6823","nonce":234337516}]},"public_addr":"172.21.15.162:6819/234337516","cluster_addr":"172.21.15.162:6821/234337516","heartbeat_back_addr":"172.21.15.162:6825/234337516","heartbeat_front_addr":"172.21.15.162:6823/234337516","state":["exists","up"]},{"osd":3,"uuid":"5b105720-6e6d-4143-b5c4-0a3b1e4a687c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6827","nonce":1726903362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6829","nonce":1726903362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6833","nonce":1726903362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6831","nonce":1726903362}]},"public_addr":"172.21.15.162:6827/1726903362","cluster_addr":"172.21.15.162:6829/1726903362","heartbeat_back_addr":"172.21.15.162:6833/1726903362","heartbeat_front_addr":"172.21.15.162:6831/1726903362","state":["exists","up"]},{"osd":4,"uuid":"611eafc5-2fe0-4c96-ba8c-b1efc3930de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6817","nonce":3338082657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6819","nonce":3338082657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6823","nonce":3338082657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6821","nonce":3338082657}]},"public_addr":"172.21.15.179:6817/3338082657","cluster_addr":"172.21.15.179:6819/3338082657","heartbeat_back_addr":"172.21.15.179:6823/3338082657","heartbeat_front_addr":"172.21.15.179:6821/3338082657","state":["exists","up"]},{"osd":5,"uuid":"b39487f5-c314-4026-90bd-02e30ecca04f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6825","nonce":4129338239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6827","nonce":4129338239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6831","nonce":4129338239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6829","nonce":4129338239}]},"public_addr":"172.21.15.179:6825/4129338239","cluster_addr":"172.21.15.179:6827/4129338239","heartbeat_back_addr":"172.21.15.179:6831/4129338239","heartbeat_front_addr":"172.21.15.179:6829/4129338239","state":["exists","up"]},{"osd":6,"uuid":"1d902755-f992-4070-b30e-e79f5fb22d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6801","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6802","nonce":823843016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6806","nonce":823843016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6815","nonce":823843016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6810","nonce":823843016}]},"public_addr":"172.21.15.179:6802/823843016","cluster_addr":"172.21.15.179:6806/823843016","heartbeat_back_addr":"172.21.15.179:6815/823843016","heartbeat_front_addr":"172.21.15.179:6810/823843016","state":["exists","up"]},{"osd":7,"uuid":"ea529f85-28fd-4dc3-a584-314e71999061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6803","nonce":3403659125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6807","nonce":3403659125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6814","nonce":3403659125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6811","nonce":3403659125}]},"public_addr":"172.21.15.179:6803/3403659125","cluster_addr":"172.21.15.179:6807/3403659125","heartbeat_back_addr":"172.21.15.179:6814/3403659125","heartbeat_front_addr":"172.21.15.179:6811/3403659125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.684518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.583123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.644576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.815957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.787155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.814409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.657210+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.676697+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T00:50:46.456 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.453+0000 7f2ea7794640 1 -- 172.21.15.162:0/1062247883 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2e84067940 msgr2=0x7f2e84069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:46.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.453+0000 7f2ea7794640 1 --2- 172.21.15.162:0/1062247883 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2e84067940 0x7f2e84069e00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c001930 tx=0x7f2e9c009040 comp rx=0 tx=0).stop 2024-04-25T00:50:46.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.453+0000 7f2ea7794640 1 -- 172.21.15.162:0/1062247883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ea01ec400 msgr2=0x7f2ea0150490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:46.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.453+0000 7f2ea7794640 1 --2- 172.21.15.162:0/1062247883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ea01ec400 0x7f2ea0150490 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c0057f0 tx=0x7f2e8c005840 comp rx=0 tx=0).stop 2024-04-25T00:50:46.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.453+0000 7f2ea7794640 1 -- 172.21.15.162:0/1062247883 shutdown_connections 2024-04-25T00:50:46.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.453+0000 7f2ea7794640 1 --2- 172.21.15.162:0/1062247883 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2e84067940 0x7f2e84069e00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:46.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.453+0000 7f2ea7794640 1 --2- 172.21.15.162:0/1062247883 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2ea01ec400 0x7f2ea0150490 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:46.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.453+0000 7f2ea7794640 1 --2- 172.21.15.162:0/1062247883 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2ea00c5f90 0x7f2ea01444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:46.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.453+0000 7f2ea7794640 1 --2- 172.21.15.162:0/1062247883 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2e8c004d50 0x7f2ea01eecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:46.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.453+0000 7f2ea7794640 1 -- 172.21.15.162:0/1062247883 >> 172.21.15.162:0/1062247883 conn(0x7f2ea00c83c0 msgr2=0x7f2ea015a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:46.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.453+0000 7f2ea7794640 1 -- 172.21.15.162:0/1062247883 shutdown_connections 2024-04-25T00:50:46.457 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.453+0000 7f2ea7794640 1 -- 172.21.15.162:0/1062247883 wait complete. 2024-04-25T00:50:46.478 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T00:50:46.479 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T00:50:46.601 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.601+0000 7f1a6e673640 1 Processor -- start 2024-04-25T00:50:46.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.601+0000 7f1a6e673640 1 -- start start 2024-04-25T00:50:46.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.601+0000 7f1a6e673640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1a68152370 0x7f1a680c9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:46.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.601+0000 7f1a6e673640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1a680c3570 0x7f1a680c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:46.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.601+0000 7f1a6e673640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a68070840 0x7f1a68158050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:46.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.601+0000 7f1a6e673640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1a68152750 con 0x7f1a680c3570 2024-04-25T00:50:46.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.601+0000 7f1a6e673640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f1a680c3a40 con 0x7f1a68152370 2024-04-25T00:50:46.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.601+0000 7f1a6e673640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6806f5b0 con 0x7f1a68070840 2024-04-25T00:50:46.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.601+0000 7f1a677fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1a680c3570 0x7f1a680c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:46.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.601+0000 7f1a677fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1a680c3570 0x7f1a680c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35108/0 (socket says 172.21.15.162:35108) 2024-04-25T00:50:46.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.601+0000 7f1a677fe640 1 -- 172.21.15.162:0/2623899799 learned_addr learned my addr 172.21.15.162:0/2623899799 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:46.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.605+0000 7f1a677fe640 1 -- 172.21.15.162:0/2623899799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a68070840 msgr2=0x7f1a68158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:46.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.605+0000 7f1a677fe640 1 --2- 172.21.15.162:0/2623899799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a68070840 0x7f1a68158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:46.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.605+0000 7f1a677fe640 1 -- 172.21.15.162:0/2623899799 >> v2:172.21.15.179:3300/0 conn(0x7f1a68152370 msgr2=0x7f1a680c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:46.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.605+0000 7f1a677fe640 1 --2- 172.21.15.162:0/2623899799 >> v2:172.21.15.179:3300/0 conn(0x7f1a68152370 0x7f1a680c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:46.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.605+0000 7f1a677fe640 1 -- 172.21.15.162:0/2623899799 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6806f890 con 0x7f1a680c3570 2024-04-25T00:50:46.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.609+0000 7f1a677fe640 1 --2- 172.21.15.162:0/2623899799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a680c3570 0x7f1a680c96a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1a680cb0d0 tx=0x7f1a5c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66854a9457b2fc2f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:46.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.613+0000 7f1a66ffd640 1 -- 172.21.15.162:0/2623899799 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c0b5070 con 0x7f1a680c3570 2024-04-25T00:50:46.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.613+0000 7f1a66ffd640 1 -- 172.21.15.162:0/2623899799 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a5c0a89d0 con 0x7f1a680c3570 2024-04-25T00:50:46.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.613+0000 7f1a66ffd640 1 -- 172.21.15.162:0/2623899799 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c0a8da0 con 0x7f1a680c3570 2024-04-25T00:50:46.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.613+0000 7f1a6e673640 1 -- 172.21.15.162:0/2623899799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a680c3570 msgr2=0x7f1a680c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:46.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.613+0000 7f1a6e673640 1 --2- 172.21.15.162:0/2623899799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a680c3570 0x7f1a680c96a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1a680cb0d0 tx=0x7f1a5c01ed10 comp rx=0 tx=0).stop 2024-04-25T00:50:46.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.613+0000 7f1a6e673640 1 -- 172.21.15.162:0/2623899799 shutdown_connections 2024-04-25T00:50:46.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.613+0000 7f1a6e673640 1 --2- 172.21.15.162:0/2623899799 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a68070840 0x7f1a68158050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:46.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.613+0000 7f1a6e673640 1 --2- 172.21.15.162:0/2623899799 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a680c3570 0x7f1a680c96a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:46.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.613+0000 7f1a6e673640 1 --2- 172.21.15.162:0/2623899799 >> v2:172.21.15.179:3300/0 conn(0x7f1a68152370 0x7f1a680c9160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:46.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.613+0000 7f1a6e673640 1 -- 172.21.15.162:0/2623899799 >> 172.21.15.162:0/2623899799 conn(0x7f1a680675c0 msgr2=0x7f1a680714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:46.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.613+0000 7f1a6e673640 1 -- 172.21.15.162:0/2623899799 shutdown_connections 2024-04-25T00:50:46.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.613+0000 7f1a6e673640 1 -- 172.21.15.162:0/2623899799 wait complete. 2024-04-25T00:50:46.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.617+0000 7f1a6e673640 1 Processor -- start 2024-04-25T00:50:46.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.617+0000 7f1a6e673640 1 -- start start 2024-04-25T00:50:46.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.617+0000 7f1a6e673640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a68070840 0x7f1a68145780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:46.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.617+0000 7f1a6e673640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a68152370 0x7f1a681ee9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:46.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.617+0000 7f1a6e673640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a6814ca90 0x7f1a6814cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:46.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.617+0000 7f1a6e673640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1a68070130 con 0x7f1a6814ca90 2024-04-25T00:50:46.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.617+0000 7f1a6e673640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6806fe50 con 0x7f1a68070840 2024-04-25T00:50:46.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.617+0000 7f1a6e673640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1a68158590 con 0x7f1a68152370 2024-04-25T00:50:46.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.617+0000 7f1a6cc10640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a6814ca90 0x7f1a6814cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:46.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.617+0000 7f1a6cc10640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a6814ca90 0x7f1a6814cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35122/0 (socket says 172.21.15.162:35122) 2024-04-25T00:50:46.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.617+0000 7f1a6cc10640 1 -- 172.21.15.162:0/3740144861 learned_addr learned my addr 172.21.15.162:0/3740144861 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:46.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.621+0000 7f1a6cc10640 1 -- 172.21.15.162:0/3740144861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a68152370 msgr2=0x7f1a681ee9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:46.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.621+0000 7f1a6cc10640 1 --2- 172.21.15.162:0/3740144861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a68152370 0x7f1a681ee9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:46.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.621+0000 7f1a6cc10640 1 -- 172.21.15.162:0/3740144861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a68070840 msgr2=0x7f1a68145780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:46.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.621+0000 7f1a6cc10640 1 --2- 172.21.15.162:0/3740144861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a68070840 0x7f1a68145780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:46.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.621+0000 7f1a6cc10640 1 -- 172.21.15.162:0/3740144861 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a681e0bf0 con 0x7f1a6814ca90 2024-04-25T00:50:46.625 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.621+0000 7f1a6cc10640 1 --2- 172.21.15.162:0/3740144861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a6814ca90 0x7f1a6814cf40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1a6000b970 tx=0x7f1a6000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:46.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.625+0000 7f1a64ff9640 1 -- 172.21.15.162:0/3740144861 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60019070 con 0x7f1a6814ca90 2024-04-25T00:50:46.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.629+0000 7f1a64ff9640 1 -- 172.21.15.162:0/3740144861 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a6000cb60 con 0x7f1a6814ca90 2024-04-25T00:50:46.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.629+0000 7f1a64ff9640 1 -- 172.21.15.162:0/3740144861 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a60014440 con 0x7f1a6814ca90 2024-04-25T00:50:46.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.629+0000 7f1a6e673640 1 -- 172.21.15.162:0/3740144861 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a681e0350 con 0x7f1a6814ca90 2024-04-25T00:50:46.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.629+0000 7f1a6e673640 1 -- 172.21.15.162:0/3740144861 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a681e0910 con 0x7f1a6814ca90 2024-04-25T00:50:46.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.629+0000 7f1a6e673640 1 -- 172.21.15.162:0/3740144861 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a68068520 con 0x7f1a6814ca90 2024-04-25T00:50:46.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.649+0000 7f1a64ff9640 1 -- 172.21.15.162:0/3740144861 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1a6001c070 con 0x7f1a6814ca90 2024-04-25T00:50:46.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.649+0000 7f1a64ff9640 1 --2- 172.21.15.162:0/3740144861 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1a54067910 0x7f1a54069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:46.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.649+0000 7f1a67fff640 1 --2- 172.21.15.162:0/3740144861 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1a54067910 0x7f1a54069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:46.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.649+0000 7f1a67fff640 1 --2- 172.21.15.162:0/3740144861 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1a54067910 0x7f1a54069dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009690 tx=0x7f1a58006c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:46.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.941+0000 7f1a64ff9640 1 -- 172.21.15.162:0/3740144861 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f1a600543c0 con 0x7f1a6814ca90 2024-04-25T00:50:46.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:46.941+0000 7f1a64ff9640 1 -- 172.21.15.162:0/3740144861 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f1a60023020 con 0x7f1a6814ca90 2024-04-25T00:50:47.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.101+0000 7f1a6e673640 1 -- 172.21.15.162:0/3740144861 --> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1a68155a70 con 0x7f1a54067910 2024-04-25T00:50:47.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.121+0000 7f1a64ff9640 1 -- 172.21.15.162:0/3740144861 <== mgr.4100 v2:172.21.15.162:6800/3960394531 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251952 (secure 0 0 0) 0x7f1a68155a70 con 0x7f1a54067910 2024-04-25T00:50:47.125 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:47.127 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-04-25T00:50:47.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.125+0000 7f1a6e673640 1 -- 172.21.15.162:0/3740144861 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1a54067910 msgr2=0x7f1a54069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:47.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.125+0000 7f1a6e673640 1 --2- 172.21.15.162:0/3740144861 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1a54067910 0x7f1a54069dd0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1a58009690 tx=0x7f1a58006c00 comp rx=0 tx=0).stop 2024-04-25T00:50:47.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.125+0000 7f1a6e673640 1 -- 172.21.15.162:0/3740144861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a6814ca90 msgr2=0x7f1a6814cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:47.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.125+0000 7f1a6e673640 1 --2- 172.21.15.162:0/3740144861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a6814ca90 0x7f1a6814cf40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1a6000b970 tx=0x7f1a6000be30 comp rx=0 tx=0).stop 2024-04-25T00:50:47.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.125+0000 7f1a6e673640 1 -- 172.21.15.162:0/3740144861 shutdown_connections 2024-04-25T00:50:47.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.125+0000 7f1a6e673640 1 --2- 172.21.15.162:0/3740144861 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1a54067910 0x7f1a54069dd0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:47.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.125+0000 7f1a6e673640 1 --2- 172.21.15.162:0/3740144861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a6814ca90 0x7f1a6814cf40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:47.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.125+0000 7f1a6e673640 1 --2- 172.21.15.162:0/3740144861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a68152370 0x7f1a681ee9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:47.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.125+0000 7f1a6e673640 1 --2- 172.21.15.162:0/3740144861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a68070840 0x7f1a68145780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:47.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.125+0000 7f1a6e673640 1 -- 172.21.15.162:0/3740144861 >> 172.21.15.162:0/3740144861 conn(0x7f1a680675c0 msgr2=0x7f1a681487e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:47.128 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.125+0000 7f1a6e673640 1 -- 172.21.15.162:0/3740144861 shutdown_connections 2024-04-25T00:50:47.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.125+0000 7f1a6e673640 1 -- 172.21.15.162:0/3740144861 wait complete. 2024-04-25T00:50:47.145 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-04-25T00:50:45.868882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593450,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223648,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751072,"statfs":{"total":773094113280,"available":772865097728,"internally_reserved":0,"allocated":3383296,"data_stored":1955084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3082,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.691667"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109574+0000","last_change":"2024-04-25T00:50:35.761428+0000","last_active":"2024-04-25T00:50:38.109574+0000","last_peered":"2024-04-25T00:50:38.109574+0000","last_clean":"2024-04-25T00:50:38.109574+0000","last_became_active":"2024-04-25T00:50:35.760579+0000","last_became_peered":"2024-04-25T00:50:35.760579+0000","last_unstale":"2024-04-25T00:50:38.109574+0000","last_undegraded":"2024-04-25T00:50:38.109574+0000","last_fullsized":"2024-04-25T00:50:38.109574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:06.236972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297768+0000","last_change":"2024-04-25T00:50:35.798137+0000","last_active":"2024-04-25T00:50:37.297768+0000","last_peered":"2024-04-25T00:50:37.297768+0000","last_clean":"2024-04-25T00:50:37.297768+0000","last_became_active":"2024-04-25T00:50:35.797354+0000","last_became_peered":"2024-04-25T00:50:35.797354+0000","last_unstale":"2024-04-25T00:50:37.297768+0000","last_undegraded":"2024-04-25T00:50:37.297768+0000","last_fullsized":"2024-04-25T00:50:37.297768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:29:18.970287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107728+0000","last_change":"2024-04-25T00:50:35.799370+0000","last_active":"2024-04-25T00:50:38.107728+0000","last_peered":"2024-04-25T00:50:38.107728+0000","last_clean":"2024-04-25T00:50:38.107728+0000","last_became_active":"2024-04-25T00:50:35.798268+0000","last_became_peered":"2024-04-25T00:50:35.798268+0000","last_unstale":"2024-04-25T00:50:38.107728+0000","last_undegraded":"2024-04-25T00:50:38.107728+0000","last_fullsized":"2024-04-25T00:50:38.107728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:27.176441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231768+0000","last_change":"2024-04-25T00:50:35.877965+0000","last_active":"2024-04-25T00:50:37.231768+0000","last_peered":"2024-04-25T00:50:37.231768+0000","last_clean":"2024-04-25T00:50:37.231768+0000","last_became_active":"2024-04-25T00:50:35.877114+0000","last_became_peered":"2024-04-25T00:50:35.877114+0000","last_unstale":"2024-04-25T00:50:37.231768+0000","last_undegraded":"2024-04-25T00:50:37.231768+0000","last_fullsized":"2024-04-25T00:50:37.231768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:20.857588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108773+0000","last_change":"2024-04-25T00:50:35.730647+0000","last_active":"2024-04-25T00:50:38.108773+0000","last_peered":"2024-04-25T00:50:38.108773+0000","last_clean":"2024-04-25T00:50:38.108773+0000","last_became_active":"2024-04-25T00:50:35.729785+0000","last_became_peered":"2024-04-25T00:50:35.729785+0000","last_unstale":"2024-04-25T00:50:38.108773+0000","last_undegraded":"2024-04-25T00:50:38.108773+0000","last_fullsized":"2024-04-25T00:50:38.108773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:02.888747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231805+0000","last_change":"2024-04-25T00:50:35.800071+0000","last_active":"2024-04-25T00:50:37.231805+0000","last_peered":"2024-04-25T00:50:37.231805+0000","last_clean":"2024-04-25T00:50:37.231805+0000","last_became_active":"2024-04-25T00:50:35.799390+0000","last_became_peered":"2024-04-25T00:50:35.799390+0000","last_unstale":"2024-04-25T00:50:37.231805+0000","last_undegraded":"2024-04-25T00:50:37.231805+0000","last_fullsized":"2024-04-25T00:50:37.231805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:16.817860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109329+0000","last_change":"2024-04-25T00:50:35.797990+0000","last_active":"2024-04-25T00:50:38.109329+0000","last_peered":"2024-04-25T00:50:38.109329+0000","last_clean":"2024-04-25T00:50:38.109329+0000","last_became_active":"2024-04-25T00:50:35.797328+0000","last_became_peered":"2024-04-25T00:50:35.797328+0000","last_unstale":"2024-04-25T00:50:38.109329+0000","last_undegraded":"2024-04-25T00:50:38.109329+0000","last_fullsized":"2024-04-25T00:50:38.109329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:59.565909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388780+0000","last_change":"2024-04-25T00:50:35.878367+0000","last_active":"2024-04-25T00:50:37.388780+0000","last_peered":"2024-04-25T00:50:37.388780+0000","last_clean":"2024-04-25T00:50:37.388780+0000","last_became_active":"2024-04-25T00:50:35.877581+0000","last_became_peered":"2024-04-25T00:50:35.877581+0000","last_unstale":"2024-04-25T00:50:37.388780+0000","last_undegraded":"2024-04-25T00:50:37.388780+0000","last_fullsized":"2024-04-25T00:50:37.388780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:53.695907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109701+0000","last_change":"2024-04-25T00:50:35.734161+0000","last_active":"2024-04-25T00:50:38.109701+0000","last_peered":"2024-04-25T00:50:38.109701+0000","last_clean":"2024-04-25T00:50:38.109701+0000","last_became_active":"2024-04-25T00:50:35.733546+0000","last_became_peered":"2024-04-25T00:50:35.733546+0000","last_unstale":"2024-04-25T00:50:38.109701+0000","last_undegraded":"2024-04-25T00:50:38.109701+0000","last_fullsized":"2024-04-25T00:50:38.109701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:24:43.171432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.364156+0000","last_change":"2024-04-25T00:50:35.765173+0000","last_active":"2024-04-25T00:50:37.364156+0000","last_peered":"2024-04-25T00:50:37.364156+0000","last_clean":"2024-04-25T00:50:37.364156+0000","last_became_active":"2024-04-25T00:50:35.764412+0000","last_became_peered":"2024-04-25T00:50:35.764412+0000","last_unstale":"2024-04-25T00:50:37.364156+0000","last_undegraded":"2024-04-25T00:50:37.364156+0000","last_fullsized":"2024-04-25T00:50:37.364156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:54.948867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363747+0000","last_change":"2024-04-25T00:50:35.764526+0000","last_active":"2024-04-25T00:50:37.363747+0000","last_peered":"2024-04-25T00:50:37.363747+0000","last_clean":"2024-04-25T00:50:37.363747+0000","last_became_active":"2024-04-25T00:50:35.763770+0000","last_became_peered":"2024-04-25T00:50:35.763770+0000","last_unstale":"2024-04-25T00:50:37.363747+0000","last_undegraded":"2024-04-25T00:50:37.363747+0000","last_fullsized":"2024-04-25T00:50:37.363747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:15.698294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.249512+0000","last_change":"2024-04-25T00:50:35.822113+0000","last_active":"2024-04-25T00:50:37.249512+0000","last_peered":"2024-04-25T00:50:37.249512+0000","last_clean":"2024-04-25T00:50:37.249512+0000","last_became_active":"2024-04-25T00:50:35.821524+0000","last_became_peered":"2024-04-25T00:50:35.821524+0000","last_unstale":"2024-04-25T00:50:37.249512+0000","last_undegraded":"2024-04-25T00:50:37.249512+0000","last_fullsized":"2024-04-25T00:50:37.249512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:43.722114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388885+0000","last_change":"2024-04-25T00:50:35.881637+0000","last_active":"2024-04-25T00:50:37.388885+0000","last_peered":"2024-04-25T00:50:37.388885+0000","last_clean":"2024-04-25T00:50:37.388885+0000","last_became_active":"2024-04-25T00:50:35.880661+0000","last_became_peered":"2024-04-25T00:50:35.880661+0000","last_unstale":"2024-04-25T00:50:37.388885+0000","last_undegraded":"2024-04-25T00:50:37.388885+0000","last_fullsized":"2024-04-25T00:50:37.388885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:39.862610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.106989+0000","last_change":"2024-04-25T00:50:35.796996+0000","last_active":"2024-04-25T00:50:38.106989+0000","last_peered":"2024-04-25T00:50:38.106989+0000","last_clean":"2024-04-25T00:50:38.106989+0000","last_became_active":"2024-04-25T00:50:35.795295+0000","last_became_peered":"2024-04-25T00:50:35.795295+0000","last_unstale":"2024-04-25T00:50:38.106989+0000","last_undegraded":"2024-04-25T00:50:38.106989+0000","last_fullsized":"2024-04-25T00:50:38.106989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:29.858476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297189+0000","last_change":"2024-04-25T00:50:35.818291+0000","last_active":"2024-04-25T00:50:37.297189+0000","last_peered":"2024-04-25T00:50:37.297189+0000","last_clean":"2024-04-25T00:50:37.297189+0000","last_became_active":"2024-04-25T00:50:35.817575+0000","last_became_peered":"2024-04-25T00:50:35.817575+0000","last_unstale":"2024-04-25T00:50:37.297189+0000","last_undegraded":"2024-04-25T00:50:37.297189+0000","last_fullsized":"2024-04-25T00:50:37.297189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:51.142494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231455+0000","last_change":"2024-04-25T00:50:35.797194+0000","last_active":"2024-04-25T00:50:37.231455+0000","last_peered":"2024-04-25T00:50:37.231455+0000","last_clean":"2024-04-25T00:50:37.231455+0000","last_became_active":"2024-04-25T00:50:35.796536+0000","last_became_peered":"2024-04-25T00:50:35.796536+0000","last_unstale":"2024-04-25T00:50:37.231455+0000","last_undegraded":"2024-04-25T00:50:37.231455+0000","last_fullsized":"2024-04-25T00:50:37.231455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:48:27.210535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.233251+0000","last_change":"2024-04-25T00:50:35.729648+0000","last_active":"2024-04-25T00:50:37.233251+0000","last_peered":"2024-04-25T00:50:37.233251+0000","last_clean":"2024-04-25T00:50:37.233251+0000","last_became_active":"2024-04-25T00:50:35.728875+0000","last_became_peered":"2024-04-25T00:50:35.728875+0000","last_unstale":"2024-04-25T00:50:37.233251+0000","last_undegraded":"2024-04-25T00:50:37.233251+0000","last_fullsized":"2024-04-25T00:50:37.233251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:46.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.106981+0000","last_change":"2024-04-25T00:50:35.760953+0000","last_active":"2024-04-25T00:50:38.106981+0000","last_peered":"2024-04-25T00:50:38.106981+0000","last_clean":"2024-04-25T00:50:38.106981+0000","last_became_active":"2024-04-25T00:50:35.760286+0000","last_became_peered":"2024-04-25T00:50:35.760286+0000","last_unstale":"2024-04-25T00:50:38.106981+0000","last_undegraded":"2024-04-25T00:50:38.106981+0000","last_fullsized":"2024-04-25T00:50:38.106981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:57.466393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109462+0000","last_change":"2024-04-25T00:50:35.732837+0000","last_active":"2024-04-25T00:50:38.109462+0000","last_peered":"2024-04-25T00:50:38.109462+0000","last_clean":"2024-04-25T00:50:38.109462+0000","last_became_active":"2024-04-25T00:50:35.732134+0000","last_became_peered":"2024-04-25T00:50:35.732134+0000","last_unstale":"2024-04-25T00:50:38.109462+0000","last_undegraded":"2024-04-25T00:50:38.109462+0000","last_fullsized":"2024-04-25T00:50:38.109462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:46.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363854+0000","last_change":"2024-04-25T00:50:35.818607+0000","last_active":"2024-04-25T00:50:37.363854+0000","last_peered":"2024-04-25T00:50:37.363854+0000","last_clean":"2024-04-25T00:50:37.363854+0000","last_became_active":"2024-04-25T00:50:35.818063+0000","last_became_peered":"2024-04-25T00:50:35.818063+0000","last_unstale":"2024-04-25T00:50:37.363854+0000","last_undegraded":"2024-04-25T00:50:37.363854+0000","last_fullsized":"2024-04-25T00:50:37.363854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:15.875347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107633+0000","last_change":"2024-04-25T00:50:35.798297+0000","last_active":"2024-04-25T00:50:38.107633+0000","last_peered":"2024-04-25T00:50:38.107633+0000","last_clean":"2024-04-25T00:50:38.107633+0000","last_became_active":"2024-04-25T00:50:35.797580+0000","last_became_peered":"2024-04-25T00:50:35.797580+0000","last_unstale":"2024-04-25T00:50:38.107633+0000","last_undegraded":"2024-04-25T00:50:38.107633+0000","last_fullsized":"2024-04-25T00:50:38.107633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:06.596770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231785+0000","last_change":"2024-04-25T00:50:35.729396+0000","last_active":"2024-04-25T00:50:37.231785+0000","last_peered":"2024-04-25T00:50:37.231785+0000","last_clean":"2024-04-25T00:50:37.231785+0000","last_became_active":"2024-04-25T00:50:35.728620+0000","last_became_peered":"2024-04-25T00:50:35.728620+0000","last_unstale":"2024-04-25T00:50:37.231785+0000","last_undegraded":"2024-04-25T00:50:37.231785+0000","last_fullsized":"2024-04-25T00:50:37.231785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:02.911498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389017+0000","last_change":"2024-04-25T00:50:35.877261+0000","last_active":"2024-04-25T00:50:37.389017+0000","last_peered":"2024-04-25T00:50:37.389017+0000","last_clean":"2024-04-25T00:50:37.389017+0000","last_became_active":"2024-04-25T00:50:35.876489+0000","last_became_peered":"2024-04-25T00:50:35.876489+0000","last_unstale":"2024-04-25T00:50:37.389017+0000","last_undegraded":"2024-04-25T00:50:37.389017+0000","last_fullsized":"2024-04-25T00:50:37.389017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:14:31.440563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231553+0000","last_change":"2024-04-25T00:50:35.877693+0000","last_active":"2024-04-25T00:50:37.231553+0000","last_peered":"2024-04-25T00:50:37.231553+0000","last_clean":"2024-04-25T00:50:37.231553+0000","last_became_active":"2024-04-25T00:50:35.876870+0000","last_became_peered":"2024-04-25T00:50:35.876870+0000","last_unstale":"2024-04-25T00:50:37.231553+0000","last_undegraded":"2024-04-25T00:50:37.231553+0000","last_fullsized":"2024-04-25T00:50:37.231553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:53.474315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389593+0000","last_change":"2024-04-25T00:50:35.881027+0000","last_active":"2024-04-25T00:50:37.389593+0000","last_peered":"2024-04-25T00:50:37.389593+0000","last_clean":"2024-04-25T00:50:37.389593+0000","last_became_active":"2024-04-25T00:50:35.880477+0000","last_became_peered":"2024-04-25T00:50:35.880477+0000","last_unstale":"2024-04-25T00:50:37.389593+0000","last_undegraded":"2024-04-25T00:50:37.389593+0000","last_fullsized":"2024-04-25T00:50:37.389593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:55:59.176935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.364221+0000","last_change":"2024-04-25T00:50:35.765295+0000","last_active":"2024-04-25T00:50:37.364221+0000","last_peered":"2024-04-25T00:50:37.364221+0000","last_clean":"2024-04-25T00:50:37.364221+0000","last_became_active":"2024-04-25T00:50:35.764358+0000","last_became_peered":"2024-04-25T00:50:35.764358+0000","last_unstale":"2024-04-25T00:50:37.364221+0000","last_undegraded":"2024-04-25T00:50:37.364221+0000","last_fullsized":"2024-04-25T00:50:37.364221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:15.104631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297462+0000","last_change":"2024-04-25T00:50:35.869695+0000","last_active":"2024-04-25T00:50:37.297462+0000","last_peered":"2024-04-25T00:50:37.297462+0000","last_clean":"2024-04-25T00:50:37.297462+0000","last_became_active":"2024-04-25T00:50:35.868857+0000","last_became_peered":"2024-04-25T00:50:35.868857+0000","last_unstale":"2024-04-25T00:50:37.297462+0000","last_undegraded":"2024-04-25T00:50:37.297462+0000","last_fullsized":"2024-04-25T00:50:37.297462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:35:38.295580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389423+0000","last_change":"2024-04-25T00:50:35.884507+0000","last_active":"2024-04-25T00:50:37.389423+0000","last_peered":"2024-04-25T00:50:37.389423+0000","last_clean":"2024-04-25T00:50:37.389423+0000","last_became_active":"2024-04-25T00:50:35.883901+0000","last_became_peered":"2024-04-25T00:50:35.883901+0000","last_unstale":"2024-04-25T00:50:37.389423+0000","last_undegraded":"2024-04-25T00:50:37.389423+0000","last_fullsized":"2024-04-25T00:50:37.389423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:40.533818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107794+0000","last_change":"2024-04-25T00:50:35.878649+0000","last_active":"2024-04-25T00:50:38.107794+0000","last_peered":"2024-04-25T00:50:38.107794+0000","last_clean":"2024-04-25T00:50:38.107794+0000","last_became_active":"2024-04-25T00:50:35.877870+0000","last_became_peered":"2024-04-25T00:50:35.877870+0000","last_unstale":"2024-04-25T00:50:38.107794+0000","last_undegraded":"2024-04-25T00:50:38.107794+0000","last_fullsized":"2024-04-25T00:50:38.107794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232184+0000","last_change":"2024-04-25T00:50:35.869614+0000","last_active":"2024-04-25T00:50:37.232184+0000","last_peered":"2024-04-25T00:50:37.232184+0000","last_clean":"2024-04-25T00:50:37.232184+0000","last_became_active":"2024-04-25T00:50:35.869016+0000","last_became_peered":"2024-04-25T00:50:35.869016+0000","last_unstale":"2024-04-25T00:50:37.232184+0000","last_undegraded":"2024-04-25T00:50:37.232184+0000","last_fullsized":"2024-04-25T00:50:37.232184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:02.888747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107611+0000","last_change":"2024-04-25T00:50:35.728757+0000","last_active":"2024-04-25T00:50:38.107611+0000","last_peered":"2024-04-25T00:50:38.107611+0000","last_clean":"2024-04-25T00:50:38.107611+0000","last_became_active":"2024-04-25T00:50:35.728271+0000","last_became_peered":"2024-04-25T00:50:35.728271+0000","last_unstale":"2024-04-25T00:50:38.107611+0000","last_undegraded":"2024-04-25T00:50:38.107611+0000","last_fullsized":"2024-04-25T00:50:38.107611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:43.722114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363386+0000","last_change":"2024-04-25T00:50:35.802347+0000","last_active":"2024-04-25T00:50:37.363386+0000","last_peered":"2024-04-25T00:50:37.363386+0000","last_clean":"2024-04-25T00:50:37.363386+0000","last_became_active":"2024-04-25T00:50:35.801389+0000","last_became_peered":"2024-04-25T00:50:35.801389+0000","last_unstale":"2024-04-25T00:50:37.363386+0000","last_undegraded":"2024-04-25T00:50:37.363386+0000","last_fullsized":"2024-04-25T00:50:37.363386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:27.176441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.248607+0000","last_change":"2024-04-25T00:50:35.822222+0000","last_active":"2024-04-25T00:50:37.248607+0000","last_peered":"2024-04-25T00:50:37.248607+0000","last_clean":"2024-04-25T00:50:37.248607+0000","last_became_active":"2024-04-25T00:50:35.821484+0000","last_became_peered":"2024-04-25T00:50:35.821484+0000","last_unstale":"2024-04-25T00:50:37.248607+0000","last_undegraded":"2024-04-25T00:50:37.248607+0000","last_fullsized":"2024-04-25T00:50:37.248607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:59.921295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389330+0000","last_change":"2024-04-25T00:50:33.391742+0000","last_active":"2024-04-25T00:50:37.389330+0000","last_peered":"2024-04-25T00:50:37.389330+0000","last_clean":"2024-04-25T00:50:37.389330+0000","last_became_active":"2024-04-25T00:50:33.390901+0000","last_became_peered":"2024-04-25T00:50:33.390901+0000","last_unstale":"2024-04-25T00:50:37.389330+0000","last_undegraded":"2024-04-25T00:50:37.389330+0000","last_fullsized":"2024-04-25T00:50:37.389330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:27.804469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107862+0000","last_change":"2024-04-25T00:50:35.821496+0000","last_active":"2024-04-25T00:50:38.107862+0000","last_peered":"2024-04-25T00:50:38.107862+0000","last_clean":"2024-04-25T00:50:38.107862+0000","last_became_active":"2024-04-25T00:50:35.820763+0000","last_became_peered":"2024-04-25T00:50:35.820763+0000","last_unstale":"2024-04-25T00:50:38.107862+0000","last_undegraded":"2024-04-25T00:50:38.107862+0000","last_fullsized":"2024-04-25T00:50:38.107862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:15.698294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363497+0000","last_change":"2024-04-25T00:50:33.394753+0000","last_active":"2024-04-25T00:50:37.363497+0000","last_peered":"2024-04-25T00:50:37.363497+0000","last_clean":"2024-04-25T00:50:37.363497+0000","last_became_active":"2024-04-25T00:50:33.392951+0000","last_became_peered":"2024-04-25T00:50:33.392951+0000","last_unstale":"2024-04-25T00:50:37.363497+0000","last_undegraded":"2024-04-25T00:50:37.363497+0000","last_fullsized":"2024-04-25T00:50:37.363497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:41.175588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388873+0000","last_change":"2024-04-25T00:50:33.393229+0000","last_active":"2024-04-25T00:50:37.388873+0000","last_peered":"2024-04-25T00:50:37.388873+0000","last_clean":"2024-04-25T00:50:37.388873+0000","last_became_active":"2024-04-25T00:50:33.392817+0000","last_became_peered":"2024-04-25T00:50:33.392817+0000","last_unstale":"2024-04-25T00:50:37.388873+0000","last_undegraded":"2024-04-25T00:50:37.388873+0000","last_fullsized":"2024-04-25T00:50:37.388873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:31:12.131616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388809+0000","last_change":"2024-04-25T00:50:35.883390+0000","last_active":"2024-04-25T00:50:37.388809+0000","last_peered":"2024-04-25T00:50:37.388809+0000","last_clean":"2024-04-25T00:50:37.388809+0000","last_became_active":"2024-04-25T00:50:35.882509+0000","last_became_peered":"2024-04-25T00:50:35.882509+0000","last_unstale":"2024-04-25T00:50:37.388809+0000","last_undegraded":"2024-04-25T00:50:37.388809+0000","last_fullsized":"2024-04-25T00:50:37.388809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:05:17.996810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231803+0000","last_change":"2024-04-25T00:50:33.383755+0000","last_active":"2024-04-25T00:50:37.231803+0000","last_peered":"2024-04-25T00:50:37.231803+0000","last_clean":"2024-04-25T00:50:37.231803+0000","last_became_active":"2024-04-25T00:50:33.382925+0000","last_became_peered":"2024-04-25T00:50:33.382925+0000","last_unstale":"2024-04-25T00:50:37.231803+0000","last_undegraded":"2024-04-25T00:50:37.231803+0000","last_fullsized":"2024-04-25T00:50:37.231803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:52.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297234+0000","last_change":"2024-04-25T00:50:35.869794+0000","last_active":"2024-04-25T00:50:37.297234+0000","last_peered":"2024-04-25T00:50:37.297234+0000","last_clean":"2024-04-25T00:50:37.297234+0000","last_became_active":"2024-04-25T00:50:35.869028+0000","last_became_peered":"2024-04-25T00:50:35.869028+0000","last_unstale":"2024-04-25T00:50:37.297234+0000","last_undegraded":"2024-04-25T00:50:37.297234+0000","last_fullsized":"2024-04-25T00:50:37.297234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:49.891966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363903+0000","last_change":"2024-04-25T00:50:33.394082+0000","last_active":"2024-04-25T00:50:37.363903+0000","last_peered":"2024-04-25T00:50:37.363903+0000","last_clean":"2024-04-25T00:50:37.363903+0000","last_became_active":"2024-04-25T00:50:33.392792+0000","last_became_peered":"2024-04-25T00:50:33.392792+0000","last_unstale":"2024-04-25T00:50:37.363903+0000","last_undegraded":"2024-04-25T00:50:37.363903+0000","last_fullsized":"2024-04-25T00:50:37.363903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:35:15.441104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.233002+0000","last_change":"2024-04-25T00:50:35.729414+0000","last_active":"2024-04-25T00:50:37.233002+0000","last_peered":"2024-04-25T00:50:37.233002+0000","last_clean":"2024-04-25T00:50:37.233002+0000","last_became_active":"2024-04-25T00:50:35.728725+0000","last_became_peered":"2024-04-25T00:50:35.728725+0000","last_unstale":"2024-04-25T00:50:37.233002+0000","last_undegraded":"2024-04-25T00:50:37.233002+0000","last_fullsized":"2024-04-25T00:50:37.233002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:05.046355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.233021+0000","last_change":"2024-04-25T00:50:33.388191+0000","last_active":"2024-04-25T00:50:37.233021+0000","last_peered":"2024-04-25T00:50:37.233021+0000","last_clean":"2024-04-25T00:50:37.233021+0000","last_became_active":"2024-04-25T00:50:33.387266+0000","last_became_peered":"2024-04-25T00:50:33.387266+0000","last_unstale":"2024-04-25T00:50:37.233021+0000","last_undegraded":"2024-04-25T00:50:37.233021+0000","last_fullsized":"2024-04-25T00:50:37.233021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:08.400693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108034+0000","last_change":"2024-04-25T00:50:35.799783+0000","last_active":"2024-04-25T00:50:38.108034+0000","last_peered":"2024-04-25T00:50:38.108034+0000","last_clean":"2024-04-25T00:50:38.108034+0000","last_became_active":"2024-04-25T00:50:35.798471+0000","last_became_peered":"2024-04-25T00:50:35.798471+0000","last_unstale":"2024-04-25T00:50:38.108034+0000","last_undegraded":"2024-04-25T00:50:38.108034+0000","last_fullsized":"2024-04-25T00:50:38.108034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:15.104631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.472958+0000","last_change":"2024-04-25T00:50:33.304731+0000","last_active":"2024-04-25T00:50:38.472958+0000","last_peered":"2024-04-25T00:50:38.472958+0000","last_clean":"2024-04-25T00:50:38.472958+0000","last_became_active":"2024-04-25T00:50:33.303821+0000","last_became_peered":"2024-04-25T00:50:33.303821+0000","last_unstale":"2024-04-25T00:50:38.472958+0000","last_undegraded":"2024-04-25T00:50:38.472958+0000","last_fullsized":"2024-04-25T00:50:38.472958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:32.196488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.249633+0000","last_change":"2024-04-25T00:50:35.828727+0000","last_active":"2024-04-25T00:50:37.249633+0000","last_peered":"2024-04-25T00:50:37.249633+0000","last_clean":"2024-04-25T00:50:37.249633+0000","last_became_active":"2024-04-25T00:50:35.827617+0000","last_became_peered":"2024-04-25T00:50:35.827617+0000","last_unstale":"2024-04-25T00:50:37.249633+0000","last_undegraded":"2024-04-25T00:50:37.249633+0000","last_fullsized":"2024-04-25T00:50:37.249633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:30:10.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"26'6","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.470923+0000","last_change":"2024-04-25T00:50:33.391005+0000","last_active":"2024-04-25T00:50:38.470923+0000","last_peered":"2024-04-25T00:50:38.470923+0000","last_clean":"2024-04-25T00:50:38.470923+0000","last_became_active":"2024-04-25T00:50:33.390133+0000","last_became_peered":"2024-04-25T00:50:33.390133+0000","last_unstale":"2024-04-25T00:50:38.470923+0000","last_undegraded":"2024-04-25T00:50:38.470923+0000","last_fullsized":"2024-04-25T00:50:38.470923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:19.913188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108901+0000","last_change":"2024-04-25T00:50:35.876022+0000","last_active":"2024-04-25T00:50:38.108901+0000","last_peered":"2024-04-25T00:50:38.108901+0000","last_clean":"2024-04-25T00:50:38.108901+0000","last_became_active":"2024-04-25T00:50:35.875322+0000","last_became_peered":"2024-04-25T00:50:35.875322+0000","last_unstale":"2024-04-25T00:50:38.108901+0000","last_undegraded":"2024-04-25T00:50:38.108901+0000","last_fullsized":"2024-04-25T00:50:38.108901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.348199+0000","last_change":"2024-04-25T00:50:33.387295+0000","last_active":"2024-04-25T00:50:38.348199+0000","last_peered":"2024-04-25T00:50:38.348199+0000","last_clean":"2024-04-25T00:50:38.348199+0000","last_became_active":"2024-04-25T00:50:33.386297+0000","last_became_peered":"2024-04-25T00:50:33.386297+0000","last_unstale":"2024-04-25T00:50:38.348199+0000","last_undegraded":"2024-04-25T00:50:38.348199+0000","last_fullsized":"2024-04-25T00:50:38.348199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:31:57.597514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107131+0000","last_change":"2024-04-25T00:50:35.796873+0000","last_active":"2024-04-25T00:50:38.107131+0000","last_peered":"2024-04-25T00:50:38.107131+0000","last_clean":"2024-04-25T00:50:38.107131+0000","last_became_active":"2024-04-25T00:50:35.796012+0000","last_became_peered":"2024-04-25T00:50:35.796012+0000","last_unstale":"2024-04-25T00:50:38.107131+0000","last_undegraded":"2024-04-25T00:50:38.107131+0000","last_fullsized":"2024-04-25T00:50:38.107131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:22.255073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232210+0000","last_change":"2024-04-25T00:50:33.385522+0000","last_active":"2024-04-25T00:50:37.232210+0000","last_peered":"2024-04-25T00:50:37.232210+0000","last_clean":"2024-04-25T00:50:37.232210+0000","last_became_active":"2024-04-25T00:50:33.384620+0000","last_became_peered":"2024-04-25T00:50:33.384620+0000","last_unstale":"2024-04-25T00:50:37.232210+0000","last_undegraded":"2024-04-25T00:50:37.232210+0000","last_fullsized":"2024-04-25T00:50:37.232210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:24.908029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108828+0000","last_change":"2024-04-25T00:50:35.820565+0000","last_active":"2024-04-25T00:50:38.108828+0000","last_peered":"2024-04-25T00:50:38.108828+0000","last_clean":"2024-04-25T00:50:38.108828+0000","last_became_active":"2024-04-25T00:50:35.819683+0000","last_became_peered":"2024-04-25T00:50:35.819683+0000","last_unstale":"2024-04-25T00:50:38.108828+0000","last_undegraded":"2024-04-25T00:50:38.108828+0000","last_fullsized":"2024-04-25T00:50:38.108828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:28.655307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363257+0000","last_change":"2024-04-25T00:50:33.390745+0000","last_active":"2024-04-25T00:50:37.363257+0000","last_peered":"2024-04-25T00:50:37.363257+0000","last_clean":"2024-04-25T00:50:37.363257+0000","last_became_active":"2024-04-25T00:50:33.390089+0000","last_became_peered":"2024-04-25T00:50:33.390089+0000","last_unstale":"2024-04-25T00:50:37.363257+0000","last_undegraded":"2024-04-25T00:50:37.363257+0000","last_fullsized":"2024-04-25T00:50:37.363257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:51.294701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363399+0000","last_change":"2024-04-25T00:50:35.801766+0000","last_active":"2024-04-25T00:50:37.363399+0000","last_peered":"2024-04-25T00:50:37.363399+0000","last_clean":"2024-04-25T00:50:37.363399+0000","last_became_active":"2024-04-25T00:50:35.801060+0000","last_became_peered":"2024-04-25T00:50:35.801060+0000","last_unstale":"2024-04-25T00:50:37.363399+0000","last_undegraded":"2024-04-25T00:50:37.363399+0000","last_fullsized":"2024-04-25T00:50:37.363399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.483755+0000","last_change":"2024-04-25T00:50:33.327283+0000","last_active":"2024-04-25T00:50:38.483755+0000","last_peered":"2024-04-25T00:50:38.483755+0000","last_clean":"2024-04-25T00:50:38.483755+0000","last_became_active":"2024-04-25T00:50:33.326464+0000","last_became_peered":"2024-04-25T00:50:33.326464+0000","last_unstale":"2024-04-25T00:50:38.483755+0000","last_undegraded":"2024-04-25T00:50:38.483755+0000","last_fullsized":"2024-04-25T00:50:38.483755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:26:26.328621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108814+0000","last_change":"2024-04-25T00:50:35.825910+0000","last_active":"2024-04-25T00:50:38.108814+0000","last_peered":"2024-04-25T00:50:38.108814+0000","last_clean":"2024-04-25T00:50:38.108814+0000","last_became_active":"2024-04-25T00:50:35.825246+0000","last_became_peered":"2024-04-25T00:50:35.825246+0000","last_unstale":"2024-04-25T00:50:38.108814+0000","last_undegraded":"2024-04-25T00:50:38.108814+0000","last_fullsized":"2024-04-25T00:50:38.108814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:40.106788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.250173+0000","last_change":"2024-04-25T00:50:33.393856+0000","last_active":"2024-04-25T00:50:37.250173+0000","last_peered":"2024-04-25T00:50:37.250173+0000","last_clean":"2024-04-25T00:50:37.250173+0000","last_became_active":"2024-04-25T00:50:33.393153+0000","last_became_peered":"2024-04-25T00:50:33.393153+0000","last_unstale":"2024-04-25T00:50:37.250173+0000","last_undegraded":"2024-04-25T00:50:37.250173+0000","last_fullsized":"2024-04-25T00:50:37.250173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:55.179146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109662+0000","last_change":"2024-04-25T00:50:35.811993+0000","last_active":"2024-04-25T00:50:38.109662+0000","last_peered":"2024-04-25T00:50:38.109662+0000","last_clean":"2024-04-25T00:50:38.109662+0000","last_became_active":"2024-04-25T00:50:35.811267+0000","last_became_peered":"2024-04-25T00:50:35.811267+0000","last_unstale":"2024-04-25T00:50:38.109662+0000","last_undegraded":"2024-04-25T00:50:38.109662+0000","last_fullsized":"2024-04-25T00:50:38.109662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:40:20.385617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.476493+0000","last_change":"2024-04-25T00:50:33.383040+0000","last_active":"2024-04-25T00:50:38.476493+0000","last_peered":"2024-04-25T00:50:38.476493+0000","last_clean":"2024-04-25T00:50:38.476493+0000","last_became_active":"2024-04-25T00:50:33.382270+0000","last_became_peered":"2024-04-25T00:50:33.382270+0000","last_unstale":"2024-04-25T00:50:38.476493+0000","last_undegraded":"2024-04-25T00:50:38.476493+0000","last_fullsized":"2024-04-25T00:50:38.476493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:13.866739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109894+0000","last_change":"2024-04-25T00:50:35.818234+0000","last_active":"2024-04-25T00:50:38.109894+0000","last_peered":"2024-04-25T00:50:38.109894+0000","last_clean":"2024-04-25T00:50:38.109894+0000","last_became_active":"2024-04-25T00:50:35.817707+0000","last_became_peered":"2024-04-25T00:50:35.817707+0000","last_unstale":"2024-04-25T00:50:38.109894+0000","last_undegraded":"2024-04-25T00:50:38.109894+0000","last_fullsized":"2024-04-25T00:50:38.109894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:31.998886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297643+0000","last_change":"2024-04-25T00:50:33.389774+0000","last_active":"2024-04-25T00:50:37.297643+0000","last_peered":"2024-04-25T00:50:37.297643+0000","last_clean":"2024-04-25T00:50:37.297643+0000","last_became_active":"2024-04-25T00:50:33.389092+0000","last_became_peered":"2024-04-25T00:50:33.389092+0000","last_unstale":"2024-04-25T00:50:37.297643+0000","last_undegraded":"2024-04-25T00:50:37.297643+0000","last_fullsized":"2024-04-25T00:50:37.297643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:30.722771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232278+0000","last_change":"2024-04-25T00:50:35.869211+0000","last_active":"2024-04-25T00:50:37.232278+0000","last_peered":"2024-04-25T00:50:37.232278+0000","last_clean":"2024-04-25T00:50:37.232278+0000","last_became_active":"2024-04-25T00:50:35.868798+0000","last_became_peered":"2024-04-25T00:50:35.868798+0000","last_unstale":"2024-04-25T00:50:37.232278+0000","last_undegraded":"2024-04-25T00:50:37.232278+0000","last_fullsized":"2024-04-25T00:50:37.232278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:40.106788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107006+0000","last_change":"2024-04-25T00:50:33.329578+0000","last_active":"2024-04-25T00:50:38.107006+0000","last_peered":"2024-04-25T00:50:38.107006+0000","last_clean":"2024-04-25T00:50:38.107006+0000","last_became_active":"2024-04-25T00:50:33.328950+0000","last_became_peered":"2024-04-25T00:50:33.328950+0000","last_unstale":"2024-04-25T00:50:38.107006+0000","last_undegraded":"2024-04-25T00:50:38.107006+0000","last_fullsized":"2024-04-25T00:50:38.107006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:55.179146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109245+0000","last_change":"2024-04-25T00:50:35.734419+0000","last_active":"2024-04-25T00:50:38.109245+0000","last_peered":"2024-04-25T00:50:38.109245+0000","last_clean":"2024-04-25T00:50:38.109245+0000","last_became_active":"2024-04-25T00:50:35.733696+0000","last_became_peered":"2024-04-25T00:50:35.733696+0000","last_unstale":"2024-04-25T00:50:38.109245+0000","last_undegraded":"2024-04-25T00:50:38.109245+0000","last_fullsized":"2024-04-25T00:50:38.109245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:05.046355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":175,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108342+0000","last_change":"2024-04-25T00:49:55.281216+0000","last_active":"2024-04-25T00:50:38.108342+0000","last_peered":"2024-04-25T00:50:38.108342+0000","last_clean":"2024-04-25T00:50:38.108342+0000","last_became_active":"2024-04-25T00:49:55.278022+0000","last_became_peered":"2024-04-25T00:49:55.278022+0000","last_unstale":"2024-04-25T00:50:38.108342+0000","last_undegraded":"2024-04-25T00:50:38.108342+0000","last_fullsized":"2024-04-25T00:50:38.108342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:49:52.475299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:49:52.475299+0000","last_clean_scrub_stamp":"2024-04-25T00:49:52.475299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:17.046656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231603+0000","last_change":"2024-04-25T00:50:33.325228+0000","last_active":"2024-04-25T00:50:37.231603+0000","last_peered":"2024-04-25T00:50:37.231603+0000","last_clean":"2024-04-25T00:50:37.231603+0000","last_became_active":"2024-04-25T00:50:33.324579+0000","last_became_peered":"2024-04-25T00:50:33.324579+0000","last_unstale":"2024-04-25T00:50:37.231603+0000","last_undegraded":"2024-04-25T00:50:37.231603+0000","last_fullsized":"2024-04-25T00:50:37.231603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:12.762746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388819+0000","last_change":"2024-04-25T00:50:35.880348+0000","last_active":"2024-04-25T00:50:37.388819+0000","last_peered":"2024-04-25T00:50:37.388819+0000","last_clean":"2024-04-25T00:50:37.388819+0000","last_became_active":"2024-04-25T00:50:35.878438+0000","last_became_peered":"2024-04-25T00:50:35.878438+0000","last_unstale":"2024-04-25T00:50:37.388819+0000","last_undegraded":"2024-04-25T00:50:37.388819+0000","last_fullsized":"2024-04-25T00:50:37.388819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:44.093119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108174+0000","last_change":"2024-04-25T00:50:33.321385+0000","last_active":"2024-04-25T00:50:38.108174+0000","last_peered":"2024-04-25T00:50:38.108174+0000","last_clean":"2024-04-25T00:50:38.108174+0000","last_became_active":"2024-04-25T00:50:33.320800+0000","last_became_peered":"2024-04-25T00:50:33.320800+0000","last_unstale":"2024-04-25T00:50:38.108174+0000","last_undegraded":"2024-04-25T00:50:38.108174+0000","last_fullsized":"2024-04-25T00:50:38.108174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:04.254885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107400+0000","last_change":"2024-04-25T00:50:35.815056+0000","last_active":"2024-04-25T00:50:38.107400+0000","last_peered":"2024-04-25T00:50:38.107400+0000","last_clean":"2024-04-25T00:50:38.107400+0000","last_became_active":"2024-04-25T00:50:35.814163+0000","last_became_peered":"2024-04-25T00:50:35.814163+0000","last_unstale":"2024-04-25T00:50:38.107400+0000","last_undegraded":"2024-04-25T00:50:38.107400+0000","last_fullsized":"2024-04-25T00:50:38.107400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:50:52.289674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107554+0000","last_change":"2024-04-25T00:50:33.384695+0000","last_active":"2024-04-25T00:50:38.107554+0000","last_peered":"2024-04-25T00:50:38.107554+0000","last_clean":"2024-04-25T00:50:38.107554+0000","last_became_active":"2024-04-25T00:50:33.383692+0000","last_became_peered":"2024-04-25T00:50:33.383692+0000","last_unstale":"2024-04-25T00:50:38.107554+0000","last_undegraded":"2024-04-25T00:50:38.107554+0000","last_fullsized":"2024-04-25T00:50:38.107554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:57.579410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297265+0000","last_change":"2024-04-25T00:50:35.723048+0000","last_active":"2024-04-25T00:50:37.297265+0000","last_peered":"2024-04-25T00:50:37.297265+0000","last_clean":"2024-04-25T00:50:37.297265+0000","last_became_active":"2024-04-25T00:50:35.722500+0000","last_became_peered":"2024-04-25T00:50:35.722500+0000","last_unstale":"2024-04-25T00:50:37.297265+0000","last_undegraded":"2024-04-25T00:50:37.297265+0000","last_fullsized":"2024-04-25T00:50:37.297265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:20:39.082516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232389+0000","last_change":"2024-04-25T00:50:33.305927+0000","last_active":"2024-04-25T00:50:37.232389+0000","last_peered":"2024-04-25T00:50:37.232389+0000","last_clean":"2024-04-25T00:50:37.232389+0000","last_became_active":"2024-04-25T00:50:33.305159+0000","last_became_peered":"2024-04-25T00:50:33.305159+0000","last_unstale":"2024-04-25T00:50:37.232389+0000","last_undegraded":"2024-04-25T00:50:37.232389+0000","last_fullsized":"2024-04-25T00:50:37.232389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:46:56.639410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.248677+0000","last_change":"2024-04-25T00:50:35.824491+0000","last_active":"2024-04-25T00:50:37.248677+0000","last_peered":"2024-04-25T00:50:37.248677+0000","last_clean":"2024-04-25T00:50:37.248677+0000","last_became_active":"2024-04-25T00:50:35.823320+0000","last_became_peered":"2024-04-25T00:50:35.823320+0000","last_unstale":"2024-04-25T00:50:37.248677+0000","last_undegraded":"2024-04-25T00:50:37.248677+0000","last_fullsized":"2024-04-25T00:50:37.248677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:57.466393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297427+0000","last_change":"2024-04-25T00:50:33.304490+0000","last_active":"2024-04-25T00:50:37.297427+0000","last_peered":"2024-04-25T00:50:37.297427+0000","last_clean":"2024-04-25T00:50:37.297427+0000","last_became_active":"2024-04-25T00:50:33.303671+0000","last_became_peered":"2024-04-25T00:50:33.303671+0000","last_unstale":"2024-04-25T00:50:37.297427+0000","last_undegraded":"2024-04-25T00:50:37.297427+0000","last_fullsized":"2024-04-25T00:50:37.297427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:30.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.233156+0000","last_change":"2024-04-25T00:50:35.878641+0000","last_active":"2024-04-25T00:50:37.233156+0000","last_peered":"2024-04-25T00:50:37.233156+0000","last_clean":"2024-04-25T00:50:37.233156+0000","last_became_active":"2024-04-25T00:50:35.876958+0000","last_became_peered":"2024-04-25T00:50:35.876958+0000","last_unstale":"2024-04-25T00:50:37.233156+0000","last_undegraded":"2024-04-25T00:50:37.233156+0000","last_fullsized":"2024-04-25T00:50:37.233156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:59.565909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109722+0000","last_change":"2024-04-25T00:50:33.319229+0000","last_active":"2024-04-25T00:50:38.109722+0000","last_peered":"2024-04-25T00:50:38.109722+0000","last_clean":"2024-04-25T00:50:38.109722+0000","last_became_active":"2024-04-25T00:50:33.318945+0000","last_became_peered":"2024-04-25T00:50:33.318945+0000","last_unstale":"2024-04-25T00:50:38.109722+0000","last_undegraded":"2024-04-25T00:50:38.109722+0000","last_fullsized":"2024-04-25T00:50:38.109722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:51.132430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297603+0000","last_change":"2024-04-25T00:50:35.722521+0000","last_active":"2024-04-25T00:50:37.297603+0000","last_peered":"2024-04-25T00:50:37.297603+0000","last_clean":"2024-04-25T00:50:37.297603+0000","last_became_active":"2024-04-25T00:50:35.722128+0000","last_became_peered":"2024-04-25T00:50:35.722128+0000","last_unstale":"2024-04-25T00:50:37.297603+0000","last_undegraded":"2024-04-25T00:50:37.297603+0000","last_fullsized":"2024-04-25T00:50:37.297603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:59:36.793140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297781+0000","last_change":"2024-04-25T00:50:33.387402+0000","last_active":"2024-04-25T00:50:37.297781+0000","last_peered":"2024-04-25T00:50:37.297781+0000","last_clean":"2024-04-25T00:50:37.297781+0000","last_became_active":"2024-04-25T00:50:33.386631+0000","last_became_peered":"2024-04-25T00:50:33.386631+0000","last_unstale":"2024-04-25T00:50:37.297781+0000","last_undegraded":"2024-04-25T00:50:37.297781+0000","last_fullsized":"2024-04-25T00:50:37.297781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:11:49.105412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389751+0000","last_change":"2024-04-25T00:50:35.882715+0000","last_active":"2024-04-25T00:50:37.389751+0000","last_peered":"2024-04-25T00:50:37.389751+0000","last_clean":"2024-04-25T00:50:37.389751+0000","last_became_active":"2024-04-25T00:50:35.878416+0000","last_became_peered":"2024-04-25T00:50:35.878416+0000","last_unstale":"2024-04-25T00:50:37.389751+0000","last_undegraded":"2024-04-25T00:50:37.389751+0000","last_fullsized":"2024-04-25T00:50:37.389751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:35.413796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.462189+0000","last_change":"2024-04-25T00:50:33.393211+0000","last_active":"2024-04-25T00:50:38.462189+0000","last_peered":"2024-04-25T00:50:38.462189+0000","last_clean":"2024-04-25T00:50:38.462189+0000","last_became_active":"2024-04-25T00:50:33.392381+0000","last_became_peered":"2024-04-25T00:50:33.392381+0000","last_unstale":"2024-04-25T00:50:38.462189+0000","last_undegraded":"2024-04-25T00:50:38.462189+0000","last_fullsized":"2024-04-25T00:50:38.462189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:18:05.276269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107930+0000","last_change":"2024-04-25T00:50:35.798491+0000","last_active":"2024-04-25T00:50:38.107930+0000","last_peered":"2024-04-25T00:50:38.107930+0000","last_clean":"2024-04-25T00:50:38.107930+0000","last_became_active":"2024-04-25T00:50:35.796775+0000","last_became_peered":"2024-04-25T00:50:35.796775+0000","last_unstale":"2024-04-25T00:50:38.107930+0000","last_undegraded":"2024-04-25T00:50:38.107930+0000","last_fullsized":"2024-04-25T00:50:38.107930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:54.948867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108161+0000","last_change":"2024-04-25T00:50:33.321163+0000","last_active":"2024-04-25T00:50:38.108161+0000","last_peered":"2024-04-25T00:50:38.108161+0000","last_clean":"2024-04-25T00:50:38.108161+0000","last_became_active":"2024-04-25T00:50:33.320554+0000","last_became_peered":"2024-04-25T00:50:33.320554+0000","last_unstale":"2024-04-25T00:50:38.108161+0000","last_undegraded":"2024-04-25T00:50:38.108161+0000","last_fullsized":"2024-04-25T00:50:38.108161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:13.533462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.248575+0000","last_change":"2024-04-25T00:50:35.824154+0000","last_active":"2024-04-25T00:50:37.248575+0000","last_peered":"2024-04-25T00:50:37.248575+0000","last_clean":"2024-04-25T00:50:37.248575+0000","last_became_active":"2024-04-25T00:50:35.823269+0000","last_became_peered":"2024-04-25T00:50:35.823269+0000","last_unstale":"2024-04-25T00:50:37.248575+0000","last_undegraded":"2024-04-25T00:50:37.248575+0000","last_fullsized":"2024-04-25T00:50:37.248575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:16.208624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.518358+0000","last_change":"2024-04-25T00:50:33.319985+0000","last_active":"2024-04-25T00:50:43.518358+0000","last_peered":"2024-04-25T00:50:43.518358+0000","last_clean":"2024-04-25T00:50:43.518358+0000","last_became_active":"2024-04-25T00:50:33.319198+0000","last_became_peered":"2024-04-25T00:50:33.319198+0000","last_unstale":"2024-04-25T00:50:43.518358+0000","last_undegraded":"2024-04-25T00:50:43.518358+0000","last_fullsized":"2024-04-25T00:50:43.518358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:01.398188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388961+0000","last_change":"2024-04-25T00:50:35.883007+0000","last_active":"2024-04-25T00:50:37.388961+0000","last_peered":"2024-04-25T00:50:37.388961+0000","last_clean":"2024-04-25T00:50:37.388961+0000","last_became_active":"2024-04-25T00:50:35.881829+0000","last_became_peered":"2024-04-25T00:50:35.881829+0000","last_unstale":"2024-04-25T00:50:37.388961+0000","last_undegraded":"2024-04-25T00:50:37.388961+0000","last_fullsized":"2024-04-25T00:50:37.388961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:02.444745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297383+0000","last_change":"2024-04-25T00:50:33.384397+0000","last_active":"2024-04-25T00:50:37.297383+0000","last_peered":"2024-04-25T00:50:37.297383+0000","last_clean":"2024-04-25T00:50:37.297383+0000","last_became_active":"2024-04-25T00:50:33.383622+0000","last_became_peered":"2024-04-25T00:50:33.383622+0000","last_unstale":"2024-04-25T00:50:37.297383+0000","last_undegraded":"2024-04-25T00:50:37.297383+0000","last_fullsized":"2024-04-25T00:50:37.297383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:31.816914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389114+0000","last_change":"2024-04-25T00:50:35.881976+0000","last_active":"2024-04-25T00:50:37.389114+0000","last_peered":"2024-04-25T00:50:37.389114+0000","last_clean":"2024-04-25T00:50:37.389114+0000","last_became_active":"2024-04-25T00:50:35.881269+0000","last_became_peered":"2024-04-25T00:50:35.881269+0000","last_unstale":"2024-04-25T00:50:37.389114+0000","last_undegraded":"2024-04-25T00:50:37.389114+0000","last_fullsized":"2024-04-25T00:50:37.389114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:54.302741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.335792+0000","last_change":"2024-04-25T00:50:33.390041+0000","last_active":"2024-04-25T00:50:38.335792+0000","last_peered":"2024-04-25T00:50:38.335792+0000","last_clean":"2024-04-25T00:50:38.335792+0000","last_became_active":"2024-04-25T00:50:33.389095+0000","last_became_peered":"2024-04-25T00:50:33.389095+0000","last_unstale":"2024-04-25T00:50:38.335792+0000","last_undegraded":"2024-04-25T00:50:38.335792+0000","last_fullsized":"2024-04-25T00:50:38.335792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:00.569613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363413+0000","last_change":"2024-04-25T00:50:35.812195+0000","last_active":"2024-04-25T00:50:37.363413+0000","last_peered":"2024-04-25T00:50:37.363413+0000","last_clean":"2024-04-25T00:50:37.363413+0000","last_became_active":"2024-04-25T00:50:35.811410+0000","last_became_peered":"2024-04-25T00:50:35.811410+0000","last_unstale":"2024-04-25T00:50:37.363413+0000","last_undegraded":"2024-04-25T00:50:37.363413+0000","last_fullsized":"2024-04-25T00:50:37.363413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:06.596770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232746+0000","last_change":"2024-04-25T00:50:35.821808+0000","last_active":"2024-04-25T00:50:37.232746+0000","last_peered":"2024-04-25T00:50:37.232746+0000","last_clean":"2024-04-25T00:50:37.232746+0000","last_became_active":"2024-04-25T00:50:35.821062+0000","last_became_peered":"2024-04-25T00:50:35.821062+0000","last_unstale":"2024-04-25T00:50:37.232746+0000","last_undegraded":"2024-04-25T00:50:37.232746+0000","last_fullsized":"2024-04-25T00:50:37.232746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.328036+0000","last_change":"2024-04-25T00:50:33.319853+0000","last_active":"2024-04-25T00:50:38.328036+0000","last_peered":"2024-04-25T00:50:38.328036+0000","last_clean":"2024-04-25T00:50:38.328036+0000","last_became_active":"2024-04-25T00:50:33.319197+0000","last_became_peered":"2024-04-25T00:50:33.319197+0000","last_unstale":"2024-04-25T00:50:38.328036+0000","last_undegraded":"2024-04-25T00:50:38.328036+0000","last_fullsized":"2024-04-25T00:50:38.328036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:24.834556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232234+0000","last_change":"2024-04-25T00:50:35.812044+0000","last_active":"2024-04-25T00:50:37.232234+0000","last_peered":"2024-04-25T00:50:37.232234+0000","last_clean":"2024-04-25T00:50:37.232234+0000","last_became_active":"2024-04-25T00:50:35.811281+0000","last_became_peered":"2024-04-25T00:50:35.811281+0000","last_unstale":"2024-04-25T00:50:37.232234+0000","last_undegraded":"2024-04-25T00:50:37.232234+0000","last_fullsized":"2024-04-25T00:50:37.232234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:28.655307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.328167+0000","last_change":"2024-04-25T00:50:33.382775+0000","last_active":"2024-04-25T00:50:38.328167+0000","last_peered":"2024-04-25T00:50:38.328167+0000","last_clean":"2024-04-25T00:50:38.328167+0000","last_became_active":"2024-04-25T00:50:33.382218+0000","last_became_peered":"2024-04-25T00:50:33.382218+0000","last_unstale":"2024-04-25T00:50:38.328167+0000","last_undegraded":"2024-04-25T00:50:38.328167+0000","last_fullsized":"2024-04-25T00:50:38.328167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:52.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107894+0000","last_change":"2024-04-25T00:50:35.802543+0000","last_active":"2024-04-25T00:50:38.107894+0000","last_peered":"2024-04-25T00:50:38.107894+0000","last_clean":"2024-04-25T00:50:38.107894+0000","last_became_active":"2024-04-25T00:50:35.801799+0000","last_became_peered":"2024-04-25T00:50:35.801799+0000","last_unstale":"2024-04-25T00:50:38.107894+0000","last_undegraded":"2024-04-25T00:50:38.107894+0000","last_fullsized":"2024-04-25T00:50:38.107894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:15.875347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389661+0000","last_change":"2024-04-25T00:50:33.389565+0000","last_active":"2024-04-25T00:50:37.389661+0000","last_peered":"2024-04-25T00:50:37.389661+0000","last_clean":"2024-04-25T00:50:37.389661+0000","last_became_active":"2024-04-25T00:50:33.388773+0000","last_became_peered":"2024-04-25T00:50:33.388773+0000","last_unstale":"2024-04-25T00:50:37.389661+0000","last_undegraded":"2024-04-25T00:50:37.389661+0000","last_fullsized":"2024-04-25T00:50:37.389661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:42.721375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389537+0000","last_change":"2024-04-25T00:50:35.877410+0000","last_active":"2024-04-25T00:50:37.389537+0000","last_peered":"2024-04-25T00:50:37.389537+0000","last_clean":"2024-04-25T00:50:37.389537+0000","last_became_active":"2024-04-25T00:50:35.876576+0000","last_became_peered":"2024-04-25T00:50:35.876576+0000","last_unstale":"2024-04-25T00:50:37.389537+0000","last_undegraded":"2024-04-25T00:50:37.389537+0000","last_fullsized":"2024-04-25T00:50:37.389537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:15.762503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.352944+0000","last_change":"2024-04-25T00:50:33.319601+0000","last_active":"2024-04-25T00:50:38.352944+0000","last_peered":"2024-04-25T00:50:38.352944+0000","last_clean":"2024-04-25T00:50:38.352944+0000","last_became_active":"2024-04-25T00:50:33.318940+0000","last_became_peered":"2024-04-25T00:50:33.318940+0000","last_unstale":"2024-04-25T00:50:38.352944+0000","last_undegraded":"2024-04-25T00:50:38.352944+0000","last_fullsized":"2024-04-25T00:50:38.352944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:41.175588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3082,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476751,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":687141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476751,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":97803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476751,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":96281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476749,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":96317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476750,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":96191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":97803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":687197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":96351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T00:50:47.149 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T00:50:47.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.317+0000 7fa4f72c9640 1 Processor -- start 2024-04-25T00:50:47.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.317+0000 7fa4f72c9640 1 -- start start 2024-04-25T00:50:47.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.317+0000 7fa4f72c9640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa4f00c9610 0x7fa4f00cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:47.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.317+0000 7fa4f72c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4f00c9a60 0x7fa4f00cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:47.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.317+0000 7fa4f72c9640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4f0158890 con 0x7fa4f01523b0 2024-04-25T00:50:47.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.317+0000 7fa4f72c9640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa4f0152790 con 0x7fa4f00c9610 2024-04-25T00:50:47.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.317+0000 7fa4f72c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f00ca000 con 0x7fa4f00c9a60 2024-04-25T00:50:47.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.337+0000 7fa4f4864640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa4f00c9610 0x7fa4f00cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:47.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.337+0000 7fa4f4864640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa4f00c9610 0x7fa4f00cd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35134/0 (socket says 172.21.15.162:35134) 2024-04-25T00:50:47.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.337+0000 7fa4f4864640 1 -- 172.21.15.162:0/1064356082 learned_addr learned my addr 172.21.15.162:0/1064356082 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:47.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.337+0000 7fa4f4864640 1 -- 172.21.15.162:0/1064356082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4f00c9a60 msgr2=0x7fa4f00cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:47.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.337+0000 7fa4f4864640 1 --2- 172.21.15.162:0/1064356082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4f00c9a60 0x7fa4f00cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:47.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.337+0000 7fa4f4864640 1 -- 172.21.15.162:0/1064356082 >> v1:172.21.15.179:6789/0 conn(0x7fa4f01523b0 legacy=0x7fa4f0158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:47.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.337+0000 7fa4f4864640 1 -- 172.21.15.162:0/1064356082 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f0158b70 con 0x7fa4f00c9610 2024-04-25T00:50:47.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.345+0000 7fa4f4864640 1 --2- 172.21.15.162:0/1064356082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f00c9610 0x7fa4f00cd9f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009870 tx=0x7fa4e001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebc9b3f85fbafd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:47.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.349+0000 7fa4e7fff640 1 -- 172.21.15.162:0/1064356082 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00ab620 con 0x7fa4f00c9610 2024-04-25T00:50:47.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.349+0000 7fa4e7fff640 1 -- 172.21.15.162:0/1064356082 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e00b0070 con 0x7fa4f00c9610 2024-04-25T00:50:47.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.349+0000 7fa4e7fff640 1 -- 172.21.15.162:0/1064356082 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00ab9e0 con 0x7fa4f00c9610 2024-04-25T00:50:47.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.349+0000 7fa4f72c9640 1 -- 172.21.15.162:0/1064356082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f00c9610 msgr2=0x7fa4f00cd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:47.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.349+0000 7fa4f72c9640 1 --2- 172.21.15.162:0/1064356082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f00c9610 0x7fa4f00cd9f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009870 tx=0x7fa4e001c460 comp rx=0 tx=0).stop 2024-04-25T00:50:47.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.349+0000 7fa4f72c9640 1 -- 172.21.15.162:0/1064356082 shutdown_connections 2024-04-25T00:50:47.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.349+0000 7fa4f72c9640 1 --2- 172.21.15.162:0/1064356082 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4f00c9a60 0x7fa4f00cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:47.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.349+0000 7fa4f72c9640 1 --2- 172.21.15.162:0/1064356082 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f00c9610 0x7fa4f00cd9f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:47.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.349+0000 7fa4f72c9640 1 -- 172.21.15.162:0/1064356082 >> 172.21.15.162:0/1064356082 conn(0x7fa4f0066fc0 msgr2=0x7fa4f00673d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:47.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.349+0000 7fa4f72c9640 1 -- 172.21.15.162:0/1064356082 shutdown_connections 2024-04-25T00:50:47.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.349+0000 7fa4f72c9640 1 -- 172.21.15.162:0/1064356082 wait complete. 2024-04-25T00:50:47.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.353+0000 7fa4f72c9640 1 Processor -- start 2024-04-25T00:50:47.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.353+0000 7fa4f72c9640 1 -- start start 2024-04-25T00:50:47.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.353+0000 7fa4f72c9640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4f00c9610 0x7fa4f01f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:47.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.353+0000 7fa4f72c9640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4f00c9a60 0x7fa4f00ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:47.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.353+0000 7fa4f72c9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f01523b0 0x7fa4f00ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:47.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.353+0000 7fa4f72c9640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f0164b60 con 0x7fa4f01523b0 2024-04-25T00:50:47.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.353+0000 7fa4f72c9640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f01649e0 con 0x7fa4f00c9a60 2024-04-25T00:50:47.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.353+0000 7fa4f72c9640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa4f0164ce0 con 0x7fa4f00c9610 2024-04-25T00:50:47.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.353+0000 7fa4f5866640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f01523b0 0x7fa4f00ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:47.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.353+0000 7fa4f5866640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f01523b0 0x7fa4f00ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35150/0 (socket says 172.21.15.162:35150) 2024-04-25T00:50:47.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.353+0000 7fa4f5866640 1 -- 172.21.15.162:0/1504547650 learned_addr learned my addr 172.21.15.162:0/1504547650 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:47.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.357+0000 7fa4f5866640 1 -- 172.21.15.162:0/1504547650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4f00c9610 msgr2=0x7fa4f01f41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:47.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.357+0000 7fa4f5866640 1 --2- 172.21.15.162:0/1504547650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4f00c9610 0x7fa4f01f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:47.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.357+0000 7fa4f5866640 1 -- 172.21.15.162:0/1504547650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4f00c9a60 msgr2=0x7fa4f00ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:47.360 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.357+0000 7fa4f5866640 1 --2- 172.21.15.162:0/1504547650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4f00c9a60 0x7fa4f00ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:47.361 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.357+0000 7fa4f5866640 1 -- 172.21.15.162:0/1504547650 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f0160dd0 con 0x7fa4f01523b0 2024-04-25T00:50:47.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.361+0000 7fa4f5866640 1 --2- 172.21.15.162:0/1504547650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f01523b0 0x7fa4f00ce600 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800b460 tx=0x7fa4e800b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:47.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.369+0000 7fa4e5ffb640 1 -- 172.21.15.162:0/1504547650 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8015020 con 0x7fa4f01523b0 2024-04-25T00:50:47.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.369+0000 7fa4e5ffb640 1 -- 172.21.15.162:0/1504547650 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4e8011890 con 0x7fa4f01523b0 2024-04-25T00:50:47.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.369+0000 7fa4e5ffb640 1 -- 172.21.15.162:0/1504547650 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4e8011c60 con 0x7fa4f01523b0 2024-04-25T00:50:47.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.369+0000 7fa4f72c9640 1 -- 172.21.15.162:0/1504547650 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f01610b0 con 0x7fa4f01523b0 2024-04-25T00:50:47.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.369+0000 7fa4f72c9640 1 -- 172.21.15.162:0/1504547650 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f0161670 con 0x7fa4f01523b0 2024-04-25T00:50:47.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.369+0000 7fa4f72c9640 1 -- 172.21.15.162:0/1504547650 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f0068520 con 0x7fa4f01523b0 2024-04-25T00:50:47.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.389+0000 7fa4e5ffb640 1 -- 172.21.15.162:0/1504547650 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa4e8018020 con 0x7fa4f01523b0 2024-04-25T00:50:47.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.389+0000 7fa4e5ffb640 1 --2- 172.21.15.162:0/1504547650 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa4d40678c0 0x7fa4d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:47.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.389+0000 7fa4f5065640 1 --2- 172.21.15.162:0/1504547650 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa4d40678c0 0x7fa4d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:47.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.389+0000 7fa4f5065640 1 --2- 172.21.15.162:0/1504547650 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa4d40678c0 0x7fa4d4069d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00abb0 tx=0x7fa4ec009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:47.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.393+0000 7fa4e5ffb640 1 -- 172.21.15.162:0/1504547650 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fa4e8011e00 con 0x7fa4f01523b0 2024-04-25T00:50:47.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.681+0000 7fa4e5ffb640 1 -- 172.21.15.162:0/1504547650 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa4e801f020 con 0x7fa4f01523b0 2024-04-25T00:50:47.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.849+0000 7fa4f72c9640 1 -- 172.21.15.162:0/1504547650 --> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa4f00b0910 con 0x7fa4d40678c0 2024-04-25T00:50:47.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.865+0000 7fa4e5ffb640 1 -- 172.21.15.162:0/1504547650 <== mgr.4100 v2:172.21.15.162:6800/3960394531 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251952 (secure 0 0 0) 0x7fa4f00b0910 con 0x7fa4d40678c0 2024-04-25T00:50:47.871 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:47.872 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-04-25T00:50:47.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.869+0000 7fa4f72c9640 1 -- 172.21.15.162:0/1504547650 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa4d40678c0 msgr2=0x7fa4d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:47.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.869+0000 7fa4f72c9640 1 --2- 172.21.15.162:0/1504547650 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa4d40678c0 0x7fa4d4069d80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec00abb0 tx=0x7fa4ec009250 comp rx=0 tx=0).stop 2024-04-25T00:50:47.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.869+0000 7fa4f72c9640 1 -- 172.21.15.162:0/1504547650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f01523b0 msgr2=0x7fa4f00ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:47.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.869+0000 7fa4f72c9640 1 --2- 172.21.15.162:0/1504547650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f01523b0 0x7fa4f00ce600 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800b460 tx=0x7fa4e800b920 comp rx=0 tx=0).stop 2024-04-25T00:50:47.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.869+0000 7fa4f72c9640 1 -- 172.21.15.162:0/1504547650 shutdown_connections 2024-04-25T00:50:47.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.869+0000 7fa4f72c9640 1 --2- 172.21.15.162:0/1504547650 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa4d40678c0 0x7fa4d4069d80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:47.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.869+0000 7fa4f72c9640 1 --2- 172.21.15.162:0/1504547650 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa4f01523b0 0x7fa4f00ce600 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:47.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.869+0000 7fa4f72c9640 1 --2- 172.21.15.162:0/1504547650 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa4f00c9a60 0x7fa4f00ce0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:47.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.869+0000 7fa4f72c9640 1 --2- 172.21.15.162:0/1504547650 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa4f00c9610 0x7fa4f01f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:47.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.869+0000 7fa4f72c9640 1 -- 172.21.15.162:0/1504547650 >> 172.21.15.162:0/1504547650 conn(0x7fa4f0066fc0 msgr2=0x7fa4f01517f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:47.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.873+0000 7fa4f72c9640 1 -- 172.21.15.162:0/1504547650 shutdown_connections 2024-04-25T00:50:47.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:47.873+0000 7fa4f72c9640 1 -- 172.21.15.162:0/1504547650 wait complete. 2024-04-25T00:50:47.894 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":50,"stamp":"2024-04-25T00:50:45.868882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":593450,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223648,"kb_used_data":3304,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751072,"statfs":{"total":773094113280,"available":772865097728,"internally_reserved":0,"allocated":3383296,"data_stored":1955084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3082,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.691667"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109574+0000","last_change":"2024-04-25T00:50:35.761428+0000","last_active":"2024-04-25T00:50:38.109574+0000","last_peered":"2024-04-25T00:50:38.109574+0000","last_clean":"2024-04-25T00:50:38.109574+0000","last_became_active":"2024-04-25T00:50:35.760579+0000","last_became_peered":"2024-04-25T00:50:35.760579+0000","last_unstale":"2024-04-25T00:50:38.109574+0000","last_undegraded":"2024-04-25T00:50:38.109574+0000","last_fullsized":"2024-04-25T00:50:38.109574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:06.236972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297768+0000","last_change":"2024-04-25T00:50:35.798137+0000","last_active":"2024-04-25T00:50:37.297768+0000","last_peered":"2024-04-25T00:50:37.297768+0000","last_clean":"2024-04-25T00:50:37.297768+0000","last_became_active":"2024-04-25T00:50:35.797354+0000","last_became_peered":"2024-04-25T00:50:35.797354+0000","last_unstale":"2024-04-25T00:50:37.297768+0000","last_undegraded":"2024-04-25T00:50:37.297768+0000","last_fullsized":"2024-04-25T00:50:37.297768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:29:18.970287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107728+0000","last_change":"2024-04-25T00:50:35.799370+0000","last_active":"2024-04-25T00:50:38.107728+0000","last_peered":"2024-04-25T00:50:38.107728+0000","last_clean":"2024-04-25T00:50:38.107728+0000","last_became_active":"2024-04-25T00:50:35.798268+0000","last_became_peered":"2024-04-25T00:50:35.798268+0000","last_unstale":"2024-04-25T00:50:38.107728+0000","last_undegraded":"2024-04-25T00:50:38.107728+0000","last_fullsized":"2024-04-25T00:50:38.107728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:27.176441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231768+0000","last_change":"2024-04-25T00:50:35.877965+0000","last_active":"2024-04-25T00:50:37.231768+0000","last_peered":"2024-04-25T00:50:37.231768+0000","last_clean":"2024-04-25T00:50:37.231768+0000","last_became_active":"2024-04-25T00:50:35.877114+0000","last_became_peered":"2024-04-25T00:50:35.877114+0000","last_unstale":"2024-04-25T00:50:37.231768+0000","last_undegraded":"2024-04-25T00:50:37.231768+0000","last_fullsized":"2024-04-25T00:50:37.231768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:20.857588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108773+0000","last_change":"2024-04-25T00:50:35.730647+0000","last_active":"2024-04-25T00:50:38.108773+0000","last_peered":"2024-04-25T00:50:38.108773+0000","last_clean":"2024-04-25T00:50:38.108773+0000","last_became_active":"2024-04-25T00:50:35.729785+0000","last_became_peered":"2024-04-25T00:50:35.729785+0000","last_unstale":"2024-04-25T00:50:38.108773+0000","last_undegraded":"2024-04-25T00:50:38.108773+0000","last_fullsized":"2024-04-25T00:50:38.108773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:02.888747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231805+0000","last_change":"2024-04-25T00:50:35.800071+0000","last_active":"2024-04-25T00:50:37.231805+0000","last_peered":"2024-04-25T00:50:37.231805+0000","last_clean":"2024-04-25T00:50:37.231805+0000","last_became_active":"2024-04-25T00:50:35.799390+0000","last_became_peered":"2024-04-25T00:50:35.799390+0000","last_unstale":"2024-04-25T00:50:37.231805+0000","last_undegraded":"2024-04-25T00:50:37.231805+0000","last_fullsized":"2024-04-25T00:50:37.231805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:16.817860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109329+0000","last_change":"2024-04-25T00:50:35.797990+0000","last_active":"2024-04-25T00:50:38.109329+0000","last_peered":"2024-04-25T00:50:38.109329+0000","last_clean":"2024-04-25T00:50:38.109329+0000","last_became_active":"2024-04-25T00:50:35.797328+0000","last_became_peered":"2024-04-25T00:50:35.797328+0000","last_unstale":"2024-04-25T00:50:38.109329+0000","last_undegraded":"2024-04-25T00:50:38.109329+0000","last_fullsized":"2024-04-25T00:50:38.109329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:59.565909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388780+0000","last_change":"2024-04-25T00:50:35.878367+0000","last_active":"2024-04-25T00:50:37.388780+0000","last_peered":"2024-04-25T00:50:37.388780+0000","last_clean":"2024-04-25T00:50:37.388780+0000","last_became_active":"2024-04-25T00:50:35.877581+0000","last_became_peered":"2024-04-25T00:50:35.877581+0000","last_unstale":"2024-04-25T00:50:37.388780+0000","last_undegraded":"2024-04-25T00:50:37.388780+0000","last_fullsized":"2024-04-25T00:50:37.388780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:53.695907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109701+0000","last_change":"2024-04-25T00:50:35.734161+0000","last_active":"2024-04-25T00:50:38.109701+0000","last_peered":"2024-04-25T00:50:38.109701+0000","last_clean":"2024-04-25T00:50:38.109701+0000","last_became_active":"2024-04-25T00:50:35.733546+0000","last_became_peered":"2024-04-25T00:50:35.733546+0000","last_unstale":"2024-04-25T00:50:38.109701+0000","last_undegraded":"2024-04-25T00:50:38.109701+0000","last_fullsized":"2024-04-25T00:50:38.109701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:24:43.171432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.364156+0000","last_change":"2024-04-25T00:50:35.765173+0000","last_active":"2024-04-25T00:50:37.364156+0000","last_peered":"2024-04-25T00:50:37.364156+0000","last_clean":"2024-04-25T00:50:37.364156+0000","last_became_active":"2024-04-25T00:50:35.764412+0000","last_became_peered":"2024-04-25T00:50:35.764412+0000","last_unstale":"2024-04-25T00:50:37.364156+0000","last_undegraded":"2024-04-25T00:50:37.364156+0000","last_fullsized":"2024-04-25T00:50:37.364156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:54.948867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363747+0000","last_change":"2024-04-25T00:50:35.764526+0000","last_active":"2024-04-25T00:50:37.363747+0000","last_peered":"2024-04-25T00:50:37.363747+0000","last_clean":"2024-04-25T00:50:37.363747+0000","last_became_active":"2024-04-25T00:50:35.763770+0000","last_became_peered":"2024-04-25T00:50:35.763770+0000","last_unstale":"2024-04-25T00:50:37.363747+0000","last_undegraded":"2024-04-25T00:50:37.363747+0000","last_fullsized":"2024-04-25T00:50:37.363747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:15.698294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.249512+0000","last_change":"2024-04-25T00:50:35.822113+0000","last_active":"2024-04-25T00:50:37.249512+0000","last_peered":"2024-04-25T00:50:37.249512+0000","last_clean":"2024-04-25T00:50:37.249512+0000","last_became_active":"2024-04-25T00:50:35.821524+0000","last_became_peered":"2024-04-25T00:50:35.821524+0000","last_unstale":"2024-04-25T00:50:37.249512+0000","last_undegraded":"2024-04-25T00:50:37.249512+0000","last_fullsized":"2024-04-25T00:50:37.249512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:43.722114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388885+0000","last_change":"2024-04-25T00:50:35.881637+0000","last_active":"2024-04-25T00:50:37.388885+0000","last_peered":"2024-04-25T00:50:37.388885+0000","last_clean":"2024-04-25T00:50:37.388885+0000","last_became_active":"2024-04-25T00:50:35.880661+0000","last_became_peered":"2024-04-25T00:50:35.880661+0000","last_unstale":"2024-04-25T00:50:37.388885+0000","last_undegraded":"2024-04-25T00:50:37.388885+0000","last_fullsized":"2024-04-25T00:50:37.388885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:39.862610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.106989+0000","last_change":"2024-04-25T00:50:35.796996+0000","last_active":"2024-04-25T00:50:38.106989+0000","last_peered":"2024-04-25T00:50:38.106989+0000","last_clean":"2024-04-25T00:50:38.106989+0000","last_became_active":"2024-04-25T00:50:35.795295+0000","last_became_peered":"2024-04-25T00:50:35.795295+0000","last_unstale":"2024-04-25T00:50:38.106989+0000","last_undegraded":"2024-04-25T00:50:38.106989+0000","last_fullsized":"2024-04-25T00:50:38.106989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:29.858476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297189+0000","last_change":"2024-04-25T00:50:35.818291+0000","last_active":"2024-04-25T00:50:37.297189+0000","last_peered":"2024-04-25T00:50:37.297189+0000","last_clean":"2024-04-25T00:50:37.297189+0000","last_became_active":"2024-04-25T00:50:35.817575+0000","last_became_peered":"2024-04-25T00:50:35.817575+0000","last_unstale":"2024-04-25T00:50:37.297189+0000","last_undegraded":"2024-04-25T00:50:37.297189+0000","last_fullsized":"2024-04-25T00:50:37.297189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:51.142494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231455+0000","last_change":"2024-04-25T00:50:35.797194+0000","last_active":"2024-04-25T00:50:37.231455+0000","last_peered":"2024-04-25T00:50:37.231455+0000","last_clean":"2024-04-25T00:50:37.231455+0000","last_became_active":"2024-04-25T00:50:35.796536+0000","last_became_peered":"2024-04-25T00:50:35.796536+0000","last_unstale":"2024-04-25T00:50:37.231455+0000","last_undegraded":"2024-04-25T00:50:37.231455+0000","last_fullsized":"2024-04-25T00:50:37.231455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:48:27.210535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.233251+0000","last_change":"2024-04-25T00:50:35.729648+0000","last_active":"2024-04-25T00:50:37.233251+0000","last_peered":"2024-04-25T00:50:37.233251+0000","last_clean":"2024-04-25T00:50:37.233251+0000","last_became_active":"2024-04-25T00:50:35.728875+0000","last_became_peered":"2024-04-25T00:50:35.728875+0000","last_unstale":"2024-04-25T00:50:37.233251+0000","last_undegraded":"2024-04-25T00:50:37.233251+0000","last_fullsized":"2024-04-25T00:50:37.233251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:46.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.106981+0000","last_change":"2024-04-25T00:50:35.760953+0000","last_active":"2024-04-25T00:50:38.106981+0000","last_peered":"2024-04-25T00:50:38.106981+0000","last_clean":"2024-04-25T00:50:38.106981+0000","last_became_active":"2024-04-25T00:50:35.760286+0000","last_became_peered":"2024-04-25T00:50:35.760286+0000","last_unstale":"2024-04-25T00:50:38.106981+0000","last_undegraded":"2024-04-25T00:50:38.106981+0000","last_fullsized":"2024-04-25T00:50:38.106981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:57.466393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109462+0000","last_change":"2024-04-25T00:50:35.732837+0000","last_active":"2024-04-25T00:50:38.109462+0000","last_peered":"2024-04-25T00:50:38.109462+0000","last_clean":"2024-04-25T00:50:38.109462+0000","last_became_active":"2024-04-25T00:50:35.732134+0000","last_became_peered":"2024-04-25T00:50:35.732134+0000","last_unstale":"2024-04-25T00:50:38.109462+0000","last_undegraded":"2024-04-25T00:50:38.109462+0000","last_fullsized":"2024-04-25T00:50:38.109462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:46.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363854+0000","last_change":"2024-04-25T00:50:35.818607+0000","last_active":"2024-04-25T00:50:37.363854+0000","last_peered":"2024-04-25T00:50:37.363854+0000","last_clean":"2024-04-25T00:50:37.363854+0000","last_became_active":"2024-04-25T00:50:35.818063+0000","last_became_peered":"2024-04-25T00:50:35.818063+0000","last_unstale":"2024-04-25T00:50:37.363854+0000","last_undegraded":"2024-04-25T00:50:37.363854+0000","last_fullsized":"2024-04-25T00:50:37.363854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:15.875347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107633+0000","last_change":"2024-04-25T00:50:35.798297+0000","last_active":"2024-04-25T00:50:38.107633+0000","last_peered":"2024-04-25T00:50:38.107633+0000","last_clean":"2024-04-25T00:50:38.107633+0000","last_became_active":"2024-04-25T00:50:35.797580+0000","last_became_peered":"2024-04-25T00:50:35.797580+0000","last_unstale":"2024-04-25T00:50:38.107633+0000","last_undegraded":"2024-04-25T00:50:38.107633+0000","last_fullsized":"2024-04-25T00:50:38.107633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:06.596770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231785+0000","last_change":"2024-04-25T00:50:35.729396+0000","last_active":"2024-04-25T00:50:37.231785+0000","last_peered":"2024-04-25T00:50:37.231785+0000","last_clean":"2024-04-25T00:50:37.231785+0000","last_became_active":"2024-04-25T00:50:35.728620+0000","last_became_peered":"2024-04-25T00:50:35.728620+0000","last_unstale":"2024-04-25T00:50:37.231785+0000","last_undegraded":"2024-04-25T00:50:37.231785+0000","last_fullsized":"2024-04-25T00:50:37.231785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:02.911498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389017+0000","last_change":"2024-04-25T00:50:35.877261+0000","last_active":"2024-04-25T00:50:37.389017+0000","last_peered":"2024-04-25T00:50:37.389017+0000","last_clean":"2024-04-25T00:50:37.389017+0000","last_became_active":"2024-04-25T00:50:35.876489+0000","last_became_peered":"2024-04-25T00:50:35.876489+0000","last_unstale":"2024-04-25T00:50:37.389017+0000","last_undegraded":"2024-04-25T00:50:37.389017+0000","last_fullsized":"2024-04-25T00:50:37.389017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:14:31.440563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231553+0000","last_change":"2024-04-25T00:50:35.877693+0000","last_active":"2024-04-25T00:50:37.231553+0000","last_peered":"2024-04-25T00:50:37.231553+0000","last_clean":"2024-04-25T00:50:37.231553+0000","last_became_active":"2024-04-25T00:50:35.876870+0000","last_became_peered":"2024-04-25T00:50:35.876870+0000","last_unstale":"2024-04-25T00:50:37.231553+0000","last_undegraded":"2024-04-25T00:50:37.231553+0000","last_fullsized":"2024-04-25T00:50:37.231553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:53.474315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389593+0000","last_change":"2024-04-25T00:50:35.881027+0000","last_active":"2024-04-25T00:50:37.389593+0000","last_peered":"2024-04-25T00:50:37.389593+0000","last_clean":"2024-04-25T00:50:37.389593+0000","last_became_active":"2024-04-25T00:50:35.880477+0000","last_became_peered":"2024-04-25T00:50:35.880477+0000","last_unstale":"2024-04-25T00:50:37.389593+0000","last_undegraded":"2024-04-25T00:50:37.389593+0000","last_fullsized":"2024-04-25T00:50:37.389593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:55:59.176935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.364221+0000","last_change":"2024-04-25T00:50:35.765295+0000","last_active":"2024-04-25T00:50:37.364221+0000","last_peered":"2024-04-25T00:50:37.364221+0000","last_clean":"2024-04-25T00:50:37.364221+0000","last_became_active":"2024-04-25T00:50:35.764358+0000","last_became_peered":"2024-04-25T00:50:35.764358+0000","last_unstale":"2024-04-25T00:50:37.364221+0000","last_undegraded":"2024-04-25T00:50:37.364221+0000","last_fullsized":"2024-04-25T00:50:37.364221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:15.104631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297462+0000","last_change":"2024-04-25T00:50:35.869695+0000","last_active":"2024-04-25T00:50:37.297462+0000","last_peered":"2024-04-25T00:50:37.297462+0000","last_clean":"2024-04-25T00:50:37.297462+0000","last_became_active":"2024-04-25T00:50:35.868857+0000","last_became_peered":"2024-04-25T00:50:35.868857+0000","last_unstale":"2024-04-25T00:50:37.297462+0000","last_undegraded":"2024-04-25T00:50:37.297462+0000","last_fullsized":"2024-04-25T00:50:37.297462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:35:38.295580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389423+0000","last_change":"2024-04-25T00:50:35.884507+0000","last_active":"2024-04-25T00:50:37.389423+0000","last_peered":"2024-04-25T00:50:37.389423+0000","last_clean":"2024-04-25T00:50:37.389423+0000","last_became_active":"2024-04-25T00:50:35.883901+0000","last_became_peered":"2024-04-25T00:50:35.883901+0000","last_unstale":"2024-04-25T00:50:37.389423+0000","last_undegraded":"2024-04-25T00:50:37.389423+0000","last_fullsized":"2024-04-25T00:50:37.389423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:40.533818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107794+0000","last_change":"2024-04-25T00:50:35.878649+0000","last_active":"2024-04-25T00:50:38.107794+0000","last_peered":"2024-04-25T00:50:38.107794+0000","last_clean":"2024-04-25T00:50:38.107794+0000","last_became_active":"2024-04-25T00:50:35.877870+0000","last_became_peered":"2024-04-25T00:50:35.877870+0000","last_unstale":"2024-04-25T00:50:38.107794+0000","last_undegraded":"2024-04-25T00:50:38.107794+0000","last_fullsized":"2024-04-25T00:50:38.107794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232184+0000","last_change":"2024-04-25T00:50:35.869614+0000","last_active":"2024-04-25T00:50:37.232184+0000","last_peered":"2024-04-25T00:50:37.232184+0000","last_clean":"2024-04-25T00:50:37.232184+0000","last_became_active":"2024-04-25T00:50:35.869016+0000","last_became_peered":"2024-04-25T00:50:35.869016+0000","last_unstale":"2024-04-25T00:50:37.232184+0000","last_undegraded":"2024-04-25T00:50:37.232184+0000","last_fullsized":"2024-04-25T00:50:37.232184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:02.888747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107611+0000","last_change":"2024-04-25T00:50:35.728757+0000","last_active":"2024-04-25T00:50:38.107611+0000","last_peered":"2024-04-25T00:50:38.107611+0000","last_clean":"2024-04-25T00:50:38.107611+0000","last_became_active":"2024-04-25T00:50:35.728271+0000","last_became_peered":"2024-04-25T00:50:35.728271+0000","last_unstale":"2024-04-25T00:50:38.107611+0000","last_undegraded":"2024-04-25T00:50:38.107611+0000","last_fullsized":"2024-04-25T00:50:38.107611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:43.722114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363386+0000","last_change":"2024-04-25T00:50:35.802347+0000","last_active":"2024-04-25T00:50:37.363386+0000","last_peered":"2024-04-25T00:50:37.363386+0000","last_clean":"2024-04-25T00:50:37.363386+0000","last_became_active":"2024-04-25T00:50:35.801389+0000","last_became_peered":"2024-04-25T00:50:35.801389+0000","last_unstale":"2024-04-25T00:50:37.363386+0000","last_undegraded":"2024-04-25T00:50:37.363386+0000","last_fullsized":"2024-04-25T00:50:37.363386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:27.176441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.248607+0000","last_change":"2024-04-25T00:50:35.822222+0000","last_active":"2024-04-25T00:50:37.248607+0000","last_peered":"2024-04-25T00:50:37.248607+0000","last_clean":"2024-04-25T00:50:37.248607+0000","last_became_active":"2024-04-25T00:50:35.821484+0000","last_became_peered":"2024-04-25T00:50:35.821484+0000","last_unstale":"2024-04-25T00:50:37.248607+0000","last_undegraded":"2024-04-25T00:50:37.248607+0000","last_fullsized":"2024-04-25T00:50:37.248607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:59.921295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389330+0000","last_change":"2024-04-25T00:50:33.391742+0000","last_active":"2024-04-25T00:50:37.389330+0000","last_peered":"2024-04-25T00:50:37.389330+0000","last_clean":"2024-04-25T00:50:37.389330+0000","last_became_active":"2024-04-25T00:50:33.390901+0000","last_became_peered":"2024-04-25T00:50:33.390901+0000","last_unstale":"2024-04-25T00:50:37.389330+0000","last_undegraded":"2024-04-25T00:50:37.389330+0000","last_fullsized":"2024-04-25T00:50:37.389330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:27.804469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107862+0000","last_change":"2024-04-25T00:50:35.821496+0000","last_active":"2024-04-25T00:50:38.107862+0000","last_peered":"2024-04-25T00:50:38.107862+0000","last_clean":"2024-04-25T00:50:38.107862+0000","last_became_active":"2024-04-25T00:50:35.820763+0000","last_became_peered":"2024-04-25T00:50:35.820763+0000","last_unstale":"2024-04-25T00:50:38.107862+0000","last_undegraded":"2024-04-25T00:50:38.107862+0000","last_fullsized":"2024-04-25T00:50:38.107862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:15.698294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363497+0000","last_change":"2024-04-25T00:50:33.394753+0000","last_active":"2024-04-25T00:50:37.363497+0000","last_peered":"2024-04-25T00:50:37.363497+0000","last_clean":"2024-04-25T00:50:37.363497+0000","last_became_active":"2024-04-25T00:50:33.392951+0000","last_became_peered":"2024-04-25T00:50:33.392951+0000","last_unstale":"2024-04-25T00:50:37.363497+0000","last_undegraded":"2024-04-25T00:50:37.363497+0000","last_fullsized":"2024-04-25T00:50:37.363497+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:41.175588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388873+0000","last_change":"2024-04-25T00:50:33.393229+0000","last_active":"2024-04-25T00:50:37.388873+0000","last_peered":"2024-04-25T00:50:37.388873+0000","last_clean":"2024-04-25T00:50:37.388873+0000","last_became_active":"2024-04-25T00:50:33.392817+0000","last_became_peered":"2024-04-25T00:50:33.392817+0000","last_unstale":"2024-04-25T00:50:37.388873+0000","last_undegraded":"2024-04-25T00:50:37.388873+0000","last_fullsized":"2024-04-25T00:50:37.388873+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:31:12.131616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388809+0000","last_change":"2024-04-25T00:50:35.883390+0000","last_active":"2024-04-25T00:50:37.388809+0000","last_peered":"2024-04-25T00:50:37.388809+0000","last_clean":"2024-04-25T00:50:37.388809+0000","last_became_active":"2024-04-25T00:50:35.882509+0000","last_became_peered":"2024-04-25T00:50:35.882509+0000","last_unstale":"2024-04-25T00:50:37.388809+0000","last_undegraded":"2024-04-25T00:50:37.388809+0000","last_fullsized":"2024-04-25T00:50:37.388809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:05:17.996810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231803+0000","last_change":"2024-04-25T00:50:33.383755+0000","last_active":"2024-04-25T00:50:37.231803+0000","last_peered":"2024-04-25T00:50:37.231803+0000","last_clean":"2024-04-25T00:50:37.231803+0000","last_became_active":"2024-04-25T00:50:33.382925+0000","last_became_peered":"2024-04-25T00:50:33.382925+0000","last_unstale":"2024-04-25T00:50:37.231803+0000","last_undegraded":"2024-04-25T00:50:37.231803+0000","last_fullsized":"2024-04-25T00:50:37.231803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:52.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297234+0000","last_change":"2024-04-25T00:50:35.869794+0000","last_active":"2024-04-25T00:50:37.297234+0000","last_peered":"2024-04-25T00:50:37.297234+0000","last_clean":"2024-04-25T00:50:37.297234+0000","last_became_active":"2024-04-25T00:50:35.869028+0000","last_became_peered":"2024-04-25T00:50:35.869028+0000","last_unstale":"2024-04-25T00:50:37.297234+0000","last_undegraded":"2024-04-25T00:50:37.297234+0000","last_fullsized":"2024-04-25T00:50:37.297234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:49.891966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363903+0000","last_change":"2024-04-25T00:50:33.394082+0000","last_active":"2024-04-25T00:50:37.363903+0000","last_peered":"2024-04-25T00:50:37.363903+0000","last_clean":"2024-04-25T00:50:37.363903+0000","last_became_active":"2024-04-25T00:50:33.392792+0000","last_became_peered":"2024-04-25T00:50:33.392792+0000","last_unstale":"2024-04-25T00:50:37.363903+0000","last_undegraded":"2024-04-25T00:50:37.363903+0000","last_fullsized":"2024-04-25T00:50:37.363903+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:35:15.441104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.233002+0000","last_change":"2024-04-25T00:50:35.729414+0000","last_active":"2024-04-25T00:50:37.233002+0000","last_peered":"2024-04-25T00:50:37.233002+0000","last_clean":"2024-04-25T00:50:37.233002+0000","last_became_active":"2024-04-25T00:50:35.728725+0000","last_became_peered":"2024-04-25T00:50:35.728725+0000","last_unstale":"2024-04-25T00:50:37.233002+0000","last_undegraded":"2024-04-25T00:50:37.233002+0000","last_fullsized":"2024-04-25T00:50:37.233002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:05.046355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.233021+0000","last_change":"2024-04-25T00:50:33.388191+0000","last_active":"2024-04-25T00:50:37.233021+0000","last_peered":"2024-04-25T00:50:37.233021+0000","last_clean":"2024-04-25T00:50:37.233021+0000","last_became_active":"2024-04-25T00:50:33.387266+0000","last_became_peered":"2024-04-25T00:50:33.387266+0000","last_unstale":"2024-04-25T00:50:37.233021+0000","last_undegraded":"2024-04-25T00:50:37.233021+0000","last_fullsized":"2024-04-25T00:50:37.233021+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:08.400693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108034+0000","last_change":"2024-04-25T00:50:35.799783+0000","last_active":"2024-04-25T00:50:38.108034+0000","last_peered":"2024-04-25T00:50:38.108034+0000","last_clean":"2024-04-25T00:50:38.108034+0000","last_became_active":"2024-04-25T00:50:35.798471+0000","last_became_peered":"2024-04-25T00:50:35.798471+0000","last_unstale":"2024-04-25T00:50:38.108034+0000","last_undegraded":"2024-04-25T00:50:38.108034+0000","last_fullsized":"2024-04-25T00:50:38.108034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:15.104631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.472958+0000","last_change":"2024-04-25T00:50:33.304731+0000","last_active":"2024-04-25T00:50:38.472958+0000","last_peered":"2024-04-25T00:50:38.472958+0000","last_clean":"2024-04-25T00:50:38.472958+0000","last_became_active":"2024-04-25T00:50:33.303821+0000","last_became_peered":"2024-04-25T00:50:33.303821+0000","last_unstale":"2024-04-25T00:50:38.472958+0000","last_undegraded":"2024-04-25T00:50:38.472958+0000","last_fullsized":"2024-04-25T00:50:38.472958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:32.196488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.249633+0000","last_change":"2024-04-25T00:50:35.828727+0000","last_active":"2024-04-25T00:50:37.249633+0000","last_peered":"2024-04-25T00:50:37.249633+0000","last_clean":"2024-04-25T00:50:37.249633+0000","last_became_active":"2024-04-25T00:50:35.827617+0000","last_became_peered":"2024-04-25T00:50:35.827617+0000","last_unstale":"2024-04-25T00:50:37.249633+0000","last_undegraded":"2024-04-25T00:50:37.249633+0000","last_fullsized":"2024-04-25T00:50:37.249633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:30:10.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"26'6","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.470923+0000","last_change":"2024-04-25T00:50:33.391005+0000","last_active":"2024-04-25T00:50:38.470923+0000","last_peered":"2024-04-25T00:50:38.470923+0000","last_clean":"2024-04-25T00:50:38.470923+0000","last_became_active":"2024-04-25T00:50:33.390133+0000","last_became_peered":"2024-04-25T00:50:33.390133+0000","last_unstale":"2024-04-25T00:50:38.470923+0000","last_undegraded":"2024-04-25T00:50:38.470923+0000","last_fullsized":"2024-04-25T00:50:38.470923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:19.913188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108901+0000","last_change":"2024-04-25T00:50:35.876022+0000","last_active":"2024-04-25T00:50:38.108901+0000","last_peered":"2024-04-25T00:50:38.108901+0000","last_clean":"2024-04-25T00:50:38.108901+0000","last_became_active":"2024-04-25T00:50:35.875322+0000","last_became_peered":"2024-04-25T00:50:35.875322+0000","last_unstale":"2024-04-25T00:50:38.108901+0000","last_undegraded":"2024-04-25T00:50:38.108901+0000","last_fullsized":"2024-04-25T00:50:38.108901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.348199+0000","last_change":"2024-04-25T00:50:33.387295+0000","last_active":"2024-04-25T00:50:38.348199+0000","last_peered":"2024-04-25T00:50:38.348199+0000","last_clean":"2024-04-25T00:50:38.348199+0000","last_became_active":"2024-04-25T00:50:33.386297+0000","last_became_peered":"2024-04-25T00:50:33.386297+0000","last_unstale":"2024-04-25T00:50:38.348199+0000","last_undegraded":"2024-04-25T00:50:38.348199+0000","last_fullsized":"2024-04-25T00:50:38.348199+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:31:57.597514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107131+0000","last_change":"2024-04-25T00:50:35.796873+0000","last_active":"2024-04-25T00:50:38.107131+0000","last_peered":"2024-04-25T00:50:38.107131+0000","last_clean":"2024-04-25T00:50:38.107131+0000","last_became_active":"2024-04-25T00:50:35.796012+0000","last_became_peered":"2024-04-25T00:50:35.796012+0000","last_unstale":"2024-04-25T00:50:38.107131+0000","last_undegraded":"2024-04-25T00:50:38.107131+0000","last_fullsized":"2024-04-25T00:50:38.107131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:22.255073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232210+0000","last_change":"2024-04-25T00:50:33.385522+0000","last_active":"2024-04-25T00:50:37.232210+0000","last_peered":"2024-04-25T00:50:37.232210+0000","last_clean":"2024-04-25T00:50:37.232210+0000","last_became_active":"2024-04-25T00:50:33.384620+0000","last_became_peered":"2024-04-25T00:50:33.384620+0000","last_unstale":"2024-04-25T00:50:37.232210+0000","last_undegraded":"2024-04-25T00:50:37.232210+0000","last_fullsized":"2024-04-25T00:50:37.232210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:24.908029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108828+0000","last_change":"2024-04-25T00:50:35.820565+0000","last_active":"2024-04-25T00:50:38.108828+0000","last_peered":"2024-04-25T00:50:38.108828+0000","last_clean":"2024-04-25T00:50:38.108828+0000","last_became_active":"2024-04-25T00:50:35.819683+0000","last_became_peered":"2024-04-25T00:50:35.819683+0000","last_unstale":"2024-04-25T00:50:38.108828+0000","last_undegraded":"2024-04-25T00:50:38.108828+0000","last_fullsized":"2024-04-25T00:50:38.108828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:28.655307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363257+0000","last_change":"2024-04-25T00:50:33.390745+0000","last_active":"2024-04-25T00:50:37.363257+0000","last_peered":"2024-04-25T00:50:37.363257+0000","last_clean":"2024-04-25T00:50:37.363257+0000","last_became_active":"2024-04-25T00:50:33.390089+0000","last_became_peered":"2024-04-25T00:50:33.390089+0000","last_unstale":"2024-04-25T00:50:37.363257+0000","last_undegraded":"2024-04-25T00:50:37.363257+0000","last_fullsized":"2024-04-25T00:50:37.363257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:51.294701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363399+0000","last_change":"2024-04-25T00:50:35.801766+0000","last_active":"2024-04-25T00:50:37.363399+0000","last_peered":"2024-04-25T00:50:37.363399+0000","last_clean":"2024-04-25T00:50:37.363399+0000","last_became_active":"2024-04-25T00:50:35.801060+0000","last_became_peered":"2024-04-25T00:50:35.801060+0000","last_unstale":"2024-04-25T00:50:37.363399+0000","last_undegraded":"2024-04-25T00:50:37.363399+0000","last_fullsized":"2024-04-25T00:50:37.363399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"26'8","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.483755+0000","last_change":"2024-04-25T00:50:33.327283+0000","last_active":"2024-04-25T00:50:38.483755+0000","last_peered":"2024-04-25T00:50:38.483755+0000","last_clean":"2024-04-25T00:50:38.483755+0000","last_became_active":"2024-04-25T00:50:33.326464+0000","last_became_peered":"2024-04-25T00:50:33.326464+0000","last_unstale":"2024-04-25T00:50:38.483755+0000","last_undegraded":"2024-04-25T00:50:38.483755+0000","last_fullsized":"2024-04-25T00:50:38.483755+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:26:26.328621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108814+0000","last_change":"2024-04-25T00:50:35.825910+0000","last_active":"2024-04-25T00:50:38.108814+0000","last_peered":"2024-04-25T00:50:38.108814+0000","last_clean":"2024-04-25T00:50:38.108814+0000","last_became_active":"2024-04-25T00:50:35.825246+0000","last_became_peered":"2024-04-25T00:50:35.825246+0000","last_unstale":"2024-04-25T00:50:38.108814+0000","last_undegraded":"2024-04-25T00:50:38.108814+0000","last_fullsized":"2024-04-25T00:50:38.108814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:40.106788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.250173+0000","last_change":"2024-04-25T00:50:33.393856+0000","last_active":"2024-04-25T00:50:37.250173+0000","last_peered":"2024-04-25T00:50:37.250173+0000","last_clean":"2024-04-25T00:50:37.250173+0000","last_became_active":"2024-04-25T00:50:33.393153+0000","last_became_peered":"2024-04-25T00:50:33.393153+0000","last_unstale":"2024-04-25T00:50:37.250173+0000","last_undegraded":"2024-04-25T00:50:37.250173+0000","last_fullsized":"2024-04-25T00:50:37.250173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:55.179146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109662+0000","last_change":"2024-04-25T00:50:35.811993+0000","last_active":"2024-04-25T00:50:38.109662+0000","last_peered":"2024-04-25T00:50:38.109662+0000","last_clean":"2024-04-25T00:50:38.109662+0000","last_became_active":"2024-04-25T00:50:35.811267+0000","last_became_peered":"2024-04-25T00:50:35.811267+0000","last_unstale":"2024-04-25T00:50:38.109662+0000","last_undegraded":"2024-04-25T00:50:38.109662+0000","last_fullsized":"2024-04-25T00:50:38.109662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:40:20.385617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.476493+0000","last_change":"2024-04-25T00:50:33.383040+0000","last_active":"2024-04-25T00:50:38.476493+0000","last_peered":"2024-04-25T00:50:38.476493+0000","last_clean":"2024-04-25T00:50:38.476493+0000","last_became_active":"2024-04-25T00:50:33.382270+0000","last_became_peered":"2024-04-25T00:50:33.382270+0000","last_unstale":"2024-04-25T00:50:38.476493+0000","last_undegraded":"2024-04-25T00:50:38.476493+0000","last_fullsized":"2024-04-25T00:50:38.476493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:13.866739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109894+0000","last_change":"2024-04-25T00:50:35.818234+0000","last_active":"2024-04-25T00:50:38.109894+0000","last_peered":"2024-04-25T00:50:38.109894+0000","last_clean":"2024-04-25T00:50:38.109894+0000","last_became_active":"2024-04-25T00:50:35.817707+0000","last_became_peered":"2024-04-25T00:50:35.817707+0000","last_unstale":"2024-04-25T00:50:38.109894+0000","last_undegraded":"2024-04-25T00:50:38.109894+0000","last_fullsized":"2024-04-25T00:50:38.109894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:31.998886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297643+0000","last_change":"2024-04-25T00:50:33.389774+0000","last_active":"2024-04-25T00:50:37.297643+0000","last_peered":"2024-04-25T00:50:37.297643+0000","last_clean":"2024-04-25T00:50:37.297643+0000","last_became_active":"2024-04-25T00:50:33.389092+0000","last_became_peered":"2024-04-25T00:50:33.389092+0000","last_unstale":"2024-04-25T00:50:37.297643+0000","last_undegraded":"2024-04-25T00:50:37.297643+0000","last_fullsized":"2024-04-25T00:50:37.297643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:30.722771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232278+0000","last_change":"2024-04-25T00:50:35.869211+0000","last_active":"2024-04-25T00:50:37.232278+0000","last_peered":"2024-04-25T00:50:37.232278+0000","last_clean":"2024-04-25T00:50:37.232278+0000","last_became_active":"2024-04-25T00:50:35.868798+0000","last_became_peered":"2024-04-25T00:50:35.868798+0000","last_unstale":"2024-04-25T00:50:37.232278+0000","last_undegraded":"2024-04-25T00:50:37.232278+0000","last_fullsized":"2024-04-25T00:50:37.232278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:40.106788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107006+0000","last_change":"2024-04-25T00:50:33.329578+0000","last_active":"2024-04-25T00:50:38.107006+0000","last_peered":"2024-04-25T00:50:38.107006+0000","last_clean":"2024-04-25T00:50:38.107006+0000","last_became_active":"2024-04-25T00:50:33.328950+0000","last_became_peered":"2024-04-25T00:50:33.328950+0000","last_unstale":"2024-04-25T00:50:38.107006+0000","last_undegraded":"2024-04-25T00:50:38.107006+0000","last_fullsized":"2024-04-25T00:50:38.107006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:55.179146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109245+0000","last_change":"2024-04-25T00:50:35.734419+0000","last_active":"2024-04-25T00:50:38.109245+0000","last_peered":"2024-04-25T00:50:38.109245+0000","last_clean":"2024-04-25T00:50:38.109245+0000","last_became_active":"2024-04-25T00:50:35.733696+0000","last_became_peered":"2024-04-25T00:50:35.733696+0000","last_unstale":"2024-04-25T00:50:38.109245+0000","last_undegraded":"2024-04-25T00:50:38.109245+0000","last_fullsized":"2024-04-25T00:50:38.109245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:05.046355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":175,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108342+0000","last_change":"2024-04-25T00:49:55.281216+0000","last_active":"2024-04-25T00:50:38.108342+0000","last_peered":"2024-04-25T00:50:38.108342+0000","last_clean":"2024-04-25T00:50:38.108342+0000","last_became_active":"2024-04-25T00:49:55.278022+0000","last_became_peered":"2024-04-25T00:49:55.278022+0000","last_unstale":"2024-04-25T00:50:38.108342+0000","last_undegraded":"2024-04-25T00:50:38.108342+0000","last_fullsized":"2024-04-25T00:50:38.108342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:49:52.475299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:49:52.475299+0000","last_clean_scrub_stamp":"2024-04-25T00:49:52.475299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:17.046656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231603+0000","last_change":"2024-04-25T00:50:33.325228+0000","last_active":"2024-04-25T00:50:37.231603+0000","last_peered":"2024-04-25T00:50:37.231603+0000","last_clean":"2024-04-25T00:50:37.231603+0000","last_became_active":"2024-04-25T00:50:33.324579+0000","last_became_peered":"2024-04-25T00:50:33.324579+0000","last_unstale":"2024-04-25T00:50:37.231603+0000","last_undegraded":"2024-04-25T00:50:37.231603+0000","last_fullsized":"2024-04-25T00:50:37.231603+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:12.762746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388819+0000","last_change":"2024-04-25T00:50:35.880348+0000","last_active":"2024-04-25T00:50:37.388819+0000","last_peered":"2024-04-25T00:50:37.388819+0000","last_clean":"2024-04-25T00:50:37.388819+0000","last_became_active":"2024-04-25T00:50:35.878438+0000","last_became_peered":"2024-04-25T00:50:35.878438+0000","last_unstale":"2024-04-25T00:50:37.388819+0000","last_undegraded":"2024-04-25T00:50:37.388819+0000","last_fullsized":"2024-04-25T00:50:37.388819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:44.093119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108174+0000","last_change":"2024-04-25T00:50:33.321385+0000","last_active":"2024-04-25T00:50:38.108174+0000","last_peered":"2024-04-25T00:50:38.108174+0000","last_clean":"2024-04-25T00:50:38.108174+0000","last_became_active":"2024-04-25T00:50:33.320800+0000","last_became_peered":"2024-04-25T00:50:33.320800+0000","last_unstale":"2024-04-25T00:50:38.108174+0000","last_undegraded":"2024-04-25T00:50:38.108174+0000","last_fullsized":"2024-04-25T00:50:38.108174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:04.254885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107400+0000","last_change":"2024-04-25T00:50:35.815056+0000","last_active":"2024-04-25T00:50:38.107400+0000","last_peered":"2024-04-25T00:50:38.107400+0000","last_clean":"2024-04-25T00:50:38.107400+0000","last_became_active":"2024-04-25T00:50:35.814163+0000","last_became_peered":"2024-04-25T00:50:35.814163+0000","last_unstale":"2024-04-25T00:50:38.107400+0000","last_undegraded":"2024-04-25T00:50:38.107400+0000","last_fullsized":"2024-04-25T00:50:38.107400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:50:52.289674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107554+0000","last_change":"2024-04-25T00:50:33.384695+0000","last_active":"2024-04-25T00:50:38.107554+0000","last_peered":"2024-04-25T00:50:38.107554+0000","last_clean":"2024-04-25T00:50:38.107554+0000","last_became_active":"2024-04-25T00:50:33.383692+0000","last_became_peered":"2024-04-25T00:50:33.383692+0000","last_unstale":"2024-04-25T00:50:38.107554+0000","last_undegraded":"2024-04-25T00:50:38.107554+0000","last_fullsized":"2024-04-25T00:50:38.107554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:57.579410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297265+0000","last_change":"2024-04-25T00:50:35.723048+0000","last_active":"2024-04-25T00:50:37.297265+0000","last_peered":"2024-04-25T00:50:37.297265+0000","last_clean":"2024-04-25T00:50:37.297265+0000","last_became_active":"2024-04-25T00:50:35.722500+0000","last_became_peered":"2024-04-25T00:50:35.722500+0000","last_unstale":"2024-04-25T00:50:37.297265+0000","last_undegraded":"2024-04-25T00:50:37.297265+0000","last_fullsized":"2024-04-25T00:50:37.297265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:20:39.082516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232389+0000","last_change":"2024-04-25T00:50:33.305927+0000","last_active":"2024-04-25T00:50:37.232389+0000","last_peered":"2024-04-25T00:50:37.232389+0000","last_clean":"2024-04-25T00:50:37.232389+0000","last_became_active":"2024-04-25T00:50:33.305159+0000","last_became_peered":"2024-04-25T00:50:33.305159+0000","last_unstale":"2024-04-25T00:50:37.232389+0000","last_undegraded":"2024-04-25T00:50:37.232389+0000","last_fullsized":"2024-04-25T00:50:37.232389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:46:56.639410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.248677+0000","last_change":"2024-04-25T00:50:35.824491+0000","last_active":"2024-04-25T00:50:37.248677+0000","last_peered":"2024-04-25T00:50:37.248677+0000","last_clean":"2024-04-25T00:50:37.248677+0000","last_became_active":"2024-04-25T00:50:35.823320+0000","last_became_peered":"2024-04-25T00:50:35.823320+0000","last_unstale":"2024-04-25T00:50:37.248677+0000","last_undegraded":"2024-04-25T00:50:37.248677+0000","last_fullsized":"2024-04-25T00:50:37.248677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:57.466393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297427+0000","last_change":"2024-04-25T00:50:33.304490+0000","last_active":"2024-04-25T00:50:37.297427+0000","last_peered":"2024-04-25T00:50:37.297427+0000","last_clean":"2024-04-25T00:50:37.297427+0000","last_became_active":"2024-04-25T00:50:33.303671+0000","last_became_peered":"2024-04-25T00:50:33.303671+0000","last_unstale":"2024-04-25T00:50:37.297427+0000","last_undegraded":"2024-04-25T00:50:37.297427+0000","last_fullsized":"2024-04-25T00:50:37.297427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:30.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.233156+0000","last_change":"2024-04-25T00:50:35.878641+0000","last_active":"2024-04-25T00:50:37.233156+0000","last_peered":"2024-04-25T00:50:37.233156+0000","last_clean":"2024-04-25T00:50:37.233156+0000","last_became_active":"2024-04-25T00:50:35.876958+0000","last_became_peered":"2024-04-25T00:50:35.876958+0000","last_unstale":"2024-04-25T00:50:37.233156+0000","last_undegraded":"2024-04-25T00:50:37.233156+0000","last_fullsized":"2024-04-25T00:50:37.233156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:59.565909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109722+0000","last_change":"2024-04-25T00:50:33.319229+0000","last_active":"2024-04-25T00:50:38.109722+0000","last_peered":"2024-04-25T00:50:38.109722+0000","last_clean":"2024-04-25T00:50:38.109722+0000","last_became_active":"2024-04-25T00:50:33.318945+0000","last_became_peered":"2024-04-25T00:50:33.318945+0000","last_unstale":"2024-04-25T00:50:38.109722+0000","last_undegraded":"2024-04-25T00:50:38.109722+0000","last_fullsized":"2024-04-25T00:50:38.109722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:51.132430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297603+0000","last_change":"2024-04-25T00:50:35.722521+0000","last_active":"2024-04-25T00:50:37.297603+0000","last_peered":"2024-04-25T00:50:37.297603+0000","last_clean":"2024-04-25T00:50:37.297603+0000","last_became_active":"2024-04-25T00:50:35.722128+0000","last_became_peered":"2024-04-25T00:50:35.722128+0000","last_unstale":"2024-04-25T00:50:37.297603+0000","last_undegraded":"2024-04-25T00:50:37.297603+0000","last_fullsized":"2024-04-25T00:50:37.297603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:59:36.793140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297781+0000","last_change":"2024-04-25T00:50:33.387402+0000","last_active":"2024-04-25T00:50:37.297781+0000","last_peered":"2024-04-25T00:50:37.297781+0000","last_clean":"2024-04-25T00:50:37.297781+0000","last_became_active":"2024-04-25T00:50:33.386631+0000","last_became_peered":"2024-04-25T00:50:33.386631+0000","last_unstale":"2024-04-25T00:50:37.297781+0000","last_undegraded":"2024-04-25T00:50:37.297781+0000","last_fullsized":"2024-04-25T00:50:37.297781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:11:49.105412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389751+0000","last_change":"2024-04-25T00:50:35.882715+0000","last_active":"2024-04-25T00:50:37.389751+0000","last_peered":"2024-04-25T00:50:37.389751+0000","last_clean":"2024-04-25T00:50:37.389751+0000","last_became_active":"2024-04-25T00:50:35.878416+0000","last_became_peered":"2024-04-25T00:50:35.878416+0000","last_unstale":"2024-04-25T00:50:37.389751+0000","last_undegraded":"2024-04-25T00:50:37.389751+0000","last_fullsized":"2024-04-25T00:50:37.389751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:35.413796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.462189+0000","last_change":"2024-04-25T00:50:33.393211+0000","last_active":"2024-04-25T00:50:38.462189+0000","last_peered":"2024-04-25T00:50:38.462189+0000","last_clean":"2024-04-25T00:50:38.462189+0000","last_became_active":"2024-04-25T00:50:33.392381+0000","last_became_peered":"2024-04-25T00:50:33.392381+0000","last_unstale":"2024-04-25T00:50:38.462189+0000","last_undegraded":"2024-04-25T00:50:38.462189+0000","last_fullsized":"2024-04-25T00:50:38.462189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:18:05.276269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107930+0000","last_change":"2024-04-25T00:50:35.798491+0000","last_active":"2024-04-25T00:50:38.107930+0000","last_peered":"2024-04-25T00:50:38.107930+0000","last_clean":"2024-04-25T00:50:38.107930+0000","last_became_active":"2024-04-25T00:50:35.796775+0000","last_became_peered":"2024-04-25T00:50:35.796775+0000","last_unstale":"2024-04-25T00:50:38.107930+0000","last_undegraded":"2024-04-25T00:50:38.107930+0000","last_fullsized":"2024-04-25T00:50:38.107930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:54.948867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108161+0000","last_change":"2024-04-25T00:50:33.321163+0000","last_active":"2024-04-25T00:50:38.108161+0000","last_peered":"2024-04-25T00:50:38.108161+0000","last_clean":"2024-04-25T00:50:38.108161+0000","last_became_active":"2024-04-25T00:50:33.320554+0000","last_became_peered":"2024-04-25T00:50:33.320554+0000","last_unstale":"2024-04-25T00:50:38.108161+0000","last_undegraded":"2024-04-25T00:50:38.108161+0000","last_fullsized":"2024-04-25T00:50:38.108161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:13.533462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.248575+0000","last_change":"2024-04-25T00:50:35.824154+0000","last_active":"2024-04-25T00:50:37.248575+0000","last_peered":"2024-04-25T00:50:37.248575+0000","last_clean":"2024-04-25T00:50:37.248575+0000","last_became_active":"2024-04-25T00:50:35.823269+0000","last_became_peered":"2024-04-25T00:50:35.823269+0000","last_unstale":"2024-04-25T00:50:37.248575+0000","last_undegraded":"2024-04-25T00:50:37.248575+0000","last_fullsized":"2024-04-25T00:50:37.248575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:16.208624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.518358+0000","last_change":"2024-04-25T00:50:33.319985+0000","last_active":"2024-04-25T00:50:43.518358+0000","last_peered":"2024-04-25T00:50:43.518358+0000","last_clean":"2024-04-25T00:50:43.518358+0000","last_became_active":"2024-04-25T00:50:33.319198+0000","last_became_peered":"2024-04-25T00:50:33.319198+0000","last_unstale":"2024-04-25T00:50:43.518358+0000","last_undegraded":"2024-04-25T00:50:43.518358+0000","last_fullsized":"2024-04-25T00:50:43.518358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:01.398188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388961+0000","last_change":"2024-04-25T00:50:35.883007+0000","last_active":"2024-04-25T00:50:37.388961+0000","last_peered":"2024-04-25T00:50:37.388961+0000","last_clean":"2024-04-25T00:50:37.388961+0000","last_became_active":"2024-04-25T00:50:35.881829+0000","last_became_peered":"2024-04-25T00:50:35.881829+0000","last_unstale":"2024-04-25T00:50:37.388961+0000","last_undegraded":"2024-04-25T00:50:37.388961+0000","last_fullsized":"2024-04-25T00:50:37.388961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:02.444745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297383+0000","last_change":"2024-04-25T00:50:33.384397+0000","last_active":"2024-04-25T00:50:37.297383+0000","last_peered":"2024-04-25T00:50:37.297383+0000","last_clean":"2024-04-25T00:50:37.297383+0000","last_became_active":"2024-04-25T00:50:33.383622+0000","last_became_peered":"2024-04-25T00:50:33.383622+0000","last_unstale":"2024-04-25T00:50:37.297383+0000","last_undegraded":"2024-04-25T00:50:37.297383+0000","last_fullsized":"2024-04-25T00:50:37.297383+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:31.816914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389114+0000","last_change":"2024-04-25T00:50:35.881976+0000","last_active":"2024-04-25T00:50:37.389114+0000","last_peered":"2024-04-25T00:50:37.389114+0000","last_clean":"2024-04-25T00:50:37.389114+0000","last_became_active":"2024-04-25T00:50:35.881269+0000","last_became_peered":"2024-04-25T00:50:35.881269+0000","last_unstale":"2024-04-25T00:50:37.389114+0000","last_undegraded":"2024-04-25T00:50:37.389114+0000","last_fullsized":"2024-04-25T00:50:37.389114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:54.302741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.335792+0000","last_change":"2024-04-25T00:50:33.390041+0000","last_active":"2024-04-25T00:50:38.335792+0000","last_peered":"2024-04-25T00:50:38.335792+0000","last_clean":"2024-04-25T00:50:38.335792+0000","last_became_active":"2024-04-25T00:50:33.389095+0000","last_became_peered":"2024-04-25T00:50:33.389095+0000","last_unstale":"2024-04-25T00:50:38.335792+0000","last_undegraded":"2024-04-25T00:50:38.335792+0000","last_fullsized":"2024-04-25T00:50:38.335792+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:00.569613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363413+0000","last_change":"2024-04-25T00:50:35.812195+0000","last_active":"2024-04-25T00:50:37.363413+0000","last_peered":"2024-04-25T00:50:37.363413+0000","last_clean":"2024-04-25T00:50:37.363413+0000","last_became_active":"2024-04-25T00:50:35.811410+0000","last_became_peered":"2024-04-25T00:50:35.811410+0000","last_unstale":"2024-04-25T00:50:37.363413+0000","last_undegraded":"2024-04-25T00:50:37.363413+0000","last_fullsized":"2024-04-25T00:50:37.363413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:06.596770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232746+0000","last_change":"2024-04-25T00:50:35.821808+0000","last_active":"2024-04-25T00:50:37.232746+0000","last_peered":"2024-04-25T00:50:37.232746+0000","last_clean":"2024-04-25T00:50:37.232746+0000","last_became_active":"2024-04-25T00:50:35.821062+0000","last_became_peered":"2024-04-25T00:50:35.821062+0000","last_unstale":"2024-04-25T00:50:37.232746+0000","last_undegraded":"2024-04-25T00:50:37.232746+0000","last_fullsized":"2024-04-25T00:50:37.232746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.328036+0000","last_change":"2024-04-25T00:50:33.319853+0000","last_active":"2024-04-25T00:50:38.328036+0000","last_peered":"2024-04-25T00:50:38.328036+0000","last_clean":"2024-04-25T00:50:38.328036+0000","last_became_active":"2024-04-25T00:50:33.319197+0000","last_became_peered":"2024-04-25T00:50:33.319197+0000","last_unstale":"2024-04-25T00:50:38.328036+0000","last_undegraded":"2024-04-25T00:50:38.328036+0000","last_fullsized":"2024-04-25T00:50:38.328036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:24.834556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232234+0000","last_change":"2024-04-25T00:50:35.812044+0000","last_active":"2024-04-25T00:50:37.232234+0000","last_peered":"2024-04-25T00:50:37.232234+0000","last_clean":"2024-04-25T00:50:37.232234+0000","last_became_active":"2024-04-25T00:50:35.811281+0000","last_became_peered":"2024-04-25T00:50:35.811281+0000","last_unstale":"2024-04-25T00:50:37.232234+0000","last_undegraded":"2024-04-25T00:50:37.232234+0000","last_fullsized":"2024-04-25T00:50:37.232234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:28.655307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.328167+0000","last_change":"2024-04-25T00:50:33.382775+0000","last_active":"2024-04-25T00:50:38.328167+0000","last_peered":"2024-04-25T00:50:38.328167+0000","last_clean":"2024-04-25T00:50:38.328167+0000","last_became_active":"2024-04-25T00:50:33.382218+0000","last_became_peered":"2024-04-25T00:50:33.382218+0000","last_unstale":"2024-04-25T00:50:38.328167+0000","last_undegraded":"2024-04-25T00:50:38.328167+0000","last_fullsized":"2024-04-25T00:50:38.328167+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:52.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107894+0000","last_change":"2024-04-25T00:50:35.802543+0000","last_active":"2024-04-25T00:50:38.107894+0000","last_peered":"2024-04-25T00:50:38.107894+0000","last_clean":"2024-04-25T00:50:38.107894+0000","last_became_active":"2024-04-25T00:50:35.801799+0000","last_became_peered":"2024-04-25T00:50:35.801799+0000","last_unstale":"2024-04-25T00:50:38.107894+0000","last_undegraded":"2024-04-25T00:50:38.107894+0000","last_fullsized":"2024-04-25T00:50:38.107894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:15.875347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389661+0000","last_change":"2024-04-25T00:50:33.389565+0000","last_active":"2024-04-25T00:50:37.389661+0000","last_peered":"2024-04-25T00:50:37.389661+0000","last_clean":"2024-04-25T00:50:37.389661+0000","last_became_active":"2024-04-25T00:50:33.388773+0000","last_became_peered":"2024-04-25T00:50:33.388773+0000","last_unstale":"2024-04-25T00:50:37.389661+0000","last_undegraded":"2024-04-25T00:50:37.389661+0000","last_fullsized":"2024-04-25T00:50:37.389661+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:42.721375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389537+0000","last_change":"2024-04-25T00:50:35.877410+0000","last_active":"2024-04-25T00:50:37.389537+0000","last_peered":"2024-04-25T00:50:37.389537+0000","last_clean":"2024-04-25T00:50:37.389537+0000","last_became_active":"2024-04-25T00:50:35.876576+0000","last_became_peered":"2024-04-25T00:50:35.876576+0000","last_unstale":"2024-04-25T00:50:37.389537+0000","last_undegraded":"2024-04-25T00:50:37.389537+0000","last_fullsized":"2024-04-25T00:50:37.389537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:15.762503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.352944+0000","last_change":"2024-04-25T00:50:33.319601+0000","last_active":"2024-04-25T00:50:38.352944+0000","last_peered":"2024-04-25T00:50:38.352944+0000","last_clean":"2024-04-25T00:50:38.352944+0000","last_became_active":"2024-04-25T00:50:33.318940+0000","last_became_peered":"2024-04-25T00:50:33.318940+0000","last_unstale":"2024-04-25T00:50:38.352944+0000","last_undegraded":"2024-04-25T00:50:38.352944+0000","last_fullsized":"2024-04-25T00:50:38.352944+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:41.175588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3082,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":5492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476751,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":687141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476751,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":97803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476751,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":96281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476749,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":96317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476750,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":96191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":97803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509454,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":687197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":96351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T00:50:47.898 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T00:50:47.899 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T00:50:47.899 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T00:50:47.899 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T00:50:47.899 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T00:50:48.057 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.057+0000 7f9dc616c640 1 Processor -- start 2024-04-25T00:50:48.057 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.057+0000 7f9dc616c640 1 -- start start 2024-04-25T00:50:48.058 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.057+0000 7f9dc616c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9dc0150b90 0x7f9dc0073120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:48.058 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.057+0000 7f9dc616c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9dc00c6f60 0x7f9dc006daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:48.058 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.057+0000 7f9dc616c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dc00c2dc0 con 0x7f9dc006dfe0 2024-04-25T00:50:48.058 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.057+0000 7f9dc616c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9dc00c3360 con 0x7f9dc00c6f60 2024-04-25T00:50:48.058 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.057+0000 7f9dc616c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f9dc00c62c0 con 0x7f9dc0150b90 2024-04-25T00:50:48.059 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.057+0000 7f9db6ffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9dc00c6f60 0x7f9dc006daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:48.059 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.057+0000 7f9dbffff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f9dc006dfe0 0x7f9dc00c7890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:49544/0 (socket says 172.21.15.162:49544) 2024-04-25T00:50:48.059 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.057+0000 7f9dbffff640 1 -- 172.21.15.162:0/165740611 learned_addr learned my addr 172.21.15.162:0/165740611 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:48.059 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.057+0000 7f9dbf7fe640 1 --2- 172.21.15.162:0/165740611 >> v2:172.21.15.179:3300/0 conn(0x7f9dc0150b90 0x7f9dc0073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:48.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.061+0000 7f9db6ffd640 1 -- 172.21.15.162:0/165740611 >> v2:172.21.15.179:3300/0 conn(0x7f9dc0150b90 msgr2=0x7f9dc0073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:48.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.061+0000 7f9db6ffd640 1 --2- 172.21.15.162:0/165740611 >> v2:172.21.15.179:3300/0 conn(0x7f9dc0150b90 0x7f9dc0073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:48.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.061+0000 7f9db6ffd640 1 -- 172.21.15.162:0/165740611 >> v1:172.21.15.162:6789/0 conn(0x7f9dc006dfe0 legacy=0x7f9dc00c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:48.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.061+0000 7f9db6ffd640 1 -- 172.21.15.162:0/165740611 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc00c3080 con 0x7f9dc00c6f60 2024-04-25T00:50:48.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.065+0000 7f9db6ffd640 1 --2- 172.21.15.162:0/165740611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dc00c6f60 0x7f9dc006daa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00c6440 tx=0x7f9da801d830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110dbb85f4ee19e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:48.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.069+0000 7f9dbeffd640 1 -- 172.21.15.162:0/165740611 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da800b040 con 0x7f9dc00c6f60 2024-04-25T00:50:48.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.069+0000 7f9dbeffd640 1 -- 172.21.15.162:0/165740611 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da80a7710 con 0x7f9dc00c6f60 2024-04-25T00:50:48.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.069+0000 7f9dbeffd640 1 -- 172.21.15.162:0/165740611 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da80a7ae0 con 0x7f9dc00c6f60 2024-04-25T00:50:48.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.069+0000 7f9dc616c640 1 -- 172.21.15.162:0/165740611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dc00c6f60 msgr2=0x7f9dc006daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:48.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.069+0000 7f9dc616c640 1 --2- 172.21.15.162:0/165740611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dc00c6f60 0x7f9dc006daa0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00c6440 tx=0x7f9da801d830 comp rx=0 tx=0).stop 2024-04-25T00:50:48.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.069+0000 7f9dc616c640 1 -- 172.21.15.162:0/165740611 shutdown_connections 2024-04-25T00:50:48.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.069+0000 7f9dc616c640 1 --2- 172.21.15.162:0/165740611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dc00c6f60 0x7f9dc006daa0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:48.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.069+0000 7f9dc616c640 1 --2- 172.21.15.162:0/165740611 >> v2:172.21.15.179:3300/0 conn(0x7f9dc0150b90 0x7f9dc0073120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:48.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.069+0000 7f9dc616c640 1 -- 172.21.15.162:0/165740611 >> 172.21.15.162:0/165740611 conn(0x7f9dc00c83c0 msgr2=0x7f9dc00c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:48.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.069+0000 7f9dc616c640 1 -- 172.21.15.162:0/165740611 shutdown_connections 2024-04-25T00:50:48.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.069+0000 7f9dc616c640 1 -- 172.21.15.162:0/165740611 wait complete. 2024-04-25T00:50:48.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.073+0000 7f9dc616c640 1 Processor -- start 2024-04-25T00:50:48.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.073+0000 7f9dc616c640 1 -- start start 2024-04-25T00:50:48.074 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.073+0000 7f9dc616c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9dc006dfe0 0x7f9dc0142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:48.074 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.073+0000 7f9dc616c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dc00c6f60 0x7f9dc013d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:48.074 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.073+0000 7f9dc616c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dc0150b90 0x7f9dc013d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:48.074 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.073+0000 7f9dc616c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc0072bf0 con 0x7f9dc00c6f60 2024-04-25T00:50:48.074 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.073+0000 7f9dc616c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc0150f70 con 0x7f9dc0150b90 2024-04-25T00:50:48.074 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.073+0000 7f9dc616c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9dc014a600 con 0x7f9dc006dfe0 2024-04-25T00:50:48.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.073+0000 7f9db6ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dc00c6f60 0x7f9dc013d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:48.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.073+0000 7f9dbf7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9dc006dfe0 0x7f9dc0142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:48.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.073+0000 7f9dbffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dc0150b90 0x7f9dc013d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:48.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.077+0000 7f9dbffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dc0150b90 0x7f9dc013d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:41682/0 (socket says 172.21.15.162:41682) 2024-04-25T00:50:48.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.077+0000 7f9dbffff640 1 -- 172.21.15.162:0/3191631893 learned_addr learned my addr 172.21.15.162:0/3191631893 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:48.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.077+0000 7f9db6ffd640 1 -- 172.21.15.162:0/3191631893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9dc006dfe0 msgr2=0x7f9dc0142da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:48.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.077+0000 7f9db6ffd640 1 --2- 172.21.15.162:0/3191631893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9dc006dfe0 0x7f9dc0142da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:48.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.077+0000 7f9db6ffd640 1 -- 172.21.15.162:0/3191631893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dc0150b90 msgr2=0x7f9dc013d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:48.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.077+0000 7f9db6ffd640 1 --2- 172.21.15.162:0/3191631893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dc0150b90 0x7f9dc013d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:48.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.077+0000 7f9db6ffd640 1 -- 172.21.15.162:0/3191631893 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc014a320 con 0x7f9dc00c6f60 2024-04-25T00:50:48.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.081+0000 7f9db6ffd640 1 --2- 172.21.15.162:0/3191631893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dc00c6f60 0x7f9dc013d1b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9da80ad000 tx=0x7f9da801a5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:48.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.085+0000 7f9dbcff9640 1 -- 172.21.15.162:0/3191631893 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da80b8650 con 0x7f9dc00c6f60 2024-04-25T00:50:48.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.085+0000 7f9dbcff9640 1 -- 172.21.15.162:0/3191631893 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da80bf070 con 0x7f9dc00c6f60 2024-04-25T00:50:48.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.085+0000 7f9dbcff9640 1 -- 172.21.15.162:0/3191631893 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da80b8a30 con 0x7f9dc00c6f60 2024-04-25T00:50:48.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.085+0000 7f9dc616c640 1 -- 172.21.15.162:0/3191631893 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc0148520 con 0x7f9dc00c6f60 2024-04-25T00:50:48.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.085+0000 7f9dc616c640 1 -- 172.21.15.162:0/3191631893 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc01499f0 con 0x7f9dc00c6f60 2024-04-25T00:50:48.087 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.085+0000 7f9dc616c640 1 -- 172.21.15.162:0/3191631893 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc00c34f0 con 0x7f9dc00c6f60 2024-04-25T00:50:48.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.413+0000 7f9dbcff9640 1 -- 172.21.15.162:0/3191631893 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9da80b8bd0 con 0x7f9dc00c6f60 2024-04-25T00:50:48.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.413+0000 7f9dbcff9640 1 --2- 172.21.15.162:0/3191631893 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9da00678c0 0x7f9da0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:48.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.413+0000 7f9dbf7fe640 1 --2- 172.21.15.162:0/3191631893 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9da00678c0 0x7f9da0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:48.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.413+0000 7f9dbf7fe640 1 --2- 172.21.15.162:0/3191631893 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9da00678c0 0x7f9da0069d80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009ac0 tx=0x7f9db0009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:48.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.449+0000 7f9dbcff9640 1 -- 172.21.15.162:0/3191631893 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f9da80ef9f0 con 0x7f9dc00c6f60 2024-04-25T00:50:48.451 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.449+0000 7f9dbcff9640 1 -- 172.21.15.162:0/3191631893 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f9da8017420 con 0x7f9dc00c6f60 2024-04-25T00:50:48.669 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.669+0000 7f9dc616c640 1 -- 172.21.15.162:0/3191631893 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9dc004f5f0 con 0x7f9dc00c6f60 2024-04-25T00:50:48.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.861+0000 7f9dbcff9640 1 -- 172.21.15.162:0/3191631893 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166894 (secure 0 0 0) 0x7f9da80f1950 con 0x7f9dc00c6f60 2024-04-25T00:50:48.866 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:48.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.865+0000 7f9dc616c640 1 -- 172.21.15.162:0/3191631893 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9da00678c0 msgr2=0x7f9da0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:48.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.865+0000 7f9dc616c640 1 --2- 172.21.15.162:0/3191631893 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9da00678c0 0x7f9da0069d80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9db0009ac0 tx=0x7f9db0009190 comp rx=0 tx=0).stop 2024-04-25T00:50:48.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.865+0000 7f9dc616c640 1 -- 172.21.15.162:0/3191631893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dc00c6f60 msgr2=0x7f9dc013d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:48.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.865+0000 7f9dc616c640 1 --2- 172.21.15.162:0/3191631893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dc00c6f60 0x7f9dc013d1b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9da80ad000 tx=0x7f9da801a5d0 comp rx=0 tx=0).stop 2024-04-25T00:50:48.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.865+0000 7f9dc616c640 1 -- 172.21.15.162:0/3191631893 shutdown_connections 2024-04-25T00:50:48.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.865+0000 7f9dc616c640 1 --2- 172.21.15.162:0/3191631893 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9dc0150b90 0x7f9dc013d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:48.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.865+0000 7f9dc616c640 1 --2- 172.21.15.162:0/3191631893 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9da00678c0 0x7f9da0069d80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:48.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.865+0000 7f9dc616c640 1 --2- 172.21.15.162:0/3191631893 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9dc00c6f60 0x7f9dc013d1b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:48.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.865+0000 7f9dc616c640 1 --2- 172.21.15.162:0/3191631893 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9dc006dfe0 0x7f9dc0142da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:48.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.865+0000 7f9dc616c640 1 -- 172.21.15.162:0/3191631893 >> 172.21.15.162:0/3191631893 conn(0x7f9dc00c83c0 msgr2=0x7f9dc0071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:48.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.865+0000 7f9dc616c640 1 -- 172.21.15.162:0/3191631893 shutdown_connections 2024-04-25T00:50:48.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:48.865+0000 7f9dc616c640 1 -- 172.21.15.162:0/3191631893 wait complete. 2024-04-25T00:50:48.886 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":5,"flags":0,"active_gid":4100,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6800","nonce":3960394531},{"type":"v1","addr":"172.21.15.162:6801","nonce":3960394531}]},"active_addr":"172.21.15.162:6801/3960394531","active_change":"2024-04-25T00:49:37.165272+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4113,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":2517146810}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":2013394072}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":1172855380}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.162:0","nonce":2945420065}]}]} 2024-04-25T00:50:48.889 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T00:50:48.889 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T00:50:48.890 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T00:50:49.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.013+0000 7f6361b66640 1 Processor -- start 2024-04-25T00:50:49.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.013+0000 7f6361b66640 1 -- start start 2024-04-25T00:50:49.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.013+0000 7f6361b66640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f635c1581c0 0x7f635c0c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:49.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.013+0000 7f6361b66640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f635c15c200 0x7f635c0c6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:49.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.013+0000 7f6361b66640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635c072f60 con 0x7f635c152320 2024-04-25T00:50:49.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.013+0000 7f6361b66640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f635c0c3070 con 0x7f635c15c200 2024-04-25T00:50:49.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.013+0000 7f6361b66640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f635c15b7b0 con 0x7f635c1581c0 2024-04-25T00:50:49.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.017+0000 7f635bfff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f635c15c200 0x7f635c0c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:49.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.017+0000 7f635bfff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f635c15c200 0x7f635c0c6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35164/0 (socket says 172.21.15.162:35164) 2024-04-25T00:50:49.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.017+0000 7f635bfff640 1 -- 172.21.15.162:0/2273906697 learned_addr learned my addr 172.21.15.162:0/2273906697 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:49.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.017+0000 7f635bfff640 1 -- 172.21.15.162:0/2273906697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f635c1581c0 msgr2=0x7f635c0c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:49.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.017+0000 7f635bfff640 1 --2- 172.21.15.162:0/2273906697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f635c1581c0 0x7f635c0c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:49.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.017+0000 7f635bfff640 1 -- 172.21.15.162:0/2273906697 >> v1:172.21.15.162:6789/0 conn(0x7f635c152320 legacy=0x7f635c072790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:49.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.017+0000 7f635bfff640 1 -- 172.21.15.162:0/2273906697 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635c073240 con 0x7f635c15c200 2024-04-25T00:50:49.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.025+0000 7f635bfff640 1 --2- 172.21.15.162:0/2273906697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f635c15c200 0x7f635c0c6080 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6354009e50 tx=0x7f635401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c60a47c48432e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:49.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.029+0000 7f635a7fc640 1 -- 172.21.15.162:0/2273906697 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63540b4070 con 0x7f635c15c200 2024-04-25T00:50:49.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.029+0000 7f635a7fc640 1 -- 172.21.15.162:0/2273906697 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63540af400 con 0x7f635c15c200 2024-04-25T00:50:49.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.029+0000 7f635a7fc640 1 -- 172.21.15.162:0/2273906697 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63540af7d0 con 0x7f635c15c200 2024-04-25T00:50:49.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.029+0000 7f6361b66640 1 -- 172.21.15.162:0/2273906697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f635c15c200 msgr2=0x7f635c0c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:49.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.029+0000 7f6361b66640 1 --2- 172.21.15.162:0/2273906697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f635c15c200 0x7f635c0c6080 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6354009e50 tx=0x7f635401f1e0 comp rx=0 tx=0).stop 2024-04-25T00:50:49.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.029+0000 7f6361b66640 1 -- 172.21.15.162:0/2273906697 shutdown_connections 2024-04-25T00:50:49.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.029+0000 7f6361b66640 1 --2- 172.21.15.162:0/2273906697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f635c1581c0 0x7f635c0c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:49.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.029+0000 7f6361b66640 1 --2- 172.21.15.162:0/2273906697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f635c15c200 0x7f635c0c6080 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:49.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.029+0000 7f6361b66640 1 -- 172.21.15.162:0/2273906697 >> 172.21.15.162:0/2273906697 conn(0x7f635c070350 msgr2=0x7f635c070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:49.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.029+0000 7f6361b66640 1 -- 172.21.15.162:0/2273906697 shutdown_connections 2024-04-25T00:50:49.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.029+0000 7f6361b66640 1 -- 172.21.15.162:0/2273906697 wait complete. 2024-04-25T00:50:49.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.029+0000 7f6361b66640 1 Processor -- start 2024-04-25T00:50:49.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.029+0000 7f6361b66640 1 -- start start 2024-04-25T00:50:49.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.033+0000 7f6361b66640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f635c152320 0x7f635c144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:49.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.033+0000 7f6361b66640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f635c1581c0 0x7f635c144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:49.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.033+0000 7f6361b66640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f635c15c200 0x7f635c0cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:49.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.033+0000 7f6361b66640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f635c15bce0 con 0x7f635c152320 2024-04-25T00:50:49.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.033+0000 7f6361b66640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f635c15ba00 con 0x7f635c15c200 2024-04-25T00:50:49.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.033+0000 7f6361b66640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f635c15c660 con 0x7f635c1581c0 2024-04-25T00:50:49.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.033+0000 7f635b7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f635c152320 0x7f635c144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:49.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.033+0000 7f635bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f635c15c200 0x7f635c0cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:49.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.033+0000 7f635bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f635c15c200 0x7f635c0cb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:41698/0 (socket says 172.21.15.162:41698) 2024-04-25T00:50:49.035 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.033+0000 7f635bfff640 1 -- 172.21.15.162:0/4020251696 learned_addr learned my addr 172.21.15.162:0/4020251696 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:49.036 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.033+0000 7f635affd640 1 --2- 172.21.15.162:0/4020251696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f635c1581c0 0x7f635c144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:49.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.037+0000 7f635bfff640 1 -- 172.21.15.162:0/4020251696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f635c1581c0 msgr2=0x7f635c144840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:49.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.037+0000 7f635bfff640 1 --2- 172.21.15.162:0/4020251696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f635c1581c0 0x7f635c144840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:49.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.037+0000 7f635bfff640 1 -- 172.21.15.162:0/4020251696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f635c152320 msgr2=0x7f635c144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:49.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.037+0000 7f635bfff640 1 --2- 172.21.15.162:0/4020251696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f635c152320 0x7f635c144300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:49.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.037+0000 7f635bfff640 1 -- 172.21.15.162:0/4020251696 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f635c15a250 con 0x7f635c15c200 2024-04-25T00:50:49.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.041+0000 7f635bfff640 1 --2- 172.21.15.162:0/4020251696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f635c15c200 0x7f635c0cb240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f635401fa80 tx=0x7f635401bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:49.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.049+0000 7f6343fff640 1 -- 172.21.15.162:0/4020251696 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63540b4040 con 0x7f635c15c200 2024-04-25T00:50:49.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.049+0000 7f6343fff640 1 -- 172.21.15.162:0/4020251696 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63540c1070 con 0x7f635c15c200 2024-04-25T00:50:49.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.049+0000 7f6343fff640 1 -- 172.21.15.162:0/4020251696 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63540ba470 con 0x7f635c15c200 2024-04-25T00:50:49.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.049+0000 7f6361b66640 1 -- 172.21.15.162:0/4020251696 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f635c15a4f0 con 0x7f635c15c200 2024-04-25T00:50:49.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.049+0000 7f6361b66640 1 -- 172.21.15.162:0/4020251696 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f635c0caa40 con 0x7f635c15c200 2024-04-25T00:50:49.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.049+0000 7f6361b66640 1 -- 172.21.15.162:0/4020251696 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f635c0cd810 con 0x7f635c15c200 2024-04-25T00:50:49.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.069+0000 7f6343fff640 1 -- 172.21.15.162:0/4020251696 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f63540ba610 con 0x7f635c15c200 2024-04-25T00:50:49.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.069+0000 7f6343fff640 1 --2- 172.21.15.162:0/4020251696 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f63480678c0 0x7f6348069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:49.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.073+0000 7f635b7fe640 1 --2- 172.21.15.162:0/4020251696 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f63480678c0 0x7f6348069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:49.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.073+0000 7f635b7fe640 1 --2- 172.21.15.162:0/4020251696 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f63480678c0 0x7f6348069d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f634c007fd0 tx=0x7f634c007e40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:49.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.341+0000 7f6343fff640 1 -- 172.21.15.162:0/4020251696 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f6354002020 con 0x7f635c15c200 2024-04-25T00:50:49.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.369+0000 7f6343fff640 1 -- 172.21.15.162:0/4020251696 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f6354018d40 con 0x7f635c15c200 2024-04-25T00:50:49.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.553+0000 7f6361b66640 1 -- 172.21.15.162:0/4020251696 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f635c157670 con 0x7f635c15c200 2024-04-25T00:50:49.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.729+0000 7f6343fff640 1 -- 172.21.15.162:0/4020251696 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+16641 (secure 0 0 0) 0x7f63540f5230 con 0x7f635c15c200 2024-04-25T00:50:49.732 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:49.732 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":26,"fsid":"e141deed-4794-4a17-83c9-f6e6e8875f5e","created":"2024-04-25T00:49:29.904605+0000","modified":"2024-04-25T00:50:37.007717+0000","last_up_change":"2024-04-25T00:49:51.119342+0000","last_in_change":"2024-04-25T00:49:39.898293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T00:49:52.297093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T00:50:31.644475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T00:50:33.242786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e20986cc-3664-4988-959c-c0b02e380775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6811","nonce":2734546478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6813","nonce":2734546478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6817","nonce":2734546478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6815","nonce":2734546478}]},"public_addr":"172.21.15.162:6811/2734546478","cluster_addr":"172.21.15.162:6813/2734546478","heartbeat_back_addr":"172.21.15.162:6817/2734546478","heartbeat_front_addr":"172.21.15.162:6815/2734546478","state":["exists","up"]},{"osd":1,"uuid":"60f1608a-ecb7-4978-b816-ce6f419e275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6803","nonce":3488816098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6805","nonce":3488816098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6809","nonce":3488816098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6807","nonce":3488816098}]},"public_addr":"172.21.15.162:6803/3488816098","cluster_addr":"172.21.15.162:6805/3488816098","heartbeat_back_addr":"172.21.15.162:6809/3488816098","heartbeat_front_addr":"172.21.15.162:6807/3488816098","state":["exists","up"]},{"osd":2,"uuid":"77552061-8e19-4f49-bc3f-1300955a07b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6819","nonce":234337516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6821","nonce":234337516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6825","nonce":234337516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6823","nonce":234337516}]},"public_addr":"172.21.15.162:6819/234337516","cluster_addr":"172.21.15.162:6821/234337516","heartbeat_back_addr":"172.21.15.162:6825/234337516","heartbeat_front_addr":"172.21.15.162:6823/234337516","state":["exists","up"]},{"osd":3,"uuid":"5b105720-6e6d-4143-b5c4-0a3b1e4a687c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6827","nonce":1726903362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6829","nonce":1726903362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6833","nonce":1726903362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6831","nonce":1726903362}]},"public_addr":"172.21.15.162:6827/1726903362","cluster_addr":"172.21.15.162:6829/1726903362","heartbeat_back_addr":"172.21.15.162:6833/1726903362","heartbeat_front_addr":"172.21.15.162:6831/1726903362","state":["exists","up"]},{"osd":4,"uuid":"611eafc5-2fe0-4c96-ba8c-b1efc3930de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6817","nonce":3338082657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6819","nonce":3338082657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6823","nonce":3338082657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6821","nonce":3338082657}]},"public_addr":"172.21.15.179:6817/3338082657","cluster_addr":"172.21.15.179:6819/3338082657","heartbeat_back_addr":"172.21.15.179:6823/3338082657","heartbeat_front_addr":"172.21.15.179:6821/3338082657","state":["exists","up"]},{"osd":5,"uuid":"b39487f5-c314-4026-90bd-02e30ecca04f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6825","nonce":4129338239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6827","nonce":4129338239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6831","nonce":4129338239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6829","nonce":4129338239}]},"public_addr":"172.21.15.179:6825/4129338239","cluster_addr":"172.21.15.179:6827/4129338239","heartbeat_back_addr":"172.21.15.179:6831/4129338239","heartbeat_front_addr":"172.21.15.179:6829/4129338239","state":["exists","up"]},{"osd":6,"uuid":"1d902755-f992-4070-b30e-e79f5fb22d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6801","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6802","nonce":823843016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6806","nonce":823843016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6815","nonce":823843016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6810","nonce":823843016}]},"public_addr":"172.21.15.179:6802/823843016","cluster_addr":"172.21.15.179:6806/823843016","heartbeat_back_addr":"172.21.15.179:6815/823843016","heartbeat_front_addr":"172.21.15.179:6810/823843016","state":["exists","up"]},{"osd":7,"uuid":"ea529f85-28fd-4dc3-a584-314e71999061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6803","nonce":3403659125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6807","nonce":3403659125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6814","nonce":3403659125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6811","nonce":3403659125}]},"public_addr":"172.21.15.179:6803/3403659125","cluster_addr":"172.21.15.179:6807/3403659125","heartbeat_back_addr":"172.21.15.179:6814/3403659125","heartbeat_front_addr":"172.21.15.179:6811/3403659125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.684518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.583123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.644576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.815957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.787155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.814409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.657210+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.676697+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T00:50:49.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.733+0000 7f6361b66640 1 -- 172.21.15.162:0/4020251696 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f63480678c0 msgr2=0x7f6348069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:49.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.733+0000 7f6361b66640 1 --2- 172.21.15.162:0/4020251696 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f63480678c0 0x7f6348069d80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f634c007fd0 tx=0x7f634c007e40 comp rx=0 tx=0).stop 2024-04-25T00:50:49.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.733+0000 7f6361b66640 1 -- 172.21.15.162:0/4020251696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f635c15c200 msgr2=0x7f635c0cb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:49.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.733+0000 7f6361b66640 1 --2- 172.21.15.162:0/4020251696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f635c15c200 0x7f635c0cb240 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f635401fa80 tx=0x7f635401bf80 comp rx=0 tx=0).stop 2024-04-25T00:50:49.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.733+0000 7f6361b66640 1 -- 172.21.15.162:0/4020251696 shutdown_connections 2024-04-25T00:50:49.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.733+0000 7f6361b66640 1 --2- 172.21.15.162:0/4020251696 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f635c15c200 0x7f635c0cb240 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:49.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.733+0000 7f6361b66640 1 --2- 172.21.15.162:0/4020251696 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f635c1581c0 0x7f635c144840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:49.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.733+0000 7f6361b66640 1 --2- 172.21.15.162:0/4020251696 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f63480678c0 0x7f6348069d80 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:49.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.733+0000 7f6361b66640 1 --2- 172.21.15.162:0/4020251696 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f635c152320 0x7f635c144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:49.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.733+0000 7f6361b66640 1 -- 172.21.15.162:0/4020251696 >> 172.21.15.162:0/4020251696 conn(0x7f635c070350 msgr2=0x7f635c0c6080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:49.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.733+0000 7f6361b66640 1 -- 172.21.15.162:0/4020251696 shutdown_connections 2024-04-25T00:50:49.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.733+0000 7f6361b66640 1 -- 172.21.15.162:0/4020251696 wait complete. 2024-04-25T00:50:49.754 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T00:50:49.754 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T00:50:49.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.873+0000 7f9c54ee2640 1 Processor -- start 2024-04-25T00:50:49.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.873+0000 7f9c54ee2640 1 -- start start 2024-04-25T00:50:49.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.873+0000 7f9c54ee2640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9c500c8460 0x7f9c501579e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:49.877 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.877+0000 7f9c54ee2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c500c7810 0x7f9c500c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:49.877 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.877+0000 7f9c54ee2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c50157f20 con 0x7f9c500c35b0 2024-04-25T00:50:49.877 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.877+0000 7f9c54ee2640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f9c500c3af0 con 0x7f9c500c8460 2024-04-25T00:50:49.877 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.877+0000 7f9c54ee2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9c500c3dd0 con 0x7f9c500c7810 2024-04-25T00:50:49.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.877+0000 7f9c4e59c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9c500c8460 0x7f9c501579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:49.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.877+0000 7f9c4e59c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9c500c8460 0x7f9c501579e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:41708/0 (socket says 172.21.15.162:41708) 2024-04-25T00:50:49.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.877+0000 7f9c4e59c640 1 -- 172.21.15.162:0/186418381 learned_addr learned my addr 172.21.15.162:0/186418381 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:49.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.885+0000 7f9c4e59c640 1 -- 172.21.15.162:0/186418381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c500c7810 msgr2=0x7f9c500c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:49.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.885+0000 7f9c4e59c640 1 --2- 172.21.15.162:0/186418381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c500c7810 0x7f9c500c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:49.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.885+0000 7f9c4e59c640 1 -- 172.21.15.162:0/186418381 >> v1:172.21.15.179:6789/0 conn(0x7f9c500c35b0 legacy=0x7f9c500c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:49.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.885+0000 7f9c4e59c640 1 -- 172.21.15.162:0/186418381 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c500c40b0 con 0x7f9c500c8460 2024-04-25T00:50:49.895 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.893+0000 7f9c4e59c640 1 --2- 172.21.15.162:0/186418381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c500c8460 0x7f9c501579e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9c40009870 tx=0x7f9c4001c340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=205f8ec6c1af7d62 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:49.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.913+0000 7f9c4d59a640 1 -- 172.21.15.162:0/186418381 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c400b0070 con 0x7f9c500c8460 2024-04-25T00:50:49.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.913+0000 7f9c4d59a640 1 -- 172.21.15.162:0/186418381 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c400ab600 con 0x7f9c500c8460 2024-04-25T00:50:49.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.913+0000 7f9c4d59a640 1 -- 172.21.15.162:0/186418381 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c400ab9d0 con 0x7f9c500c8460 2024-04-25T00:50:49.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.913+0000 7f9c54ee2640 1 -- 172.21.15.162:0/186418381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c500c8460 msgr2=0x7f9c501579e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:49.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.913+0000 7f9c54ee2640 1 --2- 172.21.15.162:0/186418381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c500c8460 0x7f9c501579e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9c40009870 tx=0x7f9c4001c340 comp rx=0 tx=0).stop 2024-04-25T00:50:49.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.913+0000 7f9c54ee2640 1 -- 172.21.15.162:0/186418381 shutdown_connections 2024-04-25T00:50:49.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.913+0000 7f9c54ee2640 1 --2- 172.21.15.162:0/186418381 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c500c7810 0x7f9c500c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:49.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.913+0000 7f9c54ee2640 1 --2- 172.21.15.162:0/186418381 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c500c8460 0x7f9c501579e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:49.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.913+0000 7f9c54ee2640 1 -- 172.21.15.162:0/186418381 >> 172.21.15.162:0/186418381 conn(0x7f9c5006fab0 msgr2=0x7f9c5006fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:49.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.913+0000 7f9c54ee2640 1 -- 172.21.15.162:0/186418381 shutdown_connections 2024-04-25T00:50:49.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.913+0000 7f9c54ee2640 1 -- 172.21.15.162:0/186418381 wait complete. 2024-04-25T00:50:49.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.913+0000 7f9c54ee2640 1 Processor -- start 2024-04-25T00:50:49.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.913+0000 7f9c54ee2640 1 -- start start 2024-04-25T00:50:49.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.917+0000 7f9c54ee2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c500c35b0 0x7f9c501f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:49.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.917+0000 7f9c54ee2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c500c7810 0x7f9c5013f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:49.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.917+0000 7f9c54ee2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c500c8460 0x7f9c5013fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:49.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.917+0000 7f9c54ee2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9c500c65d0 con 0x7f9c500c35b0 2024-04-25T00:50:49.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.917+0000 7f9c54ee2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9c500c6450 con 0x7f9c500c8460 2024-04-25T00:50:49.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.917+0000 7f9c54ee2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9c50164170 con 0x7f9c500c7810 2024-04-25T00:50:49.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.917+0000 7f9c4e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c500c35b0 0x7f9c501f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:49.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.917+0000 7f9c4e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c500c35b0 0x7f9c501f2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35184/0 (socket says 172.21.15.162:35184) 2024-04-25T00:50:49.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.917+0000 7f9c4e59c640 1 -- 172.21.15.162:0/2229374860 learned_addr learned my addr 172.21.15.162:0/2229374860 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:49.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.921+0000 7f9c4ed9d640 1 --2- 172.21.15.162:0/2229374860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c500c8460 0x7f9c5013fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:49.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.925+0000 7f9c4e59c640 1 -- 172.21.15.162:0/2229374860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c500c7810 msgr2=0x7f9c5013f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:49.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.925+0000 7f9c4e59c640 1 --2- 172.21.15.162:0/2229374860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c500c7810 0x7f9c5013f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:49.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.925+0000 7f9c4e59c640 1 -- 172.21.15.162:0/2229374860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c500c8460 msgr2=0x7f9c5013fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:49.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.925+0000 7f9c4e59c640 1 --2- 172.21.15.162:0/2229374860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c500c8460 0x7f9c5013fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:49.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.925+0000 7f9c4e59c640 1 -- 172.21.15.162:0/2229374860 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c50147b00 con 0x7f9c500c35b0 2024-04-25T00:50:49.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:49.933+0000 7f9c4e59c640 1 --2- 172.21.15.162:0/2229374860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c500c35b0 0x7f9c501f2100 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9c4001a9f0 tx=0x7f9c4001ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:50.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.025+0000 7f9c3effd640 1 -- 172.21.15.162:0/2229374860 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c400b0040 con 0x7f9c500c35b0 2024-04-25T00:50:50.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.025+0000 7f9c3effd640 1 -- 172.21.15.162:0/2229374860 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c400bc070 con 0x7f9c500c35b0 2024-04-25T00:50:50.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.025+0000 7f9c3effd640 1 -- 172.21.15.162:0/2229374860 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c400b6820 con 0x7f9c500c35b0 2024-04-25T00:50:50.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.025+0000 7f9c54ee2640 1 -- 172.21.15.162:0/2229374860 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c50148380 con 0x7f9c500c35b0 2024-04-25T00:50:50.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.029+0000 7f9c54ee2640 1 -- 172.21.15.162:0/2229374860 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c501480a0 con 0x7f9c500c35b0 2024-04-25T00:50:50.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.029+0000 7f9c54ee2640 1 -- 172.21.15.162:0/2229374860 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c50151050 con 0x7f9c500c35b0 2024-04-25T00:50:50.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.481+0000 7f9c3effd640 1 -- 172.21.15.162:0/2229374860 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9c400b69c0 con 0x7f9c500c35b0 2024-04-25T00:50:50.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.481+0000 7f9c3effd640 1 --2- 172.21.15.162:0/2229374860 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9c300678c0 0x7f9c30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.481+0000 7f9c4dd9b640 1 --2- 172.21.15.162:0/2229374860 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9c300678c0 0x7f9c30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:50.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.481+0000 7f9c4dd9b640 1 --2- 172.21.15.162:0/2229374860 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9c300678c0 0x7f9c30069d80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c500ca3b0 tx=0x7f9c440079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:50.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.497+0000 7f9c3effd640 1 -- 172.21.15.162:0/2229374860 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f9c400ab5a0 con 0x7f9c500c35b0 2024-04-25T00:50:50.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.497+0000 7f9c3effd640 1 -- 172.21.15.162:0/2229374860 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f9c50157f20 con 0x7f9c500c35b0 2024-04-25T00:50:50.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.681+0000 7f9c54ee2640 1 -- 172.21.15.162:0/2229374860 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c50161730 con 0x7f9c500c35b0 2024-04-25T00:50:50.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.717+0000 7f9c3effd640 1 -- 172.21.15.162:0/2229374860 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+16641 (secure 0 0 0) 0x7f9c400f1720 con 0x7f9c500c35b0 2024-04-25T00:50:50.721 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:50.721 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":26,"fsid":"e141deed-4794-4a17-83c9-f6e6e8875f5e","created":"2024-04-25T00:49:29.904605+0000","modified":"2024-04-25T00:50:37.007717+0000","last_up_change":"2024-04-25T00:49:51.119342+0000","last_in_change":"2024-04-25T00:49:39.898293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T00:49:52.297093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T00:50:31.644475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T00:50:33.242786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e20986cc-3664-4988-959c-c0b02e380775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6811","nonce":2734546478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6813","nonce":2734546478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6817","nonce":2734546478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6815","nonce":2734546478}]},"public_addr":"172.21.15.162:6811/2734546478","cluster_addr":"172.21.15.162:6813/2734546478","heartbeat_back_addr":"172.21.15.162:6817/2734546478","heartbeat_front_addr":"172.21.15.162:6815/2734546478","state":["exists","up"]},{"osd":1,"uuid":"60f1608a-ecb7-4978-b816-ce6f419e275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6803","nonce":3488816098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6805","nonce":3488816098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6809","nonce":3488816098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6807","nonce":3488816098}]},"public_addr":"172.21.15.162:6803/3488816098","cluster_addr":"172.21.15.162:6805/3488816098","heartbeat_back_addr":"172.21.15.162:6809/3488816098","heartbeat_front_addr":"172.21.15.162:6807/3488816098","state":["exists","up"]},{"osd":2,"uuid":"77552061-8e19-4f49-bc3f-1300955a07b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6819","nonce":234337516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6821","nonce":234337516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6825","nonce":234337516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6823","nonce":234337516}]},"public_addr":"172.21.15.162:6819/234337516","cluster_addr":"172.21.15.162:6821/234337516","heartbeat_back_addr":"172.21.15.162:6825/234337516","heartbeat_front_addr":"172.21.15.162:6823/234337516","state":["exists","up"]},{"osd":3,"uuid":"5b105720-6e6d-4143-b5c4-0a3b1e4a687c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6827","nonce":1726903362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6829","nonce":1726903362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6833","nonce":1726903362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6831","nonce":1726903362}]},"public_addr":"172.21.15.162:6827/1726903362","cluster_addr":"172.21.15.162:6829/1726903362","heartbeat_back_addr":"172.21.15.162:6833/1726903362","heartbeat_front_addr":"172.21.15.162:6831/1726903362","state":["exists","up"]},{"osd":4,"uuid":"611eafc5-2fe0-4c96-ba8c-b1efc3930de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6817","nonce":3338082657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6819","nonce":3338082657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6823","nonce":3338082657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6821","nonce":3338082657}]},"public_addr":"172.21.15.179:6817/3338082657","cluster_addr":"172.21.15.179:6819/3338082657","heartbeat_back_addr":"172.21.15.179:6823/3338082657","heartbeat_front_addr":"172.21.15.179:6821/3338082657","state":["exists","up"]},{"osd":5,"uuid":"b39487f5-c314-4026-90bd-02e30ecca04f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6825","nonce":4129338239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6827","nonce":4129338239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6831","nonce":4129338239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6829","nonce":4129338239}]},"public_addr":"172.21.15.179:6825/4129338239","cluster_addr":"172.21.15.179:6827/4129338239","heartbeat_back_addr":"172.21.15.179:6831/4129338239","heartbeat_front_addr":"172.21.15.179:6829/4129338239","state":["exists","up"]},{"osd":6,"uuid":"1d902755-f992-4070-b30e-e79f5fb22d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6801","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6802","nonce":823843016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6806","nonce":823843016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6815","nonce":823843016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6810","nonce":823843016}]},"public_addr":"172.21.15.179:6802/823843016","cluster_addr":"172.21.15.179:6806/823843016","heartbeat_back_addr":"172.21.15.179:6815/823843016","heartbeat_front_addr":"172.21.15.179:6810/823843016","state":["exists","up"]},{"osd":7,"uuid":"ea529f85-28fd-4dc3-a584-314e71999061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6803","nonce":3403659125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6807","nonce":3403659125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6814","nonce":3403659125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6811","nonce":3403659125}]},"public_addr":"172.21.15.179:6803/3403659125","cluster_addr":"172.21.15.179:6807/3403659125","heartbeat_back_addr":"172.21.15.179:6814/3403659125","heartbeat_front_addr":"172.21.15.179:6811/3403659125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.684518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.583123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.644576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.815957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.787155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.814409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.657210+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.676697+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T00:50:50.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.721+0000 7f9c54ee2640 1 -- 172.21.15.162:0/2229374860 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9c300678c0 msgr2=0x7f9c30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:50.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.721+0000 7f9c54ee2640 1 --2- 172.21.15.162:0/2229374860 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9c300678c0 0x7f9c30069d80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c500ca3b0 tx=0x7f9c440079c0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.721+0000 7f9c54ee2640 1 -- 172.21.15.162:0/2229374860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c500c35b0 msgr2=0x7f9c501f2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:50.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.721+0000 7f9c54ee2640 1 --2- 172.21.15.162:0/2229374860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c500c35b0 0x7f9c501f2100 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9c4001a9f0 tx=0x7f9c4001ab80 comp rx=0 tx=0).stop 2024-04-25T00:50:50.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.725+0000 7f9c54ee2640 1 -- 172.21.15.162:0/2229374860 shutdown_connections 2024-04-25T00:50:50.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.725+0000 7f9c54ee2640 1 --2- 172.21.15.162:0/2229374860 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9c500c8460 0x7f9c5013fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.725+0000 7f9c54ee2640 1 --2- 172.21.15.162:0/2229374860 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9c500c7810 0x7f9c5013f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.725+0000 7f9c54ee2640 1 --2- 172.21.15.162:0/2229374860 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9c300678c0 0x7f9c30069d80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.725+0000 7f9c54ee2640 1 --2- 172.21.15.162:0/2229374860 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9c500c35b0 0x7f9c501f2100 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.725+0000 7f9c54ee2640 1 -- 172.21.15.162:0/2229374860 >> 172.21.15.162:0/2229374860 conn(0x7f9c5006fab0 msgr2=0x7f9c50154e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:50.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.725+0000 7f9c54ee2640 1 -- 172.21.15.162:0/2229374860 shutdown_connections 2024-04-25T00:50:50.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.725+0000 7f9c54ee2640 1 -- 172.21.15.162:0/2229374860 wait complete. 2024-04-25T00:50:50.745 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T00:50:50.746 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T00:50:50.746 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T00:50:50.747 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T00:50:50.747 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T00:50:50.747 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T00:50:50.748 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T00:50:50.748 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T00:50:50.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.921+0000 7f2a128c2640 1 Processor -- start 2024-04-25T00:50:50.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.921+0000 7f749b1f5640 1 Processor -- start 2024-04-25T00:50:50.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.921+0000 7f2a128c2640 1 -- start start 2024-04-25T00:50:50.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.921+0000 7f749b1f5640 1 -- start start 2024-04-25T00:50:50.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f749b1f5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f74940c7220 0x7f74940cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f749b1f5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74940c78b0 0x7f74940cc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f749b1f5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7494156ae0 con 0x7f7494150500 2024-04-25T00:50:50.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f749b1f5640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f74940c28a0 con 0x7f74940c7220 2024-04-25T00:50:50.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f749b1f5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7494159680 con 0x7f74940c78b0 2024-04-25T00:50:50.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f2a128c2640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f2a0c0c6570 0x7f2a0c072d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f2a128c2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a0c073250 0x7f2a0c159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f2a128c2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a0c0c22b0 con 0x7f2a0c150740 2024-04-25T00:50:50.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f2a128c2640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f2a0c150b20 con 0x7f2a0c0c6570 2024-04-25T00:50:50.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f2a128c2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0c0c6b40 con 0x7f2a0c073250 2024-04-25T00:50:50.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f2a0bfff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f2a0c150740 0x7f2a0c071f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:49570/0 (socket says 172.21.15.162:49570) 2024-04-25T00:50:50.927 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f2a0bfff640 1 -- 172.21.15.162:0/1730788289 learned_addr learned my addr 172.21.15.162:0/1730788289 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:50.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f749a9f4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74940c78b0 0x7f74940cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:50.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f2a0b7fe640 1 --2- 172.21.15.162:0/1730788289 >> v2:172.21.15.179:3300/0 conn(0x7f2a0c0c6570 0x7f2a0c072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:50.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f9ceb53c640 1 Processor -- start 2024-04-25T00:50:50.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f74999f2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f74940c7220 0x7f74940cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:50.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f74999f2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f74940c7220 0x7f74940cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35196/0 (socket says 172.21.15.162:35196) 2024-04-25T00:50:50.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f74999f2640 1 -- 172.21.15.162:0/2323106706 learned_addr learned my addr 172.21.15.162:0/2323106706 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:50.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.929+0000 7f3f346b2640 1 Processor -- start 2024-04-25T00:50:50.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.925+0000 7f9ceb53c640 1 -- start start 2024-04-25T00:50:50.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.929+0000 7f9ceb53c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9ce41547a0 0x7f9ce406dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.929+0000 7f9ceb53c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce415ae40 0x7f9ce415e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.929+0000 7f9ceb53c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce415bca0 con 0x7f9ce415b830 2024-04-25T00:50:50.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.929+0000 7f9ceb53c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9ce40cbb30 con 0x7f9ce41547a0 2024-04-25T00:50:50.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.929+0000 7f9ceb53c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce4154b80 con 0x7f9ce415ae40 2024-04-25T00:50:50.930 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.929+0000 7f3f346b2640 1 -- start start 2024-04-25T00:50:50.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.929+0000 7f3f346b2640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3f2c1505b0 0x7f3f2c156c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.929+0000 7f3f346b2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3f2c0c8070 0x7f3f2c0c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.929+0000 7f3f346b2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f2c0cb680 con 0x7f3f2c071bd0 2024-04-25T00:50:50.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.929+0000 7f3f346b2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3f2c0c8b70 con 0x7f3f2c0c8070 2024-04-25T00:50:50.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.929+0000 7f3f346b2640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f3f2c0cb960 con 0x7f3f2c1505b0 2024-04-25T00:50:50.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.929+0000 7f74999f2640 1 -- 172.21.15.162:0/2323106706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74940c78b0 msgr2=0x7f74940cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:50.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.929+0000 7f74999f2640 1 --2- 172.21.15.162:0/2323106706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74940c78b0 0x7f74940cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.929+0000 7f74999f2640 1 -- 172.21.15.162:0/2323106706 >> v1:172.21.15.162:6789/0 conn(0x7f7494150500 legacy=0x7f7494159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:50.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.929+0000 7f2a10e5f640 1 --2- 172.21.15.162:0/1730788289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a0c073250 0x7f2a0c159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:50.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.929+0000 7f74999f2640 1 -- 172.21.15.162:0/2323106706 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7494156db0 con 0x7f74940c7220 2024-04-25T00:50:50.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.933+0000 7f2a0b7fe640 1 -- 172.21.15.162:0/1730788289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a0c073250 msgr2=0x7f2a0c159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:50.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.933+0000 7f2a0b7fe640 1 --2- 172.21.15.162:0/1730788289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a0c073250 0x7f2a0c159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.933+0000 7f2a0b7fe640 1 -- 172.21.15.162:0/1730788289 >> v1:172.21.15.162:6789/0 conn(0x7f2a0c150740 legacy=0x7f2a0c071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:50.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.933+0000 7f2a0b7fe640 1 -- 172.21.15.162:0/1730788289 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0c0c2520 con 0x7f2a0c0c6570 2024-04-25T00:50:50.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.937+0000 7f3f3244e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3f2c1505b0 0x7f3f2c156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:50.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.937+0000 7f9ce8ad7640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f9ce415b830 0x7f9ce415d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:55286/0 (socket says 172.21.15.162:55286) 2024-04-25T00:50:50.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.937+0000 7f9ce8ad7640 1 -- 172.21.15.162:0/332047117 learned_addr learned my addr 172.21.15.162:0/332047117 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:50.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.937+0000 7f3f3244e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3f2c1505b0 0x7f3f2c156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:41736/0 (socket says 172.21.15.162:41736) 2024-04-25T00:50:50.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.937+0000 7f3f3244e640 1 -- 172.21.15.162:0/3308121272 learned_addr learned my addr 172.21.15.162:0/3308121272 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:50.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.941+0000 7f912ffff640 1 Processor -- start 2024-04-25T00:50:50.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.941+0000 7f381156e640 1 Processor -- start 2024-04-25T00:50:50.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.941+0000 7f912ffff640 1 -- start start 2024-04-25T00:50:50.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.941+0000 7f381156e640 1 -- start start 2024-04-25T00:50:50.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.941+0000 7f381156e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38040d5c30 0x7f380404c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.941+0000 7f381156e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3804046a50 0x7f38040df020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.941+0000 7f912ffff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f91280d9a50 0x7f912804e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.941+0000 7f912ffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9128038220 0x7f912804d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.941+0000 7f912ffff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f91280e3090 0x7f912804d920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.941+0000 7f381156e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f380404c9f0 con 0x7f380404d840 2024-04-25T00:50:50.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.941+0000 7f912ffff640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f91280e3520 con 0x7f91280e3090 2024-04-25T00:50:50.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.941+0000 7f912ffff640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f91280e37c0 con 0x7f91280d9a50 2024-04-25T00:50:50.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.941+0000 7f381156e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f3804008760 con 0x7f3804046a50 2024-04-25T00:50:50.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.941+0000 7f912ffff640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f91280e3aa0 con 0x7f9128038220 2024-04-25T00:50:50.944 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.941+0000 7f381156e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3804008a40 con 0x7f38040d5c30 2024-04-25T00:50:50.944 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.941+0000 7f9ce92d8640 1 --2- 172.21.15.162:0/332047117 >> v2:172.21.15.162:3300/0 conn(0x7f9ce41547a0 0x7f9ce406dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:50.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.945+0000 7f9ce92d8640 1 -- 172.21.15.162:0/332047117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce415ae40 msgr2=0x7f9ce415e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:50.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.945+0000 7f9ce92d8640 1 --2- 172.21.15.162:0/332047117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce415ae40 0x7f9ce415e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.945+0000 7f9ce92d8640 1 -- 172.21.15.162:0/332047117 >> v1:172.21.15.179:6789/0 conn(0x7f9ce415b830 legacy=0x7f9ce415d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:50.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.945+0000 7f9ce92d8640 1 -- 172.21.15.162:0/332047117 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce40ca7a0 con 0x7f9ce41547a0 2024-04-25T00:50:50.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.949+0000 7f74999f2640 1 --2- 172.21.15.162:0/2323106706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74940c7220 0x7f74940cbb20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7484009870 tx=0x7f748401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d8b203cbbd3e2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:50.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.949+0000 7f3f3244e640 1 -- 172.21.15.162:0/3308121272 >> v2:172.21.15.162:3300/0 conn(0x7f3f2c0c8070 msgr2=0x7f3f2c0c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:50.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.949+0000 7f3f3244e640 1 --2- 172.21.15.162:0/3308121272 >> v2:172.21.15.162:3300/0 conn(0x7f3f2c0c8070 0x7f3f2c0c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.949+0000 7f3f3244e640 1 -- 172.21.15.162:0/3308121272 >> v1:172.21.15.179:6789/0 conn(0x7f3f2c071bd0 legacy=0x7f3f2c0c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:50.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.949+0000 7f3f3244e640 1 -- 172.21.15.162:0/3308121272 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2c0cbc40 con 0x7f3f2c1505b0 2024-04-25T00:50:50.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.953+0000 7f912effd640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f91280d9a50 0x7f912804e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:50.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.953+0000 7f912f7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f91280e3090 0x7f912804d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:50.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.953+0000 7f9ce92d8640 1 --2- 172.21.15.162:0/332047117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce41547a0 0x7f9ce406dd90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00097c0 tx=0x7f9ce001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87866e80f76c167 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:50.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.953+0000 7f912f7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f91280e3090 0x7f912804d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35230/0 (socket says 172.21.15.162:35230) 2024-04-25T00:50:50.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.953+0000 7f912f7fe640 1 -- 172.21.15.162:0/924786348 learned_addr learned my addr 172.21.15.162:0/924786348 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:50.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.957+0000 7f912e7fc640 1 --2- 172.21.15.162:0/924786348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9128038220 0x7f912804d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:50.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.957+0000 7f74991f1640 1 -- 172.21.15.162:0/2323106706 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74840b1070 con 0x7f74940c7220 2024-04-25T00:50:50.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.957+0000 7f74991f1640 1 -- 172.21.15.162:0/2323106706 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74840ac630 con 0x7f74940c7220 2024-04-25T00:50:50.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.957+0000 7f74991f1640 1 -- 172.21.15.162:0/2323106706 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74840a8050 con 0x7f74940c7220 2024-04-25T00:50:50.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.957+0000 7f380bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38040d5c30 0x7f380404c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:50.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.957+0000 7f749b1f5640 1 -- 172.21.15.162:0/2323106706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74940c7220 msgr2=0x7f74940cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:50.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.957+0000 7f749b1f5640 1 --2- 172.21.15.162:0/2323106706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74940c7220 0x7f74940cbb20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7484009870 tx=0x7f748401c540 comp rx=0 tx=0).stop 2024-04-25T00:50:50.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.957+0000 7f749b1f5640 1 -- 172.21.15.162:0/2323106706 shutdown_connections 2024-04-25T00:50:50.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.957+0000 7f749b1f5640 1 --2- 172.21.15.162:0/2323106706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74940c78b0 0x7f74940cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.957+0000 7f749b1f5640 1 --2- 172.21.15.162:0/2323106706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74940c7220 0x7f74940cbb20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.957+0000 7f749b1f5640 1 -- 172.21.15.162:0/2323106706 >> 172.21.15.162:0/2323106706 conn(0x7f749406b210 msgr2=0x7f749406b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:50.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.957+0000 7f749b1f5640 1 -- 172.21.15.162:0/2323106706 shutdown_connections 2024-04-25T00:50:50.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.957+0000 7f749b1f5640 1 -- 172.21.15.162:0/2323106706 wait complete. 2024-04-25T00:50:50.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f380bfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38040d5c30 0x7f380404c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:44654/0 (socket says 172.21.15.162:44654) 2024-04-25T00:50:50.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f380bfff640 1 -- 172.21.15.162:0/2402893638 learned_addr learned my addr 172.21.15.162:0/2402893638 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:50.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f9cdbfff640 1 -- 172.21.15.162:0/332047117 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00b0070 con 0x7f9ce41547a0 2024-04-25T00:50:50.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f9cdbfff640 1 -- 172.21.15.162:0/332047117 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ce00ab600 con 0x7f9ce41547a0 2024-04-25T00:50:50.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f749b1f5640 1 Processor -- start 2024-04-25T00:50:50.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f9cdbfff640 1 -- 172.21.15.162:0/332047117 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ce00aba10 con 0x7f9ce41547a0 2024-04-25T00:50:50.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f9ceb53c640 1 -- 172.21.15.162:0/332047117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce41547a0 msgr2=0x7f9ce406dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:50.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f9ceb53c640 1 --2- 172.21.15.162:0/332047117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce41547a0 0x7f9ce406dd90 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00097c0 tx=0x7f9ce001c450 comp rx=0 tx=0).stop 2024-04-25T00:50:50.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f749b1f5640 1 -- start start 2024-04-25T00:50:50.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f749b1f5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74940c7220 0x7f74941521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f9ceb53c640 1 -- 172.21.15.162:0/332047117 shutdown_connections 2024-04-25T00:50:50.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f9ceb53c640 1 --2- 172.21.15.162:0/332047117 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce415ae40 0x7f9ce415e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f9ceb53c640 1 --2- 172.21.15.162:0/332047117 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce41547a0 0x7f9ce406dd90 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f9ceb53c640 1 -- 172.21.15.162:0/332047117 >> 172.21.15.162:0/332047117 conn(0x7f9ce4066fc0 msgr2=0x7f9ce40673d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:50.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f749b1f5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74940c78b0 0x7f7494152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f9ceb53c640 1 -- 172.21.15.162:0/332047117 shutdown_connections 2024-04-25T00:50:50.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f749b1f5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7494150500 0x7f74941f78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f749b1f5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7494071540 con 0x7f74940c7220 2024-04-25T00:50:50.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f749b1f5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f74940c4030 con 0x7f7494150500 2024-04-25T00:50:50.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f749b1f5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f74940716c0 con 0x7f74940c78b0 2024-04-25T00:50:50.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f9ceb53c640 1 -- 172.21.15.162:0/332047117 wait complete. 2024-04-25T00:50:50.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f912e7fc640 1 -- 172.21.15.162:0/924786348 >> v2:172.21.15.179:3300/0 conn(0x7f91280d9a50 msgr2=0x7f912804e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:50.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f912e7fc640 1 --2- 172.21.15.162:0/924786348 >> v2:172.21.15.179:3300/0 conn(0x7f91280d9a50 0x7f912804e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f912e7fc640 1 -- 172.21.15.162:0/924786348 >> v2:172.21.15.162:3300/0 conn(0x7f91280e3090 msgr2=0x7f912804d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:50.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f912e7fc640 1 --2- 172.21.15.162:0/924786348 >> v2:172.21.15.162:3300/0 conn(0x7f91280e3090 0x7f912804d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.961+0000 7f912e7fc640 1 -- 172.21.15.162:0/924786348 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91280e3d80 con 0x7f9128038220 2024-04-25T00:50:50.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.965+0000 7f9ceb53c640 1 Processor -- start 2024-04-25T00:50:50.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.965+0000 7f2a0b7fe640 1 --2- 172.21.15.162:0/1730788289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a0c0c6570 0x7f2a0c072d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000a960 tx=0x7f2a0001e9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9cf8700e8155513 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:50.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.965+0000 7f9ceb53c640 1 -- start start 2024-04-25T00:50:50.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.965+0000 7f9ceb53c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce41547a0 0x7f9ce40c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.965+0000 7f9ceb53c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce415ae40 0x7f9ce4159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.965+0000 7f9ceb53c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce415b830 0x7f9ce4148e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.965+0000 7f9ceb53c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce415b250 con 0x7f9ce415ae40 2024-04-25T00:50:50.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.965+0000 7f9ceb53c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce406d900 con 0x7f9ce41547a0 2024-04-25T00:50:50.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.965+0000 7f9ceb53c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce415e580 con 0x7f9ce415b830 2024-04-25T00:50:50.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.969+0000 7f749a1f3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74940c7220 0x7f74941521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:50.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.969+0000 7f9ce8ad7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce415ae40 0x7f9ce4159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:50.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.969+0000 7f9ce8ad7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce415ae40 0x7f9ce4159af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35254/0 (socket says 172.21.15.162:35254) 2024-04-25T00:50:50.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.969+0000 7f9ce8ad7640 1 -- 172.21.15.162:0/1623549201 learned_addr learned my addr 172.21.15.162:0/1623549201 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:50.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.969+0000 7f3810d6d640 1 --2- 172.21.15.162:0/2402893638 >> v2:172.21.15.179:3300/0 conn(0x7f3804046a50 0x7f38040df020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:50.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.969+0000 7f749a1f3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74940c7220 0x7f74941521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35242/0 (socket says 172.21.15.162:35242) 2024-04-25T00:50:50.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.969+0000 7f749a1f3640 1 -- 172.21.15.162:0/1174545559 learned_addr learned my addr 172.21.15.162:0/1174545559 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:50.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.973+0000 7f380bfff640 1 -- 172.21.15.162:0/2402893638 >> v2:172.21.15.179:3300/0 conn(0x7f3804046a50 msgr2=0x7f38040df020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:50.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.973+0000 7f380bfff640 1 --2- 172.21.15.162:0/2402893638 >> v2:172.21.15.179:3300/0 conn(0x7f3804046a50 0x7f38040df020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.973+0000 7f380bfff640 1 -- 172.21.15.162:0/2402893638 >> v1:172.21.15.179:6789/0 conn(0x7f380404d840 legacy=0x7f3804046340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:50.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.973+0000 7f380bfff640 1 -- 172.21.15.162:0/2402893638 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3804008d20 con 0x7f38040d5c30 2024-04-25T00:50:50.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.973+0000 7f74999f2640 1 --2- 172.21.15.162:0/1174545559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74940c78b0 0x7f7494152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:50.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.973+0000 7f9ce8ad7640 1 -- 172.21.15.162:0/1623549201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce415b830 msgr2=0x7f9ce4148e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:50.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.973+0000 7f9ce8ad7640 1 --2- 172.21.15.162:0/1623549201 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ce415b830 0x7f9ce4148e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.973+0000 7f9ce8ad7640 1 -- 172.21.15.162:0/1623549201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce41547a0 msgr2=0x7f9ce40c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:50.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.973+0000 7f9ce8ad7640 1 --2- 172.21.15.162:0/1623549201 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ce41547a0 0x7f9ce40c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.973+0000 7f9ce8ad7640 1 -- 172.21.15.162:0/1623549201 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce40c6a10 con 0x7f9ce415ae40 2024-04-25T00:50:50.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.977+0000 7f3f3244e640 1 --2- 172.21.15.162:0/3308121272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f2c1505b0 0x7f3f2c156c30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0cc720 tx=0x7f3f1c01d710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a73031effd820be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:50.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.981+0000 7f912e7fc640 1 --2- 172.21.15.162:0/924786348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9128038220 0x7f912804d3e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f912800f020 tx=0x7f912401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fc18454b4aa2efc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:50.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.981+0000 7f749a1f3640 1 -- 172.21.15.162:0/1174545559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74940c78b0 msgr2=0x7f7494152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:50.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.981+0000 7f749a1f3640 1 --2- 172.21.15.162:0/1174545559 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f74940c78b0 0x7f7494152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.981+0000 7f749a1f3640 1 -- 172.21.15.162:0/1174545559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7494150500 msgr2=0x7f74941f78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:50.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.981+0000 7f749a1f3640 1 --2- 172.21.15.162:0/1174545559 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7494150500 0x7f74941f78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.981+0000 7f749a1f3640 1 -- 172.21.15.162:0/1174545559 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74941fab80 con 0x7f74940c7220 2024-04-25T00:50:50.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.985+0000 7f9ce8ad7640 1 --2- 172.21.15.162:0/1623549201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce415ae40 0x7f9ce4159af0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400c430 tx=0x7f9cd400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:50.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.985+0000 7f380bfff640 1 --2- 172.21.15.162:0/2402893638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38040d5c30 0x7f380404c4b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3800009870 tx=0x7f380001ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67554d0305127e1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:50.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.985+0000 7f749a1f3640 1 --2- 172.21.15.162:0/1174545559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74940c7220 0x7f74941521d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f748c00c7a0 tx=0x7f748c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:50.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.989+0000 7f3f3144c640 1 -- 172.21.15.162:0/3308121272 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0a7700 con 0x7f3f2c1505b0 2024-04-25T00:50:50.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7fdc5d1ec640 1 Processor -- start 2024-04-25T00:50:50.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7fdc5d1ec640 1 -- start start 2024-04-25T00:50:50.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7fdc5d1ec640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc580cd440 0x7fdc580cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7fdc5d1ec640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdc5815c230 0x7fdc58071380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:50.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7fdc5d1ec640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc5815b790 con 0x7fdc581523e0 2024-04-25T00:50:50.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7fdc5d1ec640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fdc5815c6c0 con 0x7fdc5815c230 2024-04-25T00:50:50.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7fdc5d1ec640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdc58158a60 con 0x7fdc580cd440 2024-04-25T00:50:50.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7f9cd9ffb640 1 -- 172.21.15.162:0/1623549201 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4017070 con 0x7f9ce415ae40 2024-04-25T00:50:50.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7f9cd9ffb640 1 -- 172.21.15.162:0/1623549201 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd4005cf0 con 0x7f9ce415ae40 2024-04-25T00:50:50.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7f9ceb53c640 1 -- 172.21.15.162:0/1623549201 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce4146e30 con 0x7f9ce415ae40 2024-04-25T00:50:50.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7f9cd9ffb640 1 -- 172.21.15.162:0/1623549201 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd40072d0 con 0x7f9ce415ae40 2024-04-25T00:50:50.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7f9ceb53c640 1 -- 172.21.15.162:0/1623549201 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce4147f60 con 0x7f9ce415ae40 2024-04-25T00:50:50.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7f9ceb53c640 1 -- 172.21.15.162:0/1623549201 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9cc4001040 con 0x7f9ce415ae40 2024-04-25T00:50:50.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7f748affd640 1 -- 172.21.15.162:0/1174545559 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748c017070 con 0x7f74940c7220 2024-04-25T00:50:50.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7f748affd640 1 -- 172.21.15.162:0/1174545559 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f748c003db0 con 0x7f74940c7220 2024-04-25T00:50:50.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7f749b1f5640 1 -- 172.21.15.162:0/1174545559 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74941fae40 con 0x7f74940c7220 2024-04-25T00:50:50.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7f3f3144c640 1 -- 172.21.15.162:0/3308121272 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f1c0a78a0 con 0x7f3f2c1505b0 2024-04-25T00:50:50.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7f3f3144c640 1 -- 172.21.15.162:0/3308121272 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0a7c70 con 0x7f3f2c1505b0 2024-04-25T00:50:50.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7f748affd640 1 -- 172.21.15.162:0/1174545559 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748c0052b0 con 0x7f74940c7220 2024-04-25T00:50:50.997 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7f749b1f5640 1 -- 172.21.15.162:0/1174545559 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74941fb400 con 0x7f74940c7220 2024-04-25T00:50:50.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.993+0000 7f749b1f5640 1 -- 172.21.15.162:0/1174545559 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f74941f7490 con 0x7f74940c7220 2024-04-25T00:50:50.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f3f346b2640 1 -- 172.21.15.162:0/3308121272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f2c1505b0 msgr2=0x7f3f2c156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:50.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f3f346b2640 1 --2- 172.21.15.162:0/3308121272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f2c1505b0 0x7f3f2c156c30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c0cc720 tx=0x7f3f1c01d710 comp rx=0 tx=0).stop 2024-04-25T00:50:50.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f3f346b2640 1 -- 172.21.15.162:0/3308121272 shutdown_connections 2024-04-25T00:50:50.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f3f346b2640 1 --2- 172.21.15.162:0/3308121272 >> v2:172.21.15.162:3300/0 conn(0x7f3f2c0c8070 0x7f3f2c0c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f3f346b2640 1 --2- 172.21.15.162:0/3308121272 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f2c1505b0 0x7f3f2c156c30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:50.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f3f346b2640 1 -- 172.21.15.162:0/3308121272 >> 172.21.15.162:0/3308121272 conn(0x7f3f2c06d7f0 msgr2=0x7f3f2c06b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:50.999 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f6fc3304640 1 Processor -- start 2024-04-25T00:50:50.999 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f3f346b2640 1 -- 172.21.15.162:0/3308121272 shutdown_connections 2024-04-25T00:50:50.999 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f6fc3304640 1 -- start start 2024-04-25T00:50:51.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f3f346b2640 1 -- 172.21.15.162:0/3308121272 wait complete. 2024-04-25T00:50:51.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f6fc3304640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fbc0cc610 0x7f6fbc0cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f6fc3304640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6fbc06c310 0x7f6fbc0cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f6fc3304640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fbc06c7b0 con 0x7f6fbc0ca580 2024-04-25T00:50:51.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f6fc3304640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6fbc0cf670 con 0x7f6fbc06c310 2024-04-25T00:50:51.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f6fc3304640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6fbc06ca70 con 0x7f6fbc0cc610 2024-04-25T00:50:51.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f3f346b2640 1 Processor -- start 2024-04-25T00:50:51.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f3f346b2640 1 -- start start 2024-04-25T00:50:51.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f3f346b2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f2c071bd0 0x7f3f2c1f8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f3f346b2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f2c0c8070 0x7f3f2c14ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f3f346b2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f2c1505b0 0x7f3f2c1551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f3f346b2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c163440 con 0x7f3f2c1505b0 2024-04-25T00:50:51.001 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f3f346b2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3f2c1632c0 con 0x7f3f2c0c8070 2024-04-25T00:50:51.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:50.997+0000 7f3f346b2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3f2c1635c0 con 0x7f3f2c071bd0 2024-04-25T00:50:51.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.001+0000 7f912dffb640 1 -- 172.21.15.162:0/924786348 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91240b5070 con 0x7f9128038220 2024-04-25T00:50:51.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.001+0000 7f912dffb640 1 -- 172.21.15.162:0/924786348 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91240a8830 con 0x7f9128038220 2024-04-25T00:50:51.002 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.001+0000 7f912dffb640 1 -- 172.21.15.162:0/924786348 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91240a8c00 con 0x7f9128038220 2024-04-25T00:50:51.003 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.001+0000 7f2a0affd640 1 -- 172.21.15.162:0/1730788289 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a000b4070 con 0x7f2a0c0c6570 2024-04-25T00:50:51.003 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.001+0000 7f2a0affd640 1 -- 172.21.15.162:0/1730788289 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a000a7a70 con 0x7f2a0c0c6570 2024-04-25T00:50:51.003 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.001+0000 7f2a0affd640 1 -- 172.21.15.162:0/1730788289 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0000b040 con 0x7f2a0c0c6570 2024-04-25T00:50:51.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.001+0000 7f2a128c2640 1 -- 172.21.15.162:0/1730788289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a0c0c6570 msgr2=0x7f2a0c072d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.001+0000 7f2a128c2640 1 --2- 172.21.15.162:0/1730788289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a0c0c6570 0x7f2a0c072d10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2a0000a960 tx=0x7f2a0001e9c0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.001+0000 7f2a128c2640 1 -- 172.21.15.162:0/1730788289 shutdown_connections 2024-04-25T00:50:51.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.001+0000 7f2a128c2640 1 --2- 172.21.15.162:0/1730788289 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a0c073250 0x7f2a0c159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.001+0000 7f2a128c2640 1 --2- 172.21.15.162:0/1730788289 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a0c0c6570 0x7f2a0c072d10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.001+0000 7f2a128c2640 1 -- 172.21.15.162:0/1730788289 >> 172.21.15.162:0/1730788289 conn(0x7f2a0c0c8670 msgr2=0x7f2a0c0c8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.001+0000 7f2a128c2640 1 -- 172.21.15.162:0/1730788289 shutdown_connections 2024-04-25T00:50:51.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.001+0000 7f2a128c2640 1 -- 172.21.15.162:0/1730788289 wait complete. 2024-04-25T00:50:51.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.001+0000 7f2a128c2640 1 Processor -- start 2024-04-25T00:50:51.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.001+0000 7f2a128c2640 1 -- start start 2024-04-25T00:50:51.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7fdc5659c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc580cd440 0x7fdc580cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f2a128c2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a0c073250 0x7f2a0c0cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f2a128c2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a0c0c6570 0x7f2a0c1f2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f2a128c2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a0c150740 0x7f2a0c13a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f2a128c2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c1634f0 con 0x7f2a0c073250 2024-04-25T00:50:51.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f2a128c2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0c0727e0 con 0x7f2a0c150740 2024-04-25T00:50:51.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f2a128c2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0c163670 con 0x7f2a0c0c6570 2024-04-25T00:50:51.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f912ffff640 1 -- 172.21.15.162:0/924786348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9128038220 msgr2=0x7f912804d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f912ffff640 1 --2- 172.21.15.162:0/924786348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9128038220 0x7f912804d3e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f912800f020 tx=0x7f912401ec70 comp rx=0 tx=0).stop 2024-04-25T00:50:51.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f912ffff640 1 -- 172.21.15.162:0/924786348 shutdown_connections 2024-04-25T00:50:51.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f912ffff640 1 --2- 172.21.15.162:0/924786348 >> v2:172.21.15.162:3300/0 conn(0x7f91280e3090 0x7f912804d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f912ffff640 1 --2- 172.21.15.162:0/924786348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9128038220 0x7f912804d3e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f912ffff640 1 --2- 172.21.15.162:0/924786348 >> v2:172.21.15.179:3300/0 conn(0x7f91280d9a50 0x7f912804e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f912ffff640 1 -- 172.21.15.162:0/924786348 >> 172.21.15.162:0/924786348 conn(0x7f912800e0d0 msgr2=0x7f912800e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f912ffff640 1 -- 172.21.15.162:0/924786348 shutdown_connections 2024-04-25T00:50:51.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f912ffff640 1 -- 172.21.15.162:0/924786348 wait complete. 2024-04-25T00:50:51.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f3f31c4d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f2c0c8070 0x7f3f2c14ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7fdc5659c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc580cd440 0x7fdc580cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:44708/0 (socket says 172.21.15.162:44708) 2024-04-25T00:50:51.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7fdc5659c640 1 -- 172.21.15.162:0/1746515791 learned_addr learned my addr 172.21.15.162:0/1746515791 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f912ffff640 1 Processor -- start 2024-04-25T00:50:51.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f912ffff640 1 -- start start 2024-04-25T00:50:51.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f3f31c4d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f2c0c8070 0x7f3f2c14ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:41806/0 (socket says 172.21.15.162:41806) 2024-04-25T00:50:51.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.005+0000 7f3f31c4d640 1 -- 172.21.15.162:0/2841093348 learned_addr learned my addr 172.21.15.162:0/2841093348 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f912ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9128038220 0x7f91280d6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f912ffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91280d9a50 0x7f91280e5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f912ffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91280e4250 0x7f91280e46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f912ffff640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f912804e8e0 con 0x7f91280d9a50 2024-04-25T00:50:51.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f912ffff640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f91280d9e30 con 0x7f9128038220 2024-04-25T00:50:51.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f912ffff640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f912804ea60 con 0x7f91280e4250 2024-04-25T00:50:51.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f380affd640 1 -- 172.21.15.162:0/2402893638 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38000b5070 con 0x7f38040d5c30 2024-04-25T00:50:51.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f380affd640 1 -- 172.21.15.162:0/2402893638 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38000a89d0 con 0x7f38040d5c30 2024-04-25T00:50:51.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f380affd640 1 -- 172.21.15.162:0/2402893638 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38000a8da0 con 0x7f38040d5c30 2024-04-25T00:50:51.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f381156e640 1 -- 172.21.15.162:0/2402893638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38040d5c30 msgr2=0x7f380404c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f381156e640 1 --2- 172.21.15.162:0/2402893638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38040d5c30 0x7f380404c4b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3800009870 tx=0x7f380001ed10 comp rx=0 tx=0).stop 2024-04-25T00:50:51.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f381156e640 1 -- 172.21.15.162:0/2402893638 shutdown_connections 2024-04-25T00:50:51.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f381156e640 1 --2- 172.21.15.162:0/2402893638 >> v2:172.21.15.179:3300/0 conn(0x7f3804046a50 0x7f38040df020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f381156e640 1 --2- 172.21.15.162:0/2402893638 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38040d5c30 0x7f380404c4b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f381156e640 1 -- 172.21.15.162:0/2402893638 >> 172.21.15.162:0/2402893638 conn(0x7f380404dd40 msgr2=0x7f380404e150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f381156e640 1 -- 172.21.15.162:0/2402893638 shutdown_connections 2024-04-25T00:50:51.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f381156e640 1 -- 172.21.15.162:0/2402893638 wait complete. 2024-04-25T00:50:51.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f381156e640 1 Processor -- start 2024-04-25T00:50:51.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.009+0000 7f381156e640 1 -- start start 2024-04-25T00:50:51.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.013+0000 7f381156e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3804046a50 0x7f3804165850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.013+0000 7f381156e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f380404d840 0x7f38040d96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.013+0000 7f381156e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38040d5c30 0x7f38040d9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.013+0000 7f381156e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f38040d6010 con 0x7f380404d840 2024-04-25T00:50:51.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.013+0000 7f381156e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f38040092e0 con 0x7f3804046a50 2024-04-25T00:50:51.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.013+0000 7f381156e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f38040d6190 con 0x7f38040d5c30 2024-04-25T00:50:51.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.013+0000 7f3f31c4d640 1 -- 172.21.15.162:0/2841093348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f2c071bd0 msgr2=0x7f3f2c1f8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.013+0000 7f3f31c4d640 1 --2- 172.21.15.162:0/2841093348 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3f2c071bd0 0x7f3f2c1f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.013+0000 7f3f31c4d640 1 -- 172.21.15.162:0/2841093348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f2c1505b0 msgr2=0x7f3f2c1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.013+0000 7f3f31c4d640 1 --2- 172.21.15.162:0/2841093348 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3f2c1505b0 0x7f3f2c1551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.013+0000 7f3f31c4d640 1 -- 172.21.15.162:0/2841093348 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f2c0c1c30 con 0x7f3f2c0c8070 2024-04-25T00:50:51.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.013+0000 7fdc5659c640 1 -- 172.21.15.162:0/1746515791 >> v2:172.21.15.179:3300/0 conn(0x7fdc5815c230 msgr2=0x7fdc58071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.013+0000 7fdc5659c640 1 --2- 172.21.15.162:0/1746515791 >> v2:172.21.15.179:3300/0 conn(0x7fdc5815c230 0x7fdc58071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.013+0000 7fdc5659c640 1 -- 172.21.15.162:0/1746515791 >> v1:172.21.15.179:6789/0 conn(0x7fdc581523e0 legacy=0x7fdc581581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.013+0000 7fdc5659c640 1 -- 172.21.15.162:0/1746515791 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc58158d40 con 0x7fdc580cd440 2024-04-25T00:50:51.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.017+0000 7f6fc10a0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fbc0cc610 0x7f6fbc0cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.017+0000 7f6fc18a1640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f6fbc0ca580 0x7f6fbc15a400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:55334/0 (socket says 172.21.15.162:55334) 2024-04-25T00:50:51.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.017+0000 7f6fc18a1640 1 -- 172.21.15.162:0/3081127105 learned_addr learned my addr 172.21.15.162:0/3081127105 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:51.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.017+0000 7f3f31c4d640 1 --2- 172.21.15.162:0/2841093348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f2c0c8070 0x7f3f2c14ea10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800b410 tx=0x7f3f2800b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.017+0000 7f2a10e5f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a0c150740 0x7f2a0c13a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.025+0000 7fdc5659c640 1 --2- 172.21.15.162:0/1746515791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc580cd440 0x7fdc580cb830 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009870 tx=0x7fdc4c01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6efe08dd13f960fa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.025+0000 7f2a10e5f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a0c150740 0x7f2a0c13a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:41810/0 (socket says 172.21.15.162:41810) 2024-04-25T00:50:51.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.025+0000 7f2a10e5f640 1 -- 172.21.15.162:0/2636258136 learned_addr learned my addr 172.21.15.162:0/2636258136 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.025+0000 7f912f7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91280e4250 0x7f91280e46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.027 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.025+0000 7f912f7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91280e4250 0x7f91280e46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:44750/0 (socket says 172.21.15.162:44750) 2024-04-25T00:50:51.027 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.025+0000 7f912f7fe640 1 -- 172.21.15.162:0/328287687 learned_addr learned my addr 172.21.15.162:0/328287687 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.027 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.025+0000 7f9cd9ffb640 1 -- 172.21.15.162:0/1623549201 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9cd401a070 con 0x7f9ce415ae40 2024-04-25T00:50:51.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.025+0000 7f9cd9ffb640 1 --2- 172.21.15.162:0/1623549201 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9cc80678f0 0x7f9cc8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.025+0000 7f9ce92d8640 1 --2- 172.21.15.162:0/1623549201 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9cc80678f0 0x7f9cc8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.025+0000 7f9ce92d8640 1 --2- 172.21.15.162:0/1623549201 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9cc80678f0 0x7f9cc8069db0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00ad000 tx=0x7f9ce0004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.029+0000 7f380bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3804046a50 0x7f3804165850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.029+0000 7f6fc10a0640 1 -- 172.21.15.162:0/3081127105 >> v2:172.21.15.162:3300/0 conn(0x7f6fbc06c310 msgr2=0x7f6fbc0cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.029+0000 7f6fc10a0640 1 --2- 172.21.15.162:0/3081127105 >> v2:172.21.15.162:3300/0 conn(0x7f6fbc06c310 0x7f6fbc0cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.029+0000 7f6fc10a0640 1 -- 172.21.15.162:0/3081127105 >> v1:172.21.15.179:6789/0 conn(0x7f6fbc0ca580 legacy=0x7f6fbc15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.029+0000 7f6fc10a0640 1 -- 172.21.15.162:0/3081127105 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fbc06cd50 con 0x7f6fbc0cc610 2024-04-25T00:50:51.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.037+0000 7f2a10e5f640 1 -- 172.21.15.162:0/2636258136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a0c0c6570 msgr2=0x7f2a0c1f2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.037+0000 7f2a10e5f640 1 --2- 172.21.15.162:0/2636258136 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a0c0c6570 0x7f2a0c1f2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.037+0000 7f2a10e5f640 1 -- 172.21.15.162:0/2636258136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a0c073250 msgr2=0x7f2a0c0cc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.037+0000 7f2a10e5f640 1 --2- 172.21.15.162:0/2636258136 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a0c073250 0x7f2a0c0cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.037+0000 7f2a10e5f640 1 -- 172.21.15.162:0/2636258136 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a0c139740 con 0x7f2a0c150740 2024-04-25T00:50:51.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.037+0000 7f912f7fe640 1 -- 172.21.15.162:0/328287687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9128038220 msgr2=0x7f91280d6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.037+0000 7f912f7fe640 1 --2- 172.21.15.162:0/328287687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9128038220 0x7f91280d6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.037+0000 7f912f7fe640 1 -- 172.21.15.162:0/328287687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91280d9a50 msgr2=0x7f91280e5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.037+0000 7f912f7fe640 1 --2- 172.21.15.162:0/328287687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f91280d9a50 0x7f91280e5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.037+0000 7f912f7fe640 1 -- 172.21.15.162:0/328287687 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91280d7810 con 0x7f91280e4250 2024-04-25T00:50:51.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.037+0000 7f3f22ffd640 1 -- 172.21.15.162:0/2841093348 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28015020 con 0x7f3f2c0c8070 2024-04-25T00:50:51.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.037+0000 7f3f22ffd640 1 -- 172.21.15.162:0/2841093348 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f28011830 con 0x7f3f2c0c8070 2024-04-25T00:50:51.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.037+0000 7f3f346b2640 1 -- 172.21.15.162:0/2841093348 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f2c1faee0 con 0x7f3f2c0c8070 2024-04-25T00:50:51.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.037+0000 7f3f22ffd640 1 -- 172.21.15.162:0/2841093348 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f28011c20 con 0x7f3f2c0c8070 2024-04-25T00:50:51.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.037+0000 7f3f346b2640 1 -- 172.21.15.162:0/2841093348 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f2c1fb480 con 0x7f3f2c0c8070 2024-04-25T00:50:51.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.041+0000 7f748affd640 1 -- 172.21.15.162:0/1174545559 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f748c01a070 con 0x7f74940c7220 2024-04-25T00:50:51.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.041+0000 7f380bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3804046a50 0x7f3804165850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:41840/0 (socket says 172.21.15.162:41840) 2024-04-25T00:50:51.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.041+0000 7f380bfff640 1 -- 172.21.15.162:0/2115985040 learned_addr learned my addr 172.21.15.162:0/2115985040 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.041+0000 7f748affd640 1 --2- 172.21.15.162:0/1174545559 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f7478067910 0x7f7478069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.041+0000 7f3f346b2640 1 -- 172.21.15.162:0/2841093348 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3f2c1f88b0 con 0x7f3f2c0c8070 2024-04-25T00:50:51.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.041+0000 7f74999f2640 1 --2- 172.21.15.162:0/1174545559 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f7478067910 0x7f7478069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.041+0000 7f2a10e5f640 1 --2- 172.21.15.162:0/2636258136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a0c150740 0x7f2a0c13a4e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00e820 tx=0x7f29fc00ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.041+0000 7f74999f2640 1 --2- 172.21.15.162:0/1174545559 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f7478067910 0x7f7478069dd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f74840ae000 tx=0x7f7484008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.045+0000 7f748affd640 1 -- 172.21.15.162:0/1174545559 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f748c053fd0 con 0x7f74940c7220 2024-04-25T00:50:51.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.045+0000 7f748affd640 1 --2- 172.21.15.162:0/1174545559 >> [v2:172.21.15.179:6816/3338082657,v1:172.21.15.179:6817/3338082657] conn(0x7f747806fab0 0x7f7478071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.045+0000 7f748affd640 1 -- 172.21.15.162:0/1174545559 --> [v2:172.21.15.179:6816/3338082657,v1:172.21.15.179:6817/3338082657] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7478072580 con 0x7f747806fab0 2024-04-25T00:50:51.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.045+0000 7f748affd640 1 -- 172.21.15.162:0/1174545559 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f748c0521d0 con 0x7f74940c7220 2024-04-25T00:50:51.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.045+0000 7f749a9f4640 1 --2- 172.21.15.162:0/1174545559 >> [v2:172.21.15.179:6816/3338082657,v1:172.21.15.179:6817/3338082657] conn(0x7f747806fab0 0x7f7478071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.049+0000 7f749a9f4640 1 --2- 172.21.15.162:0/1174545559 >> [v2:172.21.15.179:6816/3338082657,v1:172.21.15.179:6817/3338082657] conn(0x7f747806fab0 0x7f7478071ed0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.049+0000 7f9cd9ffb640 1 -- 172.21.15.162:0/1623549201 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f9cd4053c60 con 0x7f9ce415ae40 2024-04-25T00:50:51.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.049+0000 7f9cd9ffb640 1 --2- 172.21.15.162:0/1623549201 >> [v2:172.21.15.162:6810/2734546478,v1:172.21.15.162:6811/2734546478] conn(0x7f9cc806faf0 0x7f9cc8071f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.049+0000 7f9cd9ffb640 1 -- 172.21.15.162:0/1623549201 --> [v2:172.21.15.162:6810/2734546478,v1:172.21.15.162:6811/2734546478] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9cd401eec0 con 0x7f9cc806faf0 2024-04-25T00:50:51.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.049+0000 7f9cd9ffb640 1 -- 172.21.15.162:0/1623549201 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9cd4051e60 con 0x7f9ce415ae40 2024-04-25T00:50:51.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.049+0000 7f9ce9ad9640 1 --2- 172.21.15.162:0/1623549201 >> [v2:172.21.15.162:6810/2734546478,v1:172.21.15.162:6811/2734546478] conn(0x7f9cc806faf0 0x7f9cc8071f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.049+0000 7f748affd640 1 -- 172.21.15.162:0/1174545559 <== osd.4 v2:172.21.15.179:6816/3338082657 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7478072580 con 0x7f747806fab0 2024-04-25T00:50:51.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.049+0000 7f9ce9ad9640 1 --2- 172.21.15.162:0/1623549201 >> [v2:172.21.15.162:6810/2734546478,v1:172.21.15.162:6811/2734546478] conn(0x7f9cc806faf0 0x7f9cc8071f10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.049+0000 7f6fc10a0640 1 --2- 172.21.15.162:0/3081127105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fbc0cc610 0x7f6fbc0cc9f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0097c0 tx=0x7f6fac01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c09c88c9c7584c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.052 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.049+0000 7f9cd9ffb640 1 -- 172.21.15.162:0/1623549201 <== osd.0 v2:172.21.15.162:6810/2734546478 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9cd401eec0 con 0x7f9cc806faf0 2024-04-25T00:50:51.052 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.049+0000 7f380bfff640 1 -- 172.21.15.162:0/2115985040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38040d5c30 msgr2=0x7f38040d9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.052 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.049+0000 7f380bfff640 1 --2- 172.21.15.162:0/2115985040 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f38040d5c30 0x7f38040d9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.052 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.049+0000 7f380bfff640 1 -- 172.21.15.162:0/2115985040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f380404d840 msgr2=0x7f38040d96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.049+0000 7f380bfff640 1 --2- 172.21.15.162:0/2115985040 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f380404d840 0x7f38040d96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.049+0000 7f380bfff640 1 -- 172.21.15.162:0/2115985040 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38040cd5e0 con 0x7f3804046a50 2024-04-25T00:50:51.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.053+0000 7f912f7fe640 1 --2- 172.21.15.162:0/328287687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91280e4250 0x7f91280e46d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f91300765f0 tx=0x7f9130068d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.057+0000 7fdc55d9b640 1 -- 172.21.15.162:0/1746515791 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0b5070 con 0x7fdc580cd440 2024-04-25T00:50:51.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.057+0000 7fdc55d9b640 1 -- 172.21.15.162:0/1746515791 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4c0a8a50 con 0x7fdc580cd440 2024-04-25T00:50:51.060 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.057+0000 7fdc55d9b640 1 -- 172.21.15.162:0/1746515791 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0a8e20 con 0x7fdc580cd440 2024-04-25T00:50:51.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.057+0000 7f2a08ff9640 1 -- 172.21.15.162:0/2636258136 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc017070 con 0x7f2a0c150740 2024-04-25T00:50:51.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.057+0000 7f2a08ff9640 1 -- 172.21.15.162:0/2636258136 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29fc00c940 con 0x7f2a0c150740 2024-04-25T00:50:51.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.057+0000 7f2a08ff9640 1 -- 172.21.15.162:0/2636258136 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc00cd10 con 0x7f2a0c150740 2024-04-25T00:50:51.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.057+0000 7f2a128c2640 1 -- 172.21.15.162:0/2636258136 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a0c1f31b0 con 0x7f2a0c150740 2024-04-25T00:50:51.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.061+0000 7fdc5d1ec640 1 -- 172.21.15.162:0/1746515791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc580cd440 msgr2=0x7fdc580cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.061 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.061+0000 7fdc5d1ec640 1 --2- 172.21.15.162:0/1746515791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc580cd440 0x7fdc580cb830 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c009870 tx=0x7fdc4c01ed50 comp rx=0 tx=0).stop 2024-04-25T00:50:51.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.061+0000 7fdc5d1ec640 1 -- 172.21.15.162:0/1746515791 shutdown_connections 2024-04-25T00:50:51.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.061+0000 7fdc5d1ec640 1 --2- 172.21.15.162:0/1746515791 >> v2:172.21.15.179:3300/0 conn(0x7fdc5815c230 0x7fdc58071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.061+0000 7fdc5d1ec640 1 --2- 172.21.15.162:0/1746515791 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc580cd440 0x7fdc580cb830 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.061+0000 7fdc5d1ec640 1 -- 172.21.15.162:0/1746515791 >> 172.21.15.162:0/1746515791 conn(0x7fdc5806b810 msgr2=0x7fdc5806f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.061+0000 7fdc5d1ec640 1 -- 172.21.15.162:0/1746515791 shutdown_connections 2024-04-25T00:50:51.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.061+0000 7f2a128c2640 1 -- 172.21.15.162:0/2636258136 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0c139ce0 con 0x7f2a0c150740 2024-04-25T00:50:51.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.061+0000 7fdc5d1ec640 1 -- 172.21.15.162:0/1746515791 wait complete. 2024-04-25T00:50:51.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.061+0000 7f29f27fc640 1 -- 172.21.15.162:0/2636258136 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2a0c04f510 con 0x7f2a0c150740 2024-04-25T00:50:51.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.061+0000 7fdc5d1ec640 1 Processor -- start 2024-04-25T00:50:51.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.061+0000 7fdc5d1ec640 1 -- start start 2024-04-25T00:50:51.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.061+0000 7fdc5d1ec640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc580cd440 0x7fdc5814cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.061+0000 7fdc5d1ec640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc581523e0 0x7fdc580713b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.061+0000 7fdc5d1ec640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc5815c230 0x7fdc581edbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.061+0000 7fdc5d1ec640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5815bd10 con 0x7fdc581523e0 2024-04-25T00:50:51.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.061+0000 7fdc5d1ec640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdc5815ba30 con 0x7fdc5815c230 2024-04-25T00:50:51.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.061+0000 7fdc5d1ec640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdc581527c0 con 0x7fdc580cd440 2024-04-25T00:50:51.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.065+0000 7f749b1f5640 1 -- 172.21.15.162:0/1174545559 --> [v2:172.21.15.179:6816/3338082657,v1:172.21.15.179:6817/3338082657] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f749404f510 con 0x7f747806fab0 2024-04-25T00:50:51.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.065+0000 7f748affd640 1 -- 172.21.15.162:0/1174545559 <== osd.4 v2:172.21.15.179:6816/3338082657 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f749404f510 con 0x7f747806fab0 2024-04-25T00:50:51.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.065+0000 7f9ceb53c640 1 -- 172.21.15.162:0/1623549201 --> [v2:172.21.15.162:6810/2734546478,v1:172.21.15.162:6811/2734546478] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9cc4002de0 con 0x7f9cc806faf0 2024-04-25T00:50:51.069 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.065+0000 7f9cd9ffb640 1 -- 172.21.15.162:0/1623549201 <== osd.0 v2:172.21.15.162:6810/2734546478 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9cc4002de0 con 0x7f9cc806faf0 2024-04-25T00:50:51.069 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.065+0000 7f749b1f5640 1 -- 172.21.15.162:0/1174545559 >> [v2:172.21.15.179:6816/3338082657,v1:172.21.15.179:6817/3338082657] conn(0x7f747806fab0 msgr2=0x7f7478071ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.069 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.065+0000 7f749b1f5640 1 --2- 172.21.15.162:0/1174545559 >> [v2:172.21.15.179:6816/3338082657,v1:172.21.15.179:6817/3338082657] conn(0x7f747806fab0 0x7f7478071ed0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f749b1f5640 1 -- 172.21.15.162:0/1174545559 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f7478067910 msgr2=0x7f7478069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f749b1f5640 1 --2- 172.21.15.162:0/1174545559 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f7478067910 0x7f7478069dd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f74840ae000 tx=0x7f7484008040 comp rx=0 tx=0).stop 2024-04-25T00:50:51.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f749b1f5640 1 -- 172.21.15.162:0/1174545559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74940c7220 msgr2=0x7f74941521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f749b1f5640 1 --2- 172.21.15.162:0/1174545559 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f74940c7220 0x7f74941521d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f748c00c7a0 tx=0x7f748c00cc60 comp rx=0 tx=0).stop 2024-04-25T00:50:51.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f749a9f4640 1 -- 172.21.15.162:0/1174545559 reap_dead start 2024-04-25T00:50:51.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f749b1f5640 1 -- 172.21.15.162:0/1174545559 shutdown_connections 2024-04-25T00:50:51.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f749b1f5640 1 -- 172.21.15.162:0/1174545559 >> 172.21.15.162:0/1174545559 conn(0x7f749406b210 msgr2=0x7f74940c7c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f749b1f5640 1 -- 172.21.15.162:0/1174545559 shutdown_connections 2024-04-25T00:50:51.071 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f749b1f5640 1 -- 172.21.15.162:0/1174545559 wait complete. 2024-04-25T00:50:51.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f9ceb53c640 1 -- 172.21.15.162:0/1623549201 >> [v2:172.21.15.162:6810/2734546478,v1:172.21.15.162:6811/2734546478] conn(0x7f9cc806faf0 msgr2=0x7f9cc8071f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f9ceb53c640 1 --2- 172.21.15.162:0/1623549201 >> [v2:172.21.15.162:6810/2734546478,v1:172.21.15.162:6811/2734546478] conn(0x7f9cc806faf0 0x7f9cc8071f10 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f9ceb53c640 1 -- 172.21.15.162:0/1623549201 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9cc80678f0 msgr2=0x7f9cc8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f9ceb53c640 1 --2- 172.21.15.162:0/1623549201 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9cc80678f0 0x7f9cc8069db0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9ce00ad000 tx=0x7f9ce0004740 comp rx=0 tx=0).stop 2024-04-25T00:50:51.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f9ceb53c640 1 -- 172.21.15.162:0/1623549201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce415ae40 msgr2=0x7f9ce4159af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f9ceb53c640 1 --2- 172.21.15.162:0/1623549201 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ce415ae40 0x7f9ce4159af0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400c430 tx=0x7f9cd400c8f0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f9ce9ad9640 1 -- 172.21.15.162:0/1623549201 reap_dead start 2024-04-25T00:50:51.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f9ceb53c640 1 -- 172.21.15.162:0/1623549201 shutdown_connections 2024-04-25T00:50:51.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f9ceb53c640 1 -- 172.21.15.162:0/1623549201 >> 172.21.15.162:0/1623549201 conn(0x7f9ce4066fc0 msgr2=0x7f9ce415c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f9ceb53c640 1 -- 172.21.15.162:0/1623549201 shutdown_connections 2024-04-25T00:50:51.072 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.069+0000 7f9ceb53c640 1 -- 172.21.15.162:0/1623549201 wait complete. 2024-04-25T00:50:51.073 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.073+0000 7fdc5659c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc581523e0 0x7fdc580713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.073+0000 7fdc5659c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc581523e0 0x7fdc580713b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35304/0 (socket says 172.21.15.162:35304) 2024-04-25T00:50:51.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.073+0000 7fdc5659c640 1 -- 172.21.15.162:0/1429386099 learned_addr learned my addr 172.21.15.162:0/1429386099 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.073+0000 7f6fb3fff640 1 -- 172.21.15.162:0/3081127105 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0b5070 con 0x7f6fbc0cc610 2024-04-25T00:50:51.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.073+0000 7f6fb3fff640 1 -- 172.21.15.162:0/3081127105 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fac0a8990 con 0x7f6fbc0cc610 2024-04-25T00:50:51.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.073+0000 7f6fb3fff640 1 -- 172.21.15.162:0/3081127105 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fac0a8d60 con 0x7f6fbc0cc610 2024-04-25T00:50:51.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.077+0000 7f6fc3304640 1 -- 172.21.15.162:0/3081127105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fbc0cc610 msgr2=0x7f6fbc0cc9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.077+0000 7f6fc3304640 1 --2- 172.21.15.162:0/3081127105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fbc0cc610 0x7f6fbc0cc9f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0097c0 tx=0x7f6fac01ec90 comp rx=0 tx=0).stop 2024-04-25T00:50:51.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.077+0000 7f6fc3304640 1 -- 172.21.15.162:0/3081127105 shutdown_connections 2024-04-25T00:50:51.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.077+0000 7f6fc3304640 1 --2- 172.21.15.162:0/3081127105 >> v2:172.21.15.162:3300/0 conn(0x7f6fbc06c310 0x7f6fbc0cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.077+0000 7f6fc3304640 1 --2- 172.21.15.162:0/3081127105 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fbc0cc610 0x7f6fbc0cc9f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.077+0000 7f6fc3304640 1 -- 172.21.15.162:0/3081127105 >> 172.21.15.162:0/3081127105 conn(0x7f6fbc0b1710 msgr2=0x7f6fbc0b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.077+0000 7f6fc3304640 1 -- 172.21.15.162:0/3081127105 shutdown_connections 2024-04-25T00:50:51.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.077+0000 7f6fc3304640 1 -- 172.21.15.162:0/3081127105 wait complete. 2024-04-25T00:50:51.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.077+0000 7f6fc3304640 1 Processor -- start 2024-04-25T00:50:51.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.077+0000 7f6fc3304640 1 -- start start 2024-04-25T00:50:51.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.077+0000 7f6fc3304640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fbc06c310 0x7f6fbc0c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.077+0000 7f6fc3304640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fbc0ca580 0x7f6fbc0c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.077+0000 7f6fc3304640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fbc0cc610 0x7f6fbc1f0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.077+0000 7f6fc3304640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc15e010 con 0x7f6fbc06c310 2024-04-25T00:50:51.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.077+0000 7f6fc3304640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6fbc15dd30 con 0x7f6fbc0cc610 2024-04-25T00:50:51.079 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.077+0000 7f6fc3304640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6fbc15e2f0 con 0x7f6fbc0ca580 2024-04-25T00:50:51.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.081+0000 7fdc5659c640 1 -- 172.21.15.162:0/1429386099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc580cd440 msgr2=0x7fdc5814cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.081+0000 7fdc5659c640 1 --2- 172.21.15.162:0/1429386099 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc580cd440 0x7fdc5814cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.081+0000 7fdc5659c640 1 -- 172.21.15.162:0/1429386099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc5815c230 msgr2=0x7fdc581edbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.081+0000 7fdc5659c640 1 --2- 172.21.15.162:0/1429386099 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc5815c230 0x7fdc581edbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.081+0000 7fdc5659c640 1 -- 172.21.15.162:0/1429386099 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc581581d0 con 0x7fdc581523e0 2024-04-25T00:50:51.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.085+0000 7f380bfff640 1 --2- 172.21.15.162:0/2115985040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3804046a50 0x7f3804165850 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f380001f5b0 tx=0x7f380001bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.085+0000 7fdc5659c640 1 --2- 172.21.15.162:0/1429386099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc581523e0 0x7fdc580713b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c01c980 tx=0x7fdc4c01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.088 INFO:teuthology.orchestra.run.smithi162.stdout:68719476751 2024-04-25T00:50:51.088 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T00:50:51.093 INFO:teuthology.orchestra.run.smithi162.stdout:64424509456 2024-04-25T00:50:51.093 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T00:50:51.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.093+0000 7f6fc089f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fbc0ca580 0x7f6fbc0c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.097+0000 7f91177fe640 1 -- 172.21.15.162:0/328287687 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9130068e40 con 0x7f91280e4250 2024-04-25T00:50:51.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.097+0000 7f91177fe640 1 -- 172.21.15.162:0/328287687 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9130073610 con 0x7f91280e4250 2024-04-25T00:50:51.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.097+0000 7f91177fe640 1 -- 172.21.15.162:0/328287687 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f913006e410 con 0x7f91280e4250 2024-04-25T00:50:51.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.097+0000 7f912ffff640 1 -- 172.21.15.162:0/328287687 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9128051420 con 0x7f91280e4250 2024-04-25T00:50:51.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.097+0000 7f912ffff640 1 -- 172.21.15.162:0/328287687 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9128052000 con 0x7f91280e4250 2024-04-25T00:50:51.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.097+0000 7f912ffff640 1 -- 172.21.15.162:0/328287687 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9128034e30 con 0x7f91280e4250 2024-04-25T00:50:51.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.097+0000 7f6fc089f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fbc0ca580 0x7f6fbc0c82e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:44770/0 (socket says 172.21.15.162:44770) 2024-04-25T00:50:51.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.097+0000 7f6fc089f640 1 -- 172.21.15.162:0/1789849000 learned_addr learned my addr 172.21.15.162:0/1789849000 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.113+0000 7f6fc089f640 1 -- 172.21.15.162:0/1789849000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fbc0cc610 msgr2=0x7f6fbc1f0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.113+0000 7f6fc089f640 1 --2- 172.21.15.162:0/1789849000 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6fbc0cc610 0x7f6fbc1f0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.113+0000 7f6fc089f640 1 -- 172.21.15.162:0/1789849000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fbc06c310 msgr2=0x7f6fbc0c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.113+0000 7f6fc089f640 1 --2- 172.21.15.162:0/1789849000 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6fbc06c310 0x7f6fbc0c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.113+0000 7f6fc089f640 1 -- 172.21.15.162:0/1789849000 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fbc1f3e50 con 0x7f6fbc0ca580 2024-04-25T00:50:51.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.121+0000 7f3f22ffd640 1 -- 172.21.15.162:0/2841093348 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3f28018020 con 0x7f3f2c0c8070 2024-04-25T00:50:51.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.121+0000 7f6fc089f640 1 --2- 172.21.15.162:0/1789849000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fbc0ca580 0x7f6fbc0c82e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800b440 tx=0x7f6fb800b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.121+0000 7f3f22ffd640 1 --2- 172.21.15.162:0/2841093348 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3f10067940 0x7f3f10069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.121+0000 7f3f3244e640 1 --2- 172.21.15.162:0/2841093348 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3f10067940 0x7f3f10069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.121+0000 7f3f3244e640 1 --2- 172.21.15.162:0/2841093348 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3f10067940 0x7f3f10069e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0b0000 tx=0x7f3f1c004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.129+0000 7f3f22ffd640 1 -- 172.21.15.162:0/2841093348 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f3f280546c0 con 0x7f3f2c0c8070 2024-04-25T00:50:51.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.129+0000 7f3f22ffd640 1 --2- 172.21.15.162:0/2841093348 >> [v2:172.21.15.179:6800/3403659125,v1:172.21.15.179:6803/3403659125] conn(0x7f3f1006fb40 0x7f3f10071f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.129+0000 7f3f22ffd640 1 -- 172.21.15.162:0/2841093348 --> [v2:172.21.15.179:6800/3403659125,v1:172.21.15.179:6803/3403659125] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f28018ec0 con 0x7f3f1006fb40 2024-04-25T00:50:51.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.129+0000 7f3f32c4f640 1 --2- 172.21.15.162:0/2841093348 >> [v2:172.21.15.179:6800/3403659125,v1:172.21.15.179:6803/3403659125] conn(0x7f3f1006fb40 0x7f3f10071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.129+0000 7f3f32c4f640 1 --2- 172.21.15.162:0/2841093348 >> [v2:172.21.15.179:6800/3403659125,v1:172.21.15.179:6803/3403659125] conn(0x7f3f1006fb40 0x7f3f10071f60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.129+0000 7f3f22ffd640 1 -- 172.21.15.162:0/2841093348 <== osd.7 v2:172.21.15.179:6800/3403659125 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3f28018ec0 con 0x7f3f1006fb40 2024-04-25T00:50:51.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.149+0000 7fdc3f7fe640 1 -- 172.21.15.162:0/1429386099 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0b5040 con 0x7fdc581523e0 2024-04-25T00:50:51.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.149+0000 7fdc3f7fe640 1 -- 172.21.15.162:0/1429386099 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc4c0be070 con 0x7fdc581523e0 2024-04-25T00:50:51.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.149+0000 7fdc5d1ec640 1 -- 172.21.15.162:0/1429386099 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc581f1120 con 0x7fdc581523e0 2024-04-25T00:50:51.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.149+0000 7fdc3f7fe640 1 -- 172.21.15.162:0/1429386099 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c0b9440 con 0x7fdc581523e0 2024-04-25T00:50:51.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.149+0000 7fdc5d1ec640 1 -- 172.21.15.162:0/1429386099 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc5814d850 con 0x7fdc581523e0 2024-04-25T00:50:51.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.153+0000 7fdc5d1ec640 1 -- 172.21.15.162:0/1429386099 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc58075110 con 0x7fdc581523e0 2024-04-25T00:50:51.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.153+0000 7f3f346b2640 1 -- 172.21.15.162:0/2841093348 --> [v2:172.21.15.179:6800/3403659125,v1:172.21.15.179:6803/3403659125] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3f2c1f88b0 con 0x7f3f1006fb40 2024-04-25T00:50:51.157 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.157+0000 7f3f22ffd640 1 -- 172.21.15.162:0/2841093348 <== osd.7 v2:172.21.15.179:6800/3403659125 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3f2c1f88b0 con 0x7f3f1006fb40 2024-04-25T00:50:51.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.157+0000 7f3f346b2640 1 -- 172.21.15.162:0/2841093348 >> [v2:172.21.15.179:6800/3403659125,v1:172.21.15.179:6803/3403659125] conn(0x7f3f1006fb40 msgr2=0x7f3f10071f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.157+0000 7f3f346b2640 1 --2- 172.21.15.162:0/2841093348 >> [v2:172.21.15.179:6800/3403659125,v1:172.21.15.179:6803/3403659125] conn(0x7f3f1006fb40 0x7f3f10071f60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.157+0000 7f3f346b2640 1 -- 172.21.15.162:0/2841093348 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3f10067940 msgr2=0x7f3f10069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.157+0000 7f3f346b2640 1 --2- 172.21.15.162:0/2841093348 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3f10067940 0x7f3f10069e00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0b0000 tx=0x7f3f1c004740 comp rx=0 tx=0).stop 2024-04-25T00:50:51.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.157+0000 7f3f346b2640 1 -- 172.21.15.162:0/2841093348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f2c0c8070 msgr2=0x7f3f2c14ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.157+0000 7f3f346b2640 1 --2- 172.21.15.162:0/2841093348 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3f2c0c8070 0x7f3f2c14ea10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800b410 tx=0x7f3f2800b8d0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.157+0000 7f3f32c4f640 1 -- 172.21.15.162:0/2841093348 reap_dead start 2024-04-25T00:50:51.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.157+0000 7f3f346b2640 1 -- 172.21.15.162:0/2841093348 shutdown_connections 2024-04-25T00:50:51.158 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.157+0000 7f3f346b2640 1 -- 172.21.15.162:0/2841093348 >> 172.21.15.162:0/2841093348 conn(0x7f3f2c06d7f0 msgr2=0x7f3f2c0c54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.157+0000 7f3f346b2640 1 -- 172.21.15.162:0/2841093348 shutdown_connections 2024-04-25T00:50:51.159 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.157+0000 7f3f346b2640 1 -- 172.21.15.162:0/2841093348 wait complete. 2024-04-25T00:50:51.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.177+0000 7fdc3f7fe640 1 -- 172.21.15.162:0/1429386099 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdc4c0a8910 con 0x7fdc581523e0 2024-04-25T00:50:51.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.177+0000 7fdc3f7fe640 1 --2- 172.21.15.162:0/1429386099 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdc44067910 0x7fdc44069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.177+0000 7fdc56d9d640 1 --2- 172.21.15.162:0/1429386099 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdc44067910 0x7fdc44069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.177+0000 7fdc56d9d640 1 --2- 172.21.15.162:0/1429386099 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdc44067910 0x7fdc44069dd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdc48000f70 tx=0x7fdc480079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.181 INFO:teuthology.orchestra.run.smithi162.stdout:68719476753 2024-04-25T00:50:51.181 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T00:50:51.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.181+0000 7fdc3f7fe640 1 -- 172.21.15.162:0/1429386099 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fdc4c0f29c0 con 0x7fdc581523e0 2024-04-25T00:50:51.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.181+0000 7fdc3f7fe640 1 --2- 172.21.15.162:0/1429386099 >> [v2:172.21.15.179:6801/823843016,v1:172.21.15.179:6802/823843016] conn(0x7fdc4406fb10 0x7fdc44071f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.181+0000 7fdc3f7fe640 1 -- 172.21.15.162:0/1429386099 --> [v2:172.21.15.179:6801/823843016,v1:172.21.15.179:6802/823843016] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc4c00af30 con 0x7fdc4406fb10 2024-04-25T00:50:51.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.181+0000 7fdc5759e640 1 --2- 172.21.15.162:0/1429386099 >> [v2:172.21.15.179:6801/823843016,v1:172.21.15.179:6802/823843016] conn(0x7fdc4406fb10 0x7fdc44071f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.181+0000 7fdc3f7fe640 1 -- 172.21.15.162:0/1429386099 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdc4c0f0bc0 con 0x7fdc581523e0 2024-04-25T00:50:51.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.181+0000 7fdc5759e640 1 --2- 172.21.15.162:0/1429386099 >> [v2:172.21.15.179:6801/823843016,v1:172.21.15.179:6802/823843016] conn(0x7fdc4406fb10 0x7fdc44071f30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.185+0000 7fdc3f7fe640 1 -- 172.21.15.162:0/1429386099 <== osd.6 v2:172.21.15.179:6801/823843016 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc4c00af30 con 0x7fdc4406fb10 2024-04-25T00:50:51.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.205+0000 7f885ed9e640 1 Processor -- start 2024-04-25T00:50:51.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.205+0000 7f885ed9e640 1 -- start start 2024-04-25T00:50:51.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.205+0000 7f885ed9e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f885815a580 0x7f88581543b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.205+0000 7f885ed9e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f885815daa0 0x7f88581548f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.205+0000 7f885ed9e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88580c5600 con 0x7f8858072d40 2024-04-25T00:50:51.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.205+0000 7f885ed9e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f885815aac0 con 0x7f885815a580 2024-04-25T00:50:51.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.205+0000 7f885ed9e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f885815ad80 con 0x7f885815daa0 2024-04-25T00:50:51.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.209+0000 7f8857fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f885815a580 0x7f88581543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.209+0000 7f885cb3a640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8858072d40 0x7f8858073120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:49582/0 (socket says 172.21.15.162:49582) 2024-04-25T00:50:51.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.209+0000 7f885cb3a640 1 -- 172.21.15.162:0/3873472805 learned_addr learned my addr 172.21.15.162:0/3873472805 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:51.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.209+0000 7f96e1770640 1 Processor -- start 2024-04-25T00:50:51.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.209+0000 7f96e1770640 1 -- start start 2024-04-25T00:50:51.211 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.209+0000 7f96e1770640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96dc0c5fe0 0x7f96dc06b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.209+0000 7f96e1770640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96dc067490 con 0x7f96dc0c5c00 2024-04-25T00:50:51.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.209+0000 7f96e1770640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96dc15b9e0 con 0x7f96dc066fc0 2024-04-25T00:50:51.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.209+0000 7f96e1770640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f96dc15b790 con 0x7f96dc0c5fe0 2024-04-25T00:50:51.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.209+0000 7fdc5d1ec640 1 -- 172.21.15.162:0/1429386099 --> [v2:172.21.15.179:6801/823843016,v1:172.21.15.179:6802/823843016] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdc580b2b10 con 0x7fdc4406fb10 2024-04-25T00:50:51.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.213+0000 7fdc3f7fe640 1 -- 172.21.15.162:0/1429386099 <== osd.6 v2:172.21.15.179:6801/823843016 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdc580b2b10 con 0x7fdc4406fb10 2024-04-25T00:50:51.213 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.213+0000 7fdc5d1ec640 1 -- 172.21.15.162:0/1429386099 >> [v2:172.21.15.179:6801/823843016,v1:172.21.15.179:6802/823843016] conn(0x7fdc4406fb10 msgr2=0x7fdc44071f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.214 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.213+0000 7fdc5d1ec640 1 --2- 172.21.15.162:0/1429386099 >> [v2:172.21.15.179:6801/823843016,v1:172.21.15.179:6802/823843016] conn(0x7fdc4406fb10 0x7fdc44071f30 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.214 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.213+0000 7fdc5d1ec640 1 -- 172.21.15.162:0/1429386099 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdc44067910 msgr2=0x7fdc44069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.214 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.213+0000 7fdc5d1ec640 1 --2- 172.21.15.162:0/1429386099 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdc44067910 0x7fdc44069dd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdc48000f70 tx=0x7fdc480079c0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.214 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.213+0000 7fdc5d1ec640 1 -- 172.21.15.162:0/1429386099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc581523e0 msgr2=0x7fdc580713b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.214 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.213+0000 7fdc5d1ec640 1 --2- 172.21.15.162:0/1429386099 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc581523e0 0x7fdc580713b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c01c980 tx=0x7fdc4c01baf0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.214 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.213+0000 7fdc5759e640 1 -- 172.21.15.162:0/1429386099 reap_dead start 2024-04-25T00:50:51.214 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.213+0000 7fdc5d1ec640 1 -- 172.21.15.162:0/1429386099 shutdown_connections 2024-04-25T00:50:51.214 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.213+0000 7fdc5d1ec640 1 -- 172.21.15.162:0/1429386099 >> 172.21.15.162:0/1429386099 conn(0x7fdc5806b810 msgr2=0x7fdc580c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.214 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.213+0000 7fdc5d1ec640 1 -- 172.21.15.162:0/1429386099 shutdown_connections 2024-04-25T00:50:51.214 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.213+0000 7fdc5d1ec640 1 -- 172.21.15.162:0/1429386099 wait complete. 2024-04-25T00:50:51.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.213+0000 7f8857fff640 1 -- 172.21.15.162:0/3873472805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f885815daa0 msgr2=0x7f88581548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.213+0000 7f8857fff640 1 --2- 172.21.15.162:0/3873472805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f885815daa0 0x7f88581548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.213+0000 7f8857fff640 1 -- 172.21.15.162:0/3873472805 >> v1:172.21.15.162:6789/0 conn(0x7f8858072d40 legacy=0x7f8858073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.213+0000 7f8857fff640 1 -- 172.21.15.162:0/3873472805 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885815b060 con 0x7f885815a580 2024-04-25T00:50:51.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.217+0000 7f8857fff640 1 --2- 172.21.15.162:0/3873472805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f885815a580 0x7f88581543b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f88440097c0 tx=0x7f884401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b59cbcb4b3e1f2cd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.221+0000 7f96daffd640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f96dc0c5c00 0x7f96dc13dae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:49586/0 (socket says 172.21.15.162:49586) 2024-04-25T00:50:51.223 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.221+0000 7f96daffd640 1 -- 172.21.15.162:0/2422770982 learned_addr learned my addr 172.21.15.162:0/2422770982 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:51.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.229+0000 7f88577fe640 1 -- 172.21.15.162:0/3873472805 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88440b0070 con 0x7f885815a580 2024-04-25T00:50:51.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.229+0000 7f88577fe640 1 -- 172.21.15.162:0/3873472805 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88440ab600 con 0x7f885815a580 2024-04-25T00:50:51.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.229+0000 7f88577fe640 1 -- 172.21.15.162:0/3873472805 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88440ab9d0 con 0x7f885815a580 2024-04-25T00:50:51.232 INFO:teuthology.orchestra.run.smithi162.stdout:68719476753 2024-04-25T00:50:51.232 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T00:50:51.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.229+0000 7f885ed9e640 1 -- 172.21.15.162:0/3873472805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f885815a580 msgr2=0x7f88581543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.229+0000 7f885ed9e640 1 --2- 172.21.15.162:0/3873472805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f885815a580 0x7f88581543b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f88440097c0 tx=0x7f884401c430 comp rx=0 tx=0).stop 2024-04-25T00:50:51.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.229+0000 7f96da7fc640 1 -- 172.21.15.162:0/2422770982 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512480787 0 0) 0x7f96dc067490 con 0x7f96dc0c5c00 2024-04-25T00:50:51.233 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.229+0000 7f885ed9e640 1 -- 172.21.15.162:0/3873472805 shutdown_connections 2024-04-25T00:50:51.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.229+0000 7f885ed9e640 1 --2- 172.21.15.162:0/3873472805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f885815daa0 0x7f88581548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.229+0000 7f885ed9e640 1 --2- 172.21.15.162:0/3873472805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f885815a580 0x7f88581543b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.229+0000 7f885ed9e640 1 -- 172.21.15.162:0/3873472805 >> 172.21.15.162:0/3873472805 conn(0x7f8858070280 msgr2=0x7f8858070690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.229+0000 7f96da7fc640 1 -- 172.21.15.162:0/2422770982 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96c8003530 con 0x7f96dc0c5c00 2024-04-25T00:50:51.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.229+0000 7f885ed9e640 1 -- 172.21.15.162:0/3873472805 shutdown_connections 2024-04-25T00:50:51.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.229+0000 7f885ed9e640 1 -- 172.21.15.162:0/3873472805 wait complete. 2024-04-25T00:50:51.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.233+0000 7f885ed9e640 1 Processor -- start 2024-04-25T00:50:51.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.233+0000 7f885ed9e640 1 -- start start 2024-04-25T00:50:51.236 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.233+0000 7f885ed9e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8858072d40 0x7f88581f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.233+0000 7f885ed9e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f885815a580 0x7f88581f3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.233+0000 7f885ed9e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f885815daa0 0x7f88581f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.233+0000 7f885ed9e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f88581671c0 con 0x7f8858072d40 2024-04-25T00:50:51.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.233+0000 7f885ed9e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8858167040 con 0x7f885815a580 2024-04-25T00:50:51.237 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.233+0000 7f885ed9e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8858167340 con 0x7f885815daa0 2024-04-25T00:50:51.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f96da7fc640 1 -- 172.21.15.162:0/2422770982 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1831488239 0 0) 0x7f96c8003530 con 0x7f96dc0c5c00 2024-04-25T00:50:51.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f96da7fc640 1 -- 172.21.15.162:0/2422770982 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96dc0c5fe0 msgr2=0x7f96dc06b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f96da7fc640 1 --2- 172.21.15.162:0/2422770982 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96dc0c5fe0 0x7f96dc06b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f96da7fc640 1 -- 172.21.15.162:0/2422770982 >> v1:172.21.15.179:6789/0 conn(0x7f96dc066fc0 legacy=0x7f96dc0c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f96da7fc640 1 -- 172.21.15.162:0/2422770982 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96dc15bcc0 con 0x7f96dc0c5c00 2024-04-25T00:50:51.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f96da7fc640 1 -- 172.21.15.162:0/2422770982 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7f96cc0016a0 con 0x7f96dc0c5c00 2024-04-25T00:50:51.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f96da7fc640 1 -- 172.21.15.162:0/2422770982 >> v1:172.21.15.162:6789/0 conn(0x7f96dc0c5c00 legacy=0x7f96dc13dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f96da7fc640 1 --2- 172.21.15.162:0/2422770982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96c80039f0 0x7f96c8003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f96da7fc640 1 --2- 172.21.15.162:0/2422770982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96c8004810 0x7f96c8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f96da7fc640 1 --2- 172.21.15.162:0/2422770982 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96dc0c5fe0 0x7f96c800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f96da7fc640 1 -- 172.21.15.162:0/2422770982 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc15b790 con 0x7f96c8004810 2024-04-25T00:50:51.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f96da7fc640 1 -- 172.21.15.162:0/2422770982 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f96c8005530 con 0x7f96c80039f0 2024-04-25T00:50:51.240 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f96da7fc640 1 -- 172.21.15.162:0/2422770982 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f96c8010320 con 0x7f96dc0c5fe0 2024-04-25T00:50:51.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f91177fe640 1 -- 172.21.15.162:0/328287687 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f913009b060 con 0x7f91280e4250 2024-04-25T00:50:51.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f91177fe640 1 --2- 172.21.15.162:0/328287687 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f911c067910 0x7f911c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.241 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f912effd640 1 --2- 172.21.15.162:0/328287687 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f911c067910 0x7f911c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f96d3fff640 1 --2- 172.21.15.162:0/2422770982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96c8004810 0x7f96c8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f912effd640 1 --2- 172.21.15.162:0/328287687 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f911c067910 0x7f911c069dd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9120006aa0 tx=0x7f9120006a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.237+0000 7f885cb3a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8858072d40 0x7f88581f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.241+0000 7f885cb3a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8858072d40 0x7f88581f71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:35330/0 (socket says 172.21.15.162:35330) 2024-04-25T00:50:51.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.241+0000 7f885cb3a640 1 -- 172.21.15.162:0/2119008564 learned_addr learned my addr 172.21.15.162:0/2119008564 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.245+0000 7f91177fe640 1 -- 172.21.15.162:0/328287687 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f91300cf410 con 0x7f91280e4250 2024-04-25T00:50:51.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.245+0000 7f91177fe640 1 --2- 172.21.15.162:0/328287687 >> [v2:172.21.15.162:6826/1726903362,v1:172.21.15.162:6827/1726903362] conn(0x7f911c06fab0 0x7f911c071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.245+0000 7f91177fe640 1 -- 172.21.15.162:0/328287687 --> [v2:172.21.15.162:6826/1726903362,v1:172.21.15.162:6827/1726903362] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f91300a0e80 con 0x7f911c06fab0 2024-04-25T00:50:51.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.245+0000 7f912e7fc640 1 --2- 172.21.15.162:0/328287687 >> [v2:172.21.15.162:6826/1726903362,v1:172.21.15.162:6827/1726903362] conn(0x7f911c06fab0 0x7f911c071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.245+0000 7f912e7fc640 1 --2- 172.21.15.162:0/328287687 >> [v2:172.21.15.162:6826/1726903362,v1:172.21.15.162:6827/1726903362] conn(0x7f911c06fab0 0x7f911c071ed0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.245+0000 7f96d3fff640 1 -- 172.21.15.162:0/2422770982 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96dc0c5fe0 msgr2=0x7f96c800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.245+0000 7f96d3fff640 1 --2- 172.21.15.162:0/2422770982 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96dc0c5fe0 0x7f96c800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.245+0000 7f96d3fff640 1 -- 172.21.15.162:0/2422770982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96c80039f0 msgr2=0x7f96c8003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.245+0000 7f96d3fff640 1 --2- 172.21.15.162:0/2422770982 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96c80039f0 0x7f96c8003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.245+0000 7f96d3fff640 1 -- 172.21.15.162:0/2422770982 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96dc15bcc0 con 0x7f96c8004810 2024-04-25T00:50:51.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.249+0000 7f885cb3a640 1 -- 172.21.15.162:0/2119008564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f885815daa0 msgr2=0x7f88581f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.251 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.249+0000 7f885cb3a640 1 --2- 172.21.15.162:0/2119008564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f885815daa0 0x7f88581f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.251 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.249+0000 7f885cb3a640 1 -- 172.21.15.162:0/2119008564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f885815a580 msgr2=0x7f88581f3a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.251 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.249+0000 7f885cb3a640 1 --2- 172.21.15.162:0/2119008564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f885815a580 0x7f88581f3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.251 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.249+0000 7f885cb3a640 1 -- 172.21.15.162:0/2119008564 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885814e330 con 0x7f8858072d40 2024-04-25T00:50:51.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.253+0000 7f885cb3a640 1 --2- 172.21.15.162:0/2119008564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8858072d40 0x7f88581f71f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c400 tx=0x7f884c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.249+0000 7f91177fe640 1 -- 172.21.15.162:0/328287687 <== osd.3 v2:172.21.15.162:6826/1726903362 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f91300a0e80 con 0x7f911c06fab0 2024-04-25T00:50:51.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.249+0000 7f91177fe640 1 -- 172.21.15.162:0/328287687 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f91300cd610 con 0x7f91280e4250 2024-04-25T00:50:51.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.253+0000 7f96d3fff640 1 --2- 172.21.15.162:0/2422770982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96c8004810 0x7f96c8004c90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f96dc0673c0 tx=0x7f96c401c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7525313be525b14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.257+0000 7f6fb1ffb640 1 -- 172.21.15.162:0/1789849000 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8015020 con 0x7f6fbc0ca580 2024-04-25T00:50:51.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.257+0000 7f6fb1ffb640 1 -- 172.21.15.162:0/1789849000 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fb80118b0 con 0x7f6fbc0ca580 2024-04-25T00:50:51.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.257+0000 7f6fb1ffb640 1 -- 172.21.15.162:0/1789849000 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8011ca0 con 0x7f6fbc0ca580 2024-04-25T00:50:51.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.257+0000 7f6fc3304640 1 -- 172.21.15.162:0/1789849000 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fbc1f4130 con 0x7f6fbc0ca580 2024-04-25T00:50:51.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.257+0000 7f6fc3304640 1 -- 172.21.15.162:0/1789849000 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fbc1f46f0 con 0x7f6fbc0ca580 2024-04-25T00:50:51.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.257+0000 7f6fc3304640 1 -- 172.21.15.162:0/1789849000 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6fbc068310 con 0x7f6fbc0ca580 2024-04-25T00:50:51.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.265+0000 7f96da7fc640 1 -- 172.21.15.162:0/2422770982 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4001270 con 0x7f96c8004810 2024-04-25T00:50:51.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.265+0000 7f96da7fc640 1 -- 172.21.15.162:0/2422770982 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96c4005270 con 0x7f96c8004810 2024-04-25T00:50:51.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.265+0000 7f96da7fc640 1 -- 172.21.15.162:0/2422770982 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96c4003620 con 0x7f96c8004810 2024-04-25T00:50:51.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.265+0000 7f96e1770640 1 -- 172.21.15.162:0/2422770982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96c8004810 msgr2=0x7f96c8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.265+0000 7f96e1770640 1 --2- 172.21.15.162:0/2422770982 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96c8004810 0x7f96c8004c90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f96dc0673c0 tx=0x7f96c401c2a0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.265+0000 7f96db7fe640 1 -- 172.21.15.162:0/2422770982 reap_dead start 2024-04-25T00:50:51.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.265+0000 7f96e1770640 1 -- 172.21.15.162:0/2422770982 shutdown_connections 2024-04-25T00:50:51.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.265+0000 7f96e1770640 1 -- 172.21.15.162:0/2422770982 >> 172.21.15.162:0/2422770982 conn(0x7f96dc06fa80 msgr2=0x7f96dc06fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.265+0000 7f96e1770640 1 -- 172.21.15.162:0/2422770982 shutdown_connections 2024-04-25T00:50:51.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.265+0000 7f88557fa640 1 -- 172.21.15.162:0/2119008564 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c017070 con 0x7f8858072d40 2024-04-25T00:50:51.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.265+0000 7f88557fa640 1 -- 172.21.15.162:0/2119008564 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f884c005cf0 con 0x7f8858072d40 2024-04-25T00:50:51.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.265+0000 7f88557fa640 1 -- 172.21.15.162:0/2119008564 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f884c0072d0 con 0x7f8858072d40 2024-04-25T00:50:51.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.265+0000 7f885ed9e640 1 -- 172.21.15.162:0/2119008564 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f885814e060 con 0x7f8858072d40 2024-04-25T00:50:51.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.265+0000 7f885ed9e640 1 -- 172.21.15.162:0/2119008564 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8858147df0 con 0x7f8858072d40 2024-04-25T00:50:51.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.265+0000 7f885ed9e640 1 -- 172.21.15.162:0/2119008564 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88581f7eb0 con 0x7f8858072d40 2024-04-25T00:50:51.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.265+0000 7f96e1770640 1 -- 172.21.15.162:0/2422770982 wait complete. 2024-04-25T00:50:51.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.265+0000 7f96e1770640 1 Processor -- start 2024-04-25T00:50:51.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.265+0000 7f96e1770640 1 -- start start 2024-04-25T00:50:51.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.269+0000 7f96e1770640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96c8004810 0x7f96dc13a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.269+0000 7f96e1770640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96dc0ca120 0x7f96dc1f5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.269+0000 7f96e1770640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96dc1590f0 0x7f96dc137a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.269+0000 7f96e1770640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc13e1f0 con 0x7f96dc1590f0 2024-04-25T00:50:51.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.269+0000 7f96e1770640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f96dc15c310 con 0x7f96c8004810 2024-04-25T00:50:51.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.269+0000 7f96e1770640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f96dc13e370 con 0x7f96dc0ca120 2024-04-25T00:50:51.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.277+0000 7f912ffff640 1 -- 172.21.15.162:0/328287687 --> [v2:172.21.15.162:6826/1726903362,v1:172.21.15.162:6827/1726903362] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f91280473c0 con 0x7f911c06fab0 2024-04-25T00:50:51.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.277+0000 7f91177fe640 1 -- 172.21.15.162:0/328287687 <== osd.3 v2:172.21.15.162:6826/1726903362 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f91280473c0 con 0x7f911c06fab0 2024-04-25T00:50:51.279 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.277+0000 7f912ffff640 1 -- 172.21.15.162:0/328287687 >> [v2:172.21.15.162:6826/1726903362,v1:172.21.15.162:6827/1726903362] conn(0x7f911c06fab0 msgr2=0x7f911c071ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.279 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.277+0000 7f912ffff640 1 --2- 172.21.15.162:0/328287687 >> [v2:172.21.15.162:6826/1726903362,v1:172.21.15.162:6827/1726903362] conn(0x7f911c06fab0 0x7f911c071ed0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.281+0000 7f912ffff640 1 -- 172.21.15.162:0/328287687 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f911c067910 msgr2=0x7f911c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.281+0000 7f912ffff640 1 --2- 172.21.15.162:0/328287687 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f911c067910 0x7f911c069dd0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9120006aa0 tx=0x7f9120006a30 comp rx=0 tx=0).stop 2024-04-25T00:50:51.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.281+0000 7f912ffff640 1 -- 172.21.15.162:0/328287687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91280e4250 msgr2=0x7f91280e46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.281+0000 7f912ffff640 1 --2- 172.21.15.162:0/328287687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f91280e4250 0x7f91280e46d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f91300765f0 tx=0x7f9130068d10 comp rx=0 tx=0).stop 2024-04-25T00:50:51.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.281+0000 7f912f7fe640 1 -- 172.21.15.162:0/328287687 reap_dead start 2024-04-25T00:50:51.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.281+0000 7f912ffff640 1 -- 172.21.15.162:0/328287687 shutdown_connections 2024-04-25T00:50:51.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.281+0000 7f912ffff640 1 -- 172.21.15.162:0/328287687 >> 172.21.15.162:0/328287687 conn(0x7f912800e0d0 msgr2=0x7f9128009b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.281+0000 7f912ffff640 1 -- 172.21.15.162:0/328287687 shutdown_connections 2024-04-25T00:50:51.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.281+0000 7f912ffff640 1 -- 172.21.15.162:0/328287687 wait complete. 2024-04-25T00:50:51.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.297+0000 7f2a08ff9640 1 -- 172.21.15.162:0/2636258136 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f29fc01a070 con 0x7f2a0c150740 2024-04-25T00:50:51.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.297+0000 7f2a08ff9640 1 --2- 172.21.15.162:0/2636258136 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f29f8067910 0x7f29f8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.297+0000 7f2a0bfff640 1 --2- 172.21.15.162:0/2636258136 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f29f8067910 0x7f29f8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.301+0000 7f2a0bfff640 1 --2- 172.21.15.162:0/2636258136 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f29f8067910 0x7f29f8069dd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2a040088f0 tx=0x7f2a04005e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.306 INFO:teuthology.orchestra.run.smithi162.stdout:64424509456 2024-04-25T00:50:51.307 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T00:50:51.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.309+0000 7f2a08ff9640 1 -- 172.21.15.162:0/2636258136 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f29fc054450 con 0x7f2a0c150740 2024-04-25T00:50:51.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.309+0000 7f2a08ff9640 1 --2- 172.21.15.162:0/2636258136 >> [v2:172.21.15.179:6824/4129338239,v1:172.21.15.179:6825/4129338239] conn(0x7f29f806fab0 0x7f29f8071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.309+0000 7f2a08ff9640 1 -- 172.21.15.162:0/2636258136 --> [v2:172.21.15.179:6824/4129338239,v1:172.21.15.179:6825/4129338239] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29f8072580 con 0x7f29f806fab0 2024-04-25T00:50:51.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.309+0000 7f2a08ff9640 1 -- 172.21.15.162:0/2636258136 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f29fc052650 con 0x7f2a0c150740 2024-04-25T00:50:51.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.309+0000 7f2a0b7fe640 1 --2- 172.21.15.162:0/2636258136 >> [v2:172.21.15.179:6824/4129338239,v1:172.21.15.179:6825/4129338239] conn(0x7f29f806fab0 0x7f29f8071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.309+0000 7f2a0b7fe640 1 --2- 172.21.15.162:0/2636258136 >> [v2:172.21.15.179:6824/4129338239,v1:172.21.15.179:6825/4129338239] conn(0x7f29f806fab0 0x7f29f8071ed0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.309+0000 7f2a08ff9640 1 -- 172.21.15.162:0/2636258136 <== osd.5 v2:172.21.15.179:6824/4129338239 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29f8072580 con 0x7f29f806fab0 2024-04-25T00:50:51.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.313+0000 7f3808ff9640 1 -- 172.21.15.162:0/2115985040 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38000b5040 con 0x7f3804046a50 2024-04-25T00:50:51.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.313+0000 7f3808ff9640 1 -- 172.21.15.162:0/2115985040 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38000c1070 con 0x7f3804046a50 2024-04-25T00:50:51.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.313+0000 7f3808ff9640 1 -- 172.21.15.162:0/2115985040 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38000b0cb0 con 0x7f3804046a50 2024-04-25T00:50:51.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.313+0000 7f381156e640 1 -- 172.21.15.162:0/2115985040 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3804050eb0 con 0x7f3804046a50 2024-04-25T00:50:51.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.313+0000 7f381156e640 1 -- 172.21.15.162:0/2115985040 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38040db640 con 0x7f3804046a50 2024-04-25T00:50:51.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.313+0000 7f381156e640 1 -- 172.21.15.162:0/2115985040 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f38040dbfe0 con 0x7f3804046a50 2024-04-25T00:50:51.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.317+0000 7f96daffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96c8004810 0x7f96dc13a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.317+0000 7f96db7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96dc1590f0 0x7f96dc137a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.317+0000 7f96daffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96c8004810 0x7f96dc13a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:41888/0 (socket says 172.21.15.162:41888) 2024-04-25T00:50:51.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.317+0000 7f96daffd640 1 -- 172.21.15.162:0/2415505102 learned_addr learned my addr 172.21.15.162:0/2415505102 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.329+0000 7f96daffd640 1 -- 172.21.15.162:0/2415505102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96dc0ca120 msgr2=0x7f96dc1f5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.329+0000 7f96daffd640 1 --2- 172.21.15.162:0/2415505102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96dc0ca120 0x7f96dc1f5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.329+0000 7f96daffd640 1 -- 172.21.15.162:0/2415505102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96dc1590f0 msgr2=0x7f96dc137a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.329+0000 7f96daffd640 1 --2- 172.21.15.162:0/2415505102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96dc1590f0 0x7f96dc137a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.329+0000 7f96daffd640 1 -- 172.21.15.162:0/2415505102 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96dc15b5c0 con 0x7f96c8004810 2024-04-25T00:50:51.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.329+0000 7f6fb1ffb640 1 -- 172.21.15.162:0/1789849000 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6fb8018020 con 0x7f6fbc0ca580 2024-04-25T00:50:51.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.329+0000 7f6fb1ffb640 1 --2- 172.21.15.162:0/1789849000 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6fa00678c0 0x7f6fa0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.329+0000 7f6fc10a0640 1 --2- 172.21.15.162:0/1789849000 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6fa00678c0 0x7f6fa0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.329+0000 7f6fc10a0640 1 --2- 172.21.15.162:0/1789849000 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6fa00678c0 0x7f6fa0069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0b2000 tx=0x7f6fac004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7f29f27fc640 1 -- 172.21.15.162:0/2636258136 --> [v2:172.21.15.179:6824/4129338239,v1:172.21.15.179:6825/4129338239] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2a0c04f510 con 0x7f29f806fab0 2024-04-25T00:50:51.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7fc762d55640 1 Processor -- start 2024-04-25T00:50:51.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7f2a08ff9640 1 -- 172.21.15.162:0/2636258136 <== osd.5 v2:172.21.15.179:6824/4129338239 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2a0c04f510 con 0x7f29f806fab0 2024-04-25T00:50:51.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7fc762d55640 1 -- start start 2024-04-25T00:50:51.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7f29f27fc640 1 -- 172.21.15.162:0/2636258136 >> [v2:172.21.15.179:6824/4129338239,v1:172.21.15.179:6825/4129338239] conn(0x7f29f806fab0 msgr2=0x7f29f8071ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7f29f27fc640 1 --2- 172.21.15.162:0/2636258136 >> [v2:172.21.15.179:6824/4129338239,v1:172.21.15.179:6825/4129338239] conn(0x7f29f806fab0 0x7f29f8071ed0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7f29f27fc640 1 -- 172.21.15.162:0/2636258136 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f29f8067910 msgr2=0x7f29f8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7f29f27fc640 1 --2- 172.21.15.162:0/2636258136 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f29f8067910 0x7f29f8069dd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2a040088f0 tx=0x7f2a04005e90 comp rx=0 tx=0).stop 2024-04-25T00:50:51.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7f29f27fc640 1 -- 172.21.15.162:0/2636258136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a0c150740 msgr2=0x7f2a0c13a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7f29f27fc640 1 --2- 172.21.15.162:0/2636258136 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a0c150740 0x7f2a0c13a4e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f29fc00e820 tx=0x7f29fc00ece0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7f2a10e5f640 1 -- 172.21.15.162:0/2636258136 reap_dead start 2024-04-25T00:50:51.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7f29f27fc640 1 -- 172.21.15.162:0/2636258136 shutdown_connections 2024-04-25T00:50:51.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7f29f27fc640 1 -- 172.21.15.162:0/2636258136 >> 172.21.15.162:0/2636258136 conn(0x7f2a0c0c8670 msgr2=0x7f2a0c0c6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7f29f27fc640 1 -- 172.21.15.162:0/2636258136 shutdown_connections 2024-04-25T00:50:51.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7f29f27fc640 1 -- 172.21.15.162:0/2636258136 wait complete. 2024-04-25T00:50:51.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7fc762d55640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc75c0715e0 0x7fc75c15f150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7fc762d55640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc75c06d1f0 0x7fc75c1582c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7fc762d55640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc75c0cb360 con 0x7fc75c0719c0 2024-04-25T00:50:51.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7fc762d55640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fc75c0cbe40 con 0x7fc75c0715e0 2024-04-25T00:50:51.337 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.333+0000 7fc762d55640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc75c06c320 con 0x7fc75c06d1f0 2024-04-25T00:50:51.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.337+0000 7f6fb1ffb640 1 -- 172.21.15.162:0/1789849000 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f6fb8054910 con 0x7f6fbc0ca580 2024-04-25T00:50:51.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.337+0000 7f6fb1ffb640 1 --2- 172.21.15.162:0/1789849000 >> [v2:172.21.15.162:6818/234337516,v1:172.21.15.162:6819/234337516] conn(0x7f6fa006fac0 0x7f6fa0071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.337+0000 7f6fb1ffb640 1 -- 172.21.15.162:0/1789849000 --> [v2:172.21.15.162:6818/234337516,v1:172.21.15.162:6819/234337516] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6fb800de50 con 0x7f6fa006fac0 2024-04-25T00:50:51.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.337+0000 7f6fc18a1640 1 --2- 172.21.15.162:0/1789849000 >> [v2:172.21.15.162:6818/234337516,v1:172.21.15.162:6819/234337516] conn(0x7f6fa006fac0 0x7f6fa0071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.337+0000 7f6fb1ffb640 1 -- 172.21.15.162:0/1789849000 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6fb8052b10 con 0x7f6fbc0ca580 2024-04-25T00:50:51.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.337+0000 7f6fc18a1640 1 --2- 172.21.15.162:0/1789849000 >> [v2:172.21.15.162:6818/234337516,v1:172.21.15.162:6819/234337516] conn(0x7f6fa006fac0 0x7f6fa0071ee0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.337+0000 7f6fb1ffb640 1 -- 172.21.15.162:0/1789849000 <== osd.2 v2:172.21.15.162:6818/234337516 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6fb800de50 con 0x7f6fa006fac0 2024-04-25T00:50:51.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.345+0000 7fc7612f2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc75c06d1f0 0x7fc75c1582c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.345+0000 7f88557fa640 1 -- 172.21.15.162:0/2119008564 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f884c01a070 con 0x7f8858072d40 2024-04-25T00:50:51.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.345+0000 7f88557fa640 1 --2- 172.21.15.162:0/2119008564 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f883c0678c0 0x7f883c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.349+0000 7f8857fff640 1 --2- 172.21.15.162:0/2119008564 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f883c0678c0 0x7f883c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.349+0000 7f8857fff640 1 --2- 172.21.15.162:0/2119008564 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f883c0678c0 0x7f883c069d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f88440ad000 tx=0x7f8844004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.349+0000 7fc7612f2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc75c06d1f0 0x7fc75c1582c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:42976/0 (socket says 172.21.15.162:42976) 2024-04-25T00:50:51.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.349+0000 7fc7612f2640 1 -- 172.21.15.162:0/2179069840 learned_addr learned my addr 172.21.15.162:0/2179069840 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.353+0000 7fc760af1640 1 --2- 172.21.15.162:0/2179069840 >> v2:172.21.15.179:3300/0 conn(0x7fc75c0715e0 0x7fc75c15f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.355 INFO:teuthology.orchestra.run.smithi162.stdout:68719476753 2024-04-25T00:50:51.355 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T00:50:51.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.353+0000 7f96daffd640 1 --2- 172.21.15.162:0/2415505102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96c8004810 0x7f96dc13a7c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00f8a0 tx=0x7f96cc00fd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.357+0000 7fc7612f2640 1 -- 172.21.15.162:0/2179069840 >> v2:172.21.15.179:3300/0 conn(0x7fc75c0715e0 msgr2=0x7fc75c15f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.357+0000 7fc7612f2640 1 --2- 172.21.15.162:0/2179069840 >> v2:172.21.15.179:3300/0 conn(0x7fc75c0715e0 0x7fc75c15f150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.357+0000 7fc7612f2640 1 -- 172.21.15.162:0/2179069840 >> v1:172.21.15.179:6789/0 conn(0x7fc75c0719c0 legacy=0x7fc75c06cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.357+0000 7fc7612f2640 1 -- 172.21.15.162:0/2179069840 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75c0cc100 con 0x7fc75c06d1f0 2024-04-25T00:50:51.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.361+0000 7f34df9e2640 1 Processor -- start 2024-04-25T00:50:51.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.361+0000 7f34df9e2640 1 -- start start 2024-04-25T00:50:51.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.361+0000 7f34df9e2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f34d814da50 0x7f34d80c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.361+0000 7f34df9e2640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f34d80c6c60 0x7f34d8072f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.361+0000 7f34df9e2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34d814de30 con 0x7f34d80c7ba0 2024-04-25T00:50:51.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.361+0000 7f34df9e2640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f34d80c3f10 con 0x7f34d814da50 2024-04-25T00:50:51.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.361+0000 7f34df9e2640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f34d80c41f0 con 0x7f34d80c6c60 2024-04-25T00:50:51.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.361+0000 7f88557fa640 1 -- 172.21.15.162:0/2119008564 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f884c053d50 con 0x7f8858072d40 2024-04-25T00:50:51.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.361+0000 7fc7612f2640 1 --2- 172.21.15.162:0/2179069840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc75c06d1f0 0x7fc75c1582c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009e50 tx=0x7fc74c01f1c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac279fb38a2fc22a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.369+0000 7f6fc3304640 1 -- 172.21.15.162:0/1789849000 --> [v2:172.21.15.162:6818/234337516,v1:172.21.15.162:6819/234337516] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6fbc1f48f0 con 0x7f6fa006fac0 2024-04-25T00:50:51.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.369+0000 7f6fb1ffb640 1 -- 172.21.15.162:0/1789849000 <== osd.2 v2:172.21.15.162:6818/234337516 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6fbc1f48f0 con 0x7f6fa006fac0 2024-04-25T00:50:51.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.369+0000 7f6fc3304640 1 -- 172.21.15.162:0/1789849000 >> [v2:172.21.15.162:6818/234337516,v1:172.21.15.162:6819/234337516] conn(0x7f6fa006fac0 msgr2=0x7f6fa0071ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.369+0000 7f6fc3304640 1 --2- 172.21.15.162:0/1789849000 >> [v2:172.21.15.162:6818/234337516,v1:172.21.15.162:6819/234337516] conn(0x7f6fa006fac0 0x7f6fa0071ee0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.369+0000 7f6fc3304640 1 -- 172.21.15.162:0/1789849000 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6fa00678c0 msgr2=0x7f6fa0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.369+0000 7f6fc3304640 1 --2- 172.21.15.162:0/1789849000 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6fa00678c0 0x7f6fa0069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6fac0b2000 tx=0x7f6fac004740 comp rx=0 tx=0).stop 2024-04-25T00:50:51.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.369+0000 7f6fc3304640 1 -- 172.21.15.162:0/1789849000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fbc0ca580 msgr2=0x7f6fbc0c82e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.369+0000 7f6fc3304640 1 --2- 172.21.15.162:0/1789849000 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6fbc0ca580 0x7f6fbc0c82e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800b440 tx=0x7f6fb800b900 comp rx=0 tx=0).stop 2024-04-25T00:50:51.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.369+0000 7f6fc18a1640 1 -- 172.21.15.162:0/1789849000 reap_dead start 2024-04-25T00:50:51.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.369+0000 7f6fc3304640 1 -- 172.21.15.162:0/1789849000 shutdown_connections 2024-04-25T00:50:51.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.369+0000 7f6fc3304640 1 -- 172.21.15.162:0/1789849000 >> 172.21.15.162:0/1789849000 conn(0x7f6fbc0b1710 msgr2=0x7f6fbc0cd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.369+0000 7f6fc3304640 1 -- 172.21.15.162:0/1789849000 shutdown_connections 2024-04-25T00:50:51.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.369+0000 7f6fc3304640 1 -- 172.21.15.162:0/1789849000 wait complete. 2024-04-25T00:50:51.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.373+0000 7fc75b7fe640 1 -- 172.21.15.162:0/2179069840 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c0b4070 con 0x7fc75c06d1f0 2024-04-25T00:50:51.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.373+0000 7fc75b7fe640 1 -- 172.21.15.162:0/2179069840 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc74c0af400 con 0x7fc75c06d1f0 2024-04-25T00:50:51.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.373+0000 7fc75b7fe640 1 -- 172.21.15.162:0/2179069840 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc74c0af7d0 con 0x7fc75c06d1f0 2024-04-25T00:50:51.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.373+0000 7fc762d55640 1 -- 172.21.15.162:0/2179069840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc75c06d1f0 msgr2=0x7fc75c1582c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.373+0000 7fc762d55640 1 --2- 172.21.15.162:0/2179069840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc75c06d1f0 0x7fc75c1582c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc74c009e50 tx=0x7fc74c01f1c0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.373+0000 7fc762d55640 1 -- 172.21.15.162:0/2179069840 shutdown_connections 2024-04-25T00:50:51.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.373+0000 7fc762d55640 1 --2- 172.21.15.162:0/2179069840 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc75c06d1f0 0x7fc75c1582c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.373+0000 7fc762d55640 1 --2- 172.21.15.162:0/2179069840 >> v2:172.21.15.179:3300/0 conn(0x7fc75c0715e0 0x7fc75c15f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.373+0000 7fc762d55640 1 -- 172.21.15.162:0/2179069840 >> 172.21.15.162:0/2179069840 conn(0x7fc75c06b810 msgr2=0x7fc75c06f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.373+0000 7fc762d55640 1 -- 172.21.15.162:0/2179069840 shutdown_connections 2024-04-25T00:50:51.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.373+0000 7fc762d55640 1 -- 172.21.15.162:0/2179069840 wait complete. 2024-04-25T00:50:51.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.373+0000 7fc762d55640 1 Processor -- start 2024-04-25T00:50:51.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.373+0000 7fc762d55640 1 -- start start 2024-04-25T00:50:51.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.377+0000 7fc762d55640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc75c06d1f0 0x7fc75c154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.377+0000 7fc762d55640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc75c0715e0 0x7fc75c0cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.377+0000 7fc762d55640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc75c0719c0 0x7fc75c1f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.377+0000 7fc762d55640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c0cae20 con 0x7fc75c0715e0 2024-04-25T00:50:51.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.377+0000 7fc762d55640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc75c06c5e0 con 0x7fc75c0719c0 2024-04-25T00:50:51.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.377+0000 7fc762d55640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc75c0cafa0 con 0x7fc75c06d1f0 2024-04-25T00:50:51.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.381+0000 7fc760af1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc75c06d1f0 0x7fc75c154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.381+0000 7fc760af1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc75c06d1f0 0x7fc75c154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:42990/0 (socket says 172.21.15.162:42990) 2024-04-25T00:50:51.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.381+0000 7fc760af1640 1 -- 172.21.15.162:0/58988930 learned_addr learned my addr 172.21.15.162:0/58988930 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.388 INFO:teuthology.orchestra.run.smithi162.stdout:68719476752 2024-04-25T00:50:51.388 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T00:50:51.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.389+0000 7fc760af1640 1 -- 172.21.15.162:0/58988930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc75c0719c0 msgr2=0x7fc75c1f46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.389+0000 7fc760af1640 1 --2- 172.21.15.162:0/58988930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc75c0719c0 0x7fc75c1f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.389+0000 7fc760af1640 1 -- 172.21.15.162:0/58988930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc75c0715e0 msgr2=0x7fc75c0cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.389+0000 7fc760af1640 1 --2- 172.21.15.162:0/58988930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc75c0715e0 0x7fc75c0cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.389+0000 7fc760af1640 1 -- 172.21.15.162:0/58988930 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc75c0ce720 con 0x7fc75c06d1f0 2024-04-25T00:50:51.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.389+0000 7f3808ff9640 1 -- 172.21.15.162:0/2115985040 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f38000c6460 con 0x7f3804046a50 2024-04-25T00:50:51.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.389+0000 7f3808ff9640 1 --2- 172.21.15.162:0/2115985040 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f37f00678c0 0x7f37f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.393+0000 7f380b7fe640 1 --2- 172.21.15.162:0/2115985040 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f37f00678c0 0x7f37f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.393+0000 7f380b7fe640 1 --2- 172.21.15.162:0/2115985040 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f37f00678c0 0x7f37f0069d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f37f8007fd0 tx=0x7f37f80079a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.393+0000 7fc760af1640 1 --2- 172.21.15.162:0/58988930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc75c06d1f0 0x7fc75c154c50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc75400d830 tx=0x7fc75400dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.397+0000 7f3808ff9640 1 -- 172.21.15.162:0/2115985040 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f38000f29c0 con 0x7f3804046a50 2024-04-25T00:50:51.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.397+0000 7f3808ff9640 1 --2- 172.21.15.162:0/2115985040 >> [v2:172.21.15.162:6802/3488816098,v1:172.21.15.162:6803/3488816098] conn(0x7f37f006fac0 0x7f37f0071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.397+0000 7f3808ff9640 1 -- 172.21.15.162:0/2115985040 --> [v2:172.21.15.162:6802/3488816098,v1:172.21.15.162:6803/3488816098] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38000b0e50 con 0x7f37f006fac0 2024-04-25T00:50:51.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.401+0000 7f3810d6d640 1 --2- 172.21.15.162:0/2115985040 >> [v2:172.21.15.162:6802/3488816098,v1:172.21.15.162:6803/3488816098] conn(0x7f37f006fac0 0x7f37f0071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.401+0000 7f3808ff9640 1 -- 172.21.15.162:0/2115985040 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f38000f0bc0 con 0x7f3804046a50 2024-04-25T00:50:51.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.401+0000 7f3810d6d640 1 --2- 172.21.15.162:0/2115985040 >> [v2:172.21.15.162:6802/3488816098,v1:172.21.15.162:6803/3488816098] conn(0x7f37f006fac0 0x7f37f0071ee0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.402 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.401+0000 7fc7597fa640 1 -- 172.21.15.162:0/58988930 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75400b6c0 con 0x7fc75c06d1f0 2024-04-25T00:50:51.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.401+0000 7fc7597fa640 1 -- 172.21.15.162:0/58988930 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc754019070 con 0x7fc75c06d1f0 2024-04-25T00:50:51.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.401+0000 7fc7597fa640 1 -- 172.21.15.162:0/58988930 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc75400ba60 con 0x7fc75c06d1f0 2024-04-25T00:50:51.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.401+0000 7fc762d55640 1 -- 172.21.15.162:0/58988930 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc75c161a40 con 0x7fc75c06d1f0 2024-04-25T00:50:51.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.401+0000 7fc762d55640 1 -- 172.21.15.162:0/58988930 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc75c162000 con 0x7fc75c06d1f0 2024-04-25T00:50:51.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.401+0000 7fc762d55640 1 -- 172.21.15.162:0/58988930 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc75c075110 con 0x7fc75c06d1f0 2024-04-25T00:50:51.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.405+0000 7f34dd77e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f34d814da50 0x7f34d80c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.405+0000 7f34dd77e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f34d814da50 0x7f34d80c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40020/0 (socket says 172.21.15.162:40020) 2024-04-25T00:50:51.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.405+0000 7f34dd77e640 1 -- 172.21.15.162:0/2837105563 learned_addr learned my addr 172.21.15.162:0/2837105563 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.401+0000 7f3808ff9640 1 -- 172.21.15.162:0/2115985040 <== osd.1 v2:172.21.15.162:6802/3488816098 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f38000b0e50 con 0x7f37f006fac0 2024-04-25T00:50:51.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.421+0000 7f34dcf7d640 1 --2- 172.21.15.162:0/2837105563 >> v2:172.21.15.179:3300/0 conn(0x7f34d80c6c60 0x7f34d8072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.424 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.421+0000 7f34dd77e640 1 -- 172.21.15.162:0/2837105563 >> v2:172.21.15.179:3300/0 conn(0x7f34d80c6c60 msgr2=0x7f34d8072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.424 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.421+0000 7f34dd77e640 1 --2- 172.21.15.162:0/2837105563 >> v2:172.21.15.179:3300/0 conn(0x7f34d80c6c60 0x7f34d8072f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.424 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.421+0000 7f34dd77e640 1 -- 172.21.15.162:0/2837105563 >> v1:172.21.15.179:6789/0 conn(0x7f34d80c7ba0 legacy=0x7f34d8157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.421+0000 7f34dd77e640 1 -- 172.21.15.162:0/2837105563 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d80c44d0 con 0x7f34d814da50 2024-04-25T00:50:51.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.429+0000 7f381156e640 1 -- 172.21.15.162:0/2115985040 --> [v2:172.21.15.162:6802/3488816098,v1:172.21.15.162:6803/3488816098] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f38040057f0 con 0x7f37f006fac0 2024-04-25T00:50:51.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.429+0000 7feb7b414640 1 Processor -- start 2024-04-25T00:50:51.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.429+0000 7feb7b414640 1 -- start start 2024-04-25T00:50:51.432 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.429+0000 7f3808ff9640 1 -- 172.21.15.162:0/2115985040 <== osd.1 v2:172.21.15.162:6802/3488816098 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f38040057f0 con 0x7f37f006fac0 2024-04-25T00:50:51.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.429+0000 7f381156e640 1 -- 172.21.15.162:0/2115985040 >> [v2:172.21.15.162:6802/3488816098,v1:172.21.15.162:6803/3488816098] conn(0x7f37f006fac0 msgr2=0x7f37f0071ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.433+0000 7f381156e640 1 --2- 172.21.15.162:0/2115985040 >> [v2:172.21.15.162:6802/3488816098,v1:172.21.15.162:6803/3488816098] conn(0x7f37f006fac0 0x7f37f0071ee0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.433+0000 7f381156e640 1 -- 172.21.15.162:0/2115985040 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f37f00678c0 msgr2=0x7f37f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.433+0000 7f381156e640 1 --2- 172.21.15.162:0/2115985040 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f37f00678c0 0x7f37f0069d80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f37f8007fd0 tx=0x7f37f80079a0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.433+0000 7f381156e640 1 -- 172.21.15.162:0/2115985040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3804046a50 msgr2=0x7f3804165850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.433+0000 7f381156e640 1 --2- 172.21.15.162:0/2115985040 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3804046a50 0x7f3804165850 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f380001f5b0 tx=0x7f380001bab0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.433+0000 7feb7b414640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7feb74158b40 0x7feb7415e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.433 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.433+0000 7feb7b414640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feb7415ee10 0x7feb7406b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.433+0000 7feb7b414640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb74162040 con 0x7feb740cd190 2024-04-25T00:50:51.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.433+0000 7feb7b414640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7feb7415f8d0 con 0x7feb74158b40 2024-04-25T00:50:51.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.433+0000 7feb7b414640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7feb7415f310 con 0x7feb7415ee10 2024-04-25T00:50:51.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.433+0000 7f3810d6d640 1 -- 172.21.15.162:0/2115985040 reap_dead start 2024-04-25T00:50:51.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.433+0000 7f381156e640 1 -- 172.21.15.162:0/2115985040 shutdown_connections 2024-04-25T00:50:51.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.433+0000 7f381156e640 1 -- 172.21.15.162:0/2115985040 >> 172.21.15.162:0/2115985040 conn(0x7f380404dd40 msgr2=0x7f38040d4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.433+0000 7f381156e640 1 -- 172.21.15.162:0/2115985040 shutdown_connections 2024-04-25T00:50:51.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.433+0000 7f381156e640 1 -- 172.21.15.162:0/2115985040 wait complete. 2024-04-25T00:50:51.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.441+0000 7feb789af640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feb7415ee10 0x7feb7406b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.441+0000 7feb789af640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7feb7415ee10 0x7feb7406b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:60466/0 (socket says 172.21.15.162:60466) 2024-04-25T00:50:51.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.441+0000 7feb789af640 1 -- 172.21.15.162:0/1786423008 learned_addr learned my addr 172.21.15.162:0/1786423008 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.449 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.449+0000 7feb789af640 1 -- 172.21.15.162:0/1786423008 >> v2:172.21.15.162:3300/0 conn(0x7feb74158b40 msgr2=0x7feb7415e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.449+0000 7feb789af640 1 --2- 172.21.15.162:0/1786423008 >> v2:172.21.15.162:3300/0 conn(0x7feb74158b40 0x7feb7415e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.449+0000 7feb789af640 1 -- 172.21.15.162:0/1786423008 >> v1:172.21.15.179:6789/0 conn(0x7feb740cd190 legacy=0x7feb7406b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.450 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.449+0000 7feb789af640 1 -- 172.21.15.162:0/1786423008 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7415f5f0 con 0x7feb7415ee10 2024-04-25T00:50:51.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.453+0000 7f96d37fe640 1 -- 172.21.15.162:0/2415505102 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc017020 con 0x7f96c8004810 2024-04-25T00:50:51.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.453+0000 7f96d37fe640 1 -- 172.21.15.162:0/2415505102 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96cc006480 con 0x7f96c8004810 2024-04-25T00:50:51.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.453+0000 7f96d37fe640 1 -- 172.21.15.162:0/2415505102 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96cc004a10 con 0x7f96c8004810 2024-04-25T00:50:51.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.453+0000 7f96e1770640 1 -- 172.21.15.162:0/2415505102 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96dc1f5840 con 0x7f96c8004810 2024-04-25T00:50:51.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.453+0000 7f96e1770640 1 -- 172.21.15.162:0/2415505102 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96dc0ca8b0 con 0x7f96c8004810 2024-04-25T00:50:51.455 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.453+0000 7f96e1770640 1 -- 172.21.15.162:0/2415505102 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96c00052a0 con 0x7f96c8004810 2024-04-25T00:50:51.457 INFO:teuthology.orchestra.run.smithi162.stdout:60129542160 2024-04-25T00:50:51.457 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T00:50:51.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.457+0000 7feb789af640 1 --2- 172.21.15.162:0/1786423008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb7415ee10 0x7feb7406b210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb74162210 tx=0x7feb6401c4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87f8bc0e96241eb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.493+0000 7f9ecc038640 1 Processor -- start 2024-04-25T00:50:51.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.493+0000 7f9ecc038640 1 -- start start 2024-04-25T00:50:51.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.493+0000 7f9ecc038640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ec4066fc0 0x7f9ec406b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.493+0000 7f9ecc038640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9ec40c5fe0 0x7f9ec4158c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.493+0000 7f9ecc038640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ec4067490 con 0x7f9ec40c5c00 2024-04-25T00:50:51.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.493+0000 7f9ecc038640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f9ec415b790 con 0x7f9ec40c5fe0 2024-04-25T00:50:51.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.493+0000 7f9ecc038640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9ec415c310 con 0x7f9ec4066fc0 2024-04-25T00:50:51.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.517+0000 7fd1d19fa640 1 Processor -- start 2024-04-25T00:50:51.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.517+0000 7fd1d19fa640 1 -- start start 2024-04-25T00:50:51.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.521+0000 7fd1d19fa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc157430 0x7fd1cc1578c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.521+0000 7fd1d19fa640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1cc157e00 con 0x7fd1cc0c6c60 2024-04-25T00:50:51.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.521+0000 7fd1d19fa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1cc14de30 con 0x7fd1cc14da50 2024-04-25T00:50:51.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.521+0000 7fd1d19fa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd1cc0c3f10 con 0x7fd1cc157430 2024-04-25T00:50:51.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.561+0000 7f6724661640 1 Processor -- start 2024-04-25T00:50:51.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.561+0000 7f6724661640 1 -- start start 2024-04-25T00:50:51.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.561+0000 7f6724661640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f671c1546a0 0x7f671c15af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.561+0000 7f6724661640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f671c0cd5a0 con 0x7f671c0c9950 2024-04-25T00:50:51.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.561+0000 7f6724661640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f671c15dab0 con 0x7f671c0cd190 2024-04-25T00:50:51.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.561+0000 7f6724661640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f671c15dd50 con 0x7f671c1546a0 2024-04-25T00:50:51.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.621+0000 7f34dd77e640 1 --2- 172.21.15.162:0/2837105563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34d814da50 0x7f34d80c7660 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f34d80ca010 tx=0x7f34d401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6c26644eef6f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.661+0000 7f9eca5d5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9ec40c5fe0 0x7f9ec4158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.661+0000 7f9eca5d5640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f9ec40c5fe0 0x7f9ec4158c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40050/0 (socket says 172.21.15.162:40050) 2024-04-25T00:50:51.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.661+0000 7f9eca5d5640 1 -- 172.21.15.162:0/3432680898 learned_addr learned my addr 172.21.15.162:0/3432680898 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.693+0000 7f88557fa640 1 -- 172.21.15.162:0/2119008564 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f884c055cb0 con 0x7f8858072d40 2024-04-25T00:50:51.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.697+0000 7f9eca5d5640 1 -- 172.21.15.162:0/3432680898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ec4066fc0 msgr2=0x7f9ec406b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.697+0000 7f9eca5d5640 1 --2- 172.21.15.162:0/3432680898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ec4066fc0 0x7f9ec406b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.697+0000 7f9eca5d5640 1 -- 172.21.15.162:0/3432680898 >> v1:172.21.15.162:6789/0 conn(0x7f9ec40c5c00 legacy=0x7f9ec413dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.701+0000 7f9eca5d5640 1 -- 172.21.15.162:0/3432680898 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec415b9e0 con 0x7f9ec40c5fe0 2024-04-25T00:50:51.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.705+0000 7fd1ca7fc640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fd1cc0c6c60 0x7fd1cc072f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:57474/0 (socket says 172.21.15.162:57474) 2024-04-25T00:50:51.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.705+0000 7fd1ca7fc640 1 -- 172.21.15.162:0/3976508593 learned_addr learned my addr 172.21.15.162:0/3976508593 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:51.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.709+0000 7f34cffff640 1 -- 172.21.15.162:0/2837105563 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d40b2070 con 0x7f34d814da50 2024-04-25T00:50:51.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.709+0000 7f34cffff640 1 -- 172.21.15.162:0/2837105563 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d40ad680 con 0x7f34d814da50 2024-04-25T00:50:51.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.709+0000 7f34cffff640 1 -- 172.21.15.162:0/2837105563 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d40ada50 con 0x7f34d814da50 2024-04-25T00:50:51.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.709+0000 7f67223fd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f671c1546a0 0x7f671c15af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.712 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.709+0000 7f34df9e2640 1 -- 172.21.15.162:0/2837105563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34d814da50 msgr2=0x7f34d80c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.712 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.709+0000 7f34df9e2640 1 --2- 172.21.15.162:0/2837105563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34d814da50 0x7f34d80c7660 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f34d80ca010 tx=0x7f34d401c4d0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.712 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.709+0000 7f34df9e2640 1 -- 172.21.15.162:0/2837105563 shutdown_connections 2024-04-25T00:50:51.712 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.709+0000 7f34df9e2640 1 --2- 172.21.15.162:0/2837105563 >> v2:172.21.15.179:3300/0 conn(0x7f34d80c6c60 0x7f34d8072f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.712 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.709+0000 7f34df9e2640 1 --2- 172.21.15.162:0/2837105563 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34d814da50 0x7f34d80c7660 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.712 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.709+0000 7f34df9e2640 1 -- 172.21.15.162:0/2837105563 >> 172.21.15.162:0/2837105563 conn(0x7f34d8070370 msgr2=0x7f34d8070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.712 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.709+0000 7f34df9e2640 1 -- 172.21.15.162:0/2837105563 shutdown_connections 2024-04-25T00:50:51.713 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.709+0000 7f34df9e2640 1 -- 172.21.15.162:0/2837105563 wait complete. 2024-04-25T00:50:51.713 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.713+0000 7f67223fd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f671c1546a0 0x7f671c15af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40066/0 (socket says 172.21.15.162:40066) 2024-04-25T00:50:51.713 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.713+0000 7f67223fd640 1 -- 172.21.15.162:0/4014412418 learned_addr learned my addr 172.21.15.162:0/4014412418 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.713+0000 7f34df9e2640 1 Processor -- start 2024-04-25T00:50:51.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.713+0000 7f34df9e2640 1 -- start start 2024-04-25T00:50:51.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.713+0000 7f34df9e2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34d80c6c60 0x7f34d81450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.713+0000 7f34df9e2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34d80c7ba0 0x7f34d8155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.713+0000 7f34df9e2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34d814da50 0x7f34d81f3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.713+0000 7f34df9e2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f34d8164300 con 0x7f34d814da50 2024-04-25T00:50:51.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.713+0000 7f34df9e2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f34d8164180 con 0x7f34d80c6c60 2024-04-25T00:50:51.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.713+0000 7f34df9e2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f34d8164480 con 0x7f34d80c7ba0 2024-04-25T00:50:51.719 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.717+0000 7f67223fd640 1 -- 172.21.15.162:0/4014412418 >> v1:172.21.15.179:6789/0 conn(0x7f671c0cd190 legacy=0x7f671c0c9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.719 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.717+0000 7f67223fd640 1 -- 172.21.15.162:0/4014412418 >> v1:172.21.15.162:6789/0 conn(0x7f671c0c9950 legacy=0x7f671c0c5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.719 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.717+0000 7f67223fd640 1 -- 172.21.15.162:0/4014412418 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f671c15dff0 con 0x7f671c1546a0 2024-04-25T00:50:51.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.721+0000 7f9eca5d5640 1 --2- 172.21.15.162:0/3432680898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ec40c5fe0 0x7f9ec4158c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9ec415b910 tx=0x7f9ebc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa912dd0186b6a46 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.721+0000 7f34ddf7f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34d814da50 0x7f34d81f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.725+0000 7fd1c9ffb640 1 -- 172.21.15.162:0/3976508593 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1699575582 0 0) 0x7fd1cc157e00 con 0x7fd1cc0c6c60 2024-04-25T00:50:51.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.725+0000 7fd1c9ffb640 1 -- 172.21.15.162:0/3976508593 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1b4003530 con 0x7fd1cc0c6c60 2024-04-25T00:50:51.727 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.725+0000 7f67223fd640 1 --2- 172.21.15.162:0/4014412418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f671c1546a0 0x7f671c15af40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f67180098a0 tx=0x7f671801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d3215987191557 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.725+0000 7f9ec8dd2640 1 -- 172.21.15.162:0/3432680898 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0a9480 con 0x7f9ec40c5fe0 2024-04-25T00:50:51.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.725+0000 7f9ec8dd2640 1 -- 172.21.15.162:0/3432680898 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ebc0ae070 con 0x7f9ec40c5fe0 2024-04-25T00:50:51.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f9ec8dd2640 1 -- 172.21.15.162:0/3432680898 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ebc0a9840 con 0x7f9ec40c5fe0 2024-04-25T00:50:51.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f34ddf7f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34d814da50 0x7f34d81f3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40068/0 (socket says 172.21.15.162:40068) 2024-04-25T00:50:51.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f34ddf7f640 1 -- 172.21.15.162:0/680400904 learned_addr learned my addr 172.21.15.162:0/680400904 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f9ecc038640 1 -- 172.21.15.162:0/3432680898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ec40c5fe0 msgr2=0x7f9ec4158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f9ecc038640 1 --2- 172.21.15.162:0/3432680898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ec40c5fe0 0x7f9ec4158c20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9ec415b910 tx=0x7f9ebc01c9d0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f9ecc038640 1 -- 172.21.15.162:0/3432680898 shutdown_connections 2024-04-25T00:50:51.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f9ecc038640 1 --2- 172.21.15.162:0/3432680898 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ec4066fc0 0x7f9ec406b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f9ecc038640 1 --2- 172.21.15.162:0/3432680898 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ec40c5fe0 0x7f9ec4158c20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f9ecc038640 1 -- 172.21.15.162:0/3432680898 >> 172.21.15.162:0/3432680898 conn(0x7f9ec406fa80 msgr2=0x7f9ec406fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f9ecc038640 1 -- 172.21.15.162:0/3432680898 shutdown_connections 2024-04-25T00:50:51.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f9ecc038640 1 -- 172.21.15.162:0/3432680898 wait complete. 2024-04-25T00:50:51.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f9ecc038640 1 Processor -- start 2024-04-25T00:50:51.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f9ecc038640 1 -- start start 2024-04-25T00:50:51.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7fc7597fa640 1 -- 172.21.15.162:0/58988930 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc75401e460 con 0x7fc75c06d1f0 2024-04-25T00:50:51.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f9ecc038640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ec4066fc0 0x7f9ec41f1200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f9ecc038640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ec40c5c00 0x7f9ec40cc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f9ecc038640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ec40c5fe0 0x7f9ec41f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f9ecc038640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec4164cb0 con 0x7f9ec40c5c00 2024-04-25T00:50:51.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f9ecc038640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec4164b30 con 0x7f9ec40c5fe0 2024-04-25T00:50:51.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7f9ecc038640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9ec4164e30 con 0x7f9ec4066fc0 2024-04-25T00:50:51.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7fc7597fa640 1 --2- 172.21.15.162:0/58988930 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc73c067910 0x7fc73c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7fc75bfff640 1 --2- 172.21.15.162:0/58988930 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc73c067910 0x7fc73c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.729+0000 7fc75bfff640 1 --2- 172.21.15.162:0/58988930 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc73c067910 0x7fc73c069dd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc744009650 tx=0x7fc744006bb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.733+0000 7f34ddf7f640 1 -- 172.21.15.162:0/680400904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34d80c7ba0 msgr2=0x7f34d8155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.733+0000 7f34ddf7f640 1 --2- 172.21.15.162:0/680400904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34d80c7ba0 0x7f34d8155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.733+0000 7f34ddf7f640 1 -- 172.21.15.162:0/680400904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34d80c6c60 msgr2=0x7f34d81450f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.733+0000 7f34ddf7f640 1 --2- 172.21.15.162:0/680400904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34d80c6c60 0x7f34d81450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.733+0000 7f34ddf7f640 1 -- 172.21.15.162:0/680400904 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34d80cc1c0 con 0x7f34d814da50 2024-04-25T00:50:51.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.733+0000 7fc7597fa640 1 -- 172.21.15.162:0/58988930 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fc754055320 con 0x7fc75c06d1f0 2024-04-25T00:50:51.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.737+0000 7f34ddf7f640 1 --2- 172.21.15.162:0/680400904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34d814da50 0x7f34d81f3b20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f34d000c760 tx=0x7f34d000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.744 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.741+0000 7fd1c9ffb640 1 -- 172.21.15.162:0/3976508593 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3541531909 0 0) 0x7fd1b4003530 con 0x7fd1cc0c6c60 2024-04-25T00:50:51.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.741+0000 7fd1c9ffb640 1 -- 172.21.15.162:0/3976508593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc157430 msgr2=0x7fd1cc1578c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.741+0000 7fd1c9ffb640 1 --2- 172.21.15.162:0/3976508593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc157430 0x7fd1cc1578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.741+0000 7fd1c9ffb640 1 -- 172.21.15.162:0/3976508593 >> v1:172.21.15.179:6789/0 conn(0x7fd1cc14da50 legacy=0x7fd1cc0c7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.741+0000 7fd1c9ffb640 1 -- 172.21.15.162:0/3976508593 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1cc0c41f0 con 0x7fd1cc0c6c60 2024-04-25T00:50:51.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.741+0000 7fd1c9ffb640 1 -- 172.21.15.162:0/3976508593 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7fd1c0001680 con 0x7fd1cc0c6c60 2024-04-25T00:50:51.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.741+0000 7fd1c9ffb640 1 -- 172.21.15.162:0/3976508593 >> v1:172.21.15.162:6789/0 conn(0x7fd1cc0c6c60 legacy=0x7fd1cc072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.741+0000 7fd1c9ffb640 1 --2- 172.21.15.162:0/3976508593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1b40039f0 0x7fd1b4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.741+0000 7fd1c9ffb640 1 --2- 172.21.15.162:0/3976508593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1b4004810 0x7fd1b4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.741+0000 7fd1c9ffb640 1 --2- 172.21.15.162:0/3976508593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc157430 0x7fd1b400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.741+0000 7fd1c9ffb640 1 -- 172.21.15.162:0/3976508593 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc0c3f10 con 0x7fd1b40039f0 2024-04-25T00:50:51.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.741+0000 7fd1c9ffb640 1 -- 172.21.15.162:0/3976508593 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b4005610 con 0x7fd1b4004810 2024-04-25T00:50:51.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.741+0000 7fd1c9ffb640 1 -- 172.21.15.162:0/3976508593 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd1b400bf10 con 0x7fd1cc157430 2024-04-25T00:50:51.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.749+0000 7f67213fb640 1 -- 172.21.15.162:0/4014412418 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67180b5070 con 0x7f671c1546a0 2024-04-25T00:50:51.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.749+0000 7f67213fb640 1 -- 172.21.15.162:0/4014412418 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67180a89b0 con 0x7f671c1546a0 2024-04-25T00:50:51.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.749+0000 7f67213fb640 1 -- 172.21.15.162:0/4014412418 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67180a8d80 con 0x7f671c1546a0 2024-04-25T00:50:51.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.749+0000 7f6724661640 1 -- 172.21.15.162:0/4014412418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f671c1546a0 msgr2=0x7f671c15af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.749+0000 7f6724661640 1 --2- 172.21.15.162:0/4014412418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f671c1546a0 0x7f671c15af40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f67180098a0 tx=0x7f671801ecb0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.749+0000 7f6724661640 1 -- 172.21.15.162:0/4014412418 shutdown_connections 2024-04-25T00:50:51.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.749+0000 7f6724661640 1 --2- 172.21.15.162:0/4014412418 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f671c1546a0 0x7f671c15af40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.749+0000 7f6724661640 1 -- 172.21.15.162:0/4014412418 >> 172.21.15.162:0/4014412418 conn(0x7f671c070370 msgr2=0x7f671c070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.749+0000 7f6724661640 1 -- 172.21.15.162:0/4014412418 shutdown_connections 2024-04-25T00:50:51.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.749+0000 7f6724661640 1 -- 172.21.15.162:0/4014412418 wait complete. 2024-04-25T00:50:51.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.749+0000 7f34cdffb640 1 -- 172.21.15.162:0/680400904 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d0016020 con 0x7f34d814da50 2024-04-25T00:50:51.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.749+0000 7f34cdffb640 1 -- 172.21.15.162:0/680400904 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d0006d80 con 0x7f34d814da50 2024-04-25T00:50:51.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.749+0000 7f34df9e2640 1 -- 172.21.15.162:0/680400904 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34d80cc480 con 0x7f34d814da50 2024-04-25T00:50:51.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.749+0000 7f34df9e2640 1 -- 172.21.15.162:0/680400904 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34d8156480 con 0x7f34d814da50 2024-04-25T00:50:51.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.749+0000 7f34cdffb640 1 -- 172.21.15.162:0/680400904 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d0003bc0 con 0x7f34d814da50 2024-04-25T00:50:51.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.749+0000 7f6724661640 1 Processor -- start 2024-04-25T00:50:51.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.753+0000 7f9ec95d3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ec40c5c00 0x7f9ec40cc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.753+0000 7f6724661640 1 -- start start 2024-04-25T00:50:51.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.753+0000 7f34df9e2640 1 -- 172.21.15.162:0/680400904 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34b80052a0 con 0x7f34d814da50 2024-04-25T00:50:51.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.753+0000 7fc7597fa640 1 -- 172.21.15.162:0/58988930 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc754057980 con 0x7fc75c06d1f0 2024-04-25T00:50:51.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.753+0000 7f6724661640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f671c0c9950 0x7f671c158130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.753+0000 7f6724661640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f671c0cd190 0x7f671c06c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.753+0000 7f6724661640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f671c1546a0 0x7f671c1f0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.753+0000 7f6724661640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f671c15e890 con 0x7f671c0c9950 2024-04-25T00:50:51.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.753+0000 7f6724661640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f671c15e5b0 con 0x7f671c1546a0 2024-04-25T00:50:51.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.753+0000 7f6724661640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f671c154a80 con 0x7f671c0cd190 2024-04-25T00:50:51.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.753+0000 7f9ec95d3640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ec40c5c00 0x7f9ec40cc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40072/0 (socket says 172.21.15.162:40072) 2024-04-25T00:50:51.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.753+0000 7f9ec95d3640 1 -- 172.21.15.162:0/1415642758 learned_addr learned my addr 172.21.15.162:0/1415642758 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.753+0000 7fd1caffd640 1 --2- 172.21.15.162:0/3976508593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1b40039f0 0x7fd1b4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.766 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.765+0000 7f9ec9dd4640 1 --2- 172.21.15.162:0/1415642758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ec4066fc0 0x7f9ec41f1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.767 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.765+0000 7fd1cb7fe640 1 --2- 172.21.15.162:0/3976508593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc157430 0x7fd1b400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.769+0000 7fd1cb7fe640 1 -- 172.21.15.162:0/3976508593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1b4004810 msgr2=0x7fd1b4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.769+0000 7fd1cb7fe640 1 --2- 172.21.15.162:0/3976508593 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1b4004810 0x7fd1b4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.769+0000 7fd1cb7fe640 1 -- 172.21.15.162:0/3976508593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1b40039f0 msgr2=0x7fd1b4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:51.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.769+0000 7fd1cb7fe640 1 --2- 172.21.15.162:0/3976508593 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1b40039f0 0x7fd1b4003df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.769+0000 7fd1cb7fe640 1 -- 172.21.15.162:0/3976508593 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b4003530 con 0x7fd1cc157430 2024-04-25T00:50:51.779 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.777+0000 7f9ec9dd4640 1 -- 172.21.15.162:0/1415642758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ec40c5fe0 msgr2=0x7f9ec41f2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.779 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.777+0000 7f9ec9dd4640 1 --2- 172.21.15.162:0/1415642758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ec40c5fe0 0x7f9ec41f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.779 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.777+0000 7f9ec9dd4640 1 -- 172.21.15.162:0/1415642758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ec40c5c00 msgr2=0x7f9ec40cc8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.779 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.777+0000 7f9ec9dd4640 1 --2- 172.21.15.162:0/1415642758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ec40c5c00 0x7f9ec40cc8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.780 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.777+0000 7f9ec9dd4640 1 -- 172.21.15.162:0/1415642758 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec41387c0 con 0x7f9ec4066fc0 2024-04-25T00:50:51.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.785+0000 7f9ec9dd4640 1 --2- 172.21.15.162:0/1415642758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ec4066fc0 0x7f9ec41f1200 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000c410 tx=0x7f9ec000c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.785+0000 7fd1cb7fe640 1 --2- 172.21.15.162:0/3976508593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc157430 0x7fd1b400b9d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4009ca0 tx=0x7fd1c401cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc72235be1191b15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.793+0000 7f6721bfc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f671c0cd190 0x7f671c06c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.793+0000 7fd1c9ffb640 1 -- 172.21.15.162:0/3976508593 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40b2070 con 0x7fd1cc157430 2024-04-25T00:50:51.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.793+0000 7fd1c9ffb640 1 -- 172.21.15.162:0/3976508593 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c40a5980 con 0x7fd1cc157430 2024-04-25T00:50:51.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.793+0000 7fd1c9ffb640 1 -- 172.21.15.162:0/3976508593 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4006e60 con 0x7fd1cc157430 2024-04-25T00:50:51.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.793+0000 7fd1d19fa640 1 -- 172.21.15.162:0/3976508593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc157430 msgr2=0x7fd1b400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.793+0000 7fd1d19fa640 1 --2- 172.21.15.162:0/3976508593 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc157430 0x7fd1b400b9d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd1c4009ca0 tx=0x7fd1c401cc70 comp rx=0 tx=0).stop 2024-04-25T00:50:51.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.793+0000 7fd1cb7fe640 1 -- 172.21.15.162:0/3976508593 reap_dead start 2024-04-25T00:50:51.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.793+0000 7fd1d19fa640 1 -- 172.21.15.162:0/3976508593 shutdown_connections 2024-04-25T00:50:51.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.793+0000 7fd1d19fa640 1 -- 172.21.15.162:0/3976508593 >> 172.21.15.162:0/3976508593 conn(0x7fd1cc070370 msgr2=0x7fd1cc070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.793+0000 7fd1d19fa640 1 -- 172.21.15.162:0/3976508593 shutdown_connections 2024-04-25T00:50:51.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.793+0000 7fd1d19fa640 1 -- 172.21.15.162:0/3976508593 wait complete. 2024-04-25T00:50:51.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.793+0000 7fd1d19fa640 1 Processor -- start 2024-04-25T00:50:51.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.793+0000 7fd1d19fa640 1 -- start start 2024-04-25T00:50:51.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.797+0000 7fd1d19fa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1cc0ccf30 0x7fd1cc159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.797+0000 7fd1d19fa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1cc15af80 0x7fd1cc1f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.797+0000 7fd1d19fa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0cd310 0x7fd1cc1432c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.797+0000 7fd1d19fa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc0c3a50 con 0x7fd1cc0ccf30 2024-04-25T00:50:51.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.797+0000 7fd1d19fa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd1cc0c7d70 con 0x7fd1cc15af80 2024-04-25T00:50:51.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.797+0000 7fd1d19fa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd1cc0c3bd0 con 0x7fd1cc0cd310 2024-04-25T00:50:51.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.801+0000 7f6721bfc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f671c0cd190 0x7f671c06c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:43038/0 (socket says 172.21.15.162:43038) 2024-04-25T00:50:51.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.801+0000 7f6721bfc640 1 -- 172.21.15.162:0/2705435214 learned_addr learned my addr 172.21.15.162:0/2705435214 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.809+0000 7f6721bfc640 1 -- 172.21.15.162:0/2705435214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f671c1546a0 msgr2=0x7f671c1f0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.809+0000 7f6721bfc640 1 --2- 172.21.15.162:0/2705435214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f671c1546a0 0x7f671c1f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.811 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.809+0000 7f6721bfc640 1 -- 172.21.15.162:0/2705435214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f671c0c9950 msgr2=0x7f671c158130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.809+0000 7f6721bfc640 1 --2- 172.21.15.162:0/2705435214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f671c0c9950 0x7f671c158130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.809+0000 7f6721bfc640 1 -- 172.21.15.162:0/2705435214 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f671c1517c0 con 0x7f671c0cd190 2024-04-25T00:50:51.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.813+0000 7f96d37fe640 1 -- 172.21.15.162:0/2415505102 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f96cc01a020 con 0x7f96c8004810 2024-04-25T00:50:51.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.817+0000 7f96d37fe640 1 --2- 172.21.15.162:0/2415505102 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f96bc067940 0x7f96bc069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.817+0000 7f96d3fff640 1 --2- 172.21.15.162:0/2415505102 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f96bc067940 0x7f96bc069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.817 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.817+0000 7f96d3fff640 1 --2- 172.21.15.162:0/2415505102 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f96bc067940 0x7f96bc069e00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f96c40aa000 tx=0x7f96c4000fc0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.817+0000 7fd1cb7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0cd310 0x7fd1cc1432c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.817+0000 7fd1cb7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0cd310 0x7fd1cc1432c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:43054/0 (socket says 172.21.15.162:43054) 2024-04-25T00:50:51.819 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.817+0000 7fd1cb7fe640 1 -- 172.21.15.162:0/143357025 learned_addr learned my addr 172.21.15.162:0/143357025 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.820 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.817+0000 7f6721bfc640 1 --2- 172.21.15.162:0/2705435214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f671c0cd190 0x7f671c06c580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f670c00c4c0 tx=0x7f670c001e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.821+0000 7f96d37fe640 1 -- 172.21.15.162:0/2415505102 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f96cc057bb0 con 0x7f96c8004810 2024-04-25T00:50:51.828 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.825+0000 7fd1cb7fe640 1 -- 172.21.15.162:0/143357025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1cc15af80 msgr2=0x7fd1cc1f46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.828 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.825+0000 7fd1cb7fe640 1 --2- 172.21.15.162:0/143357025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1cc15af80 0x7fd1cc1f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.828 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.825+0000 7fd1cb7fe640 1 -- 172.21.15.162:0/143357025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1cc0ccf30 msgr2=0x7fd1cc159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.828 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.825+0000 7fd1cb7fe640 1 --2- 172.21.15.162:0/143357025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1cc0ccf30 0x7fd1cc159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.828 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.825+0000 7fd1cb7fe640 1 -- 172.21.15.162:0/143357025 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1cc148000 con 0x7fd1cc0cd310 2024-04-25T00:50:51.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.833+0000 7fd1cb7fe640 1 --2- 172.21.15.162:0/143357025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0cd310 0x7fd1cc1432c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd1c401c6e0 tx=0x7fd1b4005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.837+0000 7f9eba7fc640 1 -- 172.21.15.162:0/1415642758 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0017070 con 0x7f9ec4066fc0 2024-04-25T00:50:51.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.837+0000 7f9eba7fc640 1 -- 172.21.15.162:0/1415642758 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec00069e0 con 0x7f9ec4066fc0 2024-04-25T00:50:51.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.837+0000 7f9eba7fc640 1 -- 172.21.15.162:0/1415642758 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0006e10 con 0x7f9ec4066fc0 2024-04-25T00:50:51.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.837+0000 7f9ecc038640 1 -- 172.21.15.162:0/1415642758 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec415b540 con 0x7f9ec4066fc0 2024-04-25T00:50:51.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.837+0000 7f9ecc038640 1 -- 172.21.15.162:0/1415642758 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec40cb800 con 0x7f9ec4066fc0 2024-04-25T00:50:51.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.837+0000 7f9ecc038640 1 -- 172.21.15.162:0/1415642758 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ec4075110 con 0x7f9ec4066fc0 2024-04-25T00:50:51.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.845+0000 7feb6bfff640 1 -- 172.21.15.162:0/1786423008 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb640b0070 con 0x7feb7415ee10 2024-04-25T00:50:51.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.845+0000 7feb6bfff640 1 -- 172.21.15.162:0/1786423008 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb640ab600 con 0x7feb7415ee10 2024-04-25T00:50:51.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.845+0000 7feb6bfff640 1 -- 172.21.15.162:0/1786423008 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb640ab9d0 con 0x7feb7415ee10 2024-04-25T00:50:51.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.845+0000 7f96d37fe640 1 -- 172.21.15.162:0/2415505102 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f96cc021020 con 0x7f96c8004810 2024-04-25T00:50:51.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.845+0000 7feb7b414640 1 -- 172.21.15.162:0/1786423008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb7415ee10 msgr2=0x7feb7406b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.845+0000 7feb7b414640 1 --2- 172.21.15.162:0/1786423008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb7415ee10 0x7feb7406b210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb74162210 tx=0x7feb6401c4e0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.845+0000 7feb7b414640 1 -- 172.21.15.162:0/1786423008 shutdown_connections 2024-04-25T00:50:51.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.845+0000 7feb7b414640 1 --2- 172.21.15.162:0/1786423008 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb7415ee10 0x7feb7406b210 secure :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb74162210 tx=0x7feb6401c4e0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.845+0000 7feb7b414640 1 --2- 172.21.15.162:0/1786423008 >> v2:172.21.15.162:3300/0 conn(0x7feb74158b40 0x7feb7415e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.845+0000 7feb7b414640 1 -- 172.21.15.162:0/1786423008 >> 172.21.15.162:0/1786423008 conn(0x7feb74070370 msgr2=0x7feb74070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:51.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.849+0000 7fd1b3fff640 1 -- 172.21.15.162:0/143357025 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40c0070 con 0x7fd1cc0cd310 2024-04-25T00:50:51.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.849+0000 7fd1b3fff640 1 -- 172.21.15.162:0/143357025 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c40b3040 con 0x7fd1cc0cd310 2024-04-25T00:50:51.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.849+0000 7f6712ffd640 1 -- 172.21.15.162:0/2705435214 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c017070 con 0x7f671c0cd190 2024-04-25T00:50:51.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.849+0000 7f6712ffd640 1 -- 172.21.15.162:0/2705435214 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f670c003600 con 0x7f671c0cd190 2024-04-25T00:50:51.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.849+0000 7f6712ffd640 1 -- 172.21.15.162:0/2705435214 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f670c0039f0 con 0x7f671c0cd190 2024-04-25T00:50:51.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.849+0000 7f6724661640 1 -- 172.21.15.162:0/2705435214 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f671c159ec0 con 0x7f671c0cd190 2024-04-25T00:50:51.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.849+0000 7f6724661640 1 -- 172.21.15.162:0/2705435214 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f671c151a60 con 0x7f671c0cd190 2024-04-25T00:50:51.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.849+0000 7fd1b3fff640 1 -- 172.21.15.162:0/143357025 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c40b2070 con 0x7fd1cc0cd310 2024-04-25T00:50:51.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.849+0000 7fd1d19fa640 1 -- 172.21.15.162:0/143357025 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1cc1f3350 con 0x7fd1cc0cd310 2024-04-25T00:50:51.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.849+0000 7fd1d19fa640 1 -- 172.21.15.162:0/143357025 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1cc158b30 con 0x7fd1cc0cd310 2024-04-25T00:50:51.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.849+0000 7fd1d19fa640 1 -- 172.21.15.162:0/143357025 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1cc075110 con 0x7fd1cc0cd310 2024-04-25T00:50:51.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.849+0000 7f6724661640 1 -- 172.21.15.162:0/2705435214 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f671c075110 con 0x7f671c0cd190 2024-04-25T00:50:51.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.861+0000 7feb7b414640 1 -- 172.21.15.162:0/1786423008 shutdown_connections 2024-04-25T00:50:51.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.861+0000 7feb7b414640 1 -- 172.21.15.162:0/1786423008 wait complete. 2024-04-25T00:50:51.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.861+0000 7feb7b414640 1 Processor -- start 2024-04-25T00:50:51.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.861+0000 7feb7b414640 1 -- start start 2024-04-25T00:50:51.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.861+0000 7feb7b414640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb740cd190 0x7feb74151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.861+0000 7feb7b414640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb74158b40 0x7feb74150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.861+0000 7feb7b414640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb740cb410 0x7feb740c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:51.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.861+0000 7feb7b414640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7feb741590a0 con 0x7feb74158b40 2024-04-25T00:50:51.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.861+0000 7feb7b414640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7feb74158f20 con 0x7feb740cb410 2024-04-25T00:50:51.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.861+0000 7feb7b414640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7feb7406be60 con 0x7feb740cd190 2024-04-25T00:50:51.870 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.869+0000 7f885ed9e640 1 -- 172.21.15.162:0/2119008564 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f8858075110 con 0x7f8858072d40 2024-04-25T00:50:51.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.869+0000 7feb799b1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb740cb410 0x7feb740c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:51.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.873+0000 7feb799b1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb740cb410 0x7feb740c7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:60532/0 (socket says 172.21.15.162:60532) 2024-04-25T00:50:51.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.873+0000 7feb799b1640 1 -- 172.21.15.162:0/2630242014 learned_addr learned my addr 172.21.15.162:0/2630242014 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:51.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.881+0000 7feb799b1640 1 -- 172.21.15.162:0/2630242014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb740cd190 msgr2=0x7feb74151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.881+0000 7feb799b1640 1 --2- 172.21.15.162:0/2630242014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb740cd190 0x7feb74151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.881+0000 7feb799b1640 1 -- 172.21.15.162:0/2630242014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb74158b40 msgr2=0x7feb74150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:51.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.881+0000 7feb799b1640 1 --2- 172.21.15.162:0/2630242014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb74158b40 0x7feb74150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:51.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.881+0000 7feb799b1640 1 -- 172.21.15.162:0/2630242014 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb741fb720 con 0x7feb740cb410 2024-04-25T00:50:51.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.885+0000 7feb799b1640 1 --2- 172.21.15.162:0/2630242014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb740cb410 0x7feb740c7d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00c7b0 tx=0x7feb6c00cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:51.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.889+0000 7feb69ffb640 1 -- 172.21.15.162:0/2630242014 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c017070 con 0x7feb740cb410 2024-04-25T00:50:51.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.889+0000 7feb69ffb640 1 -- 172.21.15.162:0/2630242014 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb6c003db0 con 0x7feb740cb410 2024-04-25T00:50:51.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.889+0000 7feb7b414640 1 -- 172.21.15.162:0/2630242014 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb741fba00 con 0x7feb740cb410 2024-04-25T00:50:51.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.889+0000 7feb69ffb640 1 -- 172.21.15.162:0/2630242014 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c0052b0 con 0x7feb740cb410 2024-04-25T00:50:51.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.889+0000 7feb7b414640 1 -- 172.21.15.162:0/2630242014 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb740c7590 con 0x7feb740cb410 2024-04-25T00:50:51.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:51.893+0000 7feb7b414640 1 -- 172.21.15.162:0/2630242014 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb74075110 con 0x7feb740cb410 2024-04-25T00:50:52.013 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.013+0000 7f96e1770640 1 -- 172.21.15.162:0/2415505102 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f96c0005860 con 0x7f96c8004810 2024-04-25T00:50:52.055 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.053+0000 7fc762d55640 1 -- 172.21.15.162:0/58988930 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc75c0c3a60 con 0x7fc75c06d1f0 2024-04-25T00:50:52.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.065+0000 7f88557fa640 1 -- 172.21.15.162:0/2119008564 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f884c059fb0 con 0x7f8858072d40 2024-04-25T00:50:52.065 INFO:teuthology.orchestra.run.smithi162.stdout:68719476750 2024-04-25T00:50:52.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.065+0000 7f885ed9e640 1 -- 172.21.15.162:0/2119008564 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f883c0678c0 msgr2=0x7f883c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:52.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.065+0000 7f885ed9e640 1 --2- 172.21.15.162:0/2119008564 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f883c0678c0 0x7f883c069d80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f88440ad000 tx=0x7f8844004740 comp rx=0 tx=0).stop 2024-04-25T00:50:52.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.065+0000 7f885ed9e640 1 -- 172.21.15.162:0/2119008564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8858072d40 msgr2=0x7f88581f71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:52.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.065+0000 7f885ed9e640 1 --2- 172.21.15.162:0/2119008564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8858072d40 0x7f88581f71f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f884c00c400 tx=0x7f884c00c8c0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.065+0000 7f885ed9e640 1 -- 172.21.15.162:0/2119008564 shutdown_connections 2024-04-25T00:50:52.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.065+0000 7f885ed9e640 1 --2- 172.21.15.162:0/2119008564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f885815daa0 0x7f88581f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.065+0000 7f885ed9e640 1 --2- 172.21.15.162:0/2119008564 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f885815a580 0x7f88581f3a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.065+0000 7f885ed9e640 1 --2- 172.21.15.162:0/2119008564 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f883c0678c0 0x7f883c069d80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.065+0000 7f885ed9e640 1 --2- 172.21.15.162:0/2119008564 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8858072d40 0x7f88581f71f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.065+0000 7f885ed9e640 1 -- 172.21.15.162:0/2119008564 >> 172.21.15.162:0/2119008564 conn(0x7f8858070280 msgr2=0x7f8858144a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:52.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.065+0000 7f885ed9e640 1 -- 172.21.15.162:0/2119008564 shutdown_connections 2024-04-25T00:50:52.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.065+0000 7f885ed9e640 1 -- 172.21.15.162:0/2119008564 wait complete. 2024-04-25T00:50:52.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476751 got 68719476750 for osd.4 2024-04-25T00:50:52.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.089+0000 7f34cdffb640 1 -- 172.21.15.162:0/680400904 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f34d000a850 con 0x7f34d814da50 2024-04-25T00:50:52.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.089+0000 7f34cdffb640 1 --2- 172.21.15.162:0/680400904 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f34bc0678c0 0x7f34bc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:52.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.089+0000 7f34dd77e640 1 --2- 172.21.15.162:0/680400904 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f34bc0678c0 0x7f34bc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:52.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.089+0000 7f34dd77e640 1 --2- 172.21.15.162:0/680400904 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f34bc0678c0 0x7f34bc069d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f34d40af000 tx=0x7f34d4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:52.102 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.101+0000 7f34cdffb640 1 -- 172.21.15.162:0/680400904 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f34d0054c30 con 0x7f34d814da50 2024-04-25T00:50:52.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.101+0000 7f34cdffb640 1 -- 172.21.15.162:0/680400904 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f34d0020020 con 0x7f34d814da50 2024-04-25T00:50:52.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.197+0000 7f96d37fe640 1 -- 172.21.15.162:0/2415505102 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f96cc00e040 con 0x7f96c8004810 2024-04-25T00:50:52.198 INFO:teuthology.orchestra.run.smithi162.stdout:64424509455 2024-04-25T00:50:52.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.197+0000 7feb69ffb640 1 -- 172.21.15.162:0/2630242014 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feb6c01a070 con 0x7feb740cb410 2024-04-25T00:50:52.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.197+0000 7feb69ffb640 1 --2- 172.21.15.162:0/2630242014 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7feb58067910 0x7feb58069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:52.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.197+0000 7feb791b0640 1 --2- 172.21.15.162:0/2630242014 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7feb58067910 0x7feb58069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:52.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.197+0000 7feb791b0640 1 --2- 172.21.15.162:0/2630242014 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7feb58067910 0x7feb58069dd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feb70009690 tx=0x7feb70006c00 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:52.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.197+0000 7f96e1770640 1 -- 172.21.15.162:0/2415505102 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f96bc067940 msgr2=0x7f96bc069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:52.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.197+0000 7f96e1770640 1 --2- 172.21.15.162:0/2415505102 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f96bc067940 0x7f96bc069e00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f96c40aa000 tx=0x7f96c4000fc0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.197+0000 7f96e1770640 1 -- 172.21.15.162:0/2415505102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96c8004810 msgr2=0x7f96dc13a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:52.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.197+0000 7f96e1770640 1 --2- 172.21.15.162:0/2415505102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96c8004810 0x7f96dc13a7c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00f8a0 tx=0x7f96cc00fd60 comp rx=0 tx=0).stop 2024-04-25T00:50:52.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.197+0000 7f96e1770640 1 -- 172.21.15.162:0/2415505102 shutdown_connections 2024-04-25T00:50:52.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.197+0000 7f96e1770640 1 --2- 172.21.15.162:0/2415505102 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f96bc067940 0x7f96bc069e00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.197+0000 7f96e1770640 1 --2- 172.21.15.162:0/2415505102 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f96dc1590f0 0x7f96dc137a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.197+0000 7f96e1770640 1 --2- 172.21.15.162:0/2415505102 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f96dc0ca120 0x7f96dc1f5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.197+0000 7f96e1770640 1 --2- 172.21.15.162:0/2415505102 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f96c8004810 0x7f96dc13a7c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.197+0000 7f96e1770640 1 -- 172.21.15.162:0/2415505102 >> 172.21.15.162:0/2415505102 conn(0x7f96dc06fa80 msgr2=0x7f96dc0c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:52.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.197+0000 7f96e1770640 1 -- 172.21.15.162:0/2415505102 shutdown_connections 2024-04-25T00:50:52.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.197+0000 7f96e1770640 1 -- 172.21.15.162:0/2415505102 wait complete. 2024-04-25T00:50:52.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.205+0000 7feb69ffb640 1 -- 172.21.15.162:0/2630242014 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7feb6c053cc0 con 0x7feb740cb410 2024-04-25T00:50:52.216 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509455 for osd.0 2024-04-25T00:50:52.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.237+0000 7feb69ffb640 1 -- 172.21.15.162:0/2630242014 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7feb6c021020 con 0x7feb740cb410 2024-04-25T00:50:52.262 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.261+0000 7f34df9e2640 1 -- 172.21.15.162:0/680400904 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f34b8005860 con 0x7f34d814da50 2024-04-25T00:50:52.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.265+0000 7f34cdffb640 1 -- 172.21.15.162:0/680400904 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f34d0057290 con 0x7f34d814da50 2024-04-25T00:50:52.267 INFO:teuthology.orchestra.run.smithi162.stdout:68719476752 2024-04-25T00:50:52.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.269+0000 7f34df9e2640 1 -- 172.21.15.162:0/680400904 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f34bc0678c0 msgr2=0x7f34bc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:52.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.269+0000 7f34df9e2640 1 --2- 172.21.15.162:0/680400904 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f34bc0678c0 0x7f34bc069d80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f34d40af000 tx=0x7f34d4008040 comp rx=0 tx=0).stop 2024-04-25T00:50:52.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.269+0000 7f34df9e2640 1 -- 172.21.15.162:0/680400904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34d814da50 msgr2=0x7f34d81f3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:52.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.269+0000 7f34df9e2640 1 --2- 172.21.15.162:0/680400904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34d814da50 0x7f34d81f3b20 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f34d000c760 tx=0x7f34d000cc20 comp rx=0 tx=0).stop 2024-04-25T00:50:52.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.269+0000 7f34df9e2640 1 -- 172.21.15.162:0/680400904 shutdown_connections 2024-04-25T00:50:52.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.269+0000 7f34df9e2640 1 --2- 172.21.15.162:0/680400904 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f34bc0678c0 0x7f34bc069d80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.269+0000 7f34df9e2640 1 --2- 172.21.15.162:0/680400904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f34d814da50 0x7f34d81f3b20 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.269+0000 7f34df9e2640 1 --2- 172.21.15.162:0/680400904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f34d80c7ba0 0x7f34d8155f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.269+0000 7f34df9e2640 1 --2- 172.21.15.162:0/680400904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f34d80c6c60 0x7f34d81450f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.269+0000 7f34df9e2640 1 -- 172.21.15.162:0/680400904 >> 172.21.15.162:0/680400904 conn(0x7f34d8070370 msgr2=0x7f34d815a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:52.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.269+0000 7f34df9e2640 1 -- 172.21.15.162:0/680400904 shutdown_connections 2024-04-25T00:50:52.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.269+0000 7f34df9e2640 1 -- 172.21.15.162:0/680400904 wait complete. 2024-04-25T00:50:52.285 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476753 got 68719476752 for osd.6 2024-04-25T00:50:52.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.393+0000 7feb7b414640 1 -- 172.21.15.162:0/2630242014 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7feb740cd7e0 con 0x7feb740cb410 2024-04-25T00:50:52.402 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.401+0000 7feb69ffb640 1 -- 172.21.15.162:0/2630242014 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feb6c056320 con 0x7feb740cb410 2024-04-25T00:50:52.403 INFO:teuthology.orchestra.run.smithi162.stdout:64424509454 2024-04-25T00:50:52.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.405+0000 7feb7b414640 1 -- 172.21.15.162:0/2630242014 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7feb58067910 msgr2=0x7feb58069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:52.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.405+0000 7feb7b414640 1 --2- 172.21.15.162:0/2630242014 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7feb58067910 0x7feb58069dd0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feb70009690 tx=0x7feb70006c00 comp rx=0 tx=0).stop 2024-04-25T00:50:52.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.405+0000 7feb7b414640 1 -- 172.21.15.162:0/2630242014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb740cb410 msgr2=0x7feb740c7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:52.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.405+0000 7feb7b414640 1 --2- 172.21.15.162:0/2630242014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb740cb410 0x7feb740c7d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00c7b0 tx=0x7feb6c00cc70 comp rx=0 tx=0).stop 2024-04-25T00:50:52.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.405+0000 7feb7b414640 1 -- 172.21.15.162:0/2630242014 shutdown_connections 2024-04-25T00:50:52.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.405+0000 7feb7b414640 1 --2- 172.21.15.162:0/2630242014 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7feb740cb410 0x7feb740c7d90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.405+0000 7feb7b414640 1 --2- 172.21.15.162:0/2630242014 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7feb58067910 0x7feb58069dd0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.405+0000 7feb7b414640 1 --2- 172.21.15.162:0/2630242014 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7feb74158b40 0x7feb74150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.405+0000 7feb7b414640 1 --2- 172.21.15.162:0/2630242014 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7feb740cd190 0x7feb74151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.405+0000 7feb7b414640 1 -- 172.21.15.162:0/2630242014 >> 172.21.15.162:0/2630242014 conn(0x7feb74070370 msgr2=0x7feb740cc180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:52.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.405+0000 7feb7b414640 1 -- 172.21.15.162:0/2630242014 shutdown_connections 2024-04-25T00:50:52.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.405+0000 7feb7b414640 1 -- 172.21.15.162:0/2630242014 wait complete. 2024-04-25T00:50:52.421 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509454 for osd.3 2024-04-25T00:50:52.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.693+0000 7f9eba7fc640 1 -- 172.21.15.162:0/1415642758 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9ec001a070 con 0x7f9ec4066fc0 2024-04-25T00:50:52.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.697+0000 7f9eba7fc640 1 --2- 172.21.15.162:0/1415642758 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9ea8067940 0x7f9ea8069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:52.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.697+0000 7f9ec95d3640 1 --2- 172.21.15.162:0/1415642758 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9ea8067940 0x7f9ea8069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:52.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.697+0000 7f9ec95d3640 1 --2- 172.21.15.162:0/1415642758 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9ea8067940 0x7f9ea8069e00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9ec413cdd0 tx=0x7f9eb40091c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:52.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.705+0000 7f9eba7fc640 1 -- 172.21.15.162:0/1415642758 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f9ec0053760 con 0x7f9ec4066fc0 2024-04-25T00:50:52.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.741+0000 7fd1b3fff640 1 -- 172.21.15.162:0/143357025 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd1c40c3070 con 0x7fd1cc0cd310 2024-04-25T00:50:52.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.741+0000 7fd1b3fff640 1 --2- 172.21.15.162:0/143357025 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fd1b8067910 0x7fd1b8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:52.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.741+0000 7fd1caffd640 1 --2- 172.21.15.162:0/143357025 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fd1b8067910 0x7fd1b8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:52.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.745+0000 7fd1caffd640 1 --2- 172.21.15.162:0/143357025 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fd1b8067910 0x7fd1b8069dd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0015c0 tx=0x7fd1bc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:52.779 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.777+0000 7fd1b3fff640 1 -- 172.21.15.162:0/143357025 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fd1c40ee170 con 0x7fd1cc0cd310 2024-04-25T00:50:52.809 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.809+0000 7f9eba7fc640 1 -- 172.21.15.162:0/1415642758 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f9ec0021080 con 0x7f9ec4066fc0 2024-04-25T00:50:52.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.809+0000 7fd1b3fff640 1 -- 172.21.15.162:0/143357025 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd1c4008030 con 0x7fd1cc0cd310 2024-04-25T00:50:52.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.849+0000 7f6712ffd640 1 -- 172.21.15.162:0/2705435214 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f670c01a070 con 0x7f671c0cd190 2024-04-25T00:50:52.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.853+0000 7f6712ffd640 1 --2- 172.21.15.162:0/2705435214 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6700067910 0x7f6700069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:52.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.853+0000 7f67223fd640 1 --2- 172.21.15.162:0/2705435214 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6700067910 0x7f6700069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:52.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.853+0000 7f67223fd640 1 --2- 172.21.15.162:0/2705435214 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6700067910 0x7f6700069dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f67180b2000 tx=0x7f6718004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:52.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.861+0000 7f6712ffd640 1 -- 172.21.15.162:0/2705435214 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f670c0538d0 con 0x7f671c0cd190 2024-04-25T00:50:52.899 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.897+0000 7f6712ffd640 1 -- 172.21.15.162:0/2705435214 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f670c021080 con 0x7f671c0cd190 2024-04-25T00:50:52.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.909+0000 7fc7597fa640 1 -- 172.21.15.162:0/58988930 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc754057280 con 0x7fc75c06d1f0 2024-04-25T00:50:52.909 INFO:teuthology.orchestra.run.smithi162.stdout:68719476752 2024-04-25T00:50:52.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.909+0000 7fc762d55640 1 -- 172.21.15.162:0/58988930 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc73c067910 msgr2=0x7fc73c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:52.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.909+0000 7fc762d55640 1 --2- 172.21.15.162:0/58988930 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc73c067910 0x7fc73c069dd0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fc744009650 tx=0x7fc744006bb0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.909+0000 7fc762d55640 1 -- 172.21.15.162:0/58988930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc75c06d1f0 msgr2=0x7fc75c154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:52.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.909+0000 7fc762d55640 1 --2- 172.21.15.162:0/58988930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc75c06d1f0 0x7fc75c154c50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc75400d830 tx=0x7fc75400dcf0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.909+0000 7fc762d55640 1 -- 172.21.15.162:0/58988930 shutdown_connections 2024-04-25T00:50:52.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.909+0000 7fc762d55640 1 --2- 172.21.15.162:0/58988930 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc75c0719c0 0x7fc75c1f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.909+0000 7fc762d55640 1 --2- 172.21.15.162:0/58988930 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc73c067910 0x7fc73c069dd0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.909+0000 7fc762d55640 1 --2- 172.21.15.162:0/58988930 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc75c0715e0 0x7fc75c0cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.909+0000 7fc762d55640 1 --2- 172.21.15.162:0/58988930 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc75c06d1f0 0x7fc75c154c50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:52.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.909+0000 7fc762d55640 1 -- 172.21.15.162:0/58988930 >> 172.21.15.162:0/58988930 conn(0x7fc75c06b810 msgr2=0x7fc75c067850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:52.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.913+0000 7fc762d55640 1 -- 172.21.15.162:0/58988930 shutdown_connections 2024-04-25T00:50:52.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.913+0000 7fc762d55640 1 -- 172.21.15.162:0/58988930 wait complete. 2024-04-25T00:50:52.934 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476753 got 68719476752 for osd.7 2024-04-25T00:50:52.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:52.993+0000 7f9ecc038640 1 -- 172.21.15.162:0/1415642758 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f9ec4152870 con 0x7f9ec4066fc0 2024-04-25T00:50:53.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.013+0000 7fd1d19fa640 1 -- 172.21.15.162:0/143357025 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd1cc0c8890 con 0x7fd1cc0cd310 2024-04-25T00:50:53.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.081+0000 7fd1b3fff640 1 -- 172.21.15.162:0/143357025 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd1c4016980 con 0x7fd1cc0cd310 2024-04-25T00:50:53.082 INFO:teuthology.orchestra.run.smithi162.stdout:68719476751 2024-04-25T00:50:53.083 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T00:50:53.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.081+0000 7fd1d19fa640 1 -- 172.21.15.162:0/143357025 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fd1b8067910 msgr2=0x7fd1b8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.081+0000 7fd1d19fa640 1 --2- 172.21.15.162:0/143357025 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fd1b8067910 0x7fd1b8069dd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc0015c0 tx=0x7fd1bc009040 comp rx=0 tx=0).stop 2024-04-25T00:50:53.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.081+0000 7fd1d19fa640 1 -- 172.21.15.162:0/143357025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0cd310 msgr2=0x7fd1cc1432c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.084 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.081+0000 7fd1d19fa640 1 --2- 172.21.15.162:0/143357025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0cd310 0x7fd1cc1432c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd1c401c6e0 tx=0x7fd1b4005840 comp rx=0 tx=0).stop 2024-04-25T00:50:53.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.081+0000 7f9eba7fc640 1 -- 172.21.15.162:0/1415642758 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9ec00556c0 con 0x7f9ec4066fc0 2024-04-25T00:50:53.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.081+0000 7fd1d19fa640 1 -- 172.21.15.162:0/143357025 shutdown_connections 2024-04-25T00:50:53.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.081+0000 7fd1d19fa640 1 --2- 172.21.15.162:0/143357025 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd1cc0cd310 0x7fd1cc1432c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.081+0000 7fd1d19fa640 1 --2- 172.21.15.162:0/143357025 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd1cc15af80 0x7fd1cc1f46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.081+0000 7fd1d19fa640 1 --2- 172.21.15.162:0/143357025 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fd1b8067910 0x7fd1b8069dd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.081+0000 7fd1d19fa640 1 --2- 172.21.15.162:0/143357025 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd1cc0ccf30 0x7fd1cc159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.081+0000 7fd1d19fa640 1 -- 172.21.15.162:0/143357025 >> 172.21.15.162:0/143357025 conn(0x7fd1cc070370 msgr2=0x7fd1cc147240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:53.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.081+0000 7fd1d19fa640 1 -- 172.21.15.162:0/143357025 shutdown_connections 2024-04-25T00:50:53.086 INFO:teuthology.orchestra.run.smithi162.stdout:68719476752 2024-04-25T00:50:53.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.081+0000 7fd1d19fa640 1 -- 172.21.15.162:0/143357025 wait complete. 2024-04-25T00:50:53.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.085+0000 7f9ecc038640 1 -- 172.21.15.162:0/1415642758 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9ea8067940 msgr2=0x7f9ea8069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.085+0000 7f9ecc038640 1 --2- 172.21.15.162:0/1415642758 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9ea8067940 0x7f9ea8069e00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9ec413cdd0 tx=0x7f9eb40091c0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.085+0000 7f9ecc038640 1 -- 172.21.15.162:0/1415642758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ec4066fc0 msgr2=0x7f9ec41f1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.085+0000 7f9ecc038640 1 --2- 172.21.15.162:0/1415642758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ec4066fc0 0x7f9ec41f1200 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9ec000c410 tx=0x7f9ec000c8d0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.085+0000 7f9ecc038640 1 -- 172.21.15.162:0/1415642758 shutdown_connections 2024-04-25T00:50:53.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.085+0000 7f9ecc038640 1 --2- 172.21.15.162:0/1415642758 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9ec40c5fe0 0x7f9ec41f2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.085+0000 7f9ecc038640 1 --2- 172.21.15.162:0/1415642758 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9ea8067940 0x7f9ea8069e00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.085+0000 7f9ecc038640 1 --2- 172.21.15.162:0/1415642758 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9ec40c5c00 0x7f9ec40cc8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.085+0000 7f9ecc038640 1 --2- 172.21.15.162:0/1415642758 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9ec4066fc0 0x7f9ec41f1200 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.085+0000 7f9ecc038640 1 -- 172.21.15.162:0/1415642758 >> 172.21.15.162:0/1415642758 conn(0x7f9ec406fa80 msgr2=0x7f9ec4134c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:53.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.085+0000 7f9ecc038640 1 -- 172.21.15.162:0/1415642758 shutdown_connections 2024-04-25T00:50:53.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.085+0000 7f9ecc038640 1 -- 172.21.15.162:0/1415642758 wait complete. 2024-04-25T00:50:53.111 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476752 got 68719476751 for osd.2 2024-04-25T00:50:53.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476753 got 68719476752 for osd.5 2024-04-25T00:50:53.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.137+0000 7f6724661640 1 -- 172.21.15.162:0/2705435214 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f671c0cd7e0 con 0x7f671c0cd190 2024-04-25T00:50:53.217 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T00:50:53.226 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.225+0000 7f6712ffd640 1 -- 172.21.15.162:0/2705435214 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f670c055f30 con 0x7f671c0cd190 2024-04-25T00:50:53.226 INFO:teuthology.orchestra.run.smithi162.stdout:60129542160 2024-04-25T00:50:53.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.225+0000 7f6724661640 1 -- 172.21.15.162:0/2705435214 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6700067910 msgr2=0x7f6700069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.225+0000 7f6724661640 1 --2- 172.21.15.162:0/2705435214 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6700067910 0x7f6700069dd0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f67180b2000 tx=0x7f6718004740 comp rx=0 tx=0).stop 2024-04-25T00:50:53.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.225+0000 7f6724661640 1 -- 172.21.15.162:0/2705435214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f671c0cd190 msgr2=0x7f671c06c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.225+0000 7f6724661640 1 --2- 172.21.15.162:0/2705435214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f671c0cd190 0x7f671c06c580 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f670c00c4c0 tx=0x7f670c001e80 comp rx=0 tx=0).stop 2024-04-25T00:50:53.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.225+0000 7f6724661640 1 -- 172.21.15.162:0/2705435214 shutdown_connections 2024-04-25T00:50:53.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.225+0000 7f6724661640 1 --2- 172.21.15.162:0/2705435214 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f671c1546a0 0x7f671c1f0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.225+0000 7f6724661640 1 --2- 172.21.15.162:0/2705435214 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f671c0cd190 0x7f671c06c580 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f670c00c4c0 tx=0x7f670c001e80 comp rx=0 tx=0).stop 2024-04-25T00:50:53.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.229+0000 7f6724661640 1 --2- 172.21.15.162:0/2705435214 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6700067910 0x7f6700069dd0 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f67180b2000 tx=0x7f6718004740 comp rx=0 tx=0).stop 2024-04-25T00:50:53.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.229+0000 7f6724661640 1 --2- 172.21.15.162:0/2705435214 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f671c0c9950 0x7f671c158130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.229+0000 7f6724661640 1 -- 172.21.15.162:0/2705435214 >> 172.21.15.162:0/2705435214 conn(0x7f671c070370 msgr2=0x7f671c152600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:53.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.229+0000 7f6724661640 1 -- 172.21.15.162:0/2705435214 shutdown_connections 2024-04-25T00:50:53.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.229+0000 7f6724661640 1 -- 172.21.15.162:0/2705435214 wait complete. 2024-04-25T00:50:53.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.245+0000 7ffbf6b88640 1 Processor -- start 2024-04-25T00:50:53.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.245+0000 7ffbf6b88640 1 -- start start 2024-04-25T00:50:53.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.245+0000 7ffbf6b88640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ffbf0158a90 0x7ffbf00c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.245+0000 7ffbf6b88640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffbf006f030 0x7ffbf006b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.245+0000 7ffbf6b88640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbf0158e70 con 0x7ffbf015e710 2024-04-25T00:50:53.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.245+0000 7ffbf6b88640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ffbf00c7410 con 0x7ffbf0158a90 2024-04-25T00:50:53.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.245+0000 7ffbf6b88640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7ffbf00c7660 con 0x7ffbf006f030 2024-04-25T00:50:53.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.249+0000 7ffbeffff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ffbf006f030 0x7ffbf006b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:53.251 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.249+0000 7ffbf5125640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ffbf015e710 0x7ffbf015eb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:35330/0 (socket says 172.21.15.162:35330) 2024-04-25T00:50:53.251 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.249+0000 7ffbf5125640 1 -- 172.21.15.162:0/3068322002 learned_addr learned my addr 172.21.15.162:0/3068322002 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:53.253 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542160 for osd.1 2024-04-25T00:50:53.253 DEBUG:teuthology.parallel:result is None 2024-04-25T00:50:53.254 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.253+0000 7ffbf4924640 1 --2- 172.21.15.162:0/3068322002 >> v2:172.21.15.162:3300/0 conn(0x7ffbf0158a90 0x7ffbf00c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:53.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.253+0000 7ffbf4924640 1 -- 172.21.15.162:0/3068322002 >> v2:172.21.15.179:3300/0 conn(0x7ffbf006f030 msgr2=0x7ffbf006b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:53.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.253+0000 7ffbf4924640 1 --2- 172.21.15.162:0/3068322002 >> v2:172.21.15.179:3300/0 conn(0x7ffbf006f030 0x7ffbf006b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.253+0000 7ffbf4924640 1 -- 172.21.15.162:0/3068322002 >> v1:172.21.15.179:6789/0 conn(0x7ffbf015e710 legacy=0x7ffbf015eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:53.260 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.253+0000 7ffbf4924640 1 -- 172.21.15.162:0/3068322002 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf00c7940 con 0x7ffbf0158a90 2024-04-25T00:50:53.261 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.261+0000 7ffbf4924640 1 --2- 172.21.15.162:0/3068322002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbf0158a90 0x7ffbf00c6d30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffbf0067820 tx=0x7ffbdc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a302129f2e5a55 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:53.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.265+0000 7ffbef7fe640 1 -- 172.21.15.162:0/3068322002 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc0ab610 con 0x7ffbf0158a90 2024-04-25T00:50:53.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.265+0000 7ffbef7fe640 1 -- 172.21.15.162:0/3068322002 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbdc0b0070 con 0x7ffbf0158a90 2024-04-25T00:50:53.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.265+0000 7ffbf6b88640 1 -- 172.21.15.162:0/3068322002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbf0158a90 msgr2=0x7ffbf00c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.265+0000 7ffbf6b88640 1 --2- 172.21.15.162:0/3068322002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbf0158a90 0x7ffbf00c6d30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7ffbf0067820 tx=0x7ffbdc01c410 comp rx=0 tx=0).stop 2024-04-25T00:50:53.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbf6b88640 1 -- 172.21.15.162:0/3068322002 shutdown_connections 2024-04-25T00:50:53.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbf6b88640 1 --2- 172.21.15.162:0/3068322002 >> v2:172.21.15.179:3300/0 conn(0x7ffbf006f030 0x7ffbf006b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbf6b88640 1 --2- 172.21.15.162:0/3068322002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbf0158a90 0x7ffbf00c6d30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbf6b88640 1 -- 172.21.15.162:0/3068322002 >> 172.21.15.162:0/3068322002 conn(0x7ffbf0070290 msgr2=0x7ffbf00c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:53.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbf6b88640 1 -- 172.21.15.162:0/3068322002 shutdown_connections 2024-04-25T00:50:53.269 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbf6b88640 1 -- 172.21.15.162:0/3068322002 wait complete. 2024-04-25T00:50:53.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbf6b88640 1 Processor -- start 2024-04-25T00:50:53.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbf6b88640 1 -- start start 2024-04-25T00:50:53.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbf6b88640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbf006f030 0x7ffbf00c9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbf6b88640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbf0158a90 0x7ffbf01470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbf6b88640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbf015e710 0x7ffbf014e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbf6b88640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf00c8880 con 0x7ffbf006f030 2024-04-25T00:50:53.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbf6b88640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffbf00c8700 con 0x7ffbf015e710 2024-04-25T00:50:53.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbf6b88640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffbf006b750 con 0x7ffbf0158a90 2024-04-25T00:50:53.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbf4924640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbf006f030 0x7ffbf00c9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:53.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbf4924640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbf006f030 0x7ffbf00c9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40128/0 (socket says 172.21.15.162:40128) 2024-04-25T00:50:53.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbf4924640 1 -- 172.21.15.162:0/3452425378 learned_addr learned my addr 172.21.15.162:0/3452425378 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:53.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbf5125640 1 --2- 172.21.15.162:0/3452425378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbf015e710 0x7ffbf014e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:53.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.269+0000 7ffbeffff640 1 --2- 172.21.15.162:0/3452425378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbf0158a90 0x7ffbf01470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:53.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.273+0000 7ffbf4924640 1 -- 172.21.15.162:0/3452425378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbf0158a90 msgr2=0x7ffbf01470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.273+0000 7ffbf4924640 1 --2- 172.21.15.162:0/3452425378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbf0158a90 0x7ffbf01470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.273+0000 7ffbf4924640 1 -- 172.21.15.162:0/3452425378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbf015e710 msgr2=0x7ffbf014e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.273+0000 7ffbf4924640 1 --2- 172.21.15.162:0/3452425378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbf015e710 0x7ffbf014e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.273+0000 7ffbf4924640 1 -- 172.21.15.162:0/3452425378 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbf014cf10 con 0x7ffbf006f030 2024-04-25T00:50:53.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.277+0000 7ffbf4924640 1 --2- 172.21.15.162:0/3452425378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbf006f030 0x7ffbf00c9f20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc000c10 tx=0x7ffbdc0191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:53.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.281+0000 7ffbed7fa640 1 -- 172.21.15.162:0/3452425378 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc003a30 con 0x7ffbf006f030 2024-04-25T00:50:53.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.281+0000 7ffbed7fa640 1 -- 172.21.15.162:0/3452425378 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbdc003bd0 con 0x7ffbf006f030 2024-04-25T00:50:53.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.281+0000 7ffbed7fa640 1 -- 172.21.15.162:0/3452425378 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbdc0044d0 con 0x7ffbf006f030 2024-04-25T00:50:53.283 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.281+0000 7ffbf6b88640 1 -- 172.21.15.162:0/3452425378 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbf0146030 con 0x7ffbf006f030 2024-04-25T00:50:53.283 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.281+0000 7ffbf6b88640 1 -- 172.21.15.162:0/3452425378 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbf01465f0 con 0x7ffbf006f030 2024-04-25T00:50:53.284 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.281+0000 7ffbf6b88640 1 -- 172.21.15.162:0/3452425378 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbf0075110 con 0x7ffbf006f030 2024-04-25T00:50:53.285 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T00:50:53.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.305+0000 7ffbed7fa640 1 -- 172.21.15.162:0/3452425378 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffbdc0c3060 con 0x7ffbf006f030 2024-04-25T00:50:53.308 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.309+0000 7ffbed7fa640 1 --2- 172.21.15.162:0/3452425378 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ffbd4067940 0x7ffbd4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.309+0000 7ffbeffff640 1 --2- 172.21.15.162:0/3452425378 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ffbd4067940 0x7ffbd4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:53.309 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.309+0000 7ffbeffff640 1 --2- 172.21.15.162:0/3452425378 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ffbd4067940 0x7ffbd4069e00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffbf00c3270 tx=0x7ffbe4009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:53.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.341+0000 7fddf4d72640 1 Processor -- start 2024-04-25T00:50:53.343 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.341+0000 7fddf4d72640 1 -- start start 2024-04-25T00:50:53.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.341+0000 7fddf4d72640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fddf01522c0 0x7fddf01581f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.341+0000 7fddf4d72640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fddf01526a0 0x7fddf015c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.341+0000 7fddf4d72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddf006b210 0x7fddf00c6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.341+0000 7fddf4d72640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fddf0159140 con 0x7fddf01526a0 2024-04-25T00:50:53.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.341+0000 7fddf4d72640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fddf01588a0 con 0x7fddf01522c0 2024-04-25T00:50:53.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.341+0000 7fddf4d72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fddf0158b80 con 0x7fddf006b210 2024-04-25T00:50:53.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.345+0000 7fddeed9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddf006b210 0x7fddf00c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:53.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.345+0000 7fddee59c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fddf01522c0 0x7fddf01581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:53.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.345+0000 7fddee59c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fddf01522c0 0x7fddf01581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:60564/0 (socket says 172.21.15.162:60564) 2024-04-25T00:50:53.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.345+0000 7fddee59c640 1 -- 172.21.15.162:0/4089328185 learned_addr learned my addr 172.21.15.162:0/4089328185 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:53.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.349+0000 7fddee59c640 1 -- 172.21.15.162:0/4089328185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddf006b210 msgr2=0x7fddf00c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:53.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.349+0000 7fddee59c640 1 --2- 172.21.15.162:0/4089328185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddf006b210 0x7fddf00c6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.349+0000 7fddee59c640 1 -- 172.21.15.162:0/4089328185 >> v2:172.21.15.162:3300/0 conn(0x7fddf01526a0 msgr2=0x7fddf015c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:53.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.349+0000 7fddee59c640 1 --2- 172.21.15.162:0/4089328185 >> v2:172.21.15.162:3300/0 conn(0x7fddf01526a0 0x7fddf015c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.349+0000 7fddee59c640 1 -- 172.21.15.162:0/4089328185 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf0158e60 con 0x7fddf01522c0 2024-04-25T00:50:53.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.357+0000 7fddee59c640 1 --2- 172.21.15.162:0/4089328185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddf01522c0 0x7fddf01581f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fddf00ca7c0 tx=0x7fdde001ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8be81dd1385cec77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:53.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.365+0000 7fdded59a640 1 -- 172.21.15.162:0/4089328185 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde00b5070 con 0x7fddf01522c0 2024-04-25T00:50:53.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.365+0000 7fdded59a640 1 -- 172.21.15.162:0/4089328185 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde00a89d0 con 0x7fddf01522c0 2024-04-25T00:50:53.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.365+0000 7fdded59a640 1 -- 172.21.15.162:0/4089328185 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde00a8da0 con 0x7fddf01522c0 2024-04-25T00:50:53.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.369+0000 7fddf4d72640 1 -- 172.21.15.162:0/4089328185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddf01522c0 msgr2=0x7fddf01581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.369+0000 7fddf4d72640 1 --2- 172.21.15.162:0/4089328185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddf01522c0 0x7fddf01581f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fddf00ca7c0 tx=0x7fdde001ed10 comp rx=0 tx=0).stop 2024-04-25T00:50:53.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.369+0000 7fddf4d72640 1 -- 172.21.15.162:0/4089328185 shutdown_connections 2024-04-25T00:50:53.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.369+0000 7fddf4d72640 1 --2- 172.21.15.162:0/4089328185 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddf006b210 0x7fddf00c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.369+0000 7fddf4d72640 1 --2- 172.21.15.162:0/4089328185 >> v2:172.21.15.162:3300/0 conn(0x7fddf01526a0 0x7fddf015c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.369+0000 7fddf4d72640 1 --2- 172.21.15.162:0/4089328185 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddf01522c0 0x7fddf01581f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.369+0000 7fddf4d72640 1 -- 172.21.15.162:0/4089328185 >> 172.21.15.162:0/4089328185 conn(0x7fddf0070280 msgr2=0x7fddf0070690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:53.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.369+0000 7fddf4d72640 1 -- 172.21.15.162:0/4089328185 shutdown_connections 2024-04-25T00:50:53.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.369+0000 7fddf4d72640 1 -- 172.21.15.162:0/4089328185 wait complete. 2024-04-25T00:50:53.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.369+0000 7fddf4d72640 1 Processor -- start 2024-04-25T00:50:53.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.369+0000 7fddf4d72640 1 -- start start 2024-04-25T00:50:53.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.369+0000 7fddf4d72640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddf006b210 0x7fddf01557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.369+0000 7fddf4d72640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddf01522c0 0x7fddf01ee5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.369+0000 7fddf4d72640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddf01526a0 0x7fddf0156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.369+0000 7fddf4d72640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fddf00c7620 con 0x7fddf01522c0 2024-04-25T00:50:53.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.369+0000 7fddf4d72640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fddf015bb60 con 0x7fddf006b210 2024-04-25T00:50:53.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.369+0000 7fddf4d72640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fddf015c5c0 con 0x7fddf01526a0 2024-04-25T00:50:53.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.373+0000 7fddeed9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddf01526a0 0x7fddf0156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:53.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.373+0000 7fddeed9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddf01526a0 0x7fddf0156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:43094/0 (socket says 172.21.15.162:43094) 2024-04-25T00:50:53.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.373+0000 7fddeed9d640 1 -- 172.21.15.162:0/3973333636 learned_addr learned my addr 172.21.15.162:0/3973333636 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:53.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.373+0000 7fddee59c640 1 --2- 172.21.15.162:0/3973333636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddf006b210 0x7fddf01557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:53.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.381+0000 7fddeed9d640 1 -- 172.21.15.162:0/3973333636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddf006b210 msgr2=0x7fddf01557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.381+0000 7fddeed9d640 1 --2- 172.21.15.162:0/3973333636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddf006b210 0x7fddf01557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.381+0000 7fddeed9d640 1 -- 172.21.15.162:0/3973333636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddf01522c0 msgr2=0x7fddf01ee5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.381+0000 7fddeed9d640 1 --2- 172.21.15.162:0/3973333636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddf01522c0 0x7fddf01ee5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.381+0000 7fddeed9d640 1 -- 172.21.15.162:0/3973333636 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf0157e50 con 0x7fddf01526a0 2024-04-25T00:50:53.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.389+0000 7fddeed9d640 1 --2- 172.21.15.162:0/3973333636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddf01526a0 0x7fddf0156850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009dd0 tx=0x7fdde800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:53.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.393+0000 7fcf3093b640 1 Processor -- start 2024-04-25T00:50:53.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.393+0000 7fcf3093b640 1 -- start start 2024-04-25T00:50:53.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.393+0000 7fdddeffd640 1 -- 172.21.15.162:0/3973333636 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde8018020 con 0x7fddf01526a0 2024-04-25T00:50:53.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.393+0000 7fddf4d72640 1 -- 172.21.15.162:0/3973333636 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf0158130 con 0x7fddf01526a0 2024-04-25T00:50:53.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.393+0000 7fddf4d72640 1 -- 172.21.15.162:0/3973333636 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf0156050 con 0x7fddf01526a0 2024-04-25T00:50:53.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.393+0000 7fcf3093b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcf2c15a580 0x7fcf2c1543b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.393+0000 7fcf3093b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf2c15daa0 0x7fcf2c1548f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.393+0000 7fcf3093b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf2c0c5600 con 0x7fcf2c072d40 2024-04-25T00:50:53.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.393+0000 7fcf3093b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fcf2c15aac0 con 0x7fcf2c15a580 2024-04-25T00:50:53.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.393+0000 7fcf3093b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcf2c15ad80 con 0x7fcf2c15daa0 2024-04-25T00:50:53.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.393+0000 7fddf4d72640 1 -- 172.21.15.162:0/3973333636 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf0158630 con 0x7fddf01526a0 2024-04-25T00:50:53.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.393+0000 7fcf29d9b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcf2c15a580 0x7fcf2c1543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:53.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.397+0000 7fcf29d9b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fcf2c15a580 0x7fcf2c1543b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:60574/0 (socket says 172.21.15.162:60574) 2024-04-25T00:50:53.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.397+0000 7fcf29d9b640 1 -- 172.21.15.162:0/4100523941 learned_addr learned my addr 172.21.15.162:0/4100523941 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:53.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.397+0000 7fdddeffd640 1 -- 172.21.15.162:0/3973333636 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde8014480 con 0x7fddf01526a0 2024-04-25T00:50:53.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.397+0000 7fdddeffd640 1 -- 172.21.15.162:0/3973333636 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde8014830 con 0x7fddf01526a0 2024-04-25T00:50:53.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.401+0000 7fcf29d9b640 1 -- 172.21.15.162:0/4100523941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf2c15daa0 msgr2=0x7fcf2c1548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:53.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.401+0000 7fcf29d9b640 1 --2- 172.21.15.162:0/4100523941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf2c15daa0 0x7fcf2c1548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.401+0000 7fcf29d9b640 1 -- 172.21.15.162:0/4100523941 >> v1:172.21.15.179:6789/0 conn(0x7fcf2c072d40 legacy=0x7fcf2c073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.401+0000 7fcf29d9b640 1 -- 172.21.15.162:0/4100523941 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf2c15b060 con 0x7fcf2c15a580 2024-04-25T00:50:53.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.405+0000 7ffbed7fa640 1 -- 172.21.15.162:0/3452425378 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7ffbdc0ee210 con 0x7ffbf006f030 2024-04-25T00:50:53.411 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.409+0000 7fcf29d9b640 1 --2- 172.21.15.162:0/4100523941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf2c15a580 0x7fcf2c1543b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf20009870 tx=0x7fcf2001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3476db1b7c7b2190 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:53.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.417+0000 7fcf2959a640 1 -- 172.21.15.162:0/4100523941 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf200b0070 con 0x7fcf2c15a580 2024-04-25T00:50:53.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.417+0000 7fcf2959a640 1 -- 172.21.15.162:0/4100523941 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf200ab600 con 0x7fcf2c15a580 2024-04-25T00:50:53.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.417+0000 7fcf2959a640 1 -- 172.21.15.162:0/4100523941 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf200ab9d0 con 0x7fcf2c15a580 2024-04-25T00:50:53.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.421+0000 7fcf3093b640 1 -- 172.21.15.162:0/4100523941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf2c15a580 msgr2=0x7fcf2c1543b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.421+0000 7fcf3093b640 1 --2- 172.21.15.162:0/4100523941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf2c15a580 0x7fcf2c1543b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf20009870 tx=0x7fcf2001c4d0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.421+0000 7fcf3093b640 1 -- 172.21.15.162:0/4100523941 shutdown_connections 2024-04-25T00:50:53.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.421+0000 7fcf3093b640 1 --2- 172.21.15.162:0/4100523941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf2c15daa0 0x7fcf2c1548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.421+0000 7fcf3093b640 1 --2- 172.21.15.162:0/4100523941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf2c15a580 0x7fcf2c1543b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.421+0000 7fcf3093b640 1 -- 172.21.15.162:0/4100523941 >> 172.21.15.162:0/4100523941 conn(0x7fcf2c070280 msgr2=0x7fcf2c070690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:53.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.421+0000 7fcf3093b640 1 -- 172.21.15.162:0/4100523941 shutdown_connections 2024-04-25T00:50:53.422 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.421+0000 7fcf3093b640 1 -- 172.21.15.162:0/4100523941 wait complete. 2024-04-25T00:50:53.423 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T00:50:53.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.421+0000 7fcf3093b640 1 Processor -- start 2024-04-25T00:50:53.423 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.421+0000 7fcf3093b640 1 -- start start 2024-04-25T00:50:53.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.425+0000 7fcf3093b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf2c072d40 0x7fcf2c0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.425+0000 7fcf3093b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf2c15a580 0x7fcf2c0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.425+0000 7fcf3093b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf2c15daa0 0x7fcf2c14d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.425 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.425+0000 7fcf3093b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2c1671c0 con 0x7fcf2c15a580 2024-04-25T00:50:53.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.425+0000 7fcf3093b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2c167040 con 0x7fcf2c072d40 2024-04-25T00:50:53.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.425+0000 7fcf3093b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcf2c167340 con 0x7fcf2c15daa0 2024-04-25T00:50:53.428 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.425+0000 7fcf2a59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf2c072d40 0x7fcf2c0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:53.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.429+0000 7fcf2a59c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf2c072d40 0x7fcf2c0cab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:60580/0 (socket says 172.21.15.162:60580) 2024-04-25T00:50:53.429 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.429+0000 7fcf2a59c640 1 -- 172.21.15.162:0/207321885 learned_addr learned my addr 172.21.15.162:0/207321885 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:53.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.437+0000 7fcf2a59c640 1 -- 172.21.15.162:0/207321885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf2c15daa0 msgr2=0x7fcf2c14d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.437+0000 7fcf2a59c640 1 --2- 172.21.15.162:0/207321885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf2c15daa0 0x7fcf2c14d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.437+0000 7fcf2a59c640 1 -- 172.21.15.162:0/207321885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf2c15a580 msgr2=0x7fcf2c0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.437+0000 7fcf2a59c640 1 --2- 172.21.15.162:0/207321885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf2c15a580 0x7fcf2c0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.437+0000 7fcf2a59c640 1 -- 172.21.15.162:0/207321885 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf2c14fd70 con 0x7fcf2c072d40 2024-04-25T00:50:53.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.441+0000 7fcf2a59c640 1 --2- 172.21.15.162:0/207321885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf2c072d40 0x7fcf2c0cab00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00c370 tx=0x7fcf1c00c830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:53.453 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.453+0000 7fcf1affd640 1 -- 172.21.15.162:0/207321885 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c0052d0 con 0x7fcf2c072d40 2024-04-25T00:50:53.453 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.453+0000 7fcf1affd640 1 -- 172.21.15.162:0/207321885 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf1c005470 con 0x7fcf2c072d40 2024-04-25T00:50:53.453 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.453+0000 7fcf1affd640 1 -- 172.21.15.162:0/207321885 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c007260 con 0x7fcf2c072d40 2024-04-25T00:50:53.453 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.453+0000 7fcf3093b640 1 -- 172.21.15.162:0/207321885 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf2c150050 con 0x7fcf2c072d40 2024-04-25T00:50:53.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.453+0000 7fcf3093b640 1 -- 172.21.15.162:0/207321885 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf2c150610 con 0x7fcf2c072d40 2024-04-25T00:50:53.454 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.453+0000 7fcf3093b640 1 -- 172.21.15.162:0/207321885 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf2c0c4e20 con 0x7fcf2c072d40 2024-04-25T00:50:53.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.525+0000 7fde8f8f8640 1 Processor -- start 2024-04-25T00:50:53.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.525+0000 7fde8f8f8640 1 -- start start 2024-04-25T00:50:53.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.525+0000 7fde8f8f8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fde88154830 0x7fde8806e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.525+0000 7fde8f8f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde8815d8e0 0x7fde8815dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.525+0000 7fde8f8f8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde8806e230 con 0x7fde8806b210 2024-04-25T00:50:53.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.525+0000 7fde8f8f8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fde8806ebb0 con 0x7fde88154830 2024-04-25T00:50:53.528 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.525+0000 7fde8f8f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fde880c84f0 con 0x7fde8815d8e0 2024-04-25T00:50:53.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.561+0000 7ffbed7fa640 1 -- 172.21.15.162:0/3452425378 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ffbdc14a5c0 con 0x7ffbf006f030 2024-04-25T00:50:53.582 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.581+0000 7fde8d694640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fde88154830 0x7fde8806e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:53.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.581+0000 7fde8d694640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fde88154830 0x7fde8806e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40166/0 (socket says 172.21.15.162:40166) 2024-04-25T00:50:53.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.581+0000 7fde8d694640 1 -- 172.21.15.162:0/3118549681 learned_addr learned my addr 172.21.15.162:0/3118549681 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:53.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.585+0000 7fde8d694640 1 -- 172.21.15.162:0/3118549681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde8815d8e0 msgr2=0x7fde8815dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:53.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.585+0000 7fde8d694640 1 --2- 172.21.15.162:0/3118549681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde8815d8e0 0x7fde8815dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.585+0000 7fde8d694640 1 -- 172.21.15.162:0/3118549681 >> v1:172.21.15.179:6789/0 conn(0x7fde8806b210 legacy=0x7fde8806b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:53.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.585+0000 7fde8d694640 1 -- 172.21.15.162:0/3118549681 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde8806df50 con 0x7fde88154830 2024-04-25T00:50:53.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.589+0000 7fde8d694640 1 --2- 172.21.15.162:0/3118549681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde88154830 0x7fde8806e670 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fde84009870 tx=0x7fde8401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278a586eb93ec74c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:53.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.593+0000 7fde7ffff640 1 -- 172.21.15.162:0/3118549681 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde840b5070 con 0x7fde88154830 2024-04-25T00:50:53.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.593+0000 7fde7ffff640 1 -- 172.21.15.162:0/3118549681 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde840a89d0 con 0x7fde88154830 2024-04-25T00:50:53.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.593+0000 7fde7ffff640 1 -- 172.21.15.162:0/3118549681 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde840a8da0 con 0x7fde88154830 2024-04-25T00:50:53.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8f8f8640 1 -- 172.21.15.162:0/3118549681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde88154830 msgr2=0x7fde8806e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8f8f8640 1 --2- 172.21.15.162:0/3118549681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde88154830 0x7fde8806e670 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fde84009870 tx=0x7fde8401ed10 comp rx=0 tx=0).stop 2024-04-25T00:50:53.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8f8f8640 1 -- 172.21.15.162:0/3118549681 shutdown_connections 2024-04-25T00:50:53.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8f8f8640 1 --2- 172.21.15.162:0/3118549681 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde8815d8e0 0x7fde8815dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8f8f8640 1 --2- 172.21.15.162:0/3118549681 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde88154830 0x7fde8806e670 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8f8f8640 1 -- 172.21.15.162:0/3118549681 >> 172.21.15.162:0/3118549681 conn(0x7fde88070290 msgr2=0x7fde880c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:53.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8f8f8640 1 -- 172.21.15.162:0/3118549681 shutdown_connections 2024-04-25T00:50:53.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8f8f8640 1 -- 172.21.15.162:0/3118549681 wait complete. 2024-04-25T00:50:53.598 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8f8f8640 1 Processor -- start 2024-04-25T00:50:53.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8f8f8640 1 -- start start 2024-04-25T00:50:53.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8f8f8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde8806b210 0x7fde88137bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8f8f8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde88154830 0x7fde881f02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8f8f8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde8815d8e0 0x7fde880c4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8f8f8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fde880c8180 con 0x7fde88154830 2024-04-25T00:50:53.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8f8f8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fde880c7ea0 con 0x7fde8806b210 2024-04-25T00:50:53.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8f8f8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fde8806db80 con 0x7fde8815d8e0 2024-04-25T00:50:53.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8ce93640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde88154830 0x7fde881f02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:53.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8ce93640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde88154830 0x7fde881f02b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40172/0 (socket says 172.21.15.162:40172) 2024-04-25T00:50:53.600 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.597+0000 7fde8ce93640 1 -- 172.21.15.162:0/2585539900 learned_addr learned my addr 172.21.15.162:0/2585539900 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:53.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.605+0000 7fde8ce93640 1 -- 172.21.15.162:0/2585539900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde8815d8e0 msgr2=0x7fde880c4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.605+0000 7fde8ce93640 1 --2- 172.21.15.162:0/2585539900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde8815d8e0 0x7fde880c4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.605+0000 7fde8ce93640 1 -- 172.21.15.162:0/2585539900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde8806b210 msgr2=0x7fde88137bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:53.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.605+0000 7fde8ce93640 1 --2- 172.21.15.162:0/2585539900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde8806b210 0x7fde88137bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:53.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.605+0000 7fde8ce93640 1 -- 172.21.15.162:0/2585539900 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde881e4470 con 0x7fde88154830 2024-04-25T00:50:53.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.609+0000 7fde8ce93640 1 --2- 172.21.15.162:0/2585539900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde88154830 0x7fde881f02b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fde7800c4c0 tx=0x7fde78001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:53.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.613+0000 7fde7dffb640 1 -- 172.21.15.162:0/2585539900 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde78017070 con 0x7fde88154830 2024-04-25T00:50:53.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.613+0000 7fde7dffb640 1 -- 172.21.15.162:0/2585539900 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde78003600 con 0x7fde88154830 2024-04-25T00:50:53.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.613+0000 7fde8f8f8640 1 -- 172.21.15.162:0/2585539900 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde88155800 con 0x7fde88154830 2024-04-25T00:50:53.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.613+0000 7fde7dffb640 1 -- 172.21.15.162:0/2585539900 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde780039f0 con 0x7fde88154830 2024-04-25T00:50:53.614 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.613+0000 7fde8f8f8640 1 -- 172.21.15.162:0/2585539900 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde881e36b0 con 0x7fde88154830 2024-04-25T00:50:53.615 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.613+0000 7fde8f8f8640 1 -- 172.21.15.162:0/2585539900 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde88075110 con 0x7fde88154830 2024-04-25T00:50:53.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.641+0000 7fde7dffb640 1 -- 172.21.15.162:0/2585539900 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fde7801a070 con 0x7fde88154830 2024-04-25T00:50:53.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.641+0000 7fde7dffb640 1 --2- 172.21.15.162:0/2585539900 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fde6c0678f0 0x7fde6c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.645+0000 7fde8d694640 1 --2- 172.21.15.162:0/2585539900 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fde6c0678f0 0x7fde6c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:53.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.645+0000 7fde8d694640 1 --2- 172.21.15.162:0/2585539900 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fde6c0678f0 0x7fde6c069db0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fde840b2000 tx=0x7fde84004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:53.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.645+0000 7fde7dffb640 1 -- 172.21.15.162:0/2585539900 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fde78053c60 con 0x7fde88154830 2024-04-25T00:50:53.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.741+0000 7fdddeffd640 1 -- 172.21.15.162:0/3973333636 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdde801b020 con 0x7fddf01526a0 2024-04-25T00:50:53.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.741+0000 7fdddeffd640 1 --2- 172.21.15.162:0/3973333636 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fddd00678f0 0x7fddd0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.741+0000 7fddee59c640 1 --2- 172.21.15.162:0/3973333636 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fddd00678f0 0x7fddd0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:53.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.741+0000 7fddee59c640 1 --2- 172.21.15.162:0/3973333636 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fddd00678f0 0x7fddd0069db0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdde00b2000 tx=0x7fdde0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:53.750 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.749+0000 7fdddeffd640 1 -- 172.21.15.162:0/3973333636 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fdde8055670 con 0x7fddf01526a0 2024-04-25T00:50:53.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.749+0000 7ffbf6b88640 1 -- 172.21.15.162:0/3452425378 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ffbf0149060 con 0x7ffbf006f030 2024-04-25T00:50:53.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.781+0000 7fdddeffd640 1 -- 172.21.15.162:0/3973333636 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fdde8022070 con 0x7fddf01526a0 2024-04-25T00:50:53.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.789+0000 7fcf1affd640 1 -- 172.21.15.162:0/207321885 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcf1c007400 con 0x7fcf2c072d40 2024-04-25T00:50:53.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.789+0000 7fcf1affd640 1 --2- 172.21.15.162:0/207321885 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fcf0c0678f0 0x7fcf0c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:53.789 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.789+0000 7fcf29d9b640 1 --2- 172.21.15.162:0/207321885 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fcf0c0678f0 0x7fcf0c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:53.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.789+0000 7fcf29d9b640 1 --2- 172.21.15.162:0/207321885 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fcf0c0678f0 0x7fcf0c069db0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcf200ad000 tx=0x7fcf20004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:53.801 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.801+0000 7fcf1affd640 1 -- 172.21.15.162:0/207321885 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fcf1c053e90 con 0x7fcf2c072d40 2024-04-25T00:50:53.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:53.829+0000 7fcf1affd640 1 -- 172.21.15.162:0/207321885 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fcf1c0564f0 con 0x7fcf2c072d40 2024-04-25T00:50:53.935 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T00:50:54.003 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.001+0000 7fde7dffb640 1 -- 172.21.15.162:0/2585539900 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fde78021070 con 0x7fde88154830 2024-04-25T00:50:54.012 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.009+0000 7fcf3093b640 1 -- 172.21.15.162:0/207321885 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fcf2c158630 con 0x7fcf2c072d40 2024-04-25T00:50:54.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.021+0000 7fcf1affd640 1 -- 172.21.15.162:0/207321885 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcf1c055df0 con 0x7fcf2c072d40 2024-04-25T00:50:54.023 INFO:teuthology.orchestra.run.smithi162.stdout:68719476753 2024-04-25T00:50:54.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.025+0000 7fcf3093b640 1 -- 172.21.15.162:0/207321885 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fcf0c0678f0 msgr2=0x7fcf0c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.025+0000 7fcf3093b640 1 --2- 172.21.15.162:0/207321885 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fcf0c0678f0 0x7fcf0c069db0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcf200ad000 tx=0x7fcf20004740 comp rx=0 tx=0).stop 2024-04-25T00:50:54.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.025+0000 7fcf3093b640 1 -- 172.21.15.162:0/207321885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf2c072d40 msgr2=0x7fcf2c0cab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.025+0000 7fcf3093b640 1 --2- 172.21.15.162:0/207321885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf2c072d40 0x7fcf2c0cab00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00c370 tx=0x7fcf1c00c830 comp rx=0 tx=0).stop 2024-04-25T00:50:54.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.029+0000 7fcf3093b640 1 -- 172.21.15.162:0/207321885 shutdown_connections 2024-04-25T00:50:54.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.029+0000 7fcf3093b640 1 --2- 172.21.15.162:0/207321885 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcf2c15daa0 0x7fcf2c14d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.029+0000 7fcf3093b640 1 --2- 172.21.15.162:0/207321885 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fcf0c0678f0 0x7fcf0c069db0 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcf200ad000 tx=0x7fcf20004740 comp rx=0 tx=0).stop 2024-04-25T00:50:54.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.029+0000 7fcf3093b640 1 --2- 172.21.15.162:0/207321885 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcf2c15a580 0x7fcf2c0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.029+0000 7fcf3093b640 1 --2- 172.21.15.162:0/207321885 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcf2c072d40 0x7fcf2c0cab00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.029+0000 7fcf3093b640 1 -- 172.21.15.162:0/207321885 >> 172.21.15.162:0/207321885 conn(0x7fcf2c070280 msgr2=0x7fcf2c14a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:54.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.029+0000 7fcf3093b640 1 -- 172.21.15.162:0/207321885 shutdown_connections 2024-04-25T00:50:54.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.029+0000 7fcf3093b640 1 -- 172.21.15.162:0/207321885 wait complete. 2024-04-25T00:50:54.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.037+0000 7fddf4d72640 1 -- 172.21.15.162:0/3973333636 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fddf0075110 con 0x7fddf01526a0 2024-04-25T00:50:54.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.045+0000 7ffbed7fa640 1 -- 172.21.15.162:0/3452425378 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffbdc0a8050 con 0x7ffbf006f030 2024-04-25T00:50:54.045 INFO:teuthology.orchestra.run.smithi162.stdout:68719476751 2024-04-25T00:50:54.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.049+0000 7ffbf6b88640 1 -- 172.21.15.162:0/3452425378 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ffbd4067940 msgr2=0x7ffbd4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.049+0000 7ffbf6b88640 1 --2- 172.21.15.162:0/3452425378 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ffbd4067940 0x7ffbd4069e00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffbf00c3270 tx=0x7ffbe4009190 comp rx=0 tx=0).stop 2024-04-25T00:50:54.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.049+0000 7ffbf6b88640 1 -- 172.21.15.162:0/3452425378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbf006f030 msgr2=0x7ffbf00c9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.049+0000 7ffbf6b88640 1 --2- 172.21.15.162:0/3452425378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbf006f030 0x7ffbf00c9f20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ffbdc000c10 tx=0x7ffbdc0191b0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.049+0000 7ffbf6b88640 1 -- 172.21.15.162:0/3452425378 shutdown_connections 2024-04-25T00:50:54.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.049+0000 7ffbf6b88640 1 --2- 172.21.15.162:0/3452425378 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbf015e710 0x7ffbf014e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.049+0000 7ffbf6b88640 1 --2- 172.21.15.162:0/3452425378 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbf0158a90 0x7ffbf01470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.049+0000 7ffbf6b88640 1 --2- 172.21.15.162:0/3452425378 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ffbd4067940 0x7ffbd4069e00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.049+0000 7ffbf6b88640 1 --2- 172.21.15.162:0/3452425378 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbf006f030 0x7ffbf00c9f20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.049+0000 7ffbf6b88640 1 -- 172.21.15.162:0/3452425378 >> 172.21.15.162:0/3452425378 conn(0x7ffbf0070290 msgr2=0x7ffbf00c48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:54.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.049+0000 7ffbf6b88640 1 -- 172.21.15.162:0/3452425378 shutdown_connections 2024-04-25T00:50:54.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.049+0000 7ffbf6b88640 1 -- 172.21.15.162:0/3452425378 wait complete. 2024-04-25T00:50:54.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.049+0000 7fdddeffd640 1 -- 172.21.15.162:0/3973333636 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdde8010040 con 0x7fddf01526a0 2024-04-25T00:50:54.050 INFO:teuthology.orchestra.run.smithi162.stdout:64424509457 2024-04-25T00:50:54.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.053+0000 7fddf4d72640 1 -- 172.21.15.162:0/3973333636 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fddd00678f0 msgr2=0x7fddd0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.053+0000 7fddf4d72640 1 --2- 172.21.15.162:0/3973333636 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fddd00678f0 0x7fddd0069db0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdde00b2000 tx=0x7fdde0008040 comp rx=0 tx=0).stop 2024-04-25T00:50:54.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.053+0000 7fddf4d72640 1 -- 172.21.15.162:0/3973333636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddf01526a0 msgr2=0x7fddf0156850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.053+0000 7fddf4d72640 1 --2- 172.21.15.162:0/3973333636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddf01526a0 0x7fddf0156850 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009dd0 tx=0x7fdde800c490 comp rx=0 tx=0).stop 2024-04-25T00:50:54.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.053+0000 7fddf4d72640 1 -- 172.21.15.162:0/3973333636 shutdown_connections 2024-04-25T00:50:54.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.053+0000 7fddf4d72640 1 --2- 172.21.15.162:0/3973333636 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fddf01526a0 0x7fddf0156850 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.053+0000 7fddf4d72640 1 --2- 172.21.15.162:0/3973333636 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fddd00678f0 0x7fddd0069db0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.053+0000 7fddf4d72640 1 --2- 172.21.15.162:0/3973333636 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fddf01522c0 0x7fddf01ee5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.053+0000 7fddf4d72640 1 --2- 172.21.15.162:0/3973333636 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fddf006b210 0x7fddf01557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.053+0000 7fddf4d72640 1 -- 172.21.15.162:0/3973333636 >> 172.21.15.162:0/3973333636 conn(0x7fddf0070280 msgr2=0x7fddf006b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:54.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.053+0000 7fddf4d72640 1 -- 172.21.15.162:0/3973333636 shutdown_connections 2024-04-25T00:50:54.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.053+0000 7fddf4d72640 1 -- 172.21.15.162:0/3973333636 wait complete. 2024-04-25T00:50:54.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476753 got 68719476753 for osd.6 2024-04-25T00:50:54.057 DEBUG:teuthology.parallel:result is None 2024-04-25T00:50:54.076 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476751 got 68719476751 for osd.4 2024-04-25T00:50:54.076 DEBUG:teuthology.parallel:result is None 2024-04-25T00:50:54.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509457 for osd.0 2024-04-25T00:50:54.079 DEBUG:teuthology.parallel:result is None 2024-04-25T00:50:54.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.077+0000 7f68cd4a8640 1 Processor -- start 2024-04-25T00:50:54.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.077+0000 7f68cd4a8640 1 -- start start 2024-04-25T00:50:54.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.081+0000 7f68cd4a8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68c806c320 0x7f68c80caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:54.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.081+0000 7f68cd4a8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68c815acf0 con 0x7f68c8154870 2024-04-25T00:50:54.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.081+0000 7f68cd4a8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68c815dc70 con 0x7f68c80caf80 2024-04-25T00:50:54.081 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.081+0000 7f68cd4a8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f68c80c48a0 con 0x7f68c806c320 2024-04-25T00:50:54.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.081+0000 7f68c67fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68c806c320 0x7f68c80caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:54.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.081+0000 7f68c67fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68c806c320 0x7f68c80caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:43140/0 (socket says 172.21.15.162:43140) 2024-04-25T00:50:54.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.081+0000 7f68c67fc640 1 -- 172.21.15.162:0/2852149583 learned_addr learned my addr 172.21.15.162:0/2852149583 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:54.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.089+0000 7f68c67fc640 1 -- 172.21.15.162:0/2852149583 >> v1:172.21.15.179:6789/0 conn(0x7f68c80caf80 legacy=0x7f68c80c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:54.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.089+0000 7f68c67fc640 1 -- 172.21.15.162:0/2852149583 >> v1:172.21.15.162:6789/0 conn(0x7f68c8154870 legacy=0x7f68c815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:54.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.089+0000 7f68c67fc640 1 -- 172.21.15.162:0/2852149583 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c815df10 con 0x7f68c806c320 2024-04-25T00:50:54.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.093+0000 7f68c67fc640 1 --2- 172.21.15.162:0/2852149583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68c806c320 0x7f68c80caa40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f68c81581d0 tx=0x7f68bc01ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfa949d7c7bc5659 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:54.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.105+0000 7f68c5ffb640 1 -- 172.21.15.162:0/2852149583 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc0b5070 con 0x7f68c806c320 2024-04-25T00:50:54.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.105+0000 7f68c5ffb640 1 -- 172.21.15.162:0/2852149583 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68bc0a89b0 con 0x7f68c806c320 2024-04-25T00:50:54.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.105+0000 7f68c5ffb640 1 -- 172.21.15.162:0/2852149583 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc0a8d80 con 0x7f68c806c320 2024-04-25T00:50:54.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.105+0000 7f68cd4a8640 1 -- 172.21.15.162:0/2852149583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68c806c320 msgr2=0x7f68c80caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.105+0000 7f68cd4a8640 1 --2- 172.21.15.162:0/2852149583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68c806c320 0x7f68c80caa40 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f68c81581d0 tx=0x7f68bc01ecf0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.105+0000 7f68cd4a8640 1 -- 172.21.15.162:0/2852149583 shutdown_connections 2024-04-25T00:50:54.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.105+0000 7f68cd4a8640 1 --2- 172.21.15.162:0/2852149583 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68c806c320 0x7f68c80caa40 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.105+0000 7f68cd4a8640 1 -- 172.21.15.162:0/2852149583 >> 172.21.15.162:0/2852149583 conn(0x7f68c8071900 msgr2=0x7f68c8071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:54.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.105+0000 7f68cd4a8640 1 -- 172.21.15.162:0/2852149583 shutdown_connections 2024-04-25T00:50:54.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.105+0000 7f68cd4a8640 1 -- 172.21.15.162:0/2852149583 wait complete. 2024-04-25T00:50:54.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.109+0000 7f68cd4a8640 1 Processor -- start 2024-04-25T00:50:54.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.109+0000 7f68cd4a8640 1 -- start start 2024-04-25T00:50:54.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.109+0000 7f68cd4a8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c806c320 0x7f68c815d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:54.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.109+0000 7f68cd4a8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68c80caf80 0x7f68c81f3460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:54.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.109+0000 7f68cd4a8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68c8154870 0x7f68c806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:54.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.109+0000 7f68cd4a8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f68c80c4b80 con 0x7f68c806c320 2024-04-25T00:50:54.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.109+0000 7f68cd4a8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f68c815e4d0 con 0x7f68c80caf80 2024-04-25T00:50:54.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.109+0000 7f68cd4a8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f68c8154c50 con 0x7f68c8154870 2024-04-25T00:50:54.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.109+0000 7f68c6ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c806c320 0x7f68c815d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:54.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.109+0000 7f68c6ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c806c320 0x7f68c815d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40180/0 (socket says 172.21.15.162:40180) 2024-04-25T00:50:54.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.109+0000 7f68c6ffd640 1 -- 172.21.15.162:0/214606678 learned_addr learned my addr 172.21.15.162:0/214606678 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:54.113 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T00:50:54.116 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T00:50:54.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.117+0000 7f68c6ffd640 1 -- 172.21.15.162:0/214606678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68c8154870 msgr2=0x7f68c806c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.117+0000 7f68c6ffd640 1 --2- 172.21.15.162:0/214606678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68c8154870 0x7f68c806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.117+0000 7f68c6ffd640 1 -- 172.21.15.162:0/214606678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68c80caf80 msgr2=0x7f68c81f3460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.117+0000 7f68c6ffd640 1 --2- 172.21.15.162:0/214606678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68c80caf80 0x7f68c81f3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.117+0000 7f68c6ffd640 1 -- 172.21.15.162:0/214606678 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c80c5300 con 0x7f68c806c320 2024-04-25T00:50:54.121 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.121+0000 7f68c6ffd640 1 --2- 172.21.15.162:0/214606678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c806c320 0x7f68c815d2d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f68b800b3e0 tx=0x7f68b800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:54.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.129+0000 7f68af7fe640 1 -- 172.21.15.162:0/214606678 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b8015020 con 0x7f68c806c320 2024-04-25T00:50:54.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.129+0000 7f68af7fe640 1 -- 172.21.15.162:0/214606678 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68b8011850 con 0x7f68c806c320 2024-04-25T00:50:54.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.129+0000 7f68cd4a8640 1 -- 172.21.15.162:0/214606678 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c81e6060 con 0x7f68c806c320 2024-04-25T00:50:54.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.129+0000 7f68af7fe640 1 -- 172.21.15.162:0/214606678 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68b8011c40 con 0x7f68c806c320 2024-04-25T00:50:54.129 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.129+0000 7f68cd4a8640 1 -- 172.21.15.162:0/214606678 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c80c55a0 con 0x7f68c806c320 2024-04-25T00:50:54.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.137+0000 7f68cd4a8640 1 -- 172.21.15.162:0/214606678 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a80052a0 con 0x7f68c806c320 2024-04-25T00:50:54.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.273+0000 7f5870ee6640 1 Processor -- start 2024-04-25T00:50:54.273 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.273+0000 7f5870ee6640 1 -- start start 2024-04-25T00:50:54.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.273+0000 7f5870ee6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f586c0c90d0 0x7f586c0c5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:54.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.273+0000 7f5870ee6640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f586c0c5e70 0x7f586c1582f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:54.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.273+0000 7f5870ee6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f586c0c96c0 con 0x7f586c13de90 2024-04-25T00:50:54.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.273+0000 7f5870ee6640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f586c0c6cc0 con 0x7f586c0c5e70 2024-04-25T00:50:54.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.273+0000 7f5870ee6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f586c0c6fa0 con 0x7f586c0c90d0 2024-04-25T00:50:54.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.273+0000 7f5869d9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f586c0c90d0 0x7f586c0c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:54.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.273+0000 7f586ad9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f586c0c5e70 0x7f586c1582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:54.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.277+0000 7f586ad9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f586c0c5e70 0x7f586c1582f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:60600/0 (socket says 172.21.15.162:60600) 2024-04-25T00:50:54.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.277+0000 7f586ad9d640 1 -- 172.21.15.162:0/979291051 learned_addr learned my addr 172.21.15.162:0/979291051 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:54.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.281+0000 7f586ad9d640 1 -- 172.21.15.162:0/979291051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f586c0c90d0 msgr2=0x7f586c0c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:54.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.281+0000 7f586ad9d640 1 --2- 172.21.15.162:0/979291051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f586c0c90d0 0x7f586c0c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.283 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.281+0000 7f586ad9d640 1 -- 172.21.15.162:0/979291051 >> v1:172.21.15.162:6789/0 conn(0x7f586c13de90 legacy=0x7f586c06b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:54.283 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.281+0000 7f586ad9d640 1 -- 172.21.15.162:0/979291051 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586c0c7280 con 0x7f586c0c5e70 2024-04-25T00:50:54.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.285+0000 7fd5e33c5640 1 Processor -- start 2024-04-25T00:50:54.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.285+0000 7fd5e33c5640 1 -- start start 2024-04-25T00:50:54.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.285+0000 7fd5e33c5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fd5dc1523e0 0x7fd5dc0cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:54.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.285+0000 7fd5e33c5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc0cd440 0x7fd5dc15c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:54.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.285+0000 7fd5e33c5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5dc15b790 con 0x7fd5dc1581a0 2024-04-25T00:50:54.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.285+0000 7fd5e33c5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fd5dc158a60 con 0x7fd5dc1523e0 2024-04-25T00:50:54.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.285+0000 7fd5e33c5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd5dc158d40 con 0x7fd5dc0cd440 2024-04-25T00:50:54.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.289+0000 7fd5e0960640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc0cd440 0x7fd5dc15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:54.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.289+0000 7fde8f8f8640 1 -- 172.21.15.162:0/2585539900 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fde88148160 con 0x7fde88154830 2024-04-25T00:50:54.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.289+0000 7f586ad9d640 1 --2- 172.21.15.162:0/979291051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f586c0c5e70 0x7f586c1582f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5864009e50 tx=0x7f586401f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38dfc3ccf1e13de5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:54.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.289+0000 7fd5e0960640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc0cd440 0x7fd5dc15c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:43168/0 (socket says 172.21.15.162:43168) 2024-04-25T00:50:54.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.289+0000 7fd5e0960640 1 -- 172.21.15.162:0/443800855 learned_addr learned my addr 172.21.15.162:0/443800855 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:54.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.289+0000 7fd5e1161640 1 --2- 172.21.15.162:0/443800855 >> v2:172.21.15.179:3300/0 conn(0x7fd5dc1523e0 0x7fd5dc0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:54.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.289+0000 7f68af7fe640 1 -- 172.21.15.162:0/214606678 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f68b8018020 con 0x7f68c806c320 2024-04-25T00:50:54.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.289+0000 7f68af7fe640 1 --2- 172.21.15.162:0/214606678 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f68b40678c0 0x7f68b4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:54.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.293+0000 7f68c67fc640 1 --2- 172.21.15.162:0/214606678 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f68b40678c0 0x7f68b4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:54.293 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.293+0000 7f68c67fc640 1 --2- 172.21.15.162:0/214606678 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f68b40678c0 0x7f68b4069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0b2000 tx=0x7f68bc004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:54.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.297+0000 7fd5e0960640 1 -- 172.21.15.162:0/443800855 >> v2:172.21.15.179:3300/0 conn(0x7fd5dc1523e0 msgr2=0x7fd5dc0cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:54.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.297+0000 7fd5e0960640 1 --2- 172.21.15.162:0/443800855 >> v2:172.21.15.179:3300/0 conn(0x7fd5dc1523e0 0x7fd5dc0cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.297+0000 7fd5e0960640 1 -- 172.21.15.162:0/443800855 >> v1:172.21.15.162:6789/0 conn(0x7fd5dc1581a0 legacy=0x7fd5dc071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:54.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.297+0000 7fd5e0960640 1 -- 172.21.15.162:0/443800855 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc159020 con 0x7fd5dc0cd440 2024-04-25T00:50:54.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.301+0000 7fd5e0960640 1 --2- 172.21.15.162:0/443800855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc0cd440 0x7fd5dc15c230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009870 tx=0x7fd5cc01ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecea81fefc52d5dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:54.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f586959a640 1 -- 172.21.15.162:0/979291051 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58640b4070 con 0x7f586c0c5e70 2024-04-25T00:50:54.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f586959a640 1 -- 172.21.15.162:0/979291051 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58640af400 con 0x7f586c0c5e70 2024-04-25T00:50:54.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f586959a640 1 -- 172.21.15.162:0/979291051 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58640af7d0 con 0x7f586c0c5e70 2024-04-25T00:50:54.313 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f5870ee6640 1 -- 172.21.15.162:0/979291051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f586c0c5e70 msgr2=0x7f586c1582f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f5870ee6640 1 --2- 172.21.15.162:0/979291051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f586c0c5e70 0x7f586c1582f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5864009e50 tx=0x7f586401f1e0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f5870ee6640 1 -- 172.21.15.162:0/979291051 shutdown_connections 2024-04-25T00:50:54.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f5870ee6640 1 --2- 172.21.15.162:0/979291051 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f586c0c5e70 0x7f586c1582f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f5870ee6640 1 --2- 172.21.15.162:0/979291051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f586c0c90d0 0x7f586c0c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f5870ee6640 1 -- 172.21.15.162:0/979291051 >> 172.21.15.162:0/979291051 conn(0x7f586c071f60 msgr2=0x7f586c072370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:54.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f5870ee6640 1 -- 172.21.15.162:0/979291051 shutdown_connections 2024-04-25T00:50:54.314 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f5870ee6640 1 -- 172.21.15.162:0/979291051 wait complete. 2024-04-25T00:50:54.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7fd5d3fff640 1 -- 172.21.15.162:0/443800855 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0b5070 con 0x7fd5dc0cd440 2024-04-25T00:50:54.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7fd5d3fff640 1 -- 172.21.15.162:0/443800855 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5cc0a89d0 con 0x7fd5dc0cd440 2024-04-25T00:50:54.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7fd5d3fff640 1 -- 172.21.15.162:0/443800855 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0a8da0 con 0x7fd5dc0cd440 2024-04-25T00:50:54.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7fd5e33c5640 1 -- 172.21.15.162:0/443800855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc0cd440 msgr2=0x7fd5dc15c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7fd5e33c5640 1 --2- 172.21.15.162:0/443800855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc0cd440 0x7fd5dc15c230 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc009870 tx=0x7fd5cc01ed10 comp rx=0 tx=0).stop 2024-04-25T00:50:54.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7fd5e33c5640 1 -- 172.21.15.162:0/443800855 shutdown_connections 2024-04-25T00:50:54.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7fd5e33c5640 1 --2- 172.21.15.162:0/443800855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc0cd440 0x7fd5dc15c230 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7fd5e33c5640 1 --2- 172.21.15.162:0/443800855 >> v2:172.21.15.179:3300/0 conn(0x7fd5dc1523e0 0x7fd5dc0cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7fd5e33c5640 1 -- 172.21.15.162:0/443800855 >> 172.21.15.162:0/443800855 conn(0x7fd5dc06b810 msgr2=0x7fd5dc06f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:54.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7fd5e33c5640 1 -- 172.21.15.162:0/443800855 shutdown_connections 2024-04-25T00:50:54.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f5870ee6640 1 Processor -- start 2024-04-25T00:50:54.316 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7fd5e33c5640 1 -- 172.21.15.162:0/443800855 wait complete. 2024-04-25T00:50:54.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f5870ee6640 1 -- start start 2024-04-25T00:50:54.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f5870ee6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f586c0c5e70 0x7f586c1e2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:54.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f5870ee6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f586c0c90d0 0x7f586c1dfc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:54.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f5870ee6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f586c13de90 0x7f586c1de860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:54.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f5870ee6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f586c0cd020 con 0x7f586c0c90d0 2024-04-25T00:50:54.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f5870ee6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f586c0ccea0 con 0x7f586c13de90 2024-04-25T00:50:54.317 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7f5870ee6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f586c13e270 con 0x7f586c0c5e70 2024-04-25T00:50:54.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.313+0000 7fd5e33c5640 1 Processor -- start 2024-04-25T00:50:54.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.317+0000 7fd5e33c5640 1 -- start start 2024-04-25T00:50:54.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.317+0000 7fd5e33c5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5dc0cd440 0x7fd5dc0713b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:54.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.317+0000 7fd5e33c5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc1523e0 0x7fd5dc14e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:54.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.317+0000 7fd5e33c5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5dc1581a0 0x7fd5dc14ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:54.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.317+0000 7fd5e33c5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc1527c0 con 0x7fd5dc0cd440 2024-04-25T00:50:54.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.317+0000 7fd5e33c5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd5dc15bd10 con 0x7fd5dc1581a0 2024-04-25T00:50:54.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.317+0000 7fd5e33c5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd5dc0caf70 con 0x7fd5dc1523e0 2024-04-25T00:50:54.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.317+0000 7f586a59c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f586c0c5e70 0x7f586c1e2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:54.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.321+0000 7f586ad9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f586c13de90 0x7f586c1de860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:54.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.321+0000 7fd5e1962640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5dc1581a0 0x7fd5dc14ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:54.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.321+0000 7f586a59c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f586c0c5e70 0x7f586c1e2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:43176/0 (socket says 172.21.15.162:43176) 2024-04-25T00:50:54.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.321+0000 7f586a59c640 1 -- 172.21.15.162:0/1197253274 learned_addr learned my addr 172.21.15.162:0/1197253274 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:54.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.321+0000 7fd5e0960640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc1523e0 0x7fd5dc14e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:54.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.325+0000 7fd5e1962640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5dc1581a0 0x7fd5dc14ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:60622/0 (socket says 172.21.15.162:60622) 2024-04-25T00:50:54.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.325+0000 7fd5e1962640 1 -- 172.21.15.162:0/498770964 learned_addr learned my addr 172.21.15.162:0/498770964 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:54.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.333+0000 7f586a59c640 1 -- 172.21.15.162:0/1197253274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f586c13de90 msgr2=0x7f586c1de860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.333+0000 7f586a59c640 1 --2- 172.21.15.162:0/1197253274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f586c13de90 0x7f586c1de860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.333+0000 7f586a59c640 1 -- 172.21.15.162:0/1197253274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f586c0c90d0 msgr2=0x7f586c1dfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.333+0000 7f586a59c640 1 --2- 172.21.15.162:0/1197253274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f586c0c90d0 0x7f586c1dfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.333+0000 7f586a59c640 1 -- 172.21.15.162:0/1197253274 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586c1e3340 con 0x7f586c0c5e70 2024-04-25T00:50:54.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.345+0000 7fd5e1962640 1 -- 172.21.15.162:0/498770964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc1523e0 msgr2=0x7fd5dc14e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.345+0000 7fd5e1962640 1 --2- 172.21.15.162:0/498770964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc1523e0 0x7fd5dc14e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.345+0000 7fd5e1962640 1 -- 172.21.15.162:0/498770964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5dc0cd440 msgr2=0x7fd5dc0713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.345+0000 7fd5e1962640 1 --2- 172.21.15.162:0/498770964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5dc0cd440 0x7fd5dc0713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.345+0000 7fd5e1962640 1 -- 172.21.15.162:0/498770964 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5dc14fc70 con 0x7fd5dc1581a0 2024-04-25T00:50:54.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.357+0000 7f586a59c640 1 --2- 172.21.15.162:0/1197253274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f586c0c5e70 0x7f586c1e2600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f585c00b3e0 tx=0x7f585c00b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:54.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.357+0000 7fd5e1962640 1 --2- 172.21.15.162:0/498770964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5dc1581a0 0x7fd5dc14ee60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400b9f0 tx=0x7fd5d400beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:54.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.373+0000 7fd5d1ffb640 1 -- 172.21.15.162:0/498770964 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4019070 con 0x7fd5dc1581a0 2024-04-25T00:50:54.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.373+0000 7fd5d1ffb640 1 -- 172.21.15.162:0/498770964 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d400cb70 con 0x7fd5dc1581a0 2024-04-25T00:50:54.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.373+0000 7fd5e33c5640 1 -- 172.21.15.162:0/498770964 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5dc15a660 con 0x7fd5dc1581a0 2024-04-25T00:50:54.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.373+0000 7fd5d1ffb640 1 -- 172.21.15.162:0/498770964 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5d4014440 con 0x7fd5dc1581a0 2024-04-25T00:50:54.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.373+0000 7fd5e33c5640 1 -- 172.21.15.162:0/498770964 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5dc15ac20 con 0x7fd5dc1581a0 2024-04-25T00:50:54.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.373+0000 7fd5e33c5640 1 -- 172.21.15.162:0/498770964 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5dc075110 con 0x7fd5dc1581a0 2024-04-25T00:50:54.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.373+0000 7f585affd640 1 -- 172.21.15.162:0/1197253274 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585c015020 con 0x7f586c0c5e70 2024-04-25T00:50:54.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.373+0000 7f585affd640 1 -- 172.21.15.162:0/1197253274 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f585c011850 con 0x7f586c0c5e70 2024-04-25T00:50:54.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.373+0000 7f5870ee6640 1 -- 172.21.15.162:0/1197253274 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f586c1e2b40 con 0x7f586c0c5e70 2024-04-25T00:50:54.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.373+0000 7f5870ee6640 1 -- 172.21.15.162:0/1197253274 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f586c1e38c0 con 0x7f586c0c5e70 2024-04-25T00:50:54.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.373+0000 7f585affd640 1 -- 172.21.15.162:0/1197253274 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f585c011c40 con 0x7f586c0c5e70 2024-04-25T00:50:54.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.373+0000 7f5870ee6640 1 -- 172.21.15.162:0/1197253274 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58500052a0 con 0x7f586c0c5e70 2024-04-25T00:50:54.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.441+0000 7f68af7fe640 1 -- 172.21.15.162:0/214606678 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f68b8011de0 con 0x7f68c806c320 2024-04-25T00:50:54.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.441+0000 7f68af7fe640 1 -- 172.21.15.162:0/214606678 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f68b801f020 con 0x7f68c806c320 2024-04-25T00:50:54.564 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.561+0000 7fde7dffb640 1 -- 172.21.15.162:0/2585539900 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fde780562c0 con 0x7fde88154830 2024-04-25T00:50:54.565 INFO:teuthology.orchestra.run.smithi162.stdout:64424509456 2024-04-25T00:50:54.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.565+0000 7fde8f8f8640 1 -- 172.21.15.162:0/2585539900 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fde6c0678f0 msgr2=0x7fde6c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.565+0000 7fde8f8f8640 1 --2- 172.21.15.162:0/2585539900 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fde6c0678f0 0x7fde6c069db0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fde840b2000 tx=0x7fde84004740 comp rx=0 tx=0).stop 2024-04-25T00:50:54.567 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.565+0000 7fde8f8f8640 1 -- 172.21.15.162:0/2585539900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde88154830 msgr2=0x7fde881f02b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.565+0000 7fde8f8f8640 1 --2- 172.21.15.162:0/2585539900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde88154830 0x7fde881f02b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fde7800c4c0 tx=0x7fde78001e80 comp rx=0 tx=0).stop 2024-04-25T00:50:54.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.565+0000 7fde8f8f8640 1 -- 172.21.15.162:0/2585539900 shutdown_connections 2024-04-25T00:50:54.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.565+0000 7fde8f8f8640 1 --2- 172.21.15.162:0/2585539900 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fde8815d8e0 0x7fde880c4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.565+0000 7fde8f8f8640 1 --2- 172.21.15.162:0/2585539900 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fde6c0678f0 0x7fde6c069db0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.565+0000 7fde8f8f8640 1 --2- 172.21.15.162:0/2585539900 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fde88154830 0x7fde881f02b0 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fde7800c4c0 tx=0x7fde78001e80 comp rx=0 tx=0).stop 2024-04-25T00:50:54.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.565+0000 7fde8f8f8640 1 --2- 172.21.15.162:0/2585539900 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fde8806b210 0x7fde88137bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.565+0000 7fde8f8f8640 1 -- 172.21.15.162:0/2585539900 >> 172.21.15.162:0/2585539900 conn(0x7fde88070290 msgr2=0x7fde8814d070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:54.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.565+0000 7fde8f8f8640 1 -- 172.21.15.162:0/2585539900 shutdown_connections 2024-04-25T00:50:54.568 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.565+0000 7fde8f8f8640 1 -- 172.21.15.162:0/2585539900 wait complete. 2024-04-25T00:50:54.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509456 got 64424509456 for osd.3 2024-04-25T00:50:54.591 DEBUG:teuthology.parallel:result is None 2024-04-25T00:50:54.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.625+0000 7f68cd4a8640 1 -- 172.21.15.162:0/214606678 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f68a8005860 con 0x7f68c806c320 2024-04-25T00:50:54.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.633+0000 7f68af7fe640 1 -- 172.21.15.162:0/214606678 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f68b800f2e0 con 0x7f68c806c320 2024-04-25T00:50:54.635 INFO:teuthology.orchestra.run.smithi162.stdout:68719476753 2024-04-25T00:50:54.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.637+0000 7f68cd4a8640 1 -- 172.21.15.162:0/214606678 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f68b40678c0 msgr2=0x7f68b4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.637+0000 7f68cd4a8640 1 --2- 172.21.15.162:0/214606678 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f68b40678c0 0x7f68b4069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f68bc0b2000 tx=0x7f68bc004740 comp rx=0 tx=0).stop 2024-04-25T00:50:54.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.637+0000 7f68cd4a8640 1 -- 172.21.15.162:0/214606678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c806c320 msgr2=0x7f68c815d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:54.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.637+0000 7f68cd4a8640 1 --2- 172.21.15.162:0/214606678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c806c320 0x7f68c815d2d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f68b800b3e0 tx=0x7f68b800b8a0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.637+0000 7f68cd4a8640 1 -- 172.21.15.162:0/214606678 shutdown_connections 2024-04-25T00:50:54.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.637+0000 7f68cd4a8640 1 --2- 172.21.15.162:0/214606678 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f68c8154870 0x7f68c806c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.637+0000 7f68cd4a8640 1 --2- 172.21.15.162:0/214606678 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f68c80caf80 0x7f68c81f3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.637+0000 7f68cd4a8640 1 --2- 172.21.15.162:0/214606678 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f68b40678c0 0x7f68b4069d80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.637+0000 7f68cd4a8640 1 --2- 172.21.15.162:0/214606678 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f68c806c320 0x7f68c815d2d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:54.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.637+0000 7f68cd4a8640 1 -- 172.21.15.162:0/214606678 >> 172.21.15.162:0/214606678 conn(0x7f68c8071900 msgr2=0x7f68c80c3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:54.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.637+0000 7f68cd4a8640 1 -- 172.21.15.162:0/214606678 shutdown_connections 2024-04-25T00:50:54.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.637+0000 7f68cd4a8640 1 -- 172.21.15.162:0/214606678 wait complete. 2024-04-25T00:50:54.652 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476753 got 68719476753 for osd.7 2024-04-25T00:50:54.652 DEBUG:teuthology.parallel:result is None 2024-04-25T00:50:54.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.717+0000 7fd5d1ffb640 1 -- 172.21.15.162:0/498770964 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd5d401c070 con 0x7fd5dc1581a0 2024-04-25T00:50:54.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.717+0000 7fd5d1ffb640 1 --2- 172.21.15.162:0/498770964 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fd5c0067910 0x7fd5c0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:54.719 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.717+0000 7fd5e1161640 1 --2- 172.21.15.162:0/498770964 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fd5c0067910 0x7fd5c0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:54.719 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.717+0000 7fd5e1161640 1 --2- 172.21.15.162:0/498770964 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fd5c0067910 0x7fd5c0069dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8006aa0 tx=0x7fd5d8006a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:54.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.733+0000 7f585affd640 1 -- 172.21.15.162:0/1197253274 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f585c018020 con 0x7f586c0c5e70 2024-04-25T00:50:54.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.733+0000 7f585affd640 1 --2- 172.21.15.162:0/1197253274 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f584c0678f0 0x7f584c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:54.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.733+0000 7f5869d9b640 1 --2- 172.21.15.162:0/1197253274 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f584c0678f0 0x7f584c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:54.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.733+0000 7f5869d9b640 1 --2- 172.21.15.162:0/1197253274 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f584c0678f0 0x7f584c069db0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5860006aa0 tx=0x7f5860006a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:54.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.737+0000 7f585affd640 1 -- 172.21.15.162:0/1197253274 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f585c011de0 con 0x7f586c0c5e70 2024-04-25T00:50:54.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.737+0000 7fd5d1ffb640 1 -- 172.21.15.162:0/498770964 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fd5d4054340 con 0x7fd5dc1581a0 2024-04-25T00:50:54.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.773+0000 7f585affd640 1 -- 172.21.15.162:0/1197253274 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f585c01f020 con 0x7f586c0c5e70 2024-04-25T00:50:54.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.781+0000 7fd5d1ffb640 1 -- 172.21.15.162:0/498770964 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd5d4023020 con 0x7fd5dc1581a0 2024-04-25T00:50:54.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.941+0000 7f5870ee6640 1 -- 172.21.15.162:0/1197253274 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5850005860 con 0x7f586c0c5e70 2024-04-25T00:50:54.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:54.949+0000 7fd5e33c5640 1 -- 172.21.15.162:0/498770964 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd5dc0b2b10 con 0x7fd5dc1581a0 2024-04-25T00:50:55.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.025+0000 7fd5d1ffb640 1 -- 172.21.15.162:0/498770964 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd5d40562a0 con 0x7fd5dc1581a0 2024-04-25T00:50:55.025 INFO:teuthology.orchestra.run.smithi162.stdout:68719476754 2024-04-25T00:50:55.027 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.025+0000 7fd5e33c5640 1 -- 172.21.15.162:0/498770964 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fd5c0067910 msgr2=0x7fd5c0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:55.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.025+0000 7fd5e33c5640 1 --2- 172.21.15.162:0/498770964 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fd5c0067910 0x7fd5c0069dd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8006aa0 tx=0x7fd5d8006a30 comp rx=0 tx=0).stop 2024-04-25T00:50:55.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.025+0000 7fd5e33c5640 1 -- 172.21.15.162:0/498770964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5dc1581a0 msgr2=0x7fd5dc14ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:55.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.025+0000 7fd5e33c5640 1 --2- 172.21.15.162:0/498770964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5dc1581a0 0x7fd5dc14ee60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd5d400b9f0 tx=0x7fd5d400beb0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.025+0000 7fd5e33c5640 1 -- 172.21.15.162:0/498770964 shutdown_connections 2024-04-25T00:50:55.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.025+0000 7fd5e33c5640 1 --2- 172.21.15.162:0/498770964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd5dc1581a0 0x7fd5dc14ee60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.025+0000 7fd5e33c5640 1 --2- 172.21.15.162:0/498770964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd5dc1523e0 0x7fd5dc14e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.025+0000 7fd5e33c5640 1 --2- 172.21.15.162:0/498770964 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fd5c0067910 0x7fd5c0069dd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.025+0000 7fd5e33c5640 1 --2- 172.21.15.162:0/498770964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd5dc0cd440 0x7fd5dc0713b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.025+0000 7fd5e33c5640 1 -- 172.21.15.162:0/498770964 >> 172.21.15.162:0/498770964 conn(0x7fd5dc06b810 msgr2=0x7fd5dc0c29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:55.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.025+0000 7fd5e33c5640 1 -- 172.21.15.162:0/498770964 shutdown_connections 2024-04-25T00:50:55.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.025+0000 7fd5e33c5640 1 -- 172.21.15.162:0/498770964 wait complete. 2024-04-25T00:50:55.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.037+0000 7f585affd640 1 -- 172.21.15.162:0/1197253274 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f585c056b90 con 0x7f586c0c5e70 2024-04-25T00:50:55.038 INFO:teuthology.orchestra.run.smithi162.stdout:68719476753 2024-04-25T00:50:55.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.037+0000 7f5870ee6640 1 -- 172.21.15.162:0/1197253274 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f584c0678f0 msgr2=0x7f584c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:55.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.037+0000 7f5870ee6640 1 --2- 172.21.15.162:0/1197253274 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f584c0678f0 0x7f584c069db0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5860006aa0 tx=0x7f5860006a30 comp rx=0 tx=0).stop 2024-04-25T00:50:55.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.037+0000 7f5870ee6640 1 -- 172.21.15.162:0/1197253274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f586c0c5e70 msgr2=0x7f586c1e2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.037+0000 7f5870ee6640 1 --2- 172.21.15.162:0/1197253274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f586c0c5e70 0x7f586c1e2600 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f585c00b3e0 tx=0x7f585c00b8a0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.037+0000 7f5870ee6640 1 -- 172.21.15.162:0/1197253274 shutdown_connections 2024-04-25T00:50:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.037+0000 7f5870ee6640 1 --2- 172.21.15.162:0/1197253274 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f586c13de90 0x7f586c1de860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.037+0000 7f5870ee6640 1 --2- 172.21.15.162:0/1197253274 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f584c0678f0 0x7f584c069db0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.037+0000 7f5870ee6640 1 --2- 172.21.15.162:0/1197253274 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f586c0c90d0 0x7f586c1dfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.037+0000 7f5870ee6640 1 --2- 172.21.15.162:0/1197253274 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f586c0c5e70 0x7f586c1e2600 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.037+0000 7f5870ee6640 1 -- 172.21.15.162:0/1197253274 >> 172.21.15.162:0/1197253274 conn(0x7f586c071f60 msgr2=0x7f586c13ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.037+0000 7f5870ee6640 1 -- 172.21.15.162:0/1197253274 shutdown_connections 2024-04-25T00:50:55.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.037+0000 7f5870ee6640 1 -- 172.21.15.162:0/1197253274 wait complete. 2024-04-25T00:50:55.046 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476753 got 68719476754 for osd.5 2024-04-25T00:50:55.047 DEBUG:teuthology.parallel:result is None 2024-04-25T00:50:55.057 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476752 got 68719476753 for osd.2 2024-04-25T00:50:55.057 DEBUG:teuthology.parallel:result is None 2024-04-25T00:50:55.057 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T00:50:55.057 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T00:50:55.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.209+0000 7f09a3a76640 1 Processor -- start 2024-04-25T00:50:55.213 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.209+0000 7f09a3a76640 1 -- start start 2024-04-25T00:50:55.213 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.213+0000 7f09a3a76640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f099c1581c0 0x7f099c0c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:55.213 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.213+0000 7f09a3a76640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f099c15c200 0x7f099c0c6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:55.213 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.213+0000 7f09a3a76640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f099c072f60 con 0x7f099c152320 2024-04-25T00:50:55.213 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.213+0000 7f09a3a76640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f099c0c3070 con 0x7f099c1581c0 2024-04-25T00:50:55.213 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.213+0000 7f09a3a76640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f099c15b7b0 con 0x7f099c15c200 2024-04-25T00:50:55.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.213+0000 7f09a2013640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f099c15c200 0x7f099c0c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:55.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.213+0000 7f09a1011640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f099c1581c0 0x7f099c0c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:55.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.213+0000 7f09a2013640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f099c15c200 0x7f099c0c6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:43194/0 (socket says 172.21.15.162:43194) 2024-04-25T00:50:55.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.213+0000 7f09a2013640 1 -- 172.21.15.162:0/1469928183 learned_addr learned my addr 172.21.15.162:0/1469928183 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:55.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.221+0000 7f09a2013640 1 -- 172.21.15.162:0/1469928183 >> v2:172.21.15.179:3300/0 conn(0x7f099c1581c0 msgr2=0x7f099c0c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:55.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.221+0000 7f09a2013640 1 --2- 172.21.15.162:0/1469928183 >> v2:172.21.15.179:3300/0 conn(0x7f099c1581c0 0x7f099c0c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.221+0000 7f09a2013640 1 -- 172.21.15.162:0/1469928183 >> v1:172.21.15.179:6789/0 conn(0x7f099c152320 legacy=0x7f099c072790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:55.224 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.221+0000 7f09a2013640 1 -- 172.21.15.162:0/1469928183 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c073240 con 0x7f099c15c200 2024-04-25T00:50:55.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.229+0000 7f09a2013640 1 --2- 172.21.15.162:0/1469928183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f099c15c200 0x7f099c0c6080 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0994009e50 tx=0x7f099401f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ed1516225275fa6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:55.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.241+0000 7f09a0810640 1 -- 172.21.15.162:0/1469928183 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09940b4070 con 0x7f099c15c200 2024-04-25T00:50:55.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.241+0000 7f09a0810640 1 -- 172.21.15.162:0/1469928183 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09940af400 con 0x7f099c15c200 2024-04-25T00:50:55.242 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.241+0000 7f09a0810640 1 -- 172.21.15.162:0/1469928183 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09940af7d0 con 0x7f099c15c200 2024-04-25T00:50:55.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.241+0000 7f09a3a76640 1 -- 172.21.15.162:0/1469928183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f099c15c200 msgr2=0x7f099c0c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:55.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.241+0000 7f09a3a76640 1 --2- 172.21.15.162:0/1469928183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f099c15c200 0x7f099c0c6080 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0994009e50 tx=0x7f099401f210 comp rx=0 tx=0).stop 2024-04-25T00:50:55.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.241+0000 7f09a3a76640 1 -- 172.21.15.162:0/1469928183 shutdown_connections 2024-04-25T00:50:55.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.241+0000 7f09a3a76640 1 --2- 172.21.15.162:0/1469928183 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f099c15c200 0x7f099c0c6080 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.241+0000 7f09a3a76640 1 --2- 172.21.15.162:0/1469928183 >> v2:172.21.15.179:3300/0 conn(0x7f099c1581c0 0x7f099c0c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.241+0000 7f09a3a76640 1 -- 172.21.15.162:0/1469928183 >> 172.21.15.162:0/1469928183 conn(0x7f099c070350 msgr2=0x7f099c070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:55.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.241+0000 7f09a3a76640 1 -- 172.21.15.162:0/1469928183 shutdown_connections 2024-04-25T00:50:55.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.241+0000 7f09a3a76640 1 -- 172.21.15.162:0/1469928183 wait complete. 2024-04-25T00:50:55.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.241+0000 7f09a3a76640 1 Processor -- start 2024-04-25T00:50:55.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.241+0000 7f09a3a76640 1 -- start start 2024-04-25T00:50:55.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.245+0000 7f09a3a76640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f099c152320 0x7f099c1f2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:55.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.245+0000 7f09a3a76640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f099c1581c0 0x7f099c14cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:55.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.245+0000 7f09a3a76640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f099c15c200 0x7f099c15a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:55.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.245+0000 7f09a3a76640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f099c15bce0 con 0x7f099c152320 2024-04-25T00:50:55.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.245+0000 7f09a3a76640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f099c15ba00 con 0x7f099c1581c0 2024-04-25T00:50:55.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.245+0000 7f09a3a76640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f099c15c690 con 0x7f099c15c200 2024-04-25T00:50:55.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.245+0000 7f09a1812640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f099c152320 0x7f099c1f2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:55.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.245+0000 7f09a1812640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f099c152320 0x7f099c1f2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40210/0 (socket says 172.21.15.162:40210) 2024-04-25T00:50:55.246 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.245+0000 7f09a1812640 1 -- 172.21.15.162:0/1402087385 learned_addr learned my addr 172.21.15.162:0/1402087385 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:55.247 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.245+0000 7f09a2013640 1 --2- 172.21.15.162:0/1402087385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f099c15c200 0x7f099c15a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:55.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.249+0000 7f09a1812640 1 -- 172.21.15.162:0/1402087385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f099c15c200 msgr2=0x7f099c15a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:55.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.249+0000 7f09a1812640 1 --2- 172.21.15.162:0/1402087385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f099c15c200 0x7f099c15a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.249+0000 7f09a1812640 1 -- 172.21.15.162:0/1402087385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f099c1581c0 msgr2=0x7f099c14cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:55.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.249+0000 7f09a1812640 1 --2- 172.21.15.162:0/1402087385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f099c1581c0 0x7f099c14cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.249 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.249+0000 7f09a1812640 1 -- 172.21.15.162:0/1402087385 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c14b550 con 0x7f099c152320 2024-04-25T00:50:55.251 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.249+0000 7f09a1812640 1 --2- 172.21.15.162:0/1402087385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f099c152320 0x7f099c1f2600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f098c00c420 tx=0x7f098c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:55.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.253+0000 7f09927fc640 1 -- 172.21.15.162:0/1402087385 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c0052d0 con 0x7f099c152320 2024-04-25T00:50:55.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.253+0000 7f09927fc640 1 -- 172.21.15.162:0/1402087385 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f098c005470 con 0x7f099c152320 2024-04-25T00:50:55.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.253+0000 7f09927fc640 1 -- 172.21.15.162:0/1402087385 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c007240 con 0x7f099c152320 2024-04-25T00:50:55.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.253+0000 7f09a3a76640 1 -- 172.21.15.162:0/1402087385 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099c1f2b40 con 0x7f099c152320 2024-04-25T00:50:55.256 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.253+0000 7f09a3a76640 1 -- 172.21.15.162:0/1402087385 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f099c0cc280 con 0x7f099c152320 2024-04-25T00:50:55.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.257+0000 7f09a3a76640 1 -- 172.21.15.162:0/1402087385 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f099c156570 con 0x7f099c152320 2024-04-25T00:50:55.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.501+0000 7f09927fc640 1 -- 172.21.15.162:0/1402087385 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f098c0073e0 con 0x7f099c152320 2024-04-25T00:50:55.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.505+0000 7f09927fc640 1 --2- 172.21.15.162:0/1402087385 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f09800678f0 0x7f0980069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:55.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.505+0000 7f09a1011640 1 --2- 172.21.15.162:0/1402087385 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f09800678f0 0x7f0980069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:55.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.505+0000 7f09a1011640 1 --2- 172.21.15.162:0/1402087385 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f09800678f0 0x7f0980069db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0998006aa0 tx=0x7f0998006a30 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:55.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.517+0000 7f09927fc640 1 -- 172.21.15.162:0/1402087385 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f098c053e80 con 0x7f099c152320 2024-04-25T00:50:55.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.517+0000 7f09927fc640 1 -- 172.21.15.162:0/1402087385 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f099c14b550 con 0x7f099c152320 2024-04-25T00:50:55.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.681+0000 7f09a3a76640 1 -- 172.21.15.162:0/1402087385 --> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f099c04f5f0 con 0x7f09800678f0 2024-04-25T00:50:55.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.689+0000 7f09927fc640 1 -- 172.21.15.162:0/1402087385 <== mgr.4100 v2:172.21.15.162:6800/3960394531 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251917 (secure 0 0 0) 0x7f099c04f5f0 con 0x7f09800678f0 2024-04-25T00:50:55.690 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:55.694 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-04-25T00:50:55.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.693+0000 7f09a3a76640 1 -- 172.21.15.162:0/1402087385 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f09800678f0 msgr2=0x7f0980069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:55.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.693+0000 7f09a3a76640 1 --2- 172.21.15.162:0/1402087385 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f09800678f0 0x7f0980069db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0998006aa0 tx=0x7f0998006a30 comp rx=0 tx=0).stop 2024-04-25T00:50:55.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.693+0000 7f09a3a76640 1 -- 172.21.15.162:0/1402087385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f099c152320 msgr2=0x7f099c1f2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:55.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.693+0000 7f09a3a76640 1 --2- 172.21.15.162:0/1402087385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f099c152320 0x7f099c1f2600 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f098c00c420 tx=0x7f098c00c8e0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.693+0000 7f09a3a76640 1 -- 172.21.15.162:0/1402087385 shutdown_connections 2024-04-25T00:50:55.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.693+0000 7f09a3a76640 1 --2- 172.21.15.162:0/1402087385 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f099c15c200 0x7f099c15a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.693+0000 7f09a3a76640 1 --2- 172.21.15.162:0/1402087385 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f099c1581c0 0x7f099c14cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.693+0000 7f09a3a76640 1 --2- 172.21.15.162:0/1402087385 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f09800678f0 0x7f0980069db0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.693+0000 7f09a3a76640 1 --2- 172.21.15.162:0/1402087385 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f099c152320 0x7f099c1f2600 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.693+0000 7f09a3a76640 1 -- 172.21.15.162:0/1402087385 >> 172.21.15.162:0/1402087385 conn(0x7f099c070350 msgr2=0x7f099c150430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:55.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.693+0000 7f09a3a76640 1 -- 172.21.15.162:0/1402087385 shutdown_connections 2024-04-25T00:50:55.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.693+0000 7f09a3a76640 1 -- 172.21.15.162:0/1402087385 wait complete. 2024-04-25T00:50:55.710 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":54,"stamp":"2024-04-25T00:50:53.872664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595590,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":283,"num_write_kb":2454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223688,"kb_used_data":3400,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751032,"statfs":{"total":773094113280,"available":772865056768,"internally_reserved":0,"allocated":3481600,"data_stored":1960708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4446,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":112,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":36,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005017"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109574+0000","last_change":"2024-04-25T00:50:35.761428+0000","last_active":"2024-04-25T00:50:38.109574+0000","last_peered":"2024-04-25T00:50:38.109574+0000","last_clean":"2024-04-25T00:50:38.109574+0000","last_became_active":"2024-04-25T00:50:35.760579+0000","last_became_peered":"2024-04-25T00:50:35.760579+0000","last_unstale":"2024-04-25T00:50:38.109574+0000","last_undegraded":"2024-04-25T00:50:38.109574+0000","last_fullsized":"2024-04-25T00:50:38.109574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:06.236972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297768+0000","last_change":"2024-04-25T00:50:35.798137+0000","last_active":"2024-04-25T00:50:37.297768+0000","last_peered":"2024-04-25T00:50:37.297768+0000","last_clean":"2024-04-25T00:50:37.297768+0000","last_became_active":"2024-04-25T00:50:35.797354+0000","last_became_peered":"2024-04-25T00:50:35.797354+0000","last_unstale":"2024-04-25T00:50:37.297768+0000","last_undegraded":"2024-04-25T00:50:37.297768+0000","last_fullsized":"2024-04-25T00:50:37.297768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:29:18.970287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107728+0000","last_change":"2024-04-25T00:50:35.799370+0000","last_active":"2024-04-25T00:50:38.107728+0000","last_peered":"2024-04-25T00:50:38.107728+0000","last_clean":"2024-04-25T00:50:38.107728+0000","last_became_active":"2024-04-25T00:50:35.798268+0000","last_became_peered":"2024-04-25T00:50:35.798268+0000","last_unstale":"2024-04-25T00:50:38.107728+0000","last_undegraded":"2024-04-25T00:50:38.107728+0000","last_fullsized":"2024-04-25T00:50:38.107728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:27.176441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231768+0000","last_change":"2024-04-25T00:50:35.877965+0000","last_active":"2024-04-25T00:50:37.231768+0000","last_peered":"2024-04-25T00:50:37.231768+0000","last_clean":"2024-04-25T00:50:37.231768+0000","last_became_active":"2024-04-25T00:50:35.877114+0000","last_became_peered":"2024-04-25T00:50:35.877114+0000","last_unstale":"2024-04-25T00:50:37.231768+0000","last_undegraded":"2024-04-25T00:50:37.231768+0000","last_fullsized":"2024-04-25T00:50:37.231768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:20.857588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108773+0000","last_change":"2024-04-25T00:50:35.730647+0000","last_active":"2024-04-25T00:50:38.108773+0000","last_peered":"2024-04-25T00:50:38.108773+0000","last_clean":"2024-04-25T00:50:38.108773+0000","last_became_active":"2024-04-25T00:50:35.729785+0000","last_became_peered":"2024-04-25T00:50:35.729785+0000","last_unstale":"2024-04-25T00:50:38.108773+0000","last_undegraded":"2024-04-25T00:50:38.108773+0000","last_fullsized":"2024-04-25T00:50:38.108773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:02.888747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231805+0000","last_change":"2024-04-25T00:50:35.800071+0000","last_active":"2024-04-25T00:50:37.231805+0000","last_peered":"2024-04-25T00:50:37.231805+0000","last_clean":"2024-04-25T00:50:37.231805+0000","last_became_active":"2024-04-25T00:50:35.799390+0000","last_became_peered":"2024-04-25T00:50:35.799390+0000","last_unstale":"2024-04-25T00:50:37.231805+0000","last_undegraded":"2024-04-25T00:50:37.231805+0000","last_fullsized":"2024-04-25T00:50:37.231805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:16.817860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109329+0000","last_change":"2024-04-25T00:50:35.797990+0000","last_active":"2024-04-25T00:50:38.109329+0000","last_peered":"2024-04-25T00:50:38.109329+0000","last_clean":"2024-04-25T00:50:38.109329+0000","last_became_active":"2024-04-25T00:50:35.797328+0000","last_became_peered":"2024-04-25T00:50:35.797328+0000","last_unstale":"2024-04-25T00:50:38.109329+0000","last_undegraded":"2024-04-25T00:50:38.109329+0000","last_fullsized":"2024-04-25T00:50:38.109329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:59.565909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388780+0000","last_change":"2024-04-25T00:50:35.878367+0000","last_active":"2024-04-25T00:50:37.388780+0000","last_peered":"2024-04-25T00:50:37.388780+0000","last_clean":"2024-04-25T00:50:37.388780+0000","last_became_active":"2024-04-25T00:50:35.877581+0000","last_became_peered":"2024-04-25T00:50:35.877581+0000","last_unstale":"2024-04-25T00:50:37.388780+0000","last_undegraded":"2024-04-25T00:50:37.388780+0000","last_fullsized":"2024-04-25T00:50:37.388780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:53.695907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109701+0000","last_change":"2024-04-25T00:50:35.734161+0000","last_active":"2024-04-25T00:50:38.109701+0000","last_peered":"2024-04-25T00:50:38.109701+0000","last_clean":"2024-04-25T00:50:38.109701+0000","last_became_active":"2024-04-25T00:50:35.733546+0000","last_became_peered":"2024-04-25T00:50:35.733546+0000","last_unstale":"2024-04-25T00:50:38.109701+0000","last_undegraded":"2024-04-25T00:50:38.109701+0000","last_fullsized":"2024-04-25T00:50:38.109701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:24:43.171432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.364156+0000","last_change":"2024-04-25T00:50:35.765173+0000","last_active":"2024-04-25T00:50:37.364156+0000","last_peered":"2024-04-25T00:50:37.364156+0000","last_clean":"2024-04-25T00:50:37.364156+0000","last_became_active":"2024-04-25T00:50:35.764412+0000","last_became_peered":"2024-04-25T00:50:35.764412+0000","last_unstale":"2024-04-25T00:50:37.364156+0000","last_undegraded":"2024-04-25T00:50:37.364156+0000","last_fullsized":"2024-04-25T00:50:37.364156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:54.948867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363747+0000","last_change":"2024-04-25T00:50:35.764526+0000","last_active":"2024-04-25T00:50:37.363747+0000","last_peered":"2024-04-25T00:50:37.363747+0000","last_clean":"2024-04-25T00:50:37.363747+0000","last_became_active":"2024-04-25T00:50:35.763770+0000","last_became_peered":"2024-04-25T00:50:35.763770+0000","last_unstale":"2024-04-25T00:50:37.363747+0000","last_undegraded":"2024-04-25T00:50:37.363747+0000","last_fullsized":"2024-04-25T00:50:37.363747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:15.698294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.249512+0000","last_change":"2024-04-25T00:50:35.822113+0000","last_active":"2024-04-25T00:50:37.249512+0000","last_peered":"2024-04-25T00:50:37.249512+0000","last_clean":"2024-04-25T00:50:37.249512+0000","last_became_active":"2024-04-25T00:50:35.821524+0000","last_became_peered":"2024-04-25T00:50:35.821524+0000","last_unstale":"2024-04-25T00:50:37.249512+0000","last_undegraded":"2024-04-25T00:50:37.249512+0000","last_fullsized":"2024-04-25T00:50:37.249512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:43.722114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388885+0000","last_change":"2024-04-25T00:50:35.881637+0000","last_active":"2024-04-25T00:50:37.388885+0000","last_peered":"2024-04-25T00:50:37.388885+0000","last_clean":"2024-04-25T00:50:37.388885+0000","last_became_active":"2024-04-25T00:50:35.880661+0000","last_became_peered":"2024-04-25T00:50:35.880661+0000","last_unstale":"2024-04-25T00:50:37.388885+0000","last_undegraded":"2024-04-25T00:50:37.388885+0000","last_fullsized":"2024-04-25T00:50:37.388885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:39.862610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.106989+0000","last_change":"2024-04-25T00:50:35.796996+0000","last_active":"2024-04-25T00:50:38.106989+0000","last_peered":"2024-04-25T00:50:38.106989+0000","last_clean":"2024-04-25T00:50:38.106989+0000","last_became_active":"2024-04-25T00:50:35.795295+0000","last_became_peered":"2024-04-25T00:50:35.795295+0000","last_unstale":"2024-04-25T00:50:38.106989+0000","last_undegraded":"2024-04-25T00:50:38.106989+0000","last_fullsized":"2024-04-25T00:50:38.106989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:29.858476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297189+0000","last_change":"2024-04-25T00:50:35.818291+0000","last_active":"2024-04-25T00:50:37.297189+0000","last_peered":"2024-04-25T00:50:37.297189+0000","last_clean":"2024-04-25T00:50:37.297189+0000","last_became_active":"2024-04-25T00:50:35.817575+0000","last_became_peered":"2024-04-25T00:50:35.817575+0000","last_unstale":"2024-04-25T00:50:37.297189+0000","last_undegraded":"2024-04-25T00:50:37.297189+0000","last_fullsized":"2024-04-25T00:50:37.297189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:51.142494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231455+0000","last_change":"2024-04-25T00:50:35.797194+0000","last_active":"2024-04-25T00:50:37.231455+0000","last_peered":"2024-04-25T00:50:37.231455+0000","last_clean":"2024-04-25T00:50:37.231455+0000","last_became_active":"2024-04-25T00:50:35.796536+0000","last_became_peered":"2024-04-25T00:50:35.796536+0000","last_unstale":"2024-04-25T00:50:37.231455+0000","last_undegraded":"2024-04-25T00:50:37.231455+0000","last_fullsized":"2024-04-25T00:50:37.231455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:48:27.210535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.233251+0000","last_change":"2024-04-25T00:50:35.729648+0000","last_active":"2024-04-25T00:50:37.233251+0000","last_peered":"2024-04-25T00:50:37.233251+0000","last_clean":"2024-04-25T00:50:37.233251+0000","last_became_active":"2024-04-25T00:50:35.728875+0000","last_became_peered":"2024-04-25T00:50:35.728875+0000","last_unstale":"2024-04-25T00:50:37.233251+0000","last_undegraded":"2024-04-25T00:50:37.233251+0000","last_fullsized":"2024-04-25T00:50:37.233251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:46.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.106981+0000","last_change":"2024-04-25T00:50:35.760953+0000","last_active":"2024-04-25T00:50:38.106981+0000","last_peered":"2024-04-25T00:50:38.106981+0000","last_clean":"2024-04-25T00:50:38.106981+0000","last_became_active":"2024-04-25T00:50:35.760286+0000","last_became_peered":"2024-04-25T00:50:35.760286+0000","last_unstale":"2024-04-25T00:50:38.106981+0000","last_undegraded":"2024-04-25T00:50:38.106981+0000","last_fullsized":"2024-04-25T00:50:38.106981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:57.466393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109462+0000","last_change":"2024-04-25T00:50:35.732837+0000","last_active":"2024-04-25T00:50:38.109462+0000","last_peered":"2024-04-25T00:50:38.109462+0000","last_clean":"2024-04-25T00:50:38.109462+0000","last_became_active":"2024-04-25T00:50:35.732134+0000","last_became_peered":"2024-04-25T00:50:35.732134+0000","last_unstale":"2024-04-25T00:50:38.109462+0000","last_undegraded":"2024-04-25T00:50:38.109462+0000","last_fullsized":"2024-04-25T00:50:38.109462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:46.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363854+0000","last_change":"2024-04-25T00:50:35.818607+0000","last_active":"2024-04-25T00:50:37.363854+0000","last_peered":"2024-04-25T00:50:37.363854+0000","last_clean":"2024-04-25T00:50:37.363854+0000","last_became_active":"2024-04-25T00:50:35.818063+0000","last_became_peered":"2024-04-25T00:50:35.818063+0000","last_unstale":"2024-04-25T00:50:37.363854+0000","last_undegraded":"2024-04-25T00:50:37.363854+0000","last_fullsized":"2024-04-25T00:50:37.363854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:15.875347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107633+0000","last_change":"2024-04-25T00:50:35.798297+0000","last_active":"2024-04-25T00:50:38.107633+0000","last_peered":"2024-04-25T00:50:38.107633+0000","last_clean":"2024-04-25T00:50:38.107633+0000","last_became_active":"2024-04-25T00:50:35.797580+0000","last_became_peered":"2024-04-25T00:50:35.797580+0000","last_unstale":"2024-04-25T00:50:38.107633+0000","last_undegraded":"2024-04-25T00:50:38.107633+0000","last_fullsized":"2024-04-25T00:50:38.107633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:06.596770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231785+0000","last_change":"2024-04-25T00:50:35.729396+0000","last_active":"2024-04-25T00:50:37.231785+0000","last_peered":"2024-04-25T00:50:37.231785+0000","last_clean":"2024-04-25T00:50:37.231785+0000","last_became_active":"2024-04-25T00:50:35.728620+0000","last_became_peered":"2024-04-25T00:50:35.728620+0000","last_unstale":"2024-04-25T00:50:37.231785+0000","last_undegraded":"2024-04-25T00:50:37.231785+0000","last_fullsized":"2024-04-25T00:50:37.231785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:02.911498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389017+0000","last_change":"2024-04-25T00:50:35.877261+0000","last_active":"2024-04-25T00:50:37.389017+0000","last_peered":"2024-04-25T00:50:37.389017+0000","last_clean":"2024-04-25T00:50:37.389017+0000","last_became_active":"2024-04-25T00:50:35.876489+0000","last_became_peered":"2024-04-25T00:50:35.876489+0000","last_unstale":"2024-04-25T00:50:37.389017+0000","last_undegraded":"2024-04-25T00:50:37.389017+0000","last_fullsized":"2024-04-25T00:50:37.389017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:14:31.440563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231553+0000","last_change":"2024-04-25T00:50:35.877693+0000","last_active":"2024-04-25T00:50:37.231553+0000","last_peered":"2024-04-25T00:50:37.231553+0000","last_clean":"2024-04-25T00:50:37.231553+0000","last_became_active":"2024-04-25T00:50:35.876870+0000","last_became_peered":"2024-04-25T00:50:35.876870+0000","last_unstale":"2024-04-25T00:50:37.231553+0000","last_undegraded":"2024-04-25T00:50:37.231553+0000","last_fullsized":"2024-04-25T00:50:37.231553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:53.474315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389593+0000","last_change":"2024-04-25T00:50:35.881027+0000","last_active":"2024-04-25T00:50:37.389593+0000","last_peered":"2024-04-25T00:50:37.389593+0000","last_clean":"2024-04-25T00:50:37.389593+0000","last_became_active":"2024-04-25T00:50:35.880477+0000","last_became_peered":"2024-04-25T00:50:35.880477+0000","last_unstale":"2024-04-25T00:50:37.389593+0000","last_undegraded":"2024-04-25T00:50:37.389593+0000","last_fullsized":"2024-04-25T00:50:37.389593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:55:59.176935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.364221+0000","last_change":"2024-04-25T00:50:35.765295+0000","last_active":"2024-04-25T00:50:37.364221+0000","last_peered":"2024-04-25T00:50:37.364221+0000","last_clean":"2024-04-25T00:50:37.364221+0000","last_became_active":"2024-04-25T00:50:35.764358+0000","last_became_peered":"2024-04-25T00:50:35.764358+0000","last_unstale":"2024-04-25T00:50:37.364221+0000","last_undegraded":"2024-04-25T00:50:37.364221+0000","last_fullsized":"2024-04-25T00:50:37.364221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:15.104631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297462+0000","last_change":"2024-04-25T00:50:35.869695+0000","last_active":"2024-04-25T00:50:37.297462+0000","last_peered":"2024-04-25T00:50:37.297462+0000","last_clean":"2024-04-25T00:50:37.297462+0000","last_became_active":"2024-04-25T00:50:35.868857+0000","last_became_peered":"2024-04-25T00:50:35.868857+0000","last_unstale":"2024-04-25T00:50:37.297462+0000","last_undegraded":"2024-04-25T00:50:37.297462+0000","last_fullsized":"2024-04-25T00:50:37.297462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:35:38.295580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389423+0000","last_change":"2024-04-25T00:50:35.884507+0000","last_active":"2024-04-25T00:50:37.389423+0000","last_peered":"2024-04-25T00:50:37.389423+0000","last_clean":"2024-04-25T00:50:37.389423+0000","last_became_active":"2024-04-25T00:50:35.883901+0000","last_became_peered":"2024-04-25T00:50:35.883901+0000","last_unstale":"2024-04-25T00:50:37.389423+0000","last_undegraded":"2024-04-25T00:50:37.389423+0000","last_fullsized":"2024-04-25T00:50:37.389423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:40.533818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107794+0000","last_change":"2024-04-25T00:50:35.878649+0000","last_active":"2024-04-25T00:50:38.107794+0000","last_peered":"2024-04-25T00:50:38.107794+0000","last_clean":"2024-04-25T00:50:38.107794+0000","last_became_active":"2024-04-25T00:50:35.877870+0000","last_became_peered":"2024-04-25T00:50:35.877870+0000","last_unstale":"2024-04-25T00:50:38.107794+0000","last_undegraded":"2024-04-25T00:50:38.107794+0000","last_fullsized":"2024-04-25T00:50:38.107794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232184+0000","last_change":"2024-04-25T00:50:35.869614+0000","last_active":"2024-04-25T00:50:37.232184+0000","last_peered":"2024-04-25T00:50:37.232184+0000","last_clean":"2024-04-25T00:50:37.232184+0000","last_became_active":"2024-04-25T00:50:35.869016+0000","last_became_peered":"2024-04-25T00:50:35.869016+0000","last_unstale":"2024-04-25T00:50:37.232184+0000","last_undegraded":"2024-04-25T00:50:37.232184+0000","last_fullsized":"2024-04-25T00:50:37.232184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:02.888747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107611+0000","last_change":"2024-04-25T00:50:35.728757+0000","last_active":"2024-04-25T00:50:38.107611+0000","last_peered":"2024-04-25T00:50:38.107611+0000","last_clean":"2024-04-25T00:50:38.107611+0000","last_became_active":"2024-04-25T00:50:35.728271+0000","last_became_peered":"2024-04-25T00:50:35.728271+0000","last_unstale":"2024-04-25T00:50:38.107611+0000","last_undegraded":"2024-04-25T00:50:38.107611+0000","last_fullsized":"2024-04-25T00:50:38.107611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:43.722114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363386+0000","last_change":"2024-04-25T00:50:35.802347+0000","last_active":"2024-04-25T00:50:37.363386+0000","last_peered":"2024-04-25T00:50:37.363386+0000","last_clean":"2024-04-25T00:50:37.363386+0000","last_became_active":"2024-04-25T00:50:35.801389+0000","last_became_peered":"2024-04-25T00:50:35.801389+0000","last_unstale":"2024-04-25T00:50:37.363386+0000","last_undegraded":"2024-04-25T00:50:37.363386+0000","last_fullsized":"2024-04-25T00:50:37.363386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:27.176441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.248607+0000","last_change":"2024-04-25T00:50:35.822222+0000","last_active":"2024-04-25T00:50:37.248607+0000","last_peered":"2024-04-25T00:50:37.248607+0000","last_clean":"2024-04-25T00:50:37.248607+0000","last_became_active":"2024-04-25T00:50:35.821484+0000","last_became_peered":"2024-04-25T00:50:35.821484+0000","last_unstale":"2024-04-25T00:50:37.248607+0000","last_undegraded":"2024-04-25T00:50:37.248607+0000","last_fullsized":"2024-04-25T00:50:37.248607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:59.921295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.280250+0000","last_change":"2024-04-25T00:50:33.391742+0000","last_active":"2024-04-25T00:50:43.280250+0000","last_peered":"2024-04-25T00:50:43.280250+0000","last_clean":"2024-04-25T00:50:43.280250+0000","last_became_active":"2024-04-25T00:50:33.390901+0000","last_became_peered":"2024-04-25T00:50:33.390901+0000","last_unstale":"2024-04-25T00:50:43.280250+0000","last_undegraded":"2024-04-25T00:50:43.280250+0000","last_fullsized":"2024-04-25T00:50:43.280250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:27.804469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107862+0000","last_change":"2024-04-25T00:50:35.821496+0000","last_active":"2024-04-25T00:50:38.107862+0000","last_peered":"2024-04-25T00:50:38.107862+0000","last_clean":"2024-04-25T00:50:38.107862+0000","last_became_active":"2024-04-25T00:50:35.820763+0000","last_became_peered":"2024-04-25T00:50:35.820763+0000","last_unstale":"2024-04-25T00:50:38.107862+0000","last_undegraded":"2024-04-25T00:50:38.107862+0000","last_fullsized":"2024-04-25T00:50:38.107862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:15.698294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.247382+0000","last_change":"2024-04-25T00:50:33.394753+0000","last_active":"2024-04-25T00:50:50.247382+0000","last_peered":"2024-04-25T00:50:50.247382+0000","last_clean":"2024-04-25T00:50:50.247382+0000","last_became_active":"2024-04-25T00:50:33.392951+0000","last_became_peered":"2024-04-25T00:50:33.392951+0000","last_unstale":"2024-04-25T00:50:50.247382+0000","last_undegraded":"2024-04-25T00:50:50.247382+0000","last_fullsized":"2024-04-25T00:50:50.247382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:41.175588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.164261+0000","last_change":"2024-04-25T00:50:33.393229+0000","last_active":"2024-04-25T00:50:50.164261+0000","last_peered":"2024-04-25T00:50:50.164261+0000","last_clean":"2024-04-25T00:50:50.164261+0000","last_became_active":"2024-04-25T00:50:33.392817+0000","last_became_peered":"2024-04-25T00:50:33.392817+0000","last_unstale":"2024-04-25T00:50:50.164261+0000","last_undegraded":"2024-04-25T00:50:50.164261+0000","last_fullsized":"2024-04-25T00:50:50.164261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:31:12.131616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388809+0000","last_change":"2024-04-25T00:50:35.883390+0000","last_active":"2024-04-25T00:50:37.388809+0000","last_peered":"2024-04-25T00:50:37.388809+0000","last_clean":"2024-04-25T00:50:37.388809+0000","last_became_active":"2024-04-25T00:50:35.882509+0000","last_became_peered":"2024-04-25T00:50:35.882509+0000","last_unstale":"2024-04-25T00:50:37.388809+0000","last_undegraded":"2024-04-25T00:50:37.388809+0000","last_fullsized":"2024-04-25T00:50:37.388809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:05:17.996810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231921+0000","last_change":"2024-04-25T00:50:33.383755+0000","last_active":"2024-04-25T00:50:37.231921+0000","last_peered":"2024-04-25T00:50:37.231921+0000","last_clean":"2024-04-25T00:50:37.231921+0000","last_became_active":"2024-04-25T00:50:33.382925+0000","last_became_peered":"2024-04-25T00:50:33.382925+0000","last_unstale":"2024-04-25T00:50:37.231921+0000","last_undegraded":"2024-04-25T00:50:37.231921+0000","last_fullsized":"2024-04-25T00:50:37.231921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:52.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297234+0000","last_change":"2024-04-25T00:50:35.869794+0000","last_active":"2024-04-25T00:50:37.297234+0000","last_peered":"2024-04-25T00:50:37.297234+0000","last_clean":"2024-04-25T00:50:37.297234+0000","last_became_active":"2024-04-25T00:50:35.869028+0000","last_became_peered":"2024-04-25T00:50:35.869028+0000","last_unstale":"2024-04-25T00:50:37.297234+0000","last_undegraded":"2024-04-25T00:50:37.297234+0000","last_fullsized":"2024-04-25T00:50:37.297234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:49.891966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.457729+0000","last_change":"2024-04-25T00:50:33.394082+0000","last_active":"2024-04-25T00:50:43.457729+0000","last_peered":"2024-04-25T00:50:43.457729+0000","last_clean":"2024-04-25T00:50:43.457729+0000","last_became_active":"2024-04-25T00:50:33.392792+0000","last_became_peered":"2024-04-25T00:50:33.392792+0000","last_unstale":"2024-04-25T00:50:43.457729+0000","last_undegraded":"2024-04-25T00:50:43.457729+0000","last_fullsized":"2024-04-25T00:50:43.457729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:35:15.441104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.233002+0000","last_change":"2024-04-25T00:50:35.729414+0000","last_active":"2024-04-25T00:50:37.233002+0000","last_peered":"2024-04-25T00:50:37.233002+0000","last_clean":"2024-04-25T00:50:37.233002+0000","last_became_active":"2024-04-25T00:50:35.728725+0000","last_became_peered":"2024-04-25T00:50:35.728725+0000","last_unstale":"2024-04-25T00:50:37.233002+0000","last_undegraded":"2024-04-25T00:50:37.233002+0000","last_fullsized":"2024-04-25T00:50:37.233002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:05.046355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.272521+0000","last_change":"2024-04-25T00:50:33.388191+0000","last_active":"2024-04-25T00:50:43.272521+0000","last_peered":"2024-04-25T00:50:43.272521+0000","last_clean":"2024-04-25T00:50:43.272521+0000","last_became_active":"2024-04-25T00:50:33.387266+0000","last_became_peered":"2024-04-25T00:50:33.387266+0000","last_unstale":"2024-04-25T00:50:43.272521+0000","last_undegraded":"2024-04-25T00:50:43.272521+0000","last_fullsized":"2024-04-25T00:50:43.272521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:08.400693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108034+0000","last_change":"2024-04-25T00:50:35.799783+0000","last_active":"2024-04-25T00:50:38.108034+0000","last_peered":"2024-04-25T00:50:38.108034+0000","last_clean":"2024-04-25T00:50:38.108034+0000","last_became_active":"2024-04-25T00:50:35.798471+0000","last_became_peered":"2024-04-25T00:50:35.798471+0000","last_unstale":"2024-04-25T00:50:38.108034+0000","last_undegraded":"2024-04-25T00:50:38.108034+0000","last_fullsized":"2024-04-25T00:50:38.108034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:15.104631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.472958+0000","last_change":"2024-04-25T00:50:33.304731+0000","last_active":"2024-04-25T00:50:38.472958+0000","last_peered":"2024-04-25T00:50:38.472958+0000","last_clean":"2024-04-25T00:50:38.472958+0000","last_became_active":"2024-04-25T00:50:33.303821+0000","last_became_peered":"2024-04-25T00:50:33.303821+0000","last_unstale":"2024-04-25T00:50:38.472958+0000","last_undegraded":"2024-04-25T00:50:38.472958+0000","last_fullsized":"2024-04-25T00:50:38.472958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:32.196488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.249633+0000","last_change":"2024-04-25T00:50:35.828727+0000","last_active":"2024-04-25T00:50:37.249633+0000","last_peered":"2024-04-25T00:50:37.249633+0000","last_clean":"2024-04-25T00:50:37.249633+0000","last_became_active":"2024-04-25T00:50:35.827617+0000","last_became_peered":"2024-04-25T00:50:35.827617+0000","last_unstale":"2024-04-25T00:50:37.249633+0000","last_undegraded":"2024-04-25T00:50:37.249633+0000","last_fullsized":"2024-04-25T00:50:37.249633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:30:10.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"26'8","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.455122+0000","last_change":"2024-04-25T00:50:33.391005+0000","last_active":"2024-04-25T00:50:43.455122+0000","last_peered":"2024-04-25T00:50:43.455122+0000","last_clean":"2024-04-25T00:50:43.455122+0000","last_became_active":"2024-04-25T00:50:33.390133+0000","last_became_peered":"2024-04-25T00:50:33.390133+0000","last_unstale":"2024-04-25T00:50:43.455122+0000","last_undegraded":"2024-04-25T00:50:43.455122+0000","last_fullsized":"2024-04-25T00:50:43.455122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:19.913188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108901+0000","last_change":"2024-04-25T00:50:35.876022+0000","last_active":"2024-04-25T00:50:38.108901+0000","last_peered":"2024-04-25T00:50:38.108901+0000","last_clean":"2024-04-25T00:50:38.108901+0000","last_became_active":"2024-04-25T00:50:35.875322+0000","last_became_peered":"2024-04-25T00:50:35.875322+0000","last_unstale":"2024-04-25T00:50:38.108901+0000","last_undegraded":"2024-04-25T00:50:38.108901+0000","last_fullsized":"2024-04-25T00:50:38.108901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.249026+0000","last_change":"2024-04-25T00:50:33.387295+0000","last_active":"2024-04-25T00:50:50.249026+0000","last_peered":"2024-04-25T00:50:50.249026+0000","last_clean":"2024-04-25T00:50:50.249026+0000","last_became_active":"2024-04-25T00:50:33.386297+0000","last_became_peered":"2024-04-25T00:50:33.386297+0000","last_unstale":"2024-04-25T00:50:50.249026+0000","last_undegraded":"2024-04-25T00:50:50.249026+0000","last_fullsized":"2024-04-25T00:50:50.249026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:31:57.597514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107131+0000","last_change":"2024-04-25T00:50:35.796873+0000","last_active":"2024-04-25T00:50:38.107131+0000","last_peered":"2024-04-25T00:50:38.107131+0000","last_clean":"2024-04-25T00:50:38.107131+0000","last_became_active":"2024-04-25T00:50:35.796012+0000","last_became_peered":"2024-04-25T00:50:35.796012+0000","last_unstale":"2024-04-25T00:50:38.107131+0000","last_undegraded":"2024-04-25T00:50:38.107131+0000","last_fullsized":"2024-04-25T00:50:38.107131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:22.255073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.272566+0000","last_change":"2024-04-25T00:50:33.385522+0000","last_active":"2024-04-25T00:50:43.272566+0000","last_peered":"2024-04-25T00:50:43.272566+0000","last_clean":"2024-04-25T00:50:43.272566+0000","last_became_active":"2024-04-25T00:50:33.384620+0000","last_became_peered":"2024-04-25T00:50:33.384620+0000","last_unstale":"2024-04-25T00:50:43.272566+0000","last_undegraded":"2024-04-25T00:50:43.272566+0000","last_fullsized":"2024-04-25T00:50:43.272566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:24.908029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108828+0000","last_change":"2024-04-25T00:50:35.820565+0000","last_active":"2024-04-25T00:50:38.108828+0000","last_peered":"2024-04-25T00:50:38.108828+0000","last_clean":"2024-04-25T00:50:38.108828+0000","last_became_active":"2024-04-25T00:50:35.819683+0000","last_became_peered":"2024-04-25T00:50:35.819683+0000","last_unstale":"2024-04-25T00:50:38.108828+0000","last_undegraded":"2024-04-25T00:50:38.108828+0000","last_fullsized":"2024-04-25T00:50:38.108828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:28.655307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.248912+0000","last_change":"2024-04-25T00:50:33.390745+0000","last_active":"2024-04-25T00:50:50.248912+0000","last_peered":"2024-04-25T00:50:50.248912+0000","last_clean":"2024-04-25T00:50:50.248912+0000","last_became_active":"2024-04-25T00:50:33.390089+0000","last_became_peered":"2024-04-25T00:50:33.390089+0000","last_unstale":"2024-04-25T00:50:50.248912+0000","last_undegraded":"2024-04-25T00:50:50.248912+0000","last_fullsized":"2024-04-25T00:50:50.248912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:51.294701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363399+0000","last_change":"2024-04-25T00:50:35.801766+0000","last_active":"2024-04-25T00:50:37.363399+0000","last_peered":"2024-04-25T00:50:37.363399+0000","last_clean":"2024-04-25T00:50:37.363399+0000","last_became_active":"2024-04-25T00:50:35.801060+0000","last_became_peered":"2024-04-25T00:50:35.801060+0000","last_unstale":"2024-04-25T00:50:37.363399+0000","last_undegraded":"2024-04-25T00:50:37.363399+0000","last_fullsized":"2024-04-25T00:50:37.363399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.245577+0000","last_change":"2024-04-25T00:50:33.327283+0000","last_active":"2024-04-25T00:50:50.245577+0000","last_peered":"2024-04-25T00:50:50.245577+0000","last_clean":"2024-04-25T00:50:50.245577+0000","last_became_active":"2024-04-25T00:50:33.326464+0000","last_became_peered":"2024-04-25T00:50:33.326464+0000","last_unstale":"2024-04-25T00:50:50.245577+0000","last_undegraded":"2024-04-25T00:50:50.245577+0000","last_fullsized":"2024-04-25T00:50:50.245577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:26:26.328621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108814+0000","last_change":"2024-04-25T00:50:35.825910+0000","last_active":"2024-04-25T00:50:38.108814+0000","last_peered":"2024-04-25T00:50:38.108814+0000","last_clean":"2024-04-25T00:50:38.108814+0000","last_became_active":"2024-04-25T00:50:35.825246+0000","last_became_peered":"2024-04-25T00:50:35.825246+0000","last_unstale":"2024-04-25T00:50:38.108814+0000","last_undegraded":"2024-04-25T00:50:38.108814+0000","last_fullsized":"2024-04-25T00:50:38.108814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:40.106788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.250173+0000","last_change":"2024-04-25T00:50:33.393856+0000","last_active":"2024-04-25T00:50:37.250173+0000","last_peered":"2024-04-25T00:50:37.250173+0000","last_clean":"2024-04-25T00:50:37.250173+0000","last_became_active":"2024-04-25T00:50:33.393153+0000","last_became_peered":"2024-04-25T00:50:33.393153+0000","last_unstale":"2024-04-25T00:50:37.250173+0000","last_undegraded":"2024-04-25T00:50:37.250173+0000","last_fullsized":"2024-04-25T00:50:37.250173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:55.179146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109662+0000","last_change":"2024-04-25T00:50:35.811993+0000","last_active":"2024-04-25T00:50:38.109662+0000","last_peered":"2024-04-25T00:50:38.109662+0000","last_clean":"2024-04-25T00:50:38.109662+0000","last_became_active":"2024-04-25T00:50:35.811267+0000","last_became_peered":"2024-04-25T00:50:35.811267+0000","last_unstale":"2024-04-25T00:50:38.109662+0000","last_undegraded":"2024-04-25T00:50:38.109662+0000","last_fullsized":"2024-04-25T00:50:38.109662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:40:20.385617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.476493+0000","last_change":"2024-04-25T00:50:33.383040+0000","last_active":"2024-04-25T00:50:38.476493+0000","last_peered":"2024-04-25T00:50:38.476493+0000","last_clean":"2024-04-25T00:50:38.476493+0000","last_became_active":"2024-04-25T00:50:33.382270+0000","last_became_peered":"2024-04-25T00:50:33.382270+0000","last_unstale":"2024-04-25T00:50:38.476493+0000","last_undegraded":"2024-04-25T00:50:38.476493+0000","last_fullsized":"2024-04-25T00:50:38.476493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:13.866739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109894+0000","last_change":"2024-04-25T00:50:35.818234+0000","last_active":"2024-04-25T00:50:38.109894+0000","last_peered":"2024-04-25T00:50:38.109894+0000","last_clean":"2024-04-25T00:50:38.109894+0000","last_became_active":"2024-04-25T00:50:35.817707+0000","last_became_peered":"2024-04-25T00:50:35.817707+0000","last_unstale":"2024-04-25T00:50:38.109894+0000","last_undegraded":"2024-04-25T00:50:38.109894+0000","last_fullsized":"2024-04-25T00:50:38.109894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:31.998886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297643+0000","last_change":"2024-04-25T00:50:33.389774+0000","last_active":"2024-04-25T00:50:37.297643+0000","last_peered":"2024-04-25T00:50:37.297643+0000","last_clean":"2024-04-25T00:50:37.297643+0000","last_became_active":"2024-04-25T00:50:33.389092+0000","last_became_peered":"2024-04-25T00:50:33.389092+0000","last_unstale":"2024-04-25T00:50:37.297643+0000","last_undegraded":"2024-04-25T00:50:37.297643+0000","last_fullsized":"2024-04-25T00:50:37.297643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:30.722771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232278+0000","last_change":"2024-04-25T00:50:35.869211+0000","last_active":"2024-04-25T00:50:37.232278+0000","last_peered":"2024-04-25T00:50:37.232278+0000","last_clean":"2024-04-25T00:50:37.232278+0000","last_became_active":"2024-04-25T00:50:35.868798+0000","last_became_peered":"2024-04-25T00:50:35.868798+0000","last_unstale":"2024-04-25T00:50:37.232278+0000","last_undegraded":"2024-04-25T00:50:37.232278+0000","last_fullsized":"2024-04-25T00:50:37.232278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:40.106788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.245439+0000","last_change":"2024-04-25T00:50:33.329578+0000","last_active":"2024-04-25T00:50:50.245439+0000","last_peered":"2024-04-25T00:50:50.245439+0000","last_clean":"2024-04-25T00:50:50.245439+0000","last_became_active":"2024-04-25T00:50:33.328950+0000","last_became_peered":"2024-04-25T00:50:33.328950+0000","last_unstale":"2024-04-25T00:50:50.245439+0000","last_undegraded":"2024-04-25T00:50:50.245439+0000","last_fullsized":"2024-04-25T00:50:50.245439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:55.179146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109245+0000","last_change":"2024-04-25T00:50:35.734419+0000","last_active":"2024-04-25T00:50:38.109245+0000","last_peered":"2024-04-25T00:50:38.109245+0000","last_clean":"2024-04-25T00:50:38.109245+0000","last_became_active":"2024-04-25T00:50:35.733696+0000","last_became_peered":"2024-04-25T00:50:35.733696+0000","last_unstale":"2024-04-25T00:50:38.109245+0000","last_undegraded":"2024-04-25T00:50:38.109245+0000","last_fullsized":"2024-04-25T00:50:38.109245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:05.046355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":175,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108342+0000","last_change":"2024-04-25T00:49:55.281216+0000","last_active":"2024-04-25T00:50:38.108342+0000","last_peered":"2024-04-25T00:50:38.108342+0000","last_clean":"2024-04-25T00:50:38.108342+0000","last_became_active":"2024-04-25T00:49:55.278022+0000","last_became_peered":"2024-04-25T00:49:55.278022+0000","last_unstale":"2024-04-25T00:50:38.108342+0000","last_undegraded":"2024-04-25T00:50:38.108342+0000","last_fullsized":"2024-04-25T00:50:38.108342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:49:52.475299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:49:52.475299+0000","last_clean_scrub_stamp":"2024-04-25T00:49:52.475299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:17.046656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.272652+0000","last_change":"2024-04-25T00:50:33.325228+0000","last_active":"2024-04-25T00:50:43.272652+0000","last_peered":"2024-04-25T00:50:43.272652+0000","last_clean":"2024-04-25T00:50:43.272652+0000","last_became_active":"2024-04-25T00:50:33.324579+0000","last_became_peered":"2024-04-25T00:50:33.324579+0000","last_unstale":"2024-04-25T00:50:43.272652+0000","last_undegraded":"2024-04-25T00:50:43.272652+0000","last_fullsized":"2024-04-25T00:50:43.272652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:12.762746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388819+0000","last_change":"2024-04-25T00:50:35.880348+0000","last_active":"2024-04-25T00:50:37.388819+0000","last_peered":"2024-04-25T00:50:37.388819+0000","last_clean":"2024-04-25T00:50:37.388819+0000","last_became_active":"2024-04-25T00:50:35.878438+0000","last_became_peered":"2024-04-25T00:50:35.878438+0000","last_unstale":"2024-04-25T00:50:37.388819+0000","last_undegraded":"2024-04-25T00:50:37.388819+0000","last_fullsized":"2024-04-25T00:50:37.388819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:44.093119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.167929+0000","last_change":"2024-04-25T00:50:33.321385+0000","last_active":"2024-04-25T00:50:50.167929+0000","last_peered":"2024-04-25T00:50:50.167929+0000","last_clean":"2024-04-25T00:50:50.167929+0000","last_became_active":"2024-04-25T00:50:33.320800+0000","last_became_peered":"2024-04-25T00:50:33.320800+0000","last_unstale":"2024-04-25T00:50:50.167929+0000","last_undegraded":"2024-04-25T00:50:50.167929+0000","last_fullsized":"2024-04-25T00:50:50.167929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:04.254885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107400+0000","last_change":"2024-04-25T00:50:35.815056+0000","last_active":"2024-04-25T00:50:38.107400+0000","last_peered":"2024-04-25T00:50:38.107400+0000","last_clean":"2024-04-25T00:50:38.107400+0000","last_became_active":"2024-04-25T00:50:35.814163+0000","last_became_peered":"2024-04-25T00:50:35.814163+0000","last_unstale":"2024-04-25T00:50:38.107400+0000","last_undegraded":"2024-04-25T00:50:38.107400+0000","last_fullsized":"2024-04-25T00:50:38.107400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:50:52.289674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.244675+0000","last_change":"2024-04-25T00:50:33.384695+0000","last_active":"2024-04-25T00:50:50.244675+0000","last_peered":"2024-04-25T00:50:50.244675+0000","last_clean":"2024-04-25T00:50:50.244675+0000","last_became_active":"2024-04-25T00:50:33.383692+0000","last_became_peered":"2024-04-25T00:50:33.383692+0000","last_unstale":"2024-04-25T00:50:50.244675+0000","last_undegraded":"2024-04-25T00:50:50.244675+0000","last_fullsized":"2024-04-25T00:50:50.244675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:57.579410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297265+0000","last_change":"2024-04-25T00:50:35.723048+0000","last_active":"2024-04-25T00:50:37.297265+0000","last_peered":"2024-04-25T00:50:37.297265+0000","last_clean":"2024-04-25T00:50:37.297265+0000","last_became_active":"2024-04-25T00:50:35.722500+0000","last_became_peered":"2024-04-25T00:50:35.722500+0000","last_unstale":"2024-04-25T00:50:37.297265+0000","last_undegraded":"2024-04-25T00:50:37.297265+0000","last_fullsized":"2024-04-25T00:50:37.297265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:20:39.082516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232502+0000","last_change":"2024-04-25T00:50:33.305927+0000","last_active":"2024-04-25T00:50:37.232502+0000","last_peered":"2024-04-25T00:50:37.232502+0000","last_clean":"2024-04-25T00:50:37.232502+0000","last_became_active":"2024-04-25T00:50:33.305159+0000","last_became_peered":"2024-04-25T00:50:33.305159+0000","last_unstale":"2024-04-25T00:50:37.232502+0000","last_undegraded":"2024-04-25T00:50:37.232502+0000","last_fullsized":"2024-04-25T00:50:37.232502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:46:56.639410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.248677+0000","last_change":"2024-04-25T00:50:35.824491+0000","last_active":"2024-04-25T00:50:37.248677+0000","last_peered":"2024-04-25T00:50:37.248677+0000","last_clean":"2024-04-25T00:50:37.248677+0000","last_became_active":"2024-04-25T00:50:35.823320+0000","last_became_peered":"2024-04-25T00:50:35.823320+0000","last_unstale":"2024-04-25T00:50:37.248677+0000","last_undegraded":"2024-04-25T00:50:37.248677+0000","last_fullsized":"2024-04-25T00:50:37.248677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:57.466393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297427+0000","last_change":"2024-04-25T00:50:33.304490+0000","last_active":"2024-04-25T00:50:37.297427+0000","last_peered":"2024-04-25T00:50:37.297427+0000","last_clean":"2024-04-25T00:50:37.297427+0000","last_became_active":"2024-04-25T00:50:33.303671+0000","last_became_peered":"2024-04-25T00:50:33.303671+0000","last_unstale":"2024-04-25T00:50:37.297427+0000","last_undegraded":"2024-04-25T00:50:37.297427+0000","last_fullsized":"2024-04-25T00:50:37.297427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:30.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.233156+0000","last_change":"2024-04-25T00:50:35.878641+0000","last_active":"2024-04-25T00:50:37.233156+0000","last_peered":"2024-04-25T00:50:37.233156+0000","last_clean":"2024-04-25T00:50:37.233156+0000","last_became_active":"2024-04-25T00:50:35.876958+0000","last_became_peered":"2024-04-25T00:50:35.876958+0000","last_unstale":"2024-04-25T00:50:37.233156+0000","last_undegraded":"2024-04-25T00:50:37.233156+0000","last_fullsized":"2024-04-25T00:50:37.233156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:59.565909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109866+0000","last_change":"2024-04-25T00:50:33.319229+0000","last_active":"2024-04-25T00:50:38.109866+0000","last_peered":"2024-04-25T00:50:38.109866+0000","last_clean":"2024-04-25T00:50:38.109866+0000","last_became_active":"2024-04-25T00:50:33.318945+0000","last_became_peered":"2024-04-25T00:50:33.318945+0000","last_unstale":"2024-04-25T00:50:38.109866+0000","last_undegraded":"2024-04-25T00:50:38.109866+0000","last_fullsized":"2024-04-25T00:50:38.109866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:51.132430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297603+0000","last_change":"2024-04-25T00:50:35.722521+0000","last_active":"2024-04-25T00:50:37.297603+0000","last_peered":"2024-04-25T00:50:37.297603+0000","last_clean":"2024-04-25T00:50:37.297603+0000","last_became_active":"2024-04-25T00:50:35.722128+0000","last_became_peered":"2024-04-25T00:50:35.722128+0000","last_unstale":"2024-04-25T00:50:37.297603+0000","last_undegraded":"2024-04-25T00:50:37.297603+0000","last_fullsized":"2024-04-25T00:50:37.297603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:59:36.793140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.097140+0000","last_change":"2024-04-25T00:50:33.387402+0000","last_active":"2024-04-25T00:50:50.097140+0000","last_peered":"2024-04-25T00:50:50.097140+0000","last_clean":"2024-04-25T00:50:50.097140+0000","last_became_active":"2024-04-25T00:50:33.386631+0000","last_became_peered":"2024-04-25T00:50:33.386631+0000","last_unstale":"2024-04-25T00:50:50.097140+0000","last_undegraded":"2024-04-25T00:50:50.097140+0000","last_fullsized":"2024-04-25T00:50:50.097140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:11:49.105412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389751+0000","last_change":"2024-04-25T00:50:35.882715+0000","last_active":"2024-04-25T00:50:37.389751+0000","last_peered":"2024-04-25T00:50:37.389751+0000","last_clean":"2024-04-25T00:50:37.389751+0000","last_became_active":"2024-04-25T00:50:35.878416+0000","last_became_peered":"2024-04-25T00:50:35.878416+0000","last_unstale":"2024-04-25T00:50:37.389751+0000","last_undegraded":"2024-04-25T00:50:37.389751+0000","last_fullsized":"2024-04-25T00:50:37.389751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:35.413796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.456143+0000","last_change":"2024-04-25T00:50:33.393211+0000","last_active":"2024-04-25T00:50:43.456143+0000","last_peered":"2024-04-25T00:50:43.456143+0000","last_clean":"2024-04-25T00:50:43.456143+0000","last_became_active":"2024-04-25T00:50:33.392381+0000","last_became_peered":"2024-04-25T00:50:33.392381+0000","last_unstale":"2024-04-25T00:50:43.456143+0000","last_undegraded":"2024-04-25T00:50:43.456143+0000","last_fullsized":"2024-04-25T00:50:43.456143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:18:05.276269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107930+0000","last_change":"2024-04-25T00:50:35.798491+0000","last_active":"2024-04-25T00:50:38.107930+0000","last_peered":"2024-04-25T00:50:38.107930+0000","last_clean":"2024-04-25T00:50:38.107930+0000","last_became_active":"2024-04-25T00:50:35.796775+0000","last_became_peered":"2024-04-25T00:50:35.796775+0000","last_unstale":"2024-04-25T00:50:38.107930+0000","last_undegraded":"2024-04-25T00:50:38.107930+0000","last_fullsized":"2024-04-25T00:50:38.107930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:54.948867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.280018+0000","last_change":"2024-04-25T00:50:33.321163+0000","last_active":"2024-04-25T00:50:43.280018+0000","last_peered":"2024-04-25T00:50:43.280018+0000","last_clean":"2024-04-25T00:50:43.280018+0000","last_became_active":"2024-04-25T00:50:33.320554+0000","last_became_peered":"2024-04-25T00:50:33.320554+0000","last_unstale":"2024-04-25T00:50:43.280018+0000","last_undegraded":"2024-04-25T00:50:43.280018+0000","last_fullsized":"2024-04-25T00:50:43.280018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:13.533462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.248575+0000","last_change":"2024-04-25T00:50:35.824154+0000","last_active":"2024-04-25T00:50:37.248575+0000","last_peered":"2024-04-25T00:50:37.248575+0000","last_clean":"2024-04-25T00:50:37.248575+0000","last_became_active":"2024-04-25T00:50:35.823269+0000","last_became_peered":"2024-04-25T00:50:35.823269+0000","last_unstale":"2024-04-25T00:50:37.248575+0000","last_undegraded":"2024-04-25T00:50:37.248575+0000","last_fullsized":"2024-04-25T00:50:37.248575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:16.208624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.518358+0000","last_change":"2024-04-25T00:50:33.319985+0000","last_active":"2024-04-25T00:50:43.518358+0000","last_peered":"2024-04-25T00:50:43.518358+0000","last_clean":"2024-04-25T00:50:43.518358+0000","last_became_active":"2024-04-25T00:50:33.319198+0000","last_became_peered":"2024-04-25T00:50:33.319198+0000","last_unstale":"2024-04-25T00:50:43.518358+0000","last_undegraded":"2024-04-25T00:50:43.518358+0000","last_fullsized":"2024-04-25T00:50:43.518358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:01.398188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388961+0000","last_change":"2024-04-25T00:50:35.883007+0000","last_active":"2024-04-25T00:50:37.388961+0000","last_peered":"2024-04-25T00:50:37.388961+0000","last_clean":"2024-04-25T00:50:37.388961+0000","last_became_active":"2024-04-25T00:50:35.881829+0000","last_became_peered":"2024-04-25T00:50:35.881829+0000","last_unstale":"2024-04-25T00:50:37.388961+0000","last_undegraded":"2024-04-25T00:50:37.388961+0000","last_fullsized":"2024-04-25T00:50:37.388961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:02.444745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297545+0000","last_change":"2024-04-25T00:50:33.384397+0000","last_active":"2024-04-25T00:50:37.297545+0000","last_peered":"2024-04-25T00:50:37.297545+0000","last_clean":"2024-04-25T00:50:37.297545+0000","last_became_active":"2024-04-25T00:50:33.383622+0000","last_became_peered":"2024-04-25T00:50:33.383622+0000","last_unstale":"2024-04-25T00:50:37.297545+0000","last_undegraded":"2024-04-25T00:50:37.297545+0000","last_fullsized":"2024-04-25T00:50:37.297545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:31.816914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389114+0000","last_change":"2024-04-25T00:50:35.881976+0000","last_active":"2024-04-25T00:50:37.389114+0000","last_peered":"2024-04-25T00:50:37.389114+0000","last_clean":"2024-04-25T00:50:37.389114+0000","last_became_active":"2024-04-25T00:50:35.881269+0000","last_became_peered":"2024-04-25T00:50:35.881269+0000","last_unstale":"2024-04-25T00:50:37.389114+0000","last_undegraded":"2024-04-25T00:50:37.389114+0000","last_fullsized":"2024-04-25T00:50:37.389114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:54.302741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.279813+0000","last_change":"2024-04-25T00:50:33.390041+0000","last_active":"2024-04-25T00:50:43.279813+0000","last_peered":"2024-04-25T00:50:43.279813+0000","last_clean":"2024-04-25T00:50:43.279813+0000","last_became_active":"2024-04-25T00:50:33.389095+0000","last_became_peered":"2024-04-25T00:50:33.389095+0000","last_unstale":"2024-04-25T00:50:43.279813+0000","last_undegraded":"2024-04-25T00:50:43.279813+0000","last_fullsized":"2024-04-25T00:50:43.279813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:00.569613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363413+0000","last_change":"2024-04-25T00:50:35.812195+0000","last_active":"2024-04-25T00:50:37.363413+0000","last_peered":"2024-04-25T00:50:37.363413+0000","last_clean":"2024-04-25T00:50:37.363413+0000","last_became_active":"2024-04-25T00:50:35.811410+0000","last_became_peered":"2024-04-25T00:50:35.811410+0000","last_unstale":"2024-04-25T00:50:37.363413+0000","last_undegraded":"2024-04-25T00:50:37.363413+0000","last_fullsized":"2024-04-25T00:50:37.363413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:06.596770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232746+0000","last_change":"2024-04-25T00:50:35.821808+0000","last_active":"2024-04-25T00:50:37.232746+0000","last_peered":"2024-04-25T00:50:37.232746+0000","last_clean":"2024-04-25T00:50:37.232746+0000","last_became_active":"2024-04-25T00:50:35.821062+0000","last_became_peered":"2024-04-25T00:50:35.821062+0000","last_unstale":"2024-04-25T00:50:37.232746+0000","last_undegraded":"2024-04-25T00:50:37.232746+0000","last_fullsized":"2024-04-25T00:50:37.232746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.328036+0000","last_change":"2024-04-25T00:50:33.319853+0000","last_active":"2024-04-25T00:50:38.328036+0000","last_peered":"2024-04-25T00:50:38.328036+0000","last_clean":"2024-04-25T00:50:38.328036+0000","last_became_active":"2024-04-25T00:50:33.319197+0000","last_became_peered":"2024-04-25T00:50:33.319197+0000","last_unstale":"2024-04-25T00:50:38.328036+0000","last_undegraded":"2024-04-25T00:50:38.328036+0000","last_fullsized":"2024-04-25T00:50:38.328036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:24.834556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232234+0000","last_change":"2024-04-25T00:50:35.812044+0000","last_active":"2024-04-25T00:50:37.232234+0000","last_peered":"2024-04-25T00:50:37.232234+0000","last_clean":"2024-04-25T00:50:37.232234+0000","last_became_active":"2024-04-25T00:50:35.811281+0000","last_became_peered":"2024-04-25T00:50:35.811281+0000","last_unstale":"2024-04-25T00:50:37.232234+0000","last_undegraded":"2024-04-25T00:50:37.232234+0000","last_fullsized":"2024-04-25T00:50:37.232234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:28.655307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.169482+0000","last_change":"2024-04-25T00:50:33.382775+0000","last_active":"2024-04-25T00:50:50.169482+0000","last_peered":"2024-04-25T00:50:50.169482+0000","last_clean":"2024-04-25T00:50:50.169482+0000","last_became_active":"2024-04-25T00:50:33.382218+0000","last_became_peered":"2024-04-25T00:50:33.382218+0000","last_unstale":"2024-04-25T00:50:50.169482+0000","last_undegraded":"2024-04-25T00:50:50.169482+0000","last_fullsized":"2024-04-25T00:50:50.169482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:52.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107894+0000","last_change":"2024-04-25T00:50:35.802543+0000","last_active":"2024-04-25T00:50:38.107894+0000","last_peered":"2024-04-25T00:50:38.107894+0000","last_clean":"2024-04-25T00:50:38.107894+0000","last_became_active":"2024-04-25T00:50:35.801799+0000","last_became_peered":"2024-04-25T00:50:35.801799+0000","last_unstale":"2024-04-25T00:50:38.107894+0000","last_undegraded":"2024-04-25T00:50:38.107894+0000","last_fullsized":"2024-04-25T00:50:38.107894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:15.875347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.457996+0000","last_change":"2024-04-25T00:50:33.389565+0000","last_active":"2024-04-25T00:50:38.457996+0000","last_peered":"2024-04-25T00:50:38.457996+0000","last_clean":"2024-04-25T00:50:38.457996+0000","last_became_active":"2024-04-25T00:50:33.388773+0000","last_became_peered":"2024-04-25T00:50:33.388773+0000","last_unstale":"2024-04-25T00:50:38.457996+0000","last_undegraded":"2024-04-25T00:50:38.457996+0000","last_fullsized":"2024-04-25T00:50:38.457996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:42.721375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389537+0000","last_change":"2024-04-25T00:50:35.877410+0000","last_active":"2024-04-25T00:50:37.389537+0000","last_peered":"2024-04-25T00:50:37.389537+0000","last_clean":"2024-04-25T00:50:37.389537+0000","last_became_active":"2024-04-25T00:50:35.876576+0000","last_became_peered":"2024-04-25T00:50:35.876576+0000","last_unstale":"2024-04-25T00:50:37.389537+0000","last_undegraded":"2024-04-25T00:50:37.389537+0000","last_fullsized":"2024-04-25T00:50:37.389537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:15.762503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"26'9","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.251818+0000","last_change":"2024-04-25T00:50:33.319601+0000","last_active":"2024-04-25T00:50:50.251818+0000","last_peered":"2024-04-25T00:50:50.251818+0000","last_clean":"2024-04-25T00:50:50.251818+0000","last_became_active":"2024-04-25T00:50:33.318940+0000","last_became_peered":"2024-04-25T00:50:33.318940+0000","last_unstale":"2024-04-25T00:50:50.251818+0000","last_undegraded":"2024-04-25T00:50:50.251818+0000","last_fullsized":"2024-04-25T00:50:50.251818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:41.175588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5222,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":10444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476754,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":880640,"data_stored":687875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476754,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":98481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476754,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":97569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476752,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":96905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476753,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":97009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":98515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":876544,"data_stored":687219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542160,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":290816,"data_stored":97135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T00:50:55.714 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T00:50:55.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.865+0000 7f350b57f640 1 Processor -- start 2024-04-25T00:50:55.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.865+0000 7f350b57f640 1 -- start start 2024-04-25T00:50:55.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.865+0000 7f350b57f640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f35040c9bc0 0x7f350415aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:55.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.865+0000 7f350b57f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35040c75b0 0x7f35040c7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:55.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.865+0000 7f350b57f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35040c7f80 con 0x7f35040c8ac0 2024-04-25T00:50:55.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.865+0000 7f350b57f640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f350415da60 con 0x7f35040c9bc0 2024-04-25T00:50:55.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.865+0000 7f350b57f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f35040ca030 con 0x7f35040c75b0 2024-04-25T00:50:55.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.869+0000 7f3508b1a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f35040c9bc0 0x7f350415aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:55.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.869+0000 7f3508b1a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f35040c9bc0 0x7f350415aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:60642/0 (socket says 172.21.15.162:60642) 2024-04-25T00:50:55.870 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.869+0000 7f3508b1a640 1 -- 172.21.15.162:0/3965999679 learned_addr learned my addr 172.21.15.162:0/3965999679 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:55.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.873+0000 7f3508b1a640 1 -- 172.21.15.162:0/3965999679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35040c75b0 msgr2=0x7f35040c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:55.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.873+0000 7f3508b1a640 1 --2- 172.21.15.162:0/3965999679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35040c75b0 0x7f35040c7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.873+0000 7f3508b1a640 1 -- 172.21.15.162:0/3965999679 >> v1:172.21.15.179:6789/0 conn(0x7f35040c8ac0 legacy=0x7f350406b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:55.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.873+0000 7f3508b1a640 1 -- 172.21.15.162:0/3965999679 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f350415dc90 con 0x7f35040c9bc0 2024-04-25T00:50:55.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.881+0000 7f3508b1a640 1 --2- 172.21.15.162:0/3965999679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35040c9bc0 0x7f350415aef0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f34f40098a0 tx=0x7f34f401ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3680926b8c1810c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:55.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.893+0000 7f34fbfff640 1 -- 172.21.15.162:0/3965999679 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f40b5070 con 0x7f35040c9bc0 2024-04-25T00:50:55.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.893+0000 7f34fbfff640 1 -- 172.21.15.162:0/3965999679 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f40a89b0 con 0x7f35040c9bc0 2024-04-25T00:50:55.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.893+0000 7f34fbfff640 1 -- 172.21.15.162:0/3965999679 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f40a8d80 con 0x7f35040c9bc0 2024-04-25T00:50:55.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.897+0000 7f350b57f640 1 -- 172.21.15.162:0/3965999679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35040c9bc0 msgr2=0x7f350415aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:55.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.897+0000 7f350b57f640 1 --2- 172.21.15.162:0/3965999679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35040c9bc0 0x7f350415aef0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f34f40098a0 tx=0x7f34f401ecf0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.897+0000 7f350b57f640 1 -- 172.21.15.162:0/3965999679 shutdown_connections 2024-04-25T00:50:55.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.897+0000 7f350b57f640 1 --2- 172.21.15.162:0/3965999679 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35040c75b0 0x7f35040c7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.897+0000 7f350b57f640 1 --2- 172.21.15.162:0/3965999679 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35040c9bc0 0x7f350415aef0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.897+0000 7f350b57f640 1 -- 172.21.15.162:0/3965999679 >> 172.21.15.162:0/3965999679 conn(0x7f3504070350 msgr2=0x7f3504070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:55.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.897+0000 7f350b57f640 1 -- 172.21.15.162:0/3965999679 shutdown_connections 2024-04-25T00:50:55.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.897+0000 7f350b57f640 1 -- 172.21.15.162:0/3965999679 wait complete. 2024-04-25T00:50:55.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.897+0000 7f350b57f640 1 Processor -- start 2024-04-25T00:50:55.900 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.897+0000 7f350b57f640 1 -- start start 2024-04-25T00:50:55.901 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.901+0000 7f350b57f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35040c75b0 0x7f35041e5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:55.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.901+0000 7f350b57f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35040c8ac0 0x7f350415c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:55.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.901+0000 7f350b57f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35040c9bc0 0x7f350415cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:55.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.901+0000 7f350b57f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f350415e530 con 0x7f35040c8ac0 2024-04-25T00:50:55.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.901+0000 7f350b57f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f350415e250 con 0x7f35040c9bc0 2024-04-25T00:50:55.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.901+0000 7f350b57f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f350415e810 con 0x7f35040c75b0 2024-04-25T00:50:55.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.901+0000 7f3508b1a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35040c8ac0 0x7f350415c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:55.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.901+0000 7f3508b1a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35040c8ac0 0x7f350415c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40226/0 (socket says 172.21.15.162:40226) 2024-04-25T00:50:55.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.901+0000 7f3508b1a640 1 -- 172.21.15.162:0/3065126969 learned_addr learned my addr 172.21.15.162:0/3065126969 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:55.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.901+0000 7f3509b1c640 1 --2- 172.21.15.162:0/3065126969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35040c9bc0 0x7f350415cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:55.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.905+0000 7f3508b1a640 1 -- 172.21.15.162:0/3065126969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35040c75b0 msgr2=0x7f35041e5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:55.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.905+0000 7f3508b1a640 1 --2- 172.21.15.162:0/3065126969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35040c75b0 0x7f35041e5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.905+0000 7f3508b1a640 1 -- 172.21.15.162:0/3065126969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35040c9bc0 msgr2=0x7f350415cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:55.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.905+0000 7f3508b1a640 1 --2- 172.21.15.162:0/3065126969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35040c9bc0 0x7f350415cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:55.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.905+0000 7f3508b1a640 1 -- 172.21.15.162:0/3065126969 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35041f0dd0 con 0x7f35040c8ac0 2024-04-25T00:50:55.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.909+0000 7f3508b1a640 1 --2- 172.21.15.162:0/3065126969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35040c8ac0 0x7f350415c9c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f34f401f590 tx=0x7f34f401ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:55.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.913+0000 7f34f9ffb640 1 -- 172.21.15.162:0/3065126969 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f40b5040 con 0x7f35040c8ac0 2024-04-25T00:50:55.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.913+0000 7f34f9ffb640 1 -- 172.21.15.162:0/3065126969 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34f40be070 con 0x7f35040c8ac0 2024-04-25T00:50:55.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.913+0000 7f350b57f640 1 -- 172.21.15.162:0/3065126969 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35041f1090 con 0x7f35040c8ac0 2024-04-25T00:50:55.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.913+0000 7f34f9ffb640 1 -- 172.21.15.162:0/3065126969 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34f40b0aa0 con 0x7f35040c8ac0 2024-04-25T00:50:55.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.913+0000 7f350b57f640 1 -- 172.21.15.162:0/3065126969 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f350415bee0 con 0x7f35040c8ac0 2024-04-25T00:50:55.917 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:55.917+0000 7f350b57f640 1 -- 172.21.15.162:0/3065126969 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f350404f5f0 con 0x7f35040c8ac0 2024-04-25T00:50:56.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.189+0000 7f34f9ffb640 1 -- 172.21.15.162:0/3065126969 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f34f40b0c40 con 0x7f35040c8ac0 2024-04-25T00:50:56.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.189+0000 7f34f9ffb640 1 --2- 172.21.15.162:0/3065126969 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f34e80678f0 0x7f34e8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:56.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.189+0000 7f350931b640 1 --2- 172.21.15.162:0/3065126969 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f34e80678f0 0x7f34e8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:56.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.189+0000 7f350931b640 1 --2- 172.21.15.162:0/3065126969 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f34e80678f0 0x7f34e8069db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3500003cf0 tx=0x7f35000079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:56.228 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.225+0000 7f34f9ffb640 1 -- 172.21.15.162:0/3065126969 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f34f40f20e0 con 0x7f35040c8ac0 2024-04-25T00:50:56.228 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.225+0000 7f34f9ffb640 1 -- 172.21.15.162:0/3065126969 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f34f4018850 con 0x7f35040c8ac0 2024-04-25T00:50:56.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.393+0000 7f350b57f640 1 -- 172.21.15.162:0/3065126969 --> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f35040729b0 con 0x7f34e80678f0 2024-04-25T00:50:56.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.401+0000 7f34f9ffb640 1 -- 172.21.15.162:0/3065126969 <== mgr.4100 v2:172.21.15.162:6800/3960394531 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251891 (secure 0 0 0) 0x7f35040729b0 con 0x7f34e80678f0 2024-04-25T00:50:56.407 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:56.408 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-04-25T00:50:56.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.405+0000 7f350b57f640 1 -- 172.21.15.162:0/3065126969 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f34e80678f0 msgr2=0x7f34e8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:56.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.405+0000 7f350b57f640 1 --2- 172.21.15.162:0/3065126969 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f34e80678f0 0x7f34e8069db0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3500003cf0 tx=0x7f35000079c0 comp rx=0 tx=0).stop 2024-04-25T00:50:56.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.405+0000 7f350b57f640 1 -- 172.21.15.162:0/3065126969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35040c8ac0 msgr2=0x7f350415c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:56.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.405+0000 7f350b57f640 1 --2- 172.21.15.162:0/3065126969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35040c8ac0 0x7f350415c9c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f34f401f590 tx=0x7f34f401ba90 comp rx=0 tx=0).stop 2024-04-25T00:50:56.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.405+0000 7f350b57f640 1 -- 172.21.15.162:0/3065126969 shutdown_connections 2024-04-25T00:50:56.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.405+0000 7f350b57f640 1 --2- 172.21.15.162:0/3065126969 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f35040c9bc0 0x7f350415cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:56.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.405+0000 7f350b57f640 1 --2- 172.21.15.162:0/3065126969 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f34e80678f0 0x7f34e8069db0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:56.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.405+0000 7f350b57f640 1 --2- 172.21.15.162:0/3065126969 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f35040c8ac0 0x7f350415c9c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:56.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.405+0000 7f350b57f640 1 --2- 172.21.15.162:0/3065126969 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f35040c75b0 0x7f35041e5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:56.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.405+0000 7f350b57f640 1 -- 172.21.15.162:0/3065126969 >> 172.21.15.162:0/3065126969 conn(0x7f3504070350 msgr2=0x7f3504070730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:56.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.405+0000 7f350b57f640 1 -- 172.21.15.162:0/3065126969 shutdown_connections 2024-04-25T00:50:56.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.405+0000 7f350b57f640 1 -- 172.21.15.162:0/3065126969 wait complete. 2024-04-25T00:50:56.428 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-04-25T00:50:55.873249+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595590,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":283,"num_write_kb":2454,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":225,"ondisk_log_size":225,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223688,"kb_used_data":3400,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751032,"statfs":{"total":773094113280,"available":772865056768,"internally_reserved":0,"allocated":3481600,"data_stored":1960708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2812,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":80,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005138"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109574+0000","last_change":"2024-04-25T00:50:35.761428+0000","last_active":"2024-04-25T00:50:38.109574+0000","last_peered":"2024-04-25T00:50:38.109574+0000","last_clean":"2024-04-25T00:50:38.109574+0000","last_became_active":"2024-04-25T00:50:35.760579+0000","last_became_peered":"2024-04-25T00:50:35.760579+0000","last_unstale":"2024-04-25T00:50:38.109574+0000","last_undegraded":"2024-04-25T00:50:38.109574+0000","last_fullsized":"2024-04-25T00:50:38.109574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:06.236972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297768+0000","last_change":"2024-04-25T00:50:35.798137+0000","last_active":"2024-04-25T00:50:37.297768+0000","last_peered":"2024-04-25T00:50:37.297768+0000","last_clean":"2024-04-25T00:50:37.297768+0000","last_became_active":"2024-04-25T00:50:35.797354+0000","last_became_peered":"2024-04-25T00:50:35.797354+0000","last_unstale":"2024-04-25T00:50:37.297768+0000","last_undegraded":"2024-04-25T00:50:37.297768+0000","last_fullsized":"2024-04-25T00:50:37.297768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:29:18.970287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107728+0000","last_change":"2024-04-25T00:50:35.799370+0000","last_active":"2024-04-25T00:50:38.107728+0000","last_peered":"2024-04-25T00:50:38.107728+0000","last_clean":"2024-04-25T00:50:38.107728+0000","last_became_active":"2024-04-25T00:50:35.798268+0000","last_became_peered":"2024-04-25T00:50:35.798268+0000","last_unstale":"2024-04-25T00:50:38.107728+0000","last_undegraded":"2024-04-25T00:50:38.107728+0000","last_fullsized":"2024-04-25T00:50:38.107728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:27.176441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231768+0000","last_change":"2024-04-25T00:50:35.877965+0000","last_active":"2024-04-25T00:50:37.231768+0000","last_peered":"2024-04-25T00:50:37.231768+0000","last_clean":"2024-04-25T00:50:37.231768+0000","last_became_active":"2024-04-25T00:50:35.877114+0000","last_became_peered":"2024-04-25T00:50:35.877114+0000","last_unstale":"2024-04-25T00:50:37.231768+0000","last_undegraded":"2024-04-25T00:50:37.231768+0000","last_fullsized":"2024-04-25T00:50:37.231768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:20.857588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108773+0000","last_change":"2024-04-25T00:50:35.730647+0000","last_active":"2024-04-25T00:50:38.108773+0000","last_peered":"2024-04-25T00:50:38.108773+0000","last_clean":"2024-04-25T00:50:38.108773+0000","last_became_active":"2024-04-25T00:50:35.729785+0000","last_became_peered":"2024-04-25T00:50:35.729785+0000","last_unstale":"2024-04-25T00:50:38.108773+0000","last_undegraded":"2024-04-25T00:50:38.108773+0000","last_fullsized":"2024-04-25T00:50:38.108773+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:02.888747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231805+0000","last_change":"2024-04-25T00:50:35.800071+0000","last_active":"2024-04-25T00:50:37.231805+0000","last_peered":"2024-04-25T00:50:37.231805+0000","last_clean":"2024-04-25T00:50:37.231805+0000","last_became_active":"2024-04-25T00:50:35.799390+0000","last_became_peered":"2024-04-25T00:50:35.799390+0000","last_unstale":"2024-04-25T00:50:37.231805+0000","last_undegraded":"2024-04-25T00:50:37.231805+0000","last_fullsized":"2024-04-25T00:50:37.231805+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:16.817860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109329+0000","last_change":"2024-04-25T00:50:35.797990+0000","last_active":"2024-04-25T00:50:38.109329+0000","last_peered":"2024-04-25T00:50:38.109329+0000","last_clean":"2024-04-25T00:50:38.109329+0000","last_became_active":"2024-04-25T00:50:35.797328+0000","last_became_peered":"2024-04-25T00:50:35.797328+0000","last_unstale":"2024-04-25T00:50:38.109329+0000","last_undegraded":"2024-04-25T00:50:38.109329+0000","last_fullsized":"2024-04-25T00:50:38.109329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:59.565909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388780+0000","last_change":"2024-04-25T00:50:35.878367+0000","last_active":"2024-04-25T00:50:37.388780+0000","last_peered":"2024-04-25T00:50:37.388780+0000","last_clean":"2024-04-25T00:50:37.388780+0000","last_became_active":"2024-04-25T00:50:35.877581+0000","last_became_peered":"2024-04-25T00:50:35.877581+0000","last_unstale":"2024-04-25T00:50:37.388780+0000","last_undegraded":"2024-04-25T00:50:37.388780+0000","last_fullsized":"2024-04-25T00:50:37.388780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:53.695907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109701+0000","last_change":"2024-04-25T00:50:35.734161+0000","last_active":"2024-04-25T00:50:38.109701+0000","last_peered":"2024-04-25T00:50:38.109701+0000","last_clean":"2024-04-25T00:50:38.109701+0000","last_became_active":"2024-04-25T00:50:35.733546+0000","last_became_peered":"2024-04-25T00:50:35.733546+0000","last_unstale":"2024-04-25T00:50:38.109701+0000","last_undegraded":"2024-04-25T00:50:38.109701+0000","last_fullsized":"2024-04-25T00:50:38.109701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:24:43.171432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.364156+0000","last_change":"2024-04-25T00:50:35.765173+0000","last_active":"2024-04-25T00:50:37.364156+0000","last_peered":"2024-04-25T00:50:37.364156+0000","last_clean":"2024-04-25T00:50:37.364156+0000","last_became_active":"2024-04-25T00:50:35.764412+0000","last_became_peered":"2024-04-25T00:50:35.764412+0000","last_unstale":"2024-04-25T00:50:37.364156+0000","last_undegraded":"2024-04-25T00:50:37.364156+0000","last_fullsized":"2024-04-25T00:50:37.364156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:54.948867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363747+0000","last_change":"2024-04-25T00:50:35.764526+0000","last_active":"2024-04-25T00:50:37.363747+0000","last_peered":"2024-04-25T00:50:37.363747+0000","last_clean":"2024-04-25T00:50:37.363747+0000","last_became_active":"2024-04-25T00:50:35.763770+0000","last_became_peered":"2024-04-25T00:50:35.763770+0000","last_unstale":"2024-04-25T00:50:37.363747+0000","last_undegraded":"2024-04-25T00:50:37.363747+0000","last_fullsized":"2024-04-25T00:50:37.363747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:15.698294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.249512+0000","last_change":"2024-04-25T00:50:35.822113+0000","last_active":"2024-04-25T00:50:37.249512+0000","last_peered":"2024-04-25T00:50:37.249512+0000","last_clean":"2024-04-25T00:50:37.249512+0000","last_became_active":"2024-04-25T00:50:35.821524+0000","last_became_peered":"2024-04-25T00:50:35.821524+0000","last_unstale":"2024-04-25T00:50:37.249512+0000","last_undegraded":"2024-04-25T00:50:37.249512+0000","last_fullsized":"2024-04-25T00:50:37.249512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:43.722114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388885+0000","last_change":"2024-04-25T00:50:35.881637+0000","last_active":"2024-04-25T00:50:37.388885+0000","last_peered":"2024-04-25T00:50:37.388885+0000","last_clean":"2024-04-25T00:50:37.388885+0000","last_became_active":"2024-04-25T00:50:35.880661+0000","last_became_peered":"2024-04-25T00:50:35.880661+0000","last_unstale":"2024-04-25T00:50:37.388885+0000","last_undegraded":"2024-04-25T00:50:37.388885+0000","last_fullsized":"2024-04-25T00:50:37.388885+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:39.862610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.106989+0000","last_change":"2024-04-25T00:50:35.796996+0000","last_active":"2024-04-25T00:50:38.106989+0000","last_peered":"2024-04-25T00:50:38.106989+0000","last_clean":"2024-04-25T00:50:38.106989+0000","last_became_active":"2024-04-25T00:50:35.795295+0000","last_became_peered":"2024-04-25T00:50:35.795295+0000","last_unstale":"2024-04-25T00:50:38.106989+0000","last_undegraded":"2024-04-25T00:50:38.106989+0000","last_fullsized":"2024-04-25T00:50:38.106989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:29.858476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297189+0000","last_change":"2024-04-25T00:50:35.818291+0000","last_active":"2024-04-25T00:50:37.297189+0000","last_peered":"2024-04-25T00:50:37.297189+0000","last_clean":"2024-04-25T00:50:37.297189+0000","last_became_active":"2024-04-25T00:50:35.817575+0000","last_became_peered":"2024-04-25T00:50:35.817575+0000","last_unstale":"2024-04-25T00:50:37.297189+0000","last_undegraded":"2024-04-25T00:50:37.297189+0000","last_fullsized":"2024-04-25T00:50:37.297189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:51.142494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231455+0000","last_change":"2024-04-25T00:50:35.797194+0000","last_active":"2024-04-25T00:50:37.231455+0000","last_peered":"2024-04-25T00:50:37.231455+0000","last_clean":"2024-04-25T00:50:37.231455+0000","last_became_active":"2024-04-25T00:50:35.796536+0000","last_became_peered":"2024-04-25T00:50:35.796536+0000","last_unstale":"2024-04-25T00:50:37.231455+0000","last_undegraded":"2024-04-25T00:50:37.231455+0000","last_fullsized":"2024-04-25T00:50:37.231455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:48:27.210535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.233251+0000","last_change":"2024-04-25T00:50:35.729648+0000","last_active":"2024-04-25T00:50:37.233251+0000","last_peered":"2024-04-25T00:50:37.233251+0000","last_clean":"2024-04-25T00:50:37.233251+0000","last_became_active":"2024-04-25T00:50:35.728875+0000","last_became_peered":"2024-04-25T00:50:35.728875+0000","last_unstale":"2024-04-25T00:50:37.233251+0000","last_undegraded":"2024-04-25T00:50:37.233251+0000","last_fullsized":"2024-04-25T00:50:37.233251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:46.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.106981+0000","last_change":"2024-04-25T00:50:35.760953+0000","last_active":"2024-04-25T00:50:38.106981+0000","last_peered":"2024-04-25T00:50:38.106981+0000","last_clean":"2024-04-25T00:50:38.106981+0000","last_became_active":"2024-04-25T00:50:35.760286+0000","last_became_peered":"2024-04-25T00:50:35.760286+0000","last_unstale":"2024-04-25T00:50:38.106981+0000","last_undegraded":"2024-04-25T00:50:38.106981+0000","last_fullsized":"2024-04-25T00:50:38.106981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:57.466393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109462+0000","last_change":"2024-04-25T00:50:35.732837+0000","last_active":"2024-04-25T00:50:38.109462+0000","last_peered":"2024-04-25T00:50:38.109462+0000","last_clean":"2024-04-25T00:50:38.109462+0000","last_became_active":"2024-04-25T00:50:35.732134+0000","last_became_peered":"2024-04-25T00:50:35.732134+0000","last_unstale":"2024-04-25T00:50:38.109462+0000","last_undegraded":"2024-04-25T00:50:38.109462+0000","last_fullsized":"2024-04-25T00:50:38.109462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:46.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363854+0000","last_change":"2024-04-25T00:50:35.818607+0000","last_active":"2024-04-25T00:50:37.363854+0000","last_peered":"2024-04-25T00:50:37.363854+0000","last_clean":"2024-04-25T00:50:37.363854+0000","last_became_active":"2024-04-25T00:50:35.818063+0000","last_became_peered":"2024-04-25T00:50:35.818063+0000","last_unstale":"2024-04-25T00:50:37.363854+0000","last_undegraded":"2024-04-25T00:50:37.363854+0000","last_fullsized":"2024-04-25T00:50:37.363854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:15.875347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107633+0000","last_change":"2024-04-25T00:50:35.798297+0000","last_active":"2024-04-25T00:50:38.107633+0000","last_peered":"2024-04-25T00:50:38.107633+0000","last_clean":"2024-04-25T00:50:38.107633+0000","last_became_active":"2024-04-25T00:50:35.797580+0000","last_became_peered":"2024-04-25T00:50:35.797580+0000","last_unstale":"2024-04-25T00:50:38.107633+0000","last_undegraded":"2024-04-25T00:50:38.107633+0000","last_fullsized":"2024-04-25T00:50:38.107633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:06.596770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231785+0000","last_change":"2024-04-25T00:50:35.729396+0000","last_active":"2024-04-25T00:50:37.231785+0000","last_peered":"2024-04-25T00:50:37.231785+0000","last_clean":"2024-04-25T00:50:37.231785+0000","last_became_active":"2024-04-25T00:50:35.728620+0000","last_became_peered":"2024-04-25T00:50:35.728620+0000","last_unstale":"2024-04-25T00:50:37.231785+0000","last_undegraded":"2024-04-25T00:50:37.231785+0000","last_fullsized":"2024-04-25T00:50:37.231785+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:02.911498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389017+0000","last_change":"2024-04-25T00:50:35.877261+0000","last_active":"2024-04-25T00:50:37.389017+0000","last_peered":"2024-04-25T00:50:37.389017+0000","last_clean":"2024-04-25T00:50:37.389017+0000","last_became_active":"2024-04-25T00:50:35.876489+0000","last_became_peered":"2024-04-25T00:50:35.876489+0000","last_unstale":"2024-04-25T00:50:37.389017+0000","last_undegraded":"2024-04-25T00:50:37.389017+0000","last_fullsized":"2024-04-25T00:50:37.389017+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:14:31.440563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231553+0000","last_change":"2024-04-25T00:50:35.877693+0000","last_active":"2024-04-25T00:50:37.231553+0000","last_peered":"2024-04-25T00:50:37.231553+0000","last_clean":"2024-04-25T00:50:37.231553+0000","last_became_active":"2024-04-25T00:50:35.876870+0000","last_became_peered":"2024-04-25T00:50:35.876870+0000","last_unstale":"2024-04-25T00:50:37.231553+0000","last_undegraded":"2024-04-25T00:50:37.231553+0000","last_fullsized":"2024-04-25T00:50:37.231553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:53.474315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389593+0000","last_change":"2024-04-25T00:50:35.881027+0000","last_active":"2024-04-25T00:50:37.389593+0000","last_peered":"2024-04-25T00:50:37.389593+0000","last_clean":"2024-04-25T00:50:37.389593+0000","last_became_active":"2024-04-25T00:50:35.880477+0000","last_became_peered":"2024-04-25T00:50:35.880477+0000","last_unstale":"2024-04-25T00:50:37.389593+0000","last_undegraded":"2024-04-25T00:50:37.389593+0000","last_fullsized":"2024-04-25T00:50:37.389593+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:55:59.176935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.364221+0000","last_change":"2024-04-25T00:50:35.765295+0000","last_active":"2024-04-25T00:50:37.364221+0000","last_peered":"2024-04-25T00:50:37.364221+0000","last_clean":"2024-04-25T00:50:37.364221+0000","last_became_active":"2024-04-25T00:50:35.764358+0000","last_became_peered":"2024-04-25T00:50:35.764358+0000","last_unstale":"2024-04-25T00:50:37.364221+0000","last_undegraded":"2024-04-25T00:50:37.364221+0000","last_fullsized":"2024-04-25T00:50:37.364221+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:15.104631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297462+0000","last_change":"2024-04-25T00:50:35.869695+0000","last_active":"2024-04-25T00:50:37.297462+0000","last_peered":"2024-04-25T00:50:37.297462+0000","last_clean":"2024-04-25T00:50:37.297462+0000","last_became_active":"2024-04-25T00:50:35.868857+0000","last_became_peered":"2024-04-25T00:50:35.868857+0000","last_unstale":"2024-04-25T00:50:37.297462+0000","last_undegraded":"2024-04-25T00:50:37.297462+0000","last_fullsized":"2024-04-25T00:50:37.297462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:35:38.295580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389423+0000","last_change":"2024-04-25T00:50:35.884507+0000","last_active":"2024-04-25T00:50:37.389423+0000","last_peered":"2024-04-25T00:50:37.389423+0000","last_clean":"2024-04-25T00:50:37.389423+0000","last_became_active":"2024-04-25T00:50:35.883901+0000","last_became_peered":"2024-04-25T00:50:35.883901+0000","last_unstale":"2024-04-25T00:50:37.389423+0000","last_undegraded":"2024-04-25T00:50:37.389423+0000","last_fullsized":"2024-04-25T00:50:37.389423+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:40.533818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107794+0000","last_change":"2024-04-25T00:50:35.878649+0000","last_active":"2024-04-25T00:50:38.107794+0000","last_peered":"2024-04-25T00:50:38.107794+0000","last_clean":"2024-04-25T00:50:38.107794+0000","last_became_active":"2024-04-25T00:50:35.877870+0000","last_became_peered":"2024-04-25T00:50:35.877870+0000","last_unstale":"2024-04-25T00:50:38.107794+0000","last_undegraded":"2024-04-25T00:50:38.107794+0000","last_fullsized":"2024-04-25T00:50:38.107794+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232184+0000","last_change":"2024-04-25T00:50:35.869614+0000","last_active":"2024-04-25T00:50:37.232184+0000","last_peered":"2024-04-25T00:50:37.232184+0000","last_clean":"2024-04-25T00:50:37.232184+0000","last_became_active":"2024-04-25T00:50:35.869016+0000","last_became_peered":"2024-04-25T00:50:35.869016+0000","last_unstale":"2024-04-25T00:50:37.232184+0000","last_undegraded":"2024-04-25T00:50:37.232184+0000","last_fullsized":"2024-04-25T00:50:37.232184+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:02.888747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107611+0000","last_change":"2024-04-25T00:50:35.728757+0000","last_active":"2024-04-25T00:50:38.107611+0000","last_peered":"2024-04-25T00:50:38.107611+0000","last_clean":"2024-04-25T00:50:38.107611+0000","last_became_active":"2024-04-25T00:50:35.728271+0000","last_became_peered":"2024-04-25T00:50:35.728271+0000","last_unstale":"2024-04-25T00:50:38.107611+0000","last_undegraded":"2024-04-25T00:50:38.107611+0000","last_fullsized":"2024-04-25T00:50:38.107611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:43.722114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363386+0000","last_change":"2024-04-25T00:50:35.802347+0000","last_active":"2024-04-25T00:50:37.363386+0000","last_peered":"2024-04-25T00:50:37.363386+0000","last_clean":"2024-04-25T00:50:37.363386+0000","last_became_active":"2024-04-25T00:50:35.801389+0000","last_became_peered":"2024-04-25T00:50:35.801389+0000","last_unstale":"2024-04-25T00:50:37.363386+0000","last_undegraded":"2024-04-25T00:50:37.363386+0000","last_fullsized":"2024-04-25T00:50:37.363386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:27.176441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.248607+0000","last_change":"2024-04-25T00:50:35.822222+0000","last_active":"2024-04-25T00:50:37.248607+0000","last_peered":"2024-04-25T00:50:37.248607+0000","last_clean":"2024-04-25T00:50:37.248607+0000","last_became_active":"2024-04-25T00:50:35.821484+0000","last_became_peered":"2024-04-25T00:50:35.821484+0000","last_unstale":"2024-04-25T00:50:37.248607+0000","last_undegraded":"2024-04-25T00:50:37.248607+0000","last_fullsized":"2024-04-25T00:50:37.248607+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:59.921295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"26'5","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.280250+0000","last_change":"2024-04-25T00:50:33.391742+0000","last_active":"2024-04-25T00:50:43.280250+0000","last_peered":"2024-04-25T00:50:43.280250+0000","last_clean":"2024-04-25T00:50:43.280250+0000","last_became_active":"2024-04-25T00:50:33.390901+0000","last_became_peered":"2024-04-25T00:50:33.390901+0000","last_unstale":"2024-04-25T00:50:43.280250+0000","last_undegraded":"2024-04-25T00:50:43.280250+0000","last_fullsized":"2024-04-25T00:50:43.280250+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:27.804469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107862+0000","last_change":"2024-04-25T00:50:35.821496+0000","last_active":"2024-04-25T00:50:38.107862+0000","last_peered":"2024-04-25T00:50:38.107862+0000","last_clean":"2024-04-25T00:50:38.107862+0000","last_became_active":"2024-04-25T00:50:35.820763+0000","last_became_peered":"2024-04-25T00:50:35.820763+0000","last_unstale":"2024-04-25T00:50:38.107862+0000","last_undegraded":"2024-04-25T00:50:38.107862+0000","last_fullsized":"2024-04-25T00:50:38.107862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:15.698294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.247382+0000","last_change":"2024-04-25T00:50:33.394753+0000","last_active":"2024-04-25T00:50:50.247382+0000","last_peered":"2024-04-25T00:50:50.247382+0000","last_clean":"2024-04-25T00:50:50.247382+0000","last_became_active":"2024-04-25T00:50:33.392951+0000","last_became_peered":"2024-04-25T00:50:33.392951+0000","last_unstale":"2024-04-25T00:50:50.247382+0000","last_undegraded":"2024-04-25T00:50:50.247382+0000","last_fullsized":"2024-04-25T00:50:50.247382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:41.175588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.164261+0000","last_change":"2024-04-25T00:50:33.393229+0000","last_active":"2024-04-25T00:50:50.164261+0000","last_peered":"2024-04-25T00:50:50.164261+0000","last_clean":"2024-04-25T00:50:50.164261+0000","last_became_active":"2024-04-25T00:50:33.392817+0000","last_became_peered":"2024-04-25T00:50:33.392817+0000","last_unstale":"2024-04-25T00:50:50.164261+0000","last_undegraded":"2024-04-25T00:50:50.164261+0000","last_fullsized":"2024-04-25T00:50:50.164261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:31:12.131616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388809+0000","last_change":"2024-04-25T00:50:35.883390+0000","last_active":"2024-04-25T00:50:37.388809+0000","last_peered":"2024-04-25T00:50:37.388809+0000","last_clean":"2024-04-25T00:50:37.388809+0000","last_became_active":"2024-04-25T00:50:35.882509+0000","last_became_peered":"2024-04-25T00:50:35.882509+0000","last_unstale":"2024-04-25T00:50:37.388809+0000","last_undegraded":"2024-04-25T00:50:37.388809+0000","last_fullsized":"2024-04-25T00:50:37.388809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:05:17.996810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.231921+0000","last_change":"2024-04-25T00:50:33.383755+0000","last_active":"2024-04-25T00:50:37.231921+0000","last_peered":"2024-04-25T00:50:37.231921+0000","last_clean":"2024-04-25T00:50:37.231921+0000","last_became_active":"2024-04-25T00:50:33.382925+0000","last_became_peered":"2024-04-25T00:50:33.382925+0000","last_unstale":"2024-04-25T00:50:37.231921+0000","last_undegraded":"2024-04-25T00:50:37.231921+0000","last_fullsized":"2024-04-25T00:50:37.231921+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:52.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297234+0000","last_change":"2024-04-25T00:50:35.869794+0000","last_active":"2024-04-25T00:50:37.297234+0000","last_peered":"2024-04-25T00:50:37.297234+0000","last_clean":"2024-04-25T00:50:37.297234+0000","last_became_active":"2024-04-25T00:50:35.869028+0000","last_became_peered":"2024-04-25T00:50:35.869028+0000","last_unstale":"2024-04-25T00:50:37.297234+0000","last_undegraded":"2024-04-25T00:50:37.297234+0000","last_fullsized":"2024-04-25T00:50:37.297234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:49.891966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.457729+0000","last_change":"2024-04-25T00:50:33.394082+0000","last_active":"2024-04-25T00:50:43.457729+0000","last_peered":"2024-04-25T00:50:43.457729+0000","last_clean":"2024-04-25T00:50:43.457729+0000","last_became_active":"2024-04-25T00:50:33.392792+0000","last_became_peered":"2024-04-25T00:50:33.392792+0000","last_unstale":"2024-04-25T00:50:43.457729+0000","last_undegraded":"2024-04-25T00:50:43.457729+0000","last_fullsized":"2024-04-25T00:50:43.457729+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:35:15.441104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.233002+0000","last_change":"2024-04-25T00:50:35.729414+0000","last_active":"2024-04-25T00:50:37.233002+0000","last_peered":"2024-04-25T00:50:37.233002+0000","last_clean":"2024-04-25T00:50:37.233002+0000","last_became_active":"2024-04-25T00:50:35.728725+0000","last_became_peered":"2024-04-25T00:50:35.728725+0000","last_unstale":"2024-04-25T00:50:37.233002+0000","last_undegraded":"2024-04-25T00:50:37.233002+0000","last_fullsized":"2024-04-25T00:50:37.233002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:05.046355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.272521+0000","last_change":"2024-04-25T00:50:33.388191+0000","last_active":"2024-04-25T00:50:43.272521+0000","last_peered":"2024-04-25T00:50:43.272521+0000","last_clean":"2024-04-25T00:50:43.272521+0000","last_became_active":"2024-04-25T00:50:33.387266+0000","last_became_peered":"2024-04-25T00:50:33.387266+0000","last_unstale":"2024-04-25T00:50:43.272521+0000","last_undegraded":"2024-04-25T00:50:43.272521+0000","last_fullsized":"2024-04-25T00:50:43.272521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:08.400693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108034+0000","last_change":"2024-04-25T00:50:35.799783+0000","last_active":"2024-04-25T00:50:38.108034+0000","last_peered":"2024-04-25T00:50:38.108034+0000","last_clean":"2024-04-25T00:50:38.108034+0000","last_became_active":"2024-04-25T00:50:35.798471+0000","last_became_peered":"2024-04-25T00:50:35.798471+0000","last_unstale":"2024-04-25T00:50:38.108034+0000","last_undegraded":"2024-04-25T00:50:38.108034+0000","last_fullsized":"2024-04-25T00:50:38.108034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:15.104631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.472958+0000","last_change":"2024-04-25T00:50:33.304731+0000","last_active":"2024-04-25T00:50:38.472958+0000","last_peered":"2024-04-25T00:50:38.472958+0000","last_clean":"2024-04-25T00:50:38.472958+0000","last_became_active":"2024-04-25T00:50:33.303821+0000","last_became_peered":"2024-04-25T00:50:33.303821+0000","last_unstale":"2024-04-25T00:50:38.472958+0000","last_undegraded":"2024-04-25T00:50:38.472958+0000","last_fullsized":"2024-04-25T00:50:38.472958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:32.196488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.249633+0000","last_change":"2024-04-25T00:50:35.828727+0000","last_active":"2024-04-25T00:50:37.249633+0000","last_peered":"2024-04-25T00:50:37.249633+0000","last_clean":"2024-04-25T00:50:37.249633+0000","last_became_active":"2024-04-25T00:50:35.827617+0000","last_became_peered":"2024-04-25T00:50:35.827617+0000","last_unstale":"2024-04-25T00:50:37.249633+0000","last_undegraded":"2024-04-25T00:50:37.249633+0000","last_fullsized":"2024-04-25T00:50:37.249633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:30:10.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"26'8","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.455122+0000","last_change":"2024-04-25T00:50:33.391005+0000","last_active":"2024-04-25T00:50:43.455122+0000","last_peered":"2024-04-25T00:50:43.455122+0000","last_clean":"2024-04-25T00:50:43.455122+0000","last_became_active":"2024-04-25T00:50:33.390133+0000","last_became_peered":"2024-04-25T00:50:33.390133+0000","last_unstale":"2024-04-25T00:50:43.455122+0000","last_undegraded":"2024-04-25T00:50:43.455122+0000","last_fullsized":"2024-04-25T00:50:43.455122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:19.913188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108901+0000","last_change":"2024-04-25T00:50:35.876022+0000","last_active":"2024-04-25T00:50:38.108901+0000","last_peered":"2024-04-25T00:50:38.108901+0000","last_clean":"2024-04-25T00:50:38.108901+0000","last_became_active":"2024-04-25T00:50:35.875322+0000","last_became_peered":"2024-04-25T00:50:35.875322+0000","last_unstale":"2024-04-25T00:50:38.108901+0000","last_undegraded":"2024-04-25T00:50:38.108901+0000","last_fullsized":"2024-04-25T00:50:38.108901+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"26'6","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.249026+0000","last_change":"2024-04-25T00:50:33.387295+0000","last_active":"2024-04-25T00:50:50.249026+0000","last_peered":"2024-04-25T00:50:50.249026+0000","last_clean":"2024-04-25T00:50:50.249026+0000","last_became_active":"2024-04-25T00:50:33.386297+0000","last_became_peered":"2024-04-25T00:50:33.386297+0000","last_unstale":"2024-04-25T00:50:50.249026+0000","last_undegraded":"2024-04-25T00:50:50.249026+0000","last_fullsized":"2024-04-25T00:50:50.249026+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:31:57.597514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107131+0000","last_change":"2024-04-25T00:50:35.796873+0000","last_active":"2024-04-25T00:50:38.107131+0000","last_peered":"2024-04-25T00:50:38.107131+0000","last_clean":"2024-04-25T00:50:38.107131+0000","last_became_active":"2024-04-25T00:50:35.796012+0000","last_became_peered":"2024-04-25T00:50:35.796012+0000","last_unstale":"2024-04-25T00:50:38.107131+0000","last_undegraded":"2024-04-25T00:50:38.107131+0000","last_fullsized":"2024-04-25T00:50:38.107131+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:22.255073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.272566+0000","last_change":"2024-04-25T00:50:33.385522+0000","last_active":"2024-04-25T00:50:43.272566+0000","last_peered":"2024-04-25T00:50:43.272566+0000","last_clean":"2024-04-25T00:50:43.272566+0000","last_became_active":"2024-04-25T00:50:33.384620+0000","last_became_peered":"2024-04-25T00:50:33.384620+0000","last_unstale":"2024-04-25T00:50:43.272566+0000","last_undegraded":"2024-04-25T00:50:43.272566+0000","last_fullsized":"2024-04-25T00:50:43.272566+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:24.908029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108828+0000","last_change":"2024-04-25T00:50:35.820565+0000","last_active":"2024-04-25T00:50:38.108828+0000","last_peered":"2024-04-25T00:50:38.108828+0000","last_clean":"2024-04-25T00:50:38.108828+0000","last_became_active":"2024-04-25T00:50:35.819683+0000","last_became_peered":"2024-04-25T00:50:35.819683+0000","last_unstale":"2024-04-25T00:50:38.108828+0000","last_undegraded":"2024-04-25T00:50:38.108828+0000","last_fullsized":"2024-04-25T00:50:38.108828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:28.655307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.248912+0000","last_change":"2024-04-25T00:50:33.390745+0000","last_active":"2024-04-25T00:50:50.248912+0000","last_peered":"2024-04-25T00:50:50.248912+0000","last_clean":"2024-04-25T00:50:50.248912+0000","last_became_active":"2024-04-25T00:50:33.390089+0000","last_became_peered":"2024-04-25T00:50:33.390089+0000","last_unstale":"2024-04-25T00:50:50.248912+0000","last_undegraded":"2024-04-25T00:50:50.248912+0000","last_fullsized":"2024-04-25T00:50:50.248912+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:51.294701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363399+0000","last_change":"2024-04-25T00:50:35.801766+0000","last_active":"2024-04-25T00:50:37.363399+0000","last_peered":"2024-04-25T00:50:37.363399+0000","last_clean":"2024-04-25T00:50:37.363399+0000","last_became_active":"2024-04-25T00:50:35.801060+0000","last_became_peered":"2024-04-25T00:50:35.801060+0000","last_unstale":"2024-04-25T00:50:37.363399+0000","last_undegraded":"2024-04-25T00:50:37.363399+0000","last_fullsized":"2024-04-25T00:50:37.363399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"26'15","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.245577+0000","last_change":"2024-04-25T00:50:33.327283+0000","last_active":"2024-04-25T00:50:50.245577+0000","last_peered":"2024-04-25T00:50:50.245577+0000","last_clean":"2024-04-25T00:50:50.245577+0000","last_became_active":"2024-04-25T00:50:33.326464+0000","last_became_peered":"2024-04-25T00:50:33.326464+0000","last_unstale":"2024-04-25T00:50:50.245577+0000","last_undegraded":"2024-04-25T00:50:50.245577+0000","last_fullsized":"2024-04-25T00:50:50.245577+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:26:26.328621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108814+0000","last_change":"2024-04-25T00:50:35.825910+0000","last_active":"2024-04-25T00:50:38.108814+0000","last_peered":"2024-04-25T00:50:38.108814+0000","last_clean":"2024-04-25T00:50:38.108814+0000","last_became_active":"2024-04-25T00:50:35.825246+0000","last_became_peered":"2024-04-25T00:50:35.825246+0000","last_unstale":"2024-04-25T00:50:38.108814+0000","last_undegraded":"2024-04-25T00:50:38.108814+0000","last_fullsized":"2024-04-25T00:50:38.108814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:40.106788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.250173+0000","last_change":"2024-04-25T00:50:33.393856+0000","last_active":"2024-04-25T00:50:37.250173+0000","last_peered":"2024-04-25T00:50:37.250173+0000","last_clean":"2024-04-25T00:50:37.250173+0000","last_became_active":"2024-04-25T00:50:33.393153+0000","last_became_peered":"2024-04-25T00:50:33.393153+0000","last_unstale":"2024-04-25T00:50:37.250173+0000","last_undegraded":"2024-04-25T00:50:37.250173+0000","last_fullsized":"2024-04-25T00:50:37.250173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:55.179146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109662+0000","last_change":"2024-04-25T00:50:35.811993+0000","last_active":"2024-04-25T00:50:38.109662+0000","last_peered":"2024-04-25T00:50:38.109662+0000","last_clean":"2024-04-25T00:50:38.109662+0000","last_became_active":"2024-04-25T00:50:35.811267+0000","last_became_peered":"2024-04-25T00:50:35.811267+0000","last_unstale":"2024-04-25T00:50:38.109662+0000","last_undegraded":"2024-04-25T00:50:38.109662+0000","last_fullsized":"2024-04-25T00:50:38.109662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:40:20.385617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.476493+0000","last_change":"2024-04-25T00:50:33.383040+0000","last_active":"2024-04-25T00:50:38.476493+0000","last_peered":"2024-04-25T00:50:38.476493+0000","last_clean":"2024-04-25T00:50:38.476493+0000","last_became_active":"2024-04-25T00:50:33.382270+0000","last_became_peered":"2024-04-25T00:50:33.382270+0000","last_unstale":"2024-04-25T00:50:38.476493+0000","last_undegraded":"2024-04-25T00:50:38.476493+0000","last_fullsized":"2024-04-25T00:50:38.476493+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:13.866739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109894+0000","last_change":"2024-04-25T00:50:35.818234+0000","last_active":"2024-04-25T00:50:38.109894+0000","last_peered":"2024-04-25T00:50:38.109894+0000","last_clean":"2024-04-25T00:50:38.109894+0000","last_became_active":"2024-04-25T00:50:35.817707+0000","last_became_peered":"2024-04-25T00:50:35.817707+0000","last_unstale":"2024-04-25T00:50:38.109894+0000","last_undegraded":"2024-04-25T00:50:38.109894+0000","last_fullsized":"2024-04-25T00:50:38.109894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:31.998886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297643+0000","last_change":"2024-04-25T00:50:33.389774+0000","last_active":"2024-04-25T00:50:37.297643+0000","last_peered":"2024-04-25T00:50:37.297643+0000","last_clean":"2024-04-25T00:50:37.297643+0000","last_became_active":"2024-04-25T00:50:33.389092+0000","last_became_peered":"2024-04-25T00:50:33.389092+0000","last_unstale":"2024-04-25T00:50:37.297643+0000","last_undegraded":"2024-04-25T00:50:37.297643+0000","last_fullsized":"2024-04-25T00:50:37.297643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:30.722771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232278+0000","last_change":"2024-04-25T00:50:35.869211+0000","last_active":"2024-04-25T00:50:37.232278+0000","last_peered":"2024-04-25T00:50:37.232278+0000","last_clean":"2024-04-25T00:50:37.232278+0000","last_became_active":"2024-04-25T00:50:35.868798+0000","last_became_peered":"2024-04-25T00:50:35.868798+0000","last_unstale":"2024-04-25T00:50:37.232278+0000","last_undegraded":"2024-04-25T00:50:37.232278+0000","last_fullsized":"2024-04-25T00:50:37.232278+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:40.106788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.245439+0000","last_change":"2024-04-25T00:50:33.329578+0000","last_active":"2024-04-25T00:50:50.245439+0000","last_peered":"2024-04-25T00:50:50.245439+0000","last_clean":"2024-04-25T00:50:50.245439+0000","last_became_active":"2024-04-25T00:50:33.328950+0000","last_became_peered":"2024-04-25T00:50:33.328950+0000","last_unstale":"2024-04-25T00:50:50.245439+0000","last_undegraded":"2024-04-25T00:50:50.245439+0000","last_fullsized":"2024-04-25T00:50:50.245439+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:55.179146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109245+0000","last_change":"2024-04-25T00:50:35.734419+0000","last_active":"2024-04-25T00:50:38.109245+0000","last_peered":"2024-04-25T00:50:38.109245+0000","last_clean":"2024-04-25T00:50:38.109245+0000","last_became_active":"2024-04-25T00:50:35.733696+0000","last_became_peered":"2024-04-25T00:50:35.733696+0000","last_unstale":"2024-04-25T00:50:38.109245+0000","last_undegraded":"2024-04-25T00:50:38.109245+0000","last_fullsized":"2024-04-25T00:50:38.109245+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:05.046355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":175,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.108342+0000","last_change":"2024-04-25T00:49:55.281216+0000","last_active":"2024-04-25T00:50:38.108342+0000","last_peered":"2024-04-25T00:50:38.108342+0000","last_clean":"2024-04-25T00:50:38.108342+0000","last_became_active":"2024-04-25T00:49:55.278022+0000","last_became_peered":"2024-04-25T00:49:55.278022+0000","last_unstale":"2024-04-25T00:50:38.108342+0000","last_undegraded":"2024-04-25T00:50:38.108342+0000","last_fullsized":"2024-04-25T00:50:38.108342+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:49:52.475299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:49:52.475299+0000","last_clean_scrub_stamp":"2024-04-25T00:49:52.475299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:17.046656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.272652+0000","last_change":"2024-04-25T00:50:33.325228+0000","last_active":"2024-04-25T00:50:43.272652+0000","last_peered":"2024-04-25T00:50:43.272652+0000","last_clean":"2024-04-25T00:50:43.272652+0000","last_became_active":"2024-04-25T00:50:33.324579+0000","last_became_peered":"2024-04-25T00:50:33.324579+0000","last_unstale":"2024-04-25T00:50:43.272652+0000","last_undegraded":"2024-04-25T00:50:43.272652+0000","last_fullsized":"2024-04-25T00:50:43.272652+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:12.762746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388819+0000","last_change":"2024-04-25T00:50:35.880348+0000","last_active":"2024-04-25T00:50:37.388819+0000","last_peered":"2024-04-25T00:50:37.388819+0000","last_clean":"2024-04-25T00:50:37.388819+0000","last_became_active":"2024-04-25T00:50:35.878438+0000","last_became_peered":"2024-04-25T00:50:35.878438+0000","last_unstale":"2024-04-25T00:50:37.388819+0000","last_undegraded":"2024-04-25T00:50:37.388819+0000","last_fullsized":"2024-04-25T00:50:37.388819+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:44.093119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.167929+0000","last_change":"2024-04-25T00:50:33.321385+0000","last_active":"2024-04-25T00:50:50.167929+0000","last_peered":"2024-04-25T00:50:50.167929+0000","last_clean":"2024-04-25T00:50:50.167929+0000","last_became_active":"2024-04-25T00:50:33.320800+0000","last_became_peered":"2024-04-25T00:50:33.320800+0000","last_unstale":"2024-04-25T00:50:50.167929+0000","last_undegraded":"2024-04-25T00:50:50.167929+0000","last_fullsized":"2024-04-25T00:50:50.167929+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:04.254885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107400+0000","last_change":"2024-04-25T00:50:35.815056+0000","last_active":"2024-04-25T00:50:38.107400+0000","last_peered":"2024-04-25T00:50:38.107400+0000","last_clean":"2024-04-25T00:50:38.107400+0000","last_became_active":"2024-04-25T00:50:35.814163+0000","last_became_peered":"2024-04-25T00:50:35.814163+0000","last_unstale":"2024-04-25T00:50:38.107400+0000","last_undegraded":"2024-04-25T00:50:38.107400+0000","last_fullsized":"2024-04-25T00:50:38.107400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:50:52.289674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.244675+0000","last_change":"2024-04-25T00:50:33.384695+0000","last_active":"2024-04-25T00:50:50.244675+0000","last_peered":"2024-04-25T00:50:50.244675+0000","last_clean":"2024-04-25T00:50:50.244675+0000","last_became_active":"2024-04-25T00:50:33.383692+0000","last_became_peered":"2024-04-25T00:50:33.383692+0000","last_unstale":"2024-04-25T00:50:50.244675+0000","last_undegraded":"2024-04-25T00:50:50.244675+0000","last_fullsized":"2024-04-25T00:50:50.244675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:57.579410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297265+0000","last_change":"2024-04-25T00:50:35.723048+0000","last_active":"2024-04-25T00:50:37.297265+0000","last_peered":"2024-04-25T00:50:37.297265+0000","last_clean":"2024-04-25T00:50:37.297265+0000","last_became_active":"2024-04-25T00:50:35.722500+0000","last_became_peered":"2024-04-25T00:50:35.722500+0000","last_unstale":"2024-04-25T00:50:37.297265+0000","last_undegraded":"2024-04-25T00:50:37.297265+0000","last_fullsized":"2024-04-25T00:50:37.297265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:20:39.082516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232502+0000","last_change":"2024-04-25T00:50:33.305927+0000","last_active":"2024-04-25T00:50:37.232502+0000","last_peered":"2024-04-25T00:50:37.232502+0000","last_clean":"2024-04-25T00:50:37.232502+0000","last_became_active":"2024-04-25T00:50:33.305159+0000","last_became_peered":"2024-04-25T00:50:33.305159+0000","last_unstale":"2024-04-25T00:50:37.232502+0000","last_undegraded":"2024-04-25T00:50:37.232502+0000","last_fullsized":"2024-04-25T00:50:37.232502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:46:56.639410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.248677+0000","last_change":"2024-04-25T00:50:35.824491+0000","last_active":"2024-04-25T00:50:37.248677+0000","last_peered":"2024-04-25T00:50:37.248677+0000","last_clean":"2024-04-25T00:50:37.248677+0000","last_became_active":"2024-04-25T00:50:35.823320+0000","last_became_peered":"2024-04-25T00:50:35.823320+0000","last_unstale":"2024-04-25T00:50:37.248677+0000","last_undegraded":"2024-04-25T00:50:37.248677+0000","last_fullsized":"2024-04-25T00:50:37.248677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:57.466393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297427+0000","last_change":"2024-04-25T00:50:33.304490+0000","last_active":"2024-04-25T00:50:37.297427+0000","last_peered":"2024-04-25T00:50:37.297427+0000","last_clean":"2024-04-25T00:50:37.297427+0000","last_became_active":"2024-04-25T00:50:33.303671+0000","last_became_peered":"2024-04-25T00:50:33.303671+0000","last_unstale":"2024-04-25T00:50:37.297427+0000","last_undegraded":"2024-04-25T00:50:37.297427+0000","last_fullsized":"2024-04-25T00:50:37.297427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:30.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.233156+0000","last_change":"2024-04-25T00:50:35.878641+0000","last_active":"2024-04-25T00:50:37.233156+0000","last_peered":"2024-04-25T00:50:37.233156+0000","last_clean":"2024-04-25T00:50:37.233156+0000","last_became_active":"2024-04-25T00:50:35.876958+0000","last_became_peered":"2024-04-25T00:50:35.876958+0000","last_unstale":"2024-04-25T00:50:37.233156+0000","last_undegraded":"2024-04-25T00:50:37.233156+0000","last_fullsized":"2024-04-25T00:50:37.233156+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:59.565909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.109866+0000","last_change":"2024-04-25T00:50:33.319229+0000","last_active":"2024-04-25T00:50:38.109866+0000","last_peered":"2024-04-25T00:50:38.109866+0000","last_clean":"2024-04-25T00:50:38.109866+0000","last_became_active":"2024-04-25T00:50:33.318945+0000","last_became_peered":"2024-04-25T00:50:33.318945+0000","last_unstale":"2024-04-25T00:50:38.109866+0000","last_undegraded":"2024-04-25T00:50:38.109866+0000","last_fullsized":"2024-04-25T00:50:38.109866+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:51.132430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297603+0000","last_change":"2024-04-25T00:50:35.722521+0000","last_active":"2024-04-25T00:50:37.297603+0000","last_peered":"2024-04-25T00:50:37.297603+0000","last_clean":"2024-04-25T00:50:37.297603+0000","last_became_active":"2024-04-25T00:50:35.722128+0000","last_became_peered":"2024-04-25T00:50:35.722128+0000","last_unstale":"2024-04-25T00:50:37.297603+0000","last_undegraded":"2024-04-25T00:50:37.297603+0000","last_fullsized":"2024-04-25T00:50:37.297603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:59:36.793140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.097140+0000","last_change":"2024-04-25T00:50:33.387402+0000","last_active":"2024-04-25T00:50:50.097140+0000","last_peered":"2024-04-25T00:50:50.097140+0000","last_clean":"2024-04-25T00:50:50.097140+0000","last_became_active":"2024-04-25T00:50:33.386631+0000","last_became_peered":"2024-04-25T00:50:33.386631+0000","last_unstale":"2024-04-25T00:50:50.097140+0000","last_undegraded":"2024-04-25T00:50:50.097140+0000","last_fullsized":"2024-04-25T00:50:50.097140+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:11:49.105412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389751+0000","last_change":"2024-04-25T00:50:35.882715+0000","last_active":"2024-04-25T00:50:37.389751+0000","last_peered":"2024-04-25T00:50:37.389751+0000","last_clean":"2024-04-25T00:50:37.389751+0000","last_became_active":"2024-04-25T00:50:35.878416+0000","last_became_peered":"2024-04-25T00:50:35.878416+0000","last_unstale":"2024-04-25T00:50:37.389751+0000","last_undegraded":"2024-04-25T00:50:37.389751+0000","last_fullsized":"2024-04-25T00:50:37.389751+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:35.413796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.456143+0000","last_change":"2024-04-25T00:50:33.393211+0000","last_active":"2024-04-25T00:50:43.456143+0000","last_peered":"2024-04-25T00:50:43.456143+0000","last_clean":"2024-04-25T00:50:43.456143+0000","last_became_active":"2024-04-25T00:50:33.392381+0000","last_became_peered":"2024-04-25T00:50:33.392381+0000","last_unstale":"2024-04-25T00:50:43.456143+0000","last_undegraded":"2024-04-25T00:50:43.456143+0000","last_fullsized":"2024-04-25T00:50:43.456143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:18:05.276269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107930+0000","last_change":"2024-04-25T00:50:35.798491+0000","last_active":"2024-04-25T00:50:38.107930+0000","last_peered":"2024-04-25T00:50:38.107930+0000","last_clean":"2024-04-25T00:50:38.107930+0000","last_became_active":"2024-04-25T00:50:35.796775+0000","last_became_peered":"2024-04-25T00:50:35.796775+0000","last_unstale":"2024-04-25T00:50:38.107930+0000","last_undegraded":"2024-04-25T00:50:38.107930+0000","last_fullsized":"2024-04-25T00:50:38.107930+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:54.948867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.280018+0000","last_change":"2024-04-25T00:50:33.321163+0000","last_active":"2024-04-25T00:50:43.280018+0000","last_peered":"2024-04-25T00:50:43.280018+0000","last_clean":"2024-04-25T00:50:43.280018+0000","last_became_active":"2024-04-25T00:50:33.320554+0000","last_became_peered":"2024-04-25T00:50:33.320554+0000","last_unstale":"2024-04-25T00:50:43.280018+0000","last_undegraded":"2024-04-25T00:50:43.280018+0000","last_fullsized":"2024-04-25T00:50:43.280018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:13.533462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.248575+0000","last_change":"2024-04-25T00:50:35.824154+0000","last_active":"2024-04-25T00:50:37.248575+0000","last_peered":"2024-04-25T00:50:37.248575+0000","last_clean":"2024-04-25T00:50:37.248575+0000","last_became_active":"2024-04-25T00:50:35.823269+0000","last_became_peered":"2024-04-25T00:50:35.823269+0000","last_unstale":"2024-04-25T00:50:37.248575+0000","last_undegraded":"2024-04-25T00:50:37.248575+0000","last_fullsized":"2024-04-25T00:50:37.248575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:16.208624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"26'3","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.518358+0000","last_change":"2024-04-25T00:50:33.319985+0000","last_active":"2024-04-25T00:50:43.518358+0000","last_peered":"2024-04-25T00:50:43.518358+0000","last_clean":"2024-04-25T00:50:43.518358+0000","last_became_active":"2024-04-25T00:50:33.319198+0000","last_became_peered":"2024-04-25T00:50:33.319198+0000","last_unstale":"2024-04-25T00:50:43.518358+0000","last_undegraded":"2024-04-25T00:50:43.518358+0000","last_fullsized":"2024-04-25T00:50:43.518358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:01.398188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.388961+0000","last_change":"2024-04-25T00:50:35.883007+0000","last_active":"2024-04-25T00:50:37.388961+0000","last_peered":"2024-04-25T00:50:37.388961+0000","last_clean":"2024-04-25T00:50:37.388961+0000","last_became_active":"2024-04-25T00:50:35.881829+0000","last_became_peered":"2024-04-25T00:50:35.881829+0000","last_unstale":"2024-04-25T00:50:37.388961+0000","last_undegraded":"2024-04-25T00:50:37.388961+0000","last_fullsized":"2024-04-25T00:50:37.388961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:02.444745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'1","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.297545+0000","last_change":"2024-04-25T00:50:33.384397+0000","last_active":"2024-04-25T00:50:37.297545+0000","last_peered":"2024-04-25T00:50:37.297545+0000","last_clean":"2024-04-25T00:50:37.297545+0000","last_became_active":"2024-04-25T00:50:33.383622+0000","last_became_peered":"2024-04-25T00:50:33.383622+0000","last_unstale":"2024-04-25T00:50:37.297545+0000","last_undegraded":"2024-04-25T00:50:37.297545+0000","last_fullsized":"2024-04-25T00:50:37.297545+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:31.816914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389114+0000","last_change":"2024-04-25T00:50:35.881976+0000","last_active":"2024-04-25T00:50:37.389114+0000","last_peered":"2024-04-25T00:50:37.389114+0000","last_clean":"2024-04-25T00:50:37.389114+0000","last_became_active":"2024-04-25T00:50:35.881269+0000","last_became_peered":"2024-04-25T00:50:35.881269+0000","last_unstale":"2024-04-25T00:50:37.389114+0000","last_undegraded":"2024-04-25T00:50:37.389114+0000","last_fullsized":"2024-04-25T00:50:37.389114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:54.302741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:43.279813+0000","last_change":"2024-04-25T00:50:33.390041+0000","last_active":"2024-04-25T00:50:43.279813+0000","last_peered":"2024-04-25T00:50:43.279813+0000","last_clean":"2024-04-25T00:50:43.279813+0000","last_became_active":"2024-04-25T00:50:33.389095+0000","last_became_peered":"2024-04-25T00:50:33.389095+0000","last_unstale":"2024-04-25T00:50:43.279813+0000","last_undegraded":"2024-04-25T00:50:43.279813+0000","last_fullsized":"2024-04-25T00:50:43.279813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:00.569613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.363413+0000","last_change":"2024-04-25T00:50:35.812195+0000","last_active":"2024-04-25T00:50:37.363413+0000","last_peered":"2024-04-25T00:50:37.363413+0000","last_clean":"2024-04-25T00:50:37.363413+0000","last_became_active":"2024-04-25T00:50:35.811410+0000","last_became_peered":"2024-04-25T00:50:35.811410+0000","last_unstale":"2024-04-25T00:50:37.363413+0000","last_undegraded":"2024-04-25T00:50:37.363413+0000","last_fullsized":"2024-04-25T00:50:37.363413+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:06.596770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232746+0000","last_change":"2024-04-25T00:50:35.821808+0000","last_active":"2024-04-25T00:50:37.232746+0000","last_peered":"2024-04-25T00:50:37.232746+0000","last_clean":"2024-04-25T00:50:37.232746+0000","last_became_active":"2024-04-25T00:50:35.821062+0000","last_became_peered":"2024-04-25T00:50:35.821062+0000","last_unstale":"2024-04-25T00:50:37.232746+0000","last_undegraded":"2024-04-25T00:50:37.232746+0000","last_fullsized":"2024-04-25T00:50:37.232746+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.328036+0000","last_change":"2024-04-25T00:50:33.319853+0000","last_active":"2024-04-25T00:50:38.328036+0000","last_peered":"2024-04-25T00:50:38.328036+0000","last_clean":"2024-04-25T00:50:38.328036+0000","last_became_active":"2024-04-25T00:50:33.319197+0000","last_became_peered":"2024-04-25T00:50:33.319197+0000","last_unstale":"2024-04-25T00:50:38.328036+0000","last_undegraded":"2024-04-25T00:50:38.328036+0000","last_fullsized":"2024-04-25T00:50:38.328036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:24.834556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.232234+0000","last_change":"2024-04-25T00:50:35.812044+0000","last_active":"2024-04-25T00:50:37.232234+0000","last_peered":"2024-04-25T00:50:37.232234+0000","last_clean":"2024-04-25T00:50:37.232234+0000","last_became_active":"2024-04-25T00:50:35.811281+0000","last_became_peered":"2024-04-25T00:50:35.811281+0000","last_unstale":"2024-04-25T00:50:37.232234+0000","last_undegraded":"2024-04-25T00:50:37.232234+0000","last_fullsized":"2024-04-25T00:50:37.232234+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:28.655307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"26'4","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.169482+0000","last_change":"2024-04-25T00:50:33.382775+0000","last_active":"2024-04-25T00:50:50.169482+0000","last_peered":"2024-04-25T00:50:50.169482+0000","last_clean":"2024-04-25T00:50:50.169482+0000","last_became_active":"2024-04-25T00:50:33.382218+0000","last_became_peered":"2024-04-25T00:50:33.382218+0000","last_unstale":"2024-04-25T00:50:50.169482+0000","last_undegraded":"2024-04-25T00:50:50.169482+0000","last_fullsized":"2024-04-25T00:50:50.169482+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:52.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.107894+0000","last_change":"2024-04-25T00:50:35.802543+0000","last_active":"2024-04-25T00:50:38.107894+0000","last_peered":"2024-04-25T00:50:38.107894+0000","last_clean":"2024-04-25T00:50:38.107894+0000","last_became_active":"2024-04-25T00:50:35.801799+0000","last_became_peered":"2024-04-25T00:50:35.801799+0000","last_unstale":"2024-04-25T00:50:38.107894+0000","last_undegraded":"2024-04-25T00:50:38.107894+0000","last_fullsized":"2024-04-25T00:50:38.107894+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:15.875347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"26'2","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:38.457996+0000","last_change":"2024-04-25T00:50:33.389565+0000","last_active":"2024-04-25T00:50:38.457996+0000","last_peered":"2024-04-25T00:50:38.457996+0000","last_clean":"2024-04-25T00:50:38.457996+0000","last_became_active":"2024-04-25T00:50:33.388773+0000","last_became_peered":"2024-04-25T00:50:33.388773+0000","last_unstale":"2024-04-25T00:50:38.457996+0000","last_undegraded":"2024-04-25T00:50:38.457996+0000","last_fullsized":"2024-04-25T00:50:38.457996+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:42.721375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:37.389537+0000","last_change":"2024-04-25T00:50:35.877410+0000","last_active":"2024-04-25T00:50:37.389537+0000","last_peered":"2024-04-25T00:50:37.389537+0000","last_clean":"2024-04-25T00:50:37.389537+0000","last_became_active":"2024-04-25T00:50:35.876576+0000","last_became_peered":"2024-04-25T00:50:35.876576+0000","last_unstale":"2024-04-25T00:50:37.389537+0000","last_undegraded":"2024-04-25T00:50:37.389537+0000","last_fullsized":"2024-04-25T00:50:37.389537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:15.762503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"26'9","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-25T00:50:50.251818+0000","last_change":"2024-04-25T00:50:33.319601+0000","last_active":"2024-04-25T00:50:50.251818+0000","last_peered":"2024-04-25T00:50:50.251818+0000","last_clean":"2024-04-25T00:50:50.251818+0000","last_became_active":"2024-04-25T00:50:33.318940+0000","last_became_peered":"2024-04-25T00:50:33.318940+0000","last_unstale":"2024-04-25T00:50:50.251818+0000","last_undegraded":"2024-04-25T00:50:50.251818+0000","last_fullsized":"2024-04-25T00:50:50.251818+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:41.175588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5222,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":124,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":10444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":108,"ondisk_log_size":108,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719476754,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":880640,"data_stored":687875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719476754,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":98481,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719476754,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":97569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719476752,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":96905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719476753,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":97009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":98515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509457,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":876544,"data_stored":687219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":290816,"data_stored":97135,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T00:50:56.432 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T00:50:56.432 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T00:50:56.432 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T00:50:56.432 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T00:50:56.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.585+0000 7f49369a6640 1 Processor -- start 2024-04-25T00:50:56.587 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.585+0000 7f49369a6640 1 -- start start 2024-04-25T00:50:56.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.585+0000 7f49369a6640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f49300c9a60 0x7f49300caa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:56.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.585+0000 7f49369a6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4930158890 con 0x7f49300c9610 2024-04-25T00:50:56.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.585+0000 7f49369a6640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4930158b70 con 0x7f49301523b0 2024-04-25T00:50:56.588 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.585+0000 7f49369a6640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f4930152790 con 0x7f49300c9a60 2024-04-25T00:50:56.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.589+0000 7f492f7fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f49300c9610 0x7f49300cd9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:57500/0 (socket says 172.21.15.162:57500) 2024-04-25T00:50:56.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.589+0000 7f492f7fe640 1 -- 172.21.15.162:0/1922762483 learned_addr learned my addr 172.21.15.162:0/1922762483 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:56.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.589+0000 7f4934f43640 1 --2- 172.21.15.162:0/1922762483 >> v2:172.21.15.179:3300/0 conn(0x7f49300c9a60 0x7f49300caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:56.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.589+0000 7f492effd640 1 -- 172.21.15.162:0/1922762483 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1548960909 0 0) 0x7f4930158890 con 0x7f49300c9610 2024-04-25T00:50:56.593 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.589+0000 7f492effd640 1 -- 172.21.15.162:0/1922762483 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4918003530 con 0x7f49300c9610 2024-04-25T00:50:56.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.593+0000 7f492effd640 1 -- 172.21.15.162:0/1922762483 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 670109379 0 0) 0x7f4918003530 con 0x7f49300c9610 2024-04-25T00:50:56.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.593+0000 7f492effd640 1 -- 172.21.15.162:0/1922762483 >> v2:172.21.15.179:3300/0 conn(0x7f49300c9a60 msgr2=0x7f49300caa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:56.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.593+0000 7f492effd640 1 --2- 172.21.15.162:0/1922762483 >> v2:172.21.15.179:3300/0 conn(0x7f49300c9a60 0x7f49300caa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:56.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.593+0000 7f492effd640 1 -- 172.21.15.162:0/1922762483 >> v1:172.21.15.179:6789/0 conn(0x7f49301523b0 legacy=0x7f4930158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:56.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.593+0000 7f492effd640 1 -- 172.21.15.162:0/1922762483 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4930158e50 con 0x7f49300c9610 2024-04-25T00:50:56.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.593+0000 7f492effd640 1 -- 172.21.15.162:0/1922762483 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7f4924001680 con 0x7f49300c9610 2024-04-25T00:50:56.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.593+0000 7f492effd640 1 -- 172.21.15.162:0/1922762483 >> v1:172.21.15.162:6789/0 conn(0x7f49300c9610 legacy=0x7f49300cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:56.596 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.593+0000 7f492effd640 1 --2- 172.21.15.162:0/1922762483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4918003a10 0x7f4918003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:56.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.593+0000 7f492effd640 1 --2- 172.21.15.162:0/1922762483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4918004810 0x7f4918004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:56.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.593+0000 7f492effd640 1 --2- 172.21.15.162:0/1922762483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4918005240 0x7f491800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:56.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.593+0000 7f492effd640 1 -- 172.21.15.162:0/1922762483 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4930152790 con 0x7f4918003a10 2024-04-25T00:50:56.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.593+0000 7f492effd640 1 -- 172.21.15.162:0/1922762483 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f491800c1a0 con 0x7f4918005240 2024-04-25T00:50:56.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.593+0000 7f492effd640 1 -- 172.21.15.162:0/1922762483 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f491800c3a0 con 0x7f4918004810 2024-04-25T00:50:56.597 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.597+0000 7f492f7fe640 1 --2- 172.21.15.162:0/1922762483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4918004810 0x7f4918004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:56.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.597+0000 7f492ffff640 1 --2- 172.21.15.162:0/1922762483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4918003a10 0x7f4918003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:56.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.601+0000 7f492ffff640 1 -- 172.21.15.162:0/1922762483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4918004810 msgr2=0x7f4918004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:56.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.601+0000 7f492ffff640 1 --2- 172.21.15.162:0/1922762483 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4918004810 0x7f4918004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:56.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.601+0000 7f492ffff640 1 -- 172.21.15.162:0/1922762483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4918005240 msgr2=0x7f491800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:56.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.601+0000 7f492ffff640 1 --2- 172.21.15.162:0/1922762483 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4918005240 0x7f491800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:56.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.601+0000 7f492ffff640 1 -- 172.21.15.162:0/1922762483 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4918003530 con 0x7f4918003a10 2024-04-25T00:50:56.602 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.601+0000 7f4934f43640 1 -- 172.21.15.162:0/1922762483 reap_dead start 2024-04-25T00:50:56.605 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.605+0000 7f492ffff640 1 --2- 172.21.15.162:0/1922762483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4918003a10 0x7f4918003e50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4920001780 tx=0x7f492001c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a345f7eb8019e13e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:56.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.609+0000 7f492effd640 1 -- 172.21.15.162:0/1922762483 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49200013a0 con 0x7f4918003a10 2024-04-25T00:50:56.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.609+0000 7f492effd640 1 -- 172.21.15.162:0/1922762483 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49200050d0 con 0x7f4918003a10 2024-04-25T00:50:56.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.609+0000 7f492effd640 1 -- 172.21.15.162:0/1922762483 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4920003600 con 0x7f4918003a10 2024-04-25T00:50:56.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.609+0000 7f49369a6640 1 -- 172.21.15.162:0/1922762483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4918003a10 msgr2=0x7f4918003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:56.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.609+0000 7f49369a6640 1 --2- 172.21.15.162:0/1922762483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4918003a10 0x7f4918003e50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4920001780 tx=0x7f492001c360 comp rx=0 tx=0).stop 2024-04-25T00:50:56.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.609+0000 7f49369a6640 1 -- 172.21.15.162:0/1922762483 shutdown_connections 2024-04-25T00:50:56.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.609+0000 7f49369a6640 1 --2- 172.21.15.162:0/1922762483 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4918003a10 0x7f4918003e50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:56.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.609+0000 7f49369a6640 1 -- 172.21.15.162:0/1922762483 >> 172.21.15.162:0/1922762483 conn(0x7f4930066fc0 msgr2=0x7f49300673d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:56.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.609+0000 7f49369a6640 1 -- 172.21.15.162:0/1922762483 shutdown_connections 2024-04-25T00:50:56.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.609+0000 7f49369a6640 1 -- 172.21.15.162:0/1922762483 wait complete. 2024-04-25T00:50:56.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.609+0000 7f49369a6640 1 Processor -- start 2024-04-25T00:50:56.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.609+0000 7f49369a6640 1 -- start start 2024-04-25T00:50:56.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.609+0000 7f49369a6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4918003a10 0x7f493014eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:56.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.609+0000 7f49369a6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49300c4d90 0x7f493014d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:56.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.609+0000 7f49369a6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49301491c0 0x7f4930149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:56.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.609+0000 7f49369a6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f49300cabd0 con 0x7f49300c4d90 2024-04-25T00:50:56.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.609+0000 7f49369a6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f49300caa50 con 0x7f4918003a10 2024-04-25T00:50:56.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.609+0000 7f49369a6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f49300cad50 con 0x7f49301491c0 2024-04-25T00:50:56.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.613+0000 7f492f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49300c4d90 0x7f493014d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:56.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.613+0000 7f492ffff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4918003a10 0x7f493014eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:56.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.613+0000 7f492f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49300c4d90 0x7f493014d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40240/0 (socket says 172.21.15.162:40240) 2024-04-25T00:50:56.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.613+0000 7f492f7fe640 1 -- 172.21.15.162:0/2062714863 learned_addr learned my addr 172.21.15.162:0/2062714863 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:56.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.613+0000 7f4934f43640 1 --2- 172.21.15.162:0/2062714863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49301491c0 0x7f4930149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:56.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.613+0000 7f492f7fe640 1 -- 172.21.15.162:0/2062714863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49301491c0 msgr2=0x7f4930149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:56.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.613+0000 7f492f7fe640 1 --2- 172.21.15.162:0/2062714863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49301491c0 0x7f4930149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:56.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.613+0000 7f492f7fe640 1 -- 172.21.15.162:0/2062714863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4918003a10 msgr2=0x7f493014eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:56.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.613+0000 7f492f7fe640 1 --2- 172.21.15.162:0/2062714863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4918003a10 0x7f493014eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:56.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.613+0000 7f492f7fe640 1 -- 172.21.15.162:0/2062714863 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f493014dd90 con 0x7f49300c4d90 2024-04-25T00:50:56.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.617+0000 7f492f7fe640 1 --2- 172.21.15.162:0/2062714863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49300c4d90 0x7f493014d850 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4924004ed0 tx=0x7f4924007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:56.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.621+0000 7f492cff9640 1 -- 172.21.15.162:0/2062714863 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492400f7b0 con 0x7f49300c4d90 2024-04-25T00:50:56.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.621+0000 7f492cff9640 1 -- 172.21.15.162:0/2062714863 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4924018070 con 0x7f49300c4d90 2024-04-25T00:50:56.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.621+0000 7f492cff9640 1 -- 172.21.15.162:0/2062714863 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f492400fb70 con 0x7f49300c4d90 2024-04-25T00:50:56.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.621+0000 7f49369a6640 1 -- 172.21.15.162:0/2062714863 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f493014e220 con 0x7f49300c4d90 2024-04-25T00:50:56.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.621+0000 7f49369a6640 1 -- 172.21.15.162:0/2062714863 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f493014cbf0 con 0x7f49300c4d90 2024-04-25T00:50:56.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.621+0000 7f49369a6640 1 -- 172.21.15.162:0/2062714863 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4930068520 con 0x7f49300c4d90 2024-04-25T00:50:56.651 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.649+0000 7f492cff9640 1 -- 172.21.15.162:0/2062714863 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f492400fd10 con 0x7f49300c4d90 2024-04-25T00:50:56.651 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.649+0000 7f492cff9640 1 --2- 172.21.15.162:0/2062714863 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f491c067940 0x7f491c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:56.651 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.649+0000 7f492ffff640 1 --2- 172.21.15.162:0/2062714863 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f491c067940 0x7f491c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:56.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.649+0000 7f492ffff640 1 --2- 172.21.15.162:0/2062714863 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f491c067940 0x7f491c069e00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4920001750 tx=0x7f49200011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:56.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.653+0000 7f492cff9640 1 -- 172.21.15.162:0/2062714863 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f4924054ae0 con 0x7f49300c4d90 2024-04-25T00:50:56.908 INFO:tasks.ceph.mds.a.smithi162.stderr:2024-04-25T00:50:56.901+0000 f9ef640 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2024-04-25T00:50:56.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:56.921+0000 7f492cff9640 1 -- 172.21.15.162:0/2062714863 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f4924056a40 con 0x7f49300c4d90 2024-04-25T00:50:57.156 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.153+0000 7f49369a6640 1 -- 172.21.15.162:0/2062714863 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f493004f5f0 con 0x7f49300c4d90 2024-04-25T00:50:57.164 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.161+0000 7f492cff9640 1 -- 172.21.15.162:0/2062714863 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f492405ad40 con 0x7f49300c4d90 2024-04-25T00:50:57.165 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:57.165 INFO:teuthology.orchestra.run.smithi162.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T00:50:57.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.165+0000 7f49369a6640 1 -- 172.21.15.162:0/2062714863 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f491c067940 msgr2=0x7f491c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:57.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.165+0000 7f49369a6640 1 --2- 172.21.15.162:0/2062714863 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f491c067940 0x7f491c069e00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4920001750 tx=0x7f49200011a0 comp rx=0 tx=0).stop 2024-04-25T00:50:57.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.165+0000 7f49369a6640 1 -- 172.21.15.162:0/2062714863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49300c4d90 msgr2=0x7f493014d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:57.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.165+0000 7f49369a6640 1 --2- 172.21.15.162:0/2062714863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49300c4d90 0x7f493014d850 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4924004ed0 tx=0x7f4924007430 comp rx=0 tx=0).stop 2024-04-25T00:50:57.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.165+0000 7f49369a6640 1 -- 172.21.15.162:0/2062714863 shutdown_connections 2024-04-25T00:50:57.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.165+0000 7f49369a6640 1 --2- 172.21.15.162:0/2062714863 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f49301491c0 0x7f4930149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:57.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.165+0000 7f49369a6640 1 --2- 172.21.15.162:0/2062714863 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f491c067940 0x7f491c069e00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:57.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.165+0000 7f49369a6640 1 --2- 172.21.15.162:0/2062714863 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f49300c4d90 0x7f493014d850 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:57.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.165+0000 7f49369a6640 1 --2- 172.21.15.162:0/2062714863 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4918003a10 0x7f493014eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:57.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.165+0000 7f49369a6640 1 -- 172.21.15.162:0/2062714863 >> 172.21.15.162:0/2062714863 conn(0x7f4930066fc0 msgr2=0x7f49300ccc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:57.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.165+0000 7f49369a6640 1 -- 172.21.15.162:0/2062714863 shutdown_connections 2024-04-25T00:50:57.168 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.165+0000 7f49369a6640 1 -- 172.21.15.162:0/2062714863 wait complete. 2024-04-25T00:50:57.183 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T00:50:57.183 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T00:50:57.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.293+0000 7f8e9d0f1640 1 Processor -- start 2024-04-25T00:50:57.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.293+0000 7f8e9d0f1640 1 -- start start 2024-04-25T00:50:57.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.293+0000 7f8e9d0f1640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8e98152170 0x7f8e980c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:57.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.293+0000 7f8e9d0f1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e980c8460 0x7f8e9815bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:57.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.293+0000 7f8e9d0f1640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e980c8f20 con 0x7f8e98152550 2024-04-25T00:50:57.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.293+0000 7f8e9d0f1640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f8e981583b0 con 0x7f8e98152170 2024-04-25T00:50:57.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.293+0000 7f8e9d0f1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8e98158690 con 0x7f8e980c8460 2024-04-25T00:50:57.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.297+0000 7f8e9759e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e980c8460 0x7f8e9815bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:57.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.297+0000 7f8e96d9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f8e98152170 0x7f8e980c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:57.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.297+0000 7f8e9759e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e980c8460 0x7f8e9815bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:43238/0 (socket says 172.21.15.162:43238) 2024-04-25T00:50:57.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.297+0000 7f8e9759e640 1 -- 172.21.15.162:0/3585327564 learned_addr learned my addr 172.21.15.162:0/3585327564 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:57.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.305+0000 7f8e9759e640 1 -- 172.21.15.162:0/3585327564 >> v2:172.21.15.179:3300/0 conn(0x7f8e98152170 msgr2=0x7f8e980c89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:57.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.305+0000 7f8e9759e640 1 --2- 172.21.15.162:0/3585327564 >> v2:172.21.15.179:3300/0 conn(0x7f8e98152170 0x7f8e980c89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:57.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.305+0000 7f8e9759e640 1 -- 172.21.15.162:0/3585327564 >> v1:172.21.15.179:6789/0 conn(0x7f8e98152550 legacy=0x7f8e980c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:57.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.305+0000 7f8e9759e640 1 -- 172.21.15.162:0/3585327564 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e98158970 con 0x7f8e980c8460 2024-04-25T00:50:57.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.309+0000 7f8e9759e640 1 --2- 172.21.15.162:0/3585327564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e980c8460 0x7f8e9815bb90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009e50 tx=0x7f8e9001f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ec02a79d94bf91 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:57.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.317+0000 7f8e95d9b640 1 -- 172.21.15.162:0/3585327564 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e900b4070 con 0x7f8e980c8460 2024-04-25T00:50:57.318 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.317+0000 7f8e95d9b640 1 -- 172.21.15.162:0/3585327564 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e900af400 con 0x7f8e980c8460 2024-04-25T00:50:57.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.317+0000 7f8e95d9b640 1 -- 172.21.15.162:0/3585327564 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e900af7d0 con 0x7f8e980c8460 2024-04-25T00:50:57.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.317+0000 7f8e9d0f1640 1 -- 172.21.15.162:0/3585327564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e980c8460 msgr2=0x7f8e9815bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:57.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.317+0000 7f8e9d0f1640 1 --2- 172.21.15.162:0/3585327564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e980c8460 0x7f8e9815bb90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009e50 tx=0x7f8e9001f210 comp rx=0 tx=0).stop 2024-04-25T00:50:57.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.317+0000 7f8e9d0f1640 1 -- 172.21.15.162:0/3585327564 shutdown_connections 2024-04-25T00:50:57.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.317+0000 7f8e9d0f1640 1 --2- 172.21.15.162:0/3585327564 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e980c8460 0x7f8e9815bb90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:57.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.317+0000 7f8e9d0f1640 1 --2- 172.21.15.162:0/3585327564 >> v2:172.21.15.179:3300/0 conn(0x7f8e98152170 0x7f8e980c89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:57.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.317+0000 7f8e9d0f1640 1 -- 172.21.15.162:0/3585327564 >> 172.21.15.162:0/3585327564 conn(0x7f8e9806fe00 msgr2=0x7f8e98066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:57.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.317+0000 7f8e9d0f1640 1 -- 172.21.15.162:0/3585327564 shutdown_connections 2024-04-25T00:50:57.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.317+0000 7f8e9d0f1640 1 -- 172.21.15.162:0/3585327564 wait complete. 2024-04-25T00:50:57.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.317+0000 7f8e9d0f1640 1 Processor -- start 2024-04-25T00:50:57.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.317+0000 7f8e9d0f1640 1 -- start start 2024-04-25T00:50:57.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.321+0000 7f8e9d0f1640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e980c8460 0x7f8e981efff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:57.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.321+0000 7f8e9d0f1640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e98152170 0x7f8e9806d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:57.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.321+0000 7f8e9d0f1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e98152550 0x7f8e980aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:57.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.321+0000 7f8e9d0f1640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8e9815b670 con 0x7f8e980c8460 2024-04-25T00:50:57.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.321+0000 7f8e9d0f1640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8e98158f30 con 0x7f8e98152170 2024-04-25T00:50:57.321 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.321+0000 7f8e9d0f1640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8e98158080 con 0x7f8e98152550 2024-04-25T00:50:57.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.321+0000 7f8e9759e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e98152550 0x7f8e980aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:57.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.321+0000 7f8e9759e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e98152550 0x7f8e980aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:43252/0 (socket says 172.21.15.162:43252) 2024-04-25T00:50:57.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.321+0000 7f8e9759e640 1 -- 172.21.15.162:0/2636775859 learned_addr learned my addr 172.21.15.162:0/2636775859 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:57.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.325+0000 7f8e96d9d640 1 --2- 172.21.15.162:0/2636775859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e980c8460 0x7f8e981efff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:57.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.325+0000 7f8e9659c640 1 --2- 172.21.15.162:0/2636775859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e98152170 0x7f8e9806d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:57.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.329+0000 7f8e9759e640 1 -- 172.21.15.162:0/2636775859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e98152170 msgr2=0x7f8e9806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:57.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.329+0000 7f8e9759e640 1 --2- 172.21.15.162:0/2636775859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e98152170 0x7f8e9806d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:57.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.329+0000 7f8e9759e640 1 -- 172.21.15.162:0/2636775859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e980c8460 msgr2=0x7f8e981efff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:57.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.329+0000 7f8e9759e640 1 --2- 172.21.15.162:0/2636775859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e980c8460 0x7f8e981efff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:57.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.329+0000 7f8e9759e640 1 -- 172.21.15.162:0/2636775859 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e9806c3c0 con 0x7f8e98152550 2024-04-25T00:50:57.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.329+0000 7f8e9759e640 1 --2- 172.21.15.162:0/2636775859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e98152550 0x7f8e980aec60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e9001d8c0 tx=0x7f8e9001bfb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:57.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.337+0000 7f8e7f7fe640 1 -- 172.21.15.162:0/2636775859 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e900b4040 con 0x7f8e98152550 2024-04-25T00:50:57.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.337+0000 7f8e7f7fe640 1 -- 172.21.15.162:0/2636775859 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e900bf070 con 0x7f8e98152550 2024-04-25T00:50:57.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.337+0000 7f8e7f7fe640 1 -- 172.21.15.162:0/2636775859 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e900b9410 con 0x7f8e98152550 2024-04-25T00:50:57.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.337+0000 7f8e9d0f1640 1 -- 172.21.15.162:0/2636775859 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e9806c630 con 0x7f8e98152550 2024-04-25T00:50:57.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.337+0000 7f8e9d0f1640 1 -- 172.21.15.162:0/2636775859 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e9806cbf0 con 0x7f8e98152550 2024-04-25T00:50:57.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.337+0000 7f8e9d0f1640 1 -- 172.21.15.162:0/2636775859 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e98068520 con 0x7f8e98152550 2024-04-25T00:50:57.654 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.653+0000 7f8e7f7fe640 1 -- 172.21.15.162:0/2636775859 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8e900a8d10 con 0x7f8e98152550 2024-04-25T00:50:57.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.653+0000 7f8e7f7fe640 1 --2- 172.21.15.162:0/2636775859 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8e840678f0 0x7f8e84069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:57.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.653+0000 7f8e96d9d640 1 --2- 172.21.15.162:0/2636775859 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8e840678f0 0x7f8e84069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:57.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.653+0000 7f8e96d9d640 1 --2- 172.21.15.162:0/2636775859 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8e840678f0 0x7f8e84069db0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009b60 tx=0x7f8e88009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:57.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.657+0000 7f8e7f7fe640 1 -- 172.21.15.162:0/2636775859 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f8e90002020 con 0x7f8e98152550 2024-04-25T00:50:57.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.677+0000 7f8e7f7fe640 1 -- 172.21.15.162:0/2636775859 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8e90018d70 con 0x7f8e98152550 2024-04-25T00:50:57.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.849+0000 7f8e9d0f1640 1 -- 172.21.15.162:0/2636775859 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e98155a30 con 0x7f8e98152550 2024-04-25T00:50:57.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.953+0000 7f8e7f7fe640 1 -- 172.21.15.162:0/2636775859 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+16641 (secure 0 0 0) 0x7f8e900f4aa0 con 0x7f8e98152550 2024-04-25T00:50:57.957 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:50:57.957 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":26,"fsid":"e141deed-4794-4a17-83c9-f6e6e8875f5e","created":"2024-04-25T00:49:29.904605+0000","modified":"2024-04-25T00:50:37.007717+0000","last_up_change":"2024-04-25T00:49:51.119342+0000","last_in_change":"2024-04-25T00:49:39.898293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T00:49:52.297093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T00:50:31.644475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T00:50:33.242786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e20986cc-3664-4988-959c-c0b02e380775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6811","nonce":2734546478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6813","nonce":2734546478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6817","nonce":2734546478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6815","nonce":2734546478}]},"public_addr":"172.21.15.162:6811/2734546478","cluster_addr":"172.21.15.162:6813/2734546478","heartbeat_back_addr":"172.21.15.162:6817/2734546478","heartbeat_front_addr":"172.21.15.162:6815/2734546478","state":["exists","up"]},{"osd":1,"uuid":"60f1608a-ecb7-4978-b816-ce6f419e275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6803","nonce":3488816098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6805","nonce":3488816098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6809","nonce":3488816098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6807","nonce":3488816098}]},"public_addr":"172.21.15.162:6803/3488816098","cluster_addr":"172.21.15.162:6805/3488816098","heartbeat_back_addr":"172.21.15.162:6809/3488816098","heartbeat_front_addr":"172.21.15.162:6807/3488816098","state":["exists","up"]},{"osd":2,"uuid":"77552061-8e19-4f49-bc3f-1300955a07b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6819","nonce":234337516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6821","nonce":234337516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6825","nonce":234337516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6823","nonce":234337516}]},"public_addr":"172.21.15.162:6819/234337516","cluster_addr":"172.21.15.162:6821/234337516","heartbeat_back_addr":"172.21.15.162:6825/234337516","heartbeat_front_addr":"172.21.15.162:6823/234337516","state":["exists","up"]},{"osd":3,"uuid":"5b105720-6e6d-4143-b5c4-0a3b1e4a687c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6827","nonce":1726903362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6829","nonce":1726903362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6833","nonce":1726903362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6831","nonce":1726903362}]},"public_addr":"172.21.15.162:6827/1726903362","cluster_addr":"172.21.15.162:6829/1726903362","heartbeat_back_addr":"172.21.15.162:6833/1726903362","heartbeat_front_addr":"172.21.15.162:6831/1726903362","state":["exists","up"]},{"osd":4,"uuid":"611eafc5-2fe0-4c96-ba8c-b1efc3930de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6817","nonce":3338082657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6819","nonce":3338082657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6823","nonce":3338082657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6821","nonce":3338082657}]},"public_addr":"172.21.15.179:6817/3338082657","cluster_addr":"172.21.15.179:6819/3338082657","heartbeat_back_addr":"172.21.15.179:6823/3338082657","heartbeat_front_addr":"172.21.15.179:6821/3338082657","state":["exists","up"]},{"osd":5,"uuid":"b39487f5-c314-4026-90bd-02e30ecca04f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6825","nonce":4129338239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6827","nonce":4129338239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6831","nonce":4129338239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6829","nonce":4129338239}]},"public_addr":"172.21.15.179:6825/4129338239","cluster_addr":"172.21.15.179:6827/4129338239","heartbeat_back_addr":"172.21.15.179:6831/4129338239","heartbeat_front_addr":"172.21.15.179:6829/4129338239","state":["exists","up"]},{"osd":6,"uuid":"1d902755-f992-4070-b30e-e79f5fb22d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6801","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6802","nonce":823843016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6806","nonce":823843016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6815","nonce":823843016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6810","nonce":823843016}]},"public_addr":"172.21.15.179:6802/823843016","cluster_addr":"172.21.15.179:6806/823843016","heartbeat_back_addr":"172.21.15.179:6815/823843016","heartbeat_front_addr":"172.21.15.179:6810/823843016","state":["exists","up"]},{"osd":7,"uuid":"ea529f85-28fd-4dc3-a584-314e71999061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6803","nonce":3403659125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6807","nonce":3403659125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6814","nonce":3403659125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6811","nonce":3403659125}]},"public_addr":"172.21.15.179:6803/3403659125","cluster_addr":"172.21.15.179:6807/3403659125","heartbeat_back_addr":"172.21.15.179:6814/3403659125","heartbeat_front_addr":"172.21.15.179:6811/3403659125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.684518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.583123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.644576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.815957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.787155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.814409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.657210+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.676697+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T00:50:57.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.957+0000 7f8e9d0f1640 1 -- 172.21.15.162:0/2636775859 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8e840678f0 msgr2=0x7f8e84069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:57.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.957+0000 7f8e9d0f1640 1 --2- 172.21.15.162:0/2636775859 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8e840678f0 0x7f8e84069db0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009b60 tx=0x7f8e88009190 comp rx=0 tx=0).stop 2024-04-25T00:50:57.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.957+0000 7f8e9d0f1640 1 -- 172.21.15.162:0/2636775859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e98152550 msgr2=0x7f8e980aec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:57.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.957+0000 7f8e9d0f1640 1 --2- 172.21.15.162:0/2636775859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e98152550 0x7f8e980aec60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8e9001d8c0 tx=0x7f8e9001bfb0 comp rx=0 tx=0).stop 2024-04-25T00:50:57.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.957+0000 7f8e9d0f1640 1 -- 172.21.15.162:0/2636775859 shutdown_connections 2024-04-25T00:50:57.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.957+0000 7f8e9d0f1640 1 --2- 172.21.15.162:0/2636775859 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f8e98152550 0x7f8e980aec60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:57.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.957+0000 7f8e9d0f1640 1 --2- 172.21.15.162:0/2636775859 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8e98152170 0x7f8e9806d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:57.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.957+0000 7f8e9d0f1640 1 --2- 172.21.15.162:0/2636775859 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8e840678f0 0x7f8e84069db0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:57.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.957+0000 7f8e9d0f1640 1 --2- 172.21.15.162:0/2636775859 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f8e980c8460 0x7f8e981efff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:57.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.957+0000 7f8e9d0f1640 1 -- 172.21.15.162:0/2636775859 >> 172.21.15.162:0/2636775859 conn(0x7f8e9806fe00 msgr2=0x7f8e980b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:57.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.957+0000 7f8e9d0f1640 1 -- 172.21.15.162:0/2636775859 shutdown_connections 2024-04-25T00:50:57.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:57.957+0000 7f8e9d0f1640 1 -- 172.21.15.162:0/2636775859 wait complete. 2024-04-25T00:50:57.979 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T00:49:52.297093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T00:50:31.644475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T00:50:33.242786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T00:50:57.979 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T00:50:58.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.097+0000 7f4a39308640 1 Processor -- start 2024-04-25T00:50:58.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.097+0000 7f4a39308640 1 -- start start 2024-04-25T00:50:58.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.097+0000 7f4a39308640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a3406d6f0 0x7f4a340c7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:58.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.097+0000 7f4a39308640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f4a3406e7d0 0x7f4a3406ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:58.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.097+0000 7f4a39308640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3406f1a0 con 0x7f4a3413e060 2024-04-25T00:50:58.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.097+0000 7f4a39308640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f4a34158540 con 0x7f4a3406e7d0 2024-04-25T00:50:58.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.097+0000 7f4a39308640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4a34158820 con 0x7f4a3406d6f0 2024-04-25T00:50:58.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.097+0000 7f4a32ffd640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f4a3413e060 0x7f4a340c5830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:57508/0 (socket says 172.21.15.162:57508) 2024-04-25T00:50:58.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.097+0000 7f4a32ffd640 1 -- 172.21.15.162:0/1591205101 learned_addr learned my addr 172.21.15.162:0/1591205101 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:50:58.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.101+0000 7f4a327fc640 1 -- 172.21.15.162:0/1591205101 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2605881714 0 0) 0x7f4a3406f1a0 con 0x7f4a3413e060 2024-04-25T00:50:58.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.101+0000 7f4a327fc640 1 -- 172.21.15.162:0/1591205101 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a20003530 con 0x7f4a3413e060 2024-04-25T00:50:58.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.105+0000 7f4a337fe640 1 --2- 172.21.15.162:0/1591205101 >> v2:172.21.15.179:3300/0 conn(0x7f4a3406e7d0 0x7f4a3406ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:58.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.105+0000 7f4a2bfff640 1 --2- 172.21.15.162:0/1591205101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a3406d6f0 0x7f4a340c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:58.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.105+0000 7f4a327fc640 1 -- 172.21.15.162:0/1591205101 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3034131980 0 0) 0x7f4a20003530 con 0x7f4a3413e060 2024-04-25T00:50:58.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.105+0000 7f4a327fc640 1 -- 172.21.15.162:0/1591205101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a3406d6f0 msgr2=0x7f4a340c7530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:58.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.105+0000 7f4a327fc640 1 --2- 172.21.15.162:0/1591205101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a3406d6f0 0x7f4a340c7530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:58.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.105+0000 7f4a327fc640 1 -- 172.21.15.162:0/1591205101 >> v2:172.21.15.179:3300/0 conn(0x7f4a3406e7d0 msgr2=0x7f4a3406ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:58.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.105+0000 7f4a327fc640 1 --2- 172.21.15.162:0/1591205101 >> v2:172.21.15.179:3300/0 conn(0x7f4a3406e7d0 0x7f4a3406ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:58.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.105+0000 7f4a327fc640 1 -- 172.21.15.162:0/1591205101 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a34158b00 con 0x7f4a3413e060 2024-04-25T00:50:58.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.105+0000 7f4a327fc640 1 -- 172.21.15.162:0/1591205101 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7f4a24001680 con 0x7f4a3413e060 2024-04-25T00:50:58.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.105+0000 7f4a327fc640 1 -- 172.21.15.162:0/1591205101 >> v1:172.21.15.162:6789/0 conn(0x7f4a3413e060 legacy=0x7f4a340c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:58.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.105+0000 7f4a327fc640 1 --2- 172.21.15.162:0/1591205101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a200039c0 0x7f4a20003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:58.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.105+0000 7f4a327fc640 1 --2- 172.21.15.162:0/1591205101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a20004810 0x7f4a20004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:58.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.105+0000 7f4a327fc640 1 --2- 172.21.15.162:0/1591205101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a3406d6f0 0x7f4a200051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:58.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.105+0000 7f4a327fc640 1 -- 172.21.15.162:0/1591205101 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a34158540 con 0x7f4a20004810 2024-04-25T00:50:58.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.105+0000 7f4a327fc640 1 -- 172.21.15.162:0/1591205101 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4a34158820 con 0x7f4a200039c0 2024-04-25T00:50:58.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.105+0000 7f4a327fc640 1 -- 172.21.15.162:0/1591205101 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4a2000bb40 con 0x7f4a3406d6f0 2024-04-25T00:50:58.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.109+0000 7f4a2bfff640 1 --2- 172.21.15.162:0/1591205101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a20004810 0x7f4a20004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:58.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.113+0000 7f4a337fe640 1 --2- 172.21.15.162:0/1591205101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a3406d6f0 0x7f4a200051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:58.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.113+0000 7f4a2bfff640 1 -- 172.21.15.162:0/1591205101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a3406d6f0 msgr2=0x7f4a200051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:58.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.113+0000 7f4a2bfff640 1 --2- 172.21.15.162:0/1591205101 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a3406d6f0 0x7f4a200051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:58.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.113+0000 7f4a2bfff640 1 -- 172.21.15.162:0/1591205101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a200039c0 msgr2=0x7f4a20003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:58.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.113+0000 7f4a2bfff640 1 --2- 172.21.15.162:0/1591205101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a200039c0 0x7f4a20003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:58.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.113+0000 7f4a2bfff640 1 -- 172.21.15.162:0/1591205101 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a20003530 con 0x7f4a20004810 2024-04-25T00:50:58.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.173+0000 7f4a2bfff640 1 --2- 172.21.15.162:0/1591205101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a20004810 0x7f4a20004c90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00ba00 tx=0x7f4a1c01c640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c814da7c839297 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:58.214 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.213+0000 7f4a327fc640 1 -- 172.21.15.162:0/1591205101 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c00b600 con 0x7f4a20004810 2024-04-25T00:50:58.214 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.213+0000 7f4a327fc640 1 -- 172.21.15.162:0/1591205101 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a1c0b0070 con 0x7f4a20004810 2024-04-25T00:50:58.214 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.213+0000 7f4a327fc640 1 -- 172.21.15.162:0/1591205101 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c0ab890 con 0x7f4a20004810 2024-04-25T00:50:58.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.213+0000 7f4a39308640 1 -- 172.21.15.162:0/1591205101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a20004810 msgr2=0x7f4a20004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:58.215 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.213+0000 7f4a39308640 1 --2- 172.21.15.162:0/1591205101 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a20004810 0x7f4a20004c90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00ba00 tx=0x7f4a1c01c640 comp rx=0 tx=0).stop 2024-04-25T00:50:58.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.213+0000 7f4a337fe640 1 -- 172.21.15.162:0/1591205101 reap_dead start 2024-04-25T00:50:58.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.213+0000 7f4a39308640 1 -- 172.21.15.162:0/1591205101 shutdown_connections 2024-04-25T00:50:58.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.213+0000 7f4a39308640 1 -- 172.21.15.162:0/1591205101 >> 172.21.15.162:0/1591205101 conn(0x7f4a34070290 msgr2=0x7f4a340c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:58.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.213+0000 7f4a39308640 1 -- 172.21.15.162:0/1591205101 shutdown_connections 2024-04-25T00:50:58.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.213+0000 7f4a39308640 1 -- 172.21.15.162:0/1591205101 wait complete. 2024-04-25T00:50:58.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.217+0000 7f4a39308640 1 Processor -- start 2024-04-25T00:50:58.218 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.217+0000 7f4a39308640 1 -- start start 2024-04-25T00:50:58.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.217+0000 7f4a39308640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a20004810 0x7f4a341f3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:58.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.217+0000 7f4a39308640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a341339e0 0x7f4a340cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:58.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.217+0000 7f4a39308640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a341343b0 0x7f4a340c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:58.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.217+0000 7f4a39308640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3406e2b0 con 0x7f4a341339e0 2024-04-25T00:50:58.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.217+0000 7f4a39308640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4a341590c0 con 0x7f4a20004810 2024-04-25T00:50:58.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.217+0000 7f4a39308640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4a34158190 con 0x7f4a341343b0 2024-04-25T00:50:58.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.217+0000 7f4a2bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a341339e0 0x7f4a340cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:58.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.217+0000 7f4a2bfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a341339e0 0x7f4a340cc850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40260/0 (socket says 172.21.15.162:40260) 2024-04-25T00:50:58.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.217+0000 7f4a2bfff640 1 -- 172.21.15.162:0/3619380884 learned_addr learned my addr 172.21.15.162:0/3619380884 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:58.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.225+0000 7f4a2bfff640 1 -- 172.21.15.162:0/3619380884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a341343b0 msgr2=0x7f4a340c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:58.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.225+0000 7f4a2bfff640 1 --2- 172.21.15.162:0/3619380884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a341343b0 0x7f4a340c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:58.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.225+0000 7f4a2bfff640 1 -- 172.21.15.162:0/3619380884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a20004810 msgr2=0x7f4a341f3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:58.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.225+0000 7f4a2bfff640 1 --2- 172.21.15.162:0/3619380884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a20004810 0x7f4a341f3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:58.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.225+0000 7f4a2bfff640 1 -- 172.21.15.162:0/3619380884 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a341326c0 con 0x7f4a341339e0 2024-04-25T00:50:58.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.229+0000 7f4a2bfff640 1 --2- 172.21.15.162:0/3619380884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a341339e0 0x7f4a340cc850 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0ad040 tx=0x7f4a20005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:58.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.237+0000 7f4a2b7fe640 1 -- 172.21.15.162:0/3619380884 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c0ba070 con 0x7f4a341339e0 2024-04-25T00:50:58.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.237+0000 7f4a2b7fe640 1 -- 172.21.15.162:0/3619380884 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a1c0abcd0 con 0x7f4a341339e0 2024-04-25T00:50:58.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.237+0000 7f4a39308640 1 -- 172.21.15.162:0/3619380884 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a34132f40 con 0x7f4a341339e0 2024-04-25T00:50:58.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.237+0000 7f4a2b7fe640 1 -- 172.21.15.162:0/3619380884 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c004260 con 0x7f4a341339e0 2024-04-25T00:50:58.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.237+0000 7f4a39308640 1 -- 172.21.15.162:0/3619380884 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a341331e0 con 0x7f4a341339e0 2024-04-25T00:50:58.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.237+0000 7f4a39308640 1 -- 172.21.15.162:0/3619380884 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a34075110 con 0x7f4a341339e0 2024-04-25T00:50:58.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.257+0000 7f4a2b7fe640 1 -- 172.21.15.162:0/3619380884 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4a1c003620 con 0x7f4a341339e0 2024-04-25T00:50:58.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.257+0000 7f4a2b7fe640 1 --2- 172.21.15.162:0/3619380884 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4a14067910 0x7f4a14069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:58.257 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.257+0000 7f4a32ffd640 1 --2- 172.21.15.162:0/3619380884 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4a14067910 0x7f4a14069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:58.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.257+0000 7f4a32ffd640 1 --2- 172.21.15.162:0/3619380884 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4a14067910 0x7f4a14069dd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4a24000f70 tx=0x7f4a240015d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:58.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.257+0000 7f4a2b7fe640 1 -- 172.21.15.162:0/3619380884 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f4a1c0aae40 con 0x7f4a341339e0 2024-04-25T00:50:58.540 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.537+0000 7f4a2b7fe640 1 -- 172.21.15.162:0/3619380884 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f4a1c0c4060 con 0x7f4a341339e0 2024-04-25T00:50:58.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.717+0000 7f4a39308640 1 -- 172.21.15.162:0/3619380884 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4a3406c960 con 0x7f4a341339e0 2024-04-25T00:50:58.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.721+0000 7f4a2b7fe640 1 -- 172.21.15.162:0/3619380884 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f4a1c016350 con 0x7f4a341339e0 2024-04-25T00:50:58.775 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-04-25T00:50:58.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.725+0000 7f4a39308640 1 -- 172.21.15.162:0/3619380884 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4a14067910 msgr2=0x7f4a14069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:58.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.725+0000 7f4a39308640 1 --2- 172.21.15.162:0/3619380884 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4a14067910 0x7f4a14069dd0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4a24000f70 tx=0x7f4a240015d0 comp rx=0 tx=0).stop 2024-04-25T00:50:58.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.725+0000 7f4a39308640 1 -- 172.21.15.162:0/3619380884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a341339e0 msgr2=0x7f4a340cc850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:58.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.725+0000 7f4a39308640 1 --2- 172.21.15.162:0/3619380884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a341339e0 0x7f4a340cc850 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c0ad040 tx=0x7f4a20005840 comp rx=0 tx=0).stop 2024-04-25T00:50:58.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.725+0000 7f4a39308640 1 -- 172.21.15.162:0/3619380884 shutdown_connections 2024-04-25T00:50:58.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.725+0000 7f4a39308640 1 --2- 172.21.15.162:0/3619380884 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4a341343b0 0x7f4a340c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:58.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.725+0000 7f4a39308640 1 --2- 172.21.15.162:0/3619380884 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4a14067910 0x7f4a14069dd0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:58.777 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.725+0000 7f4a39308640 1 --2- 172.21.15.162:0/3619380884 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4a341339e0 0x7f4a340cc850 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:58.777 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.725+0000 7f4a39308640 1 --2- 172.21.15.162:0/3619380884 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4a20004810 0x7f4a341f3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:58.777 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.725+0000 7f4a39308640 1 -- 172.21.15.162:0/3619380884 >> 172.21.15.162:0/3619380884 conn(0x7f4a34070290 msgr2=0x7f4a34130630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:58.777 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.725+0000 7f4a39308640 1 -- 172.21.15.162:0/3619380884 shutdown_connections 2024-04-25T00:50:58.777 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.725+0000 7f4a39308640 1 -- 172.21.15.162:0/3619380884 wait complete. 2024-04-25T00:50:58.777 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T00:50:58.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.893+0000 7f00e018b640 1 Processor -- start 2024-04-25T00:50:58.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.893+0000 7f00e018b640 1 -- start start 2024-04-25T00:50:58.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.897+0000 7f00e018b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f00d814da50 0x7f00d80c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:58.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.897+0000 7f00e018b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00d80c6c60 0x7f00d8072f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:58.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.897+0000 7f00e018b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00d814de30 con 0x7f00d80c7ba0 2024-04-25T00:50:58.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.897+0000 7f00e018b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f00d80c3f10 con 0x7f00d814da50 2024-04-25T00:50:58.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.897+0000 7f00e018b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f00d80c41f0 con 0x7f00d80c6c60 2024-04-25T00:50:58.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.897+0000 7f00ddf27640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f00d814da50 0x7f00d80c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:58.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.897+0000 7f00ddf27640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f00d814da50 0x7f00d80c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40270/0 (socket says 172.21.15.162:40270) 2024-04-25T00:50:58.899 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.897+0000 7f00ddf27640 1 -- 172.21.15.162:0/1290284120 learned_addr learned my addr 172.21.15.162:0/1290284120 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:58.899 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.897+0000 7f00dd726640 1 --2- 172.21.15.162:0/1290284120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00d80c6c60 0x7f00d8072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:58.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.901+0000 7f00ddf27640 1 -- 172.21.15.162:0/1290284120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00d80c6c60 msgr2=0x7f00d8072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:58.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.901+0000 7f00ddf27640 1 --2- 172.21.15.162:0/1290284120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00d80c6c60 0x7f00d8072f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:58.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.901+0000 7f00ddf27640 1 -- 172.21.15.162:0/1290284120 >> v1:172.21.15.162:6789/0 conn(0x7f00d80c7ba0 legacy=0x7f00d8157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:58.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.901+0000 7f00ddf27640 1 -- 172.21.15.162:0/1290284120 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d80c44d0 con 0x7f00d814da50 2024-04-25T00:50:58.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.905+0000 7f00ddf27640 1 --2- 172.21.15.162:0/1290284120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d814da50 0x7f00d80c7660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009e50 tx=0x7f00d001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87039d5560904f9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:58.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.909+0000 7f00dcf25640 1 -- 172.21.15.162:0/1290284120 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d00a5750 con 0x7f00d814da50 2024-04-25T00:50:58.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.909+0000 7f00dcf25640 1 -- 172.21.15.162:0/1290284120 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00d00a58f0 con 0x7f00d814da50 2024-04-25T00:50:58.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.909+0000 7f00dcf25640 1 -- 172.21.15.162:0/1290284120 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d00a5cc0 con 0x7f00d814da50 2024-04-25T00:50:58.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.909+0000 7f00e018b640 1 -- 172.21.15.162:0/1290284120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d814da50 msgr2=0x7f00d80c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:58.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.909+0000 7f00e018b640 1 --2- 172.21.15.162:0/1290284120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d814da50 0x7f00d80c7660 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009e50 tx=0x7f00d001c9a0 comp rx=0 tx=0).stop 2024-04-25T00:50:58.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.909+0000 7f00e018b640 1 -- 172.21.15.162:0/1290284120 shutdown_connections 2024-04-25T00:50:58.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.909+0000 7f00e018b640 1 --2- 172.21.15.162:0/1290284120 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00d80c6c60 0x7f00d8072f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:58.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.909+0000 7f00e018b640 1 --2- 172.21.15.162:0/1290284120 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d814da50 0x7f00d80c7660 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:58.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.909+0000 7f00e018b640 1 -- 172.21.15.162:0/1290284120 >> 172.21.15.162:0/1290284120 conn(0x7f00d8070370 msgr2=0x7f00d8070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:58.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.909+0000 7f00e018b640 1 -- 172.21.15.162:0/1290284120 shutdown_connections 2024-04-25T00:50:58.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.909+0000 7f00e018b640 1 -- 172.21.15.162:0/1290284120 wait complete. 2024-04-25T00:50:58.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.913+0000 7f00e018b640 1 Processor -- start 2024-04-25T00:50:58.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.913+0000 7f00e018b640 1 -- start start 2024-04-25T00:50:58.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.913+0000 7f00e018b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00d80c6c60 0x7f00d81420a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:58.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.913+0000 7f00e018b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00d80c7ba0 0x7f00d8138960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:58.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.913+0000 7f00e018b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d814da50 0x7f00d8138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:58.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.913+0000 7f00e018b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f00d806b390 con 0x7f00d814da50 2024-04-25T00:50:58.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.913+0000 7f00e018b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f00d806b210 con 0x7f00d80c6c60 2024-04-25T00:50:58.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.913+0000 7f00e018b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f00d806b510 con 0x7f00d80c7ba0 2024-04-25T00:50:58.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.913+0000 7f00de728640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d814da50 0x7f00d8138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:58.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.913+0000 7f00de728640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d814da50 0x7f00d8138ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40284/0 (socket says 172.21.15.162:40284) 2024-04-25T00:50:58.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.913+0000 7f00de728640 1 -- 172.21.15.162:0/3660438002 learned_addr learned my addr 172.21.15.162:0/3660438002 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:58.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.913+0000 7f00dd726640 1 --2- 172.21.15.162:0/3660438002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00d80c7ba0 0x7f00d8138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:58.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.913+0000 7f00ddf27640 1 --2- 172.21.15.162:0/3660438002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00d80c6c60 0x7f00d81420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:58.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.917+0000 7f00de728640 1 -- 172.21.15.162:0/3660438002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00d80c7ba0 msgr2=0x7f00d8138960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:58.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.917+0000 7f00de728640 1 --2- 172.21.15.162:0/3660438002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00d80c7ba0 0x7f00d8138960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:58.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.917+0000 7f00de728640 1 -- 172.21.15.162:0/3660438002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00d80c6c60 msgr2=0x7f00d81420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:58.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.917+0000 7f00de728640 1 --2- 172.21.15.162:0/3660438002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00d80c6c60 0x7f00d81420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:58.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.917+0000 7f00de728640 1 -- 172.21.15.162:0/3660438002 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00d80c59e0 con 0x7f00d814da50 2024-04-25T00:50:58.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.917+0000 7f00de728640 1 --2- 172.21.15.162:0/3660438002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d814da50 0x7f00d8138ea0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f00d400c3c0 tx=0x7f00d400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:58.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.925+0000 7f00ce7fc640 1 -- 172.21.15.162:0/3660438002 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4017070 con 0x7f00d814da50 2024-04-25T00:50:58.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.925+0000 7f00ce7fc640 1 -- 172.21.15.162:0/3660438002 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00d40052d0 con 0x7f00d814da50 2024-04-25T00:50:58.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.925+0000 7f00e018b640 1 -- 172.21.15.162:0/3660438002 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00d80cabe0 con 0x7f00d814da50 2024-04-25T00:50:58.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.925+0000 7f00ce7fc640 1 -- 172.21.15.162:0/3660438002 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4003840 con 0x7f00d814da50 2024-04-25T00:50:58.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.925+0000 7f00e018b640 1 -- 172.21.15.162:0/3660438002 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00d8155f90 con 0x7f00d814da50 2024-04-25T00:50:58.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:58.925+0000 7f00e018b640 1 -- 172.21.15.162:0/3660438002 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00d8075110 con 0x7f00d814da50 2024-04-25T00:50:59.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.205+0000 7f00ce7fc640 1 -- 172.21.15.162:0/3660438002 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f00d401a070 con 0x7f00d814da50 2024-04-25T00:50:59.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.205+0000 7f00ce7fc640 1 --2- 172.21.15.162:0/3660438002 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f00bc067910 0x7f00bc069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:59.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.205+0000 7f00ddf27640 1 --2- 172.21.15.162:0/3660438002 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f00bc067910 0x7f00bc069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:59.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.205+0000 7f00ddf27640 1 --2- 172.21.15.162:0/3660438002 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f00bc067910 0x7f00bc069dd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f00d00ae000 tx=0x7f00d00a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:59.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.245+0000 7f00ce7fc640 1 -- 172.21.15.162:0/3660438002 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f00d40538f0 con 0x7f00d814da50 2024-04-25T00:50:59.259 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.257+0000 7f00ce7fc640 1 -- 172.21.15.162:0/3660438002 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f00d4021020 con 0x7f00d814da50 2024-04-25T00:50:59.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.485+0000 7f00e018b640 1 -- 172.21.15.162:0/3660438002 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f00d80c7440 con 0x7f00d814da50 2024-04-25T00:50:59.495 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.493+0000 7f00ce7fc640 1 -- 172.21.15.162:0/3660438002 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f00d4005480 con 0x7f00d814da50 2024-04-25T00:50:59.496 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-04-25T00:50:59.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.497+0000 7f00e018b640 1 -- 172.21.15.162:0/3660438002 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f00bc067910 msgr2=0x7f00bc069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:59.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.497+0000 7f00e018b640 1 --2- 172.21.15.162:0/3660438002 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f00bc067910 0x7f00bc069dd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f00d00ae000 tx=0x7f00d00a7070 comp rx=0 tx=0).stop 2024-04-25T00:50:59.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.497+0000 7f00e018b640 1 -- 172.21.15.162:0/3660438002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d814da50 msgr2=0x7f00d8138ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:59.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.497+0000 7f00e018b640 1 --2- 172.21.15.162:0/3660438002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d814da50 0x7f00d8138ea0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f00d400c3c0 tx=0x7f00d400c880 comp rx=0 tx=0).stop 2024-04-25T00:50:59.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.497+0000 7f00e018b640 1 -- 172.21.15.162:0/3660438002 shutdown_connections 2024-04-25T00:50:59.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.497+0000 7f00e018b640 1 --2- 172.21.15.162:0/3660438002 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f00bc067910 0x7f00bc069dd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:59.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.497+0000 7f00e018b640 1 --2- 172.21.15.162:0/3660438002 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00d814da50 0x7f00d8138ea0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:59.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.497+0000 7f00e018b640 1 --2- 172.21.15.162:0/3660438002 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00d80c7ba0 0x7f00d8138960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:59.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.497+0000 7f00e018b640 1 --2- 172.21.15.162:0/3660438002 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00d80c6c60 0x7f00d81420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:59.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.497+0000 7f00e018b640 1 -- 172.21.15.162:0/3660438002 >> 172.21.15.162:0/3660438002 conn(0x7f00d8070370 msgr2=0x7f00d806c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:59.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.497+0000 7f00e018b640 1 -- 172.21.15.162:0/3660438002 shutdown_connections 2024-04-25T00:50:59.500 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.497+0000 7f00e018b640 1 -- 172.21.15.162:0/3660438002 wait complete. 2024-04-25T00:50:59.515 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T00:50:59.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.633+0000 7f6c14971640 1 Processor -- start 2024-04-25T00:50:59.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.633+0000 7f6c14971640 1 -- start start 2024-04-25T00:50:59.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.637+0000 7f6c14971640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c10154470 0x7f6c100cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:59.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.637+0000 7f6c14971640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6c10071380 0x7f6c100717e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:59.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.637+0000 7f6c14971640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c1006c3c0 con 0x7f6c10154850 2024-04-25T00:50:59.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.637+0000 7f6c14971640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6c1006cf90 con 0x7f6c10071380 2024-04-25T00:50:59.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.637+0000 7f6c14971640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6c1006c660 con 0x7f6c10154470 2024-04-25T00:50:59.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.637+0000 7f6c0ed9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6c10071380 0x7f6c100717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:59.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.637+0000 7f6c0ed9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6c10071380 0x7f6c100717e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40298/0 (socket says 172.21.15.162:40298) 2024-04-25T00:50:59.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.637+0000 7f6c0ed9d640 1 -- 172.21.15.162:0/4184884549 learned_addr learned my addr 172.21.15.162:0/4184884549 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:59.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.637+0000 7f6c0e59c640 1 --2- 172.21.15.162:0/4184884549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c10154470 0x7f6c100cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:59.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.637+0000 7f6c0ed9d640 1 -- 172.21.15.162:0/4184884549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c10154470 msgr2=0x7f6c100cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:50:59.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.637+0000 7f6c0ed9d640 1 --2- 172.21.15.162:0/4184884549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c10154470 0x7f6c100cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:59.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.637+0000 7f6c0ed9d640 1 -- 172.21.15.162:0/4184884549 >> v1:172.21.15.179:6789/0 conn(0x7f6c10154850 legacy=0x7f6c1015adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:59.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.637+0000 7f6c0ed9d640 1 -- 172.21.15.162:0/4184884549 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c1006c940 con 0x7f6c10071380 2024-04-25T00:50:59.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.641+0000 7f6c0ed9d640 1 --2- 172.21.15.162:0/4184884549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071380 0x7f6c100717e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009870 tx=0x7f6c0001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cbc8de32b4b690 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:59.646 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.645+0000 7f6c0d59a640 1 -- 172.21.15.162:0/4184884549 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c000b2070 con 0x7f6c10071380 2024-04-25T00:50:59.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.645+0000 7f6c0d59a640 1 -- 172.21.15.162:0/4184884549 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c000a9070 con 0x7f6c10071380 2024-04-25T00:50:59.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.645+0000 7f6c0d59a640 1 -- 172.21.15.162:0/4184884549 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c000ad880 con 0x7f6c10071380 2024-04-25T00:50:59.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.649+0000 7f6c14971640 1 -- 172.21.15.162:0/4184884549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071380 msgr2=0x7f6c100717e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:59.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.649+0000 7f6c14971640 1 --2- 172.21.15.162:0/4184884549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071380 0x7f6c100717e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6c00009870 tx=0x7f6c0001c560 comp rx=0 tx=0).stop 2024-04-25T00:50:59.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.649+0000 7f6c14971640 1 -- 172.21.15.162:0/4184884549 shutdown_connections 2024-04-25T00:50:59.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.649+0000 7f6c14971640 1 --2- 172.21.15.162:0/4184884549 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071380 0x7f6c100717e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:59.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.649+0000 7f6c14971640 1 --2- 172.21.15.162:0/4184884549 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c10154470 0x7f6c100cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:59.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.649+0000 7f6c14971640 1 -- 172.21.15.162:0/4184884549 >> 172.21.15.162:0/4184884549 conn(0x7f6c1006b810 msgr2=0x7f6c1006f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:50:59.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.649+0000 7f6c14971640 1 -- 172.21.15.162:0/4184884549 shutdown_connections 2024-04-25T00:50:59.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.649+0000 7f6c14971640 1 -- 172.21.15.162:0/4184884549 wait complete. 2024-04-25T00:50:59.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.649+0000 7f6c14971640 1 Processor -- start 2024-04-25T00:50:59.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.649+0000 7f6c14971640 1 -- start start 2024-04-25T00:50:59.651 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.649+0000 7f6c14971640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071380 0x7f6c10158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:59.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.649+0000 7f6c14971640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c10154470 0x7f6c1015ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:59.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.649+0000 7f6c14971640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c10154850 0x7f6c1014d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:59.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.649+0000 7f6c14971640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6c10166e50 con 0x7f6c10071380 2024-04-25T00:50:59.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.649+0000 7f6c14971640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6c10166cd0 con 0x7f6c10154850 2024-04-25T00:50:59.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.649+0000 7f6c14971640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6c10166fd0 con 0x7f6c10154470 2024-04-25T00:50:59.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.649+0000 7f6c0e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071380 0x7f6c10158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:59.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.653+0000 7f6c0e59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071380 0x7f6c10158230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40312/0 (socket says 172.21.15.162:40312) 2024-04-25T00:50:59.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.653+0000 7f6c0e59c640 1 -- 172.21.15.162:0/3713740867 learned_addr learned my addr 172.21.15.162:0/3713740867 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:50:59.654 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.653+0000 7f6c0dd9b640 1 --2- 172.21.15.162:0/3713740867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c10154470 0x7f6c1015ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:59.654 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.653+0000 7f6c0ed9d640 1 --2- 172.21.15.162:0/3713740867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c10154850 0x7f6c1014d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:59.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.653+0000 7f6c0e59c640 1 -- 172.21.15.162:0/3713740867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c10154470 msgr2=0x7f6c1015ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:59.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.653+0000 7f6c0e59c640 1 --2- 172.21.15.162:0/3713740867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c10154470 0x7f6c1015ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:59.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.653+0000 7f6c0e59c640 1 -- 172.21.15.162:0/3713740867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c10154850 msgr2=0x7f6c1014d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:50:59.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.653+0000 7f6c0e59c640 1 --2- 172.21.15.162:0/3713740867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c10154850 0x7f6c1014d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:50:59.656 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.653+0000 7f6c0e59c640 1 -- 172.21.15.162:0/3713740867 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c10158770 con 0x7f6c10071380 2024-04-25T00:50:59.658 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.657+0000 7f6c0e59c640 1 --2- 172.21.15.162:0/3713740867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071380 0x7f6c10158230 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6c08007e40 tx=0x7f6c0800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:59.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.661+0000 7f6bfeffd640 1 -- 172.21.15.162:0/3713740867 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08014620 con 0x7f6c10071380 2024-04-25T00:50:59.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.661+0000 7f6bfeffd640 1 -- 172.21.15.162:0/3713740867 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c08019070 con 0x7f6c10071380 2024-04-25T00:50:59.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.661+0000 7f6c14971640 1 -- 172.21.15.162:0/3713740867 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c10158a00 con 0x7f6c10071380 2024-04-25T00:50:59.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.661+0000 7f6bfeffd640 1 -- 172.21.15.162:0/3713740867 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c08014a00 con 0x7f6c10071380 2024-04-25T00:50:59.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.661+0000 7f6c14971640 1 -- 172.21.15.162:0/3713740867 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c1015cae0 con 0x7f6c10071380 2024-04-25T00:50:59.663 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.661+0000 7f6c14971640 1 -- 172.21.15.162:0/3713740867 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c10075110 con 0x7f6c10071380 2024-04-25T00:50:59.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.681+0000 7f6bfeffd640 1 -- 172.21.15.162:0/3713740867 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6c08014ba0 con 0x7f6c10071380 2024-04-25T00:50:59.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.681+0000 7f6bfeffd640 1 --2- 172.21.15.162:0/3713740867 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6bf0067910 0x7f6bf0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:50:59.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.681+0000 7f6c0dd9b640 1 --2- 172.21.15.162:0/3713740867 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6bf0067910 0x7f6bf0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:50:59.685 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.685+0000 7f6c0dd9b640 1 --2- 172.21.15.162:0/3713740867 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6bf0067910 0x7f6bf0069dd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6c100cb4e0 tx=0x7f6c04009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:50:59.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.961+0000 7f6bfeffd640 1 -- 172.21.15.162:0/3713740867 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f6c080557c0 con 0x7f6c10071380 2024-04-25T00:50:59.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:50:59.965+0000 7f6bfeffd640 1 -- 172.21.15.162:0/3713740867 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f6c08057720 con 0x7f6c10071380 2024-04-25T00:51:00.127 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.125+0000 7f6c14971640 1 -- 172.21.15.162:0/3713740867 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6c100ce590 con 0x7f6c10071380 2024-04-25T00:51:00.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.137+0000 7f6bfeffd640 1 -- 172.21.15.162:0/3713740867 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f6c0805ba20 con 0x7f6c10071380 2024-04-25T00:51:00.139 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-04-25T00:51:00.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.141+0000 7f6c14971640 1 -- 172.21.15.162:0/3713740867 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6bf0067910 msgr2=0x7f6bf0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:00.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.141+0000 7f6c14971640 1 --2- 172.21.15.162:0/3713740867 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6bf0067910 0x7f6bf0069dd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6c100cb4e0 tx=0x7f6c04009040 comp rx=0 tx=0).stop 2024-04-25T00:51:00.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.141+0000 7f6c14971640 1 -- 172.21.15.162:0/3713740867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071380 msgr2=0x7f6c10158230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:00.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.141+0000 7f6c14971640 1 --2- 172.21.15.162:0/3713740867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071380 0x7f6c10158230 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6c08007e40 tx=0x7f6c0800e4b0 comp rx=0 tx=0).stop 2024-04-25T00:51:00.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.141+0000 7f6c14971640 1 -- 172.21.15.162:0/3713740867 shutdown_connections 2024-04-25T00:51:00.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.141+0000 7f6c14971640 1 --2- 172.21.15.162:0/3713740867 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6c10154850 0x7f6c1014d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:00.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.141+0000 7f6c14971640 1 --2- 172.21.15.162:0/3713740867 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6c10154470 0x7f6c1015ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:00.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.141+0000 7f6c14971640 1 --2- 172.21.15.162:0/3713740867 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6bf0067910 0x7f6bf0069dd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:00.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.141+0000 7f6c14971640 1 --2- 172.21.15.162:0/3713740867 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6c10071380 0x7f6c10158230 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:00.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.141+0000 7f6c14971640 1 -- 172.21.15.162:0/3713740867 >> 172.21.15.162:0/3713740867 conn(0x7f6c1006b810 msgr2=0x7f6c100cc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:00.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.141+0000 7f6c14971640 1 -- 172.21.15.162:0/3713740867 shutdown_connections 2024-04-25T00:51:00.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.141+0000 7f6c14971640 1 -- 172.21.15.162:0/3713740867 wait complete. 2024-04-25T00:51:00.159 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T00:51:00.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.273+0000 7fdcebb9d640 1 Processor -- start 2024-04-25T00:51:00.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.273+0000 7fdcebb9d640 1 -- start start 2024-04-25T00:51:00.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.273+0000 7fdcebb9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdce406b210 0x7fdce406d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:00.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.273+0000 7fdcebb9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce406df10 0x7fdce40c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:00.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.273+0000 7fdcebb9d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce415b660 con 0x7fdce415c140 2024-04-25T00:51:00.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.273+0000 7fdcebb9d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fdce4158400 con 0x7fdce406b210 2024-04-25T00:51:00.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.273+0000 7fdcebb9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdce41580b0 con 0x7fdce406df10 2024-04-25T00:51:00.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.273+0000 7fdce9939640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fdce415c140 0x7fdce4158890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:35426/0 (socket says 172.21.15.162:35426) 2024-04-25T00:51:00.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.273+0000 7fdce9939640 1 -- 172.21.15.162:0/3320435499 learned_addr learned my addr 172.21.15.162:0/3320435499 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:51:00.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.277+0000 7fdcea13a640 1 --2- 172.21.15.162:0/3320435499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce406df10 0x7fdce40c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:00.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.277+0000 7fdce9138640 1 --2- 172.21.15.162:0/3320435499 >> v2:172.21.15.162:3300/0 conn(0x7fdce406b210 0x7fdce406d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:00.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.281+0000 7fdce8937640 1 -- 172.21.15.162:0/3320435499 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2370826963 0 0) 0x7fdce415b660 con 0x7fdce415c140 2024-04-25T00:51:00.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.281+0000 7fdce8937640 1 -- 172.21.15.162:0/3320435499 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcd0003530 con 0x7fdce415c140 2024-04-25T00:51:00.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.281+0000 7fdce9138640 1 -- 172.21.15.162:0/3320435499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce406df10 msgr2=0x7fdce40c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:00.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.281+0000 7fdce9138640 1 --2- 172.21.15.162:0/3320435499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce406df10 0x7fdce40c57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:00.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.281+0000 7fdce9138640 1 -- 172.21.15.162:0/3320435499 >> v1:172.21.15.179:6789/0 conn(0x7fdce415c140 legacy=0x7fdce4158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:00.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.281+0000 7fdce9138640 1 -- 172.21.15.162:0/3320435499 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce40c6ab0 con 0x7fdce406b210 2024-04-25T00:51:00.284 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.281+0000 7fdce9138640 1 --2- 172.21.15.162:0/3320435499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdce406b210 0x7fdce406d9d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdce4158580 tx=0x7fdcd401ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a02d7c6593f4bfd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:00.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdce8937640 1 -- 172.21.15.162:0/3320435499 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd40b5070 con 0x7fdce406b210 2024-04-25T00:51:00.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdce8937640 1 -- 172.21.15.162:0/3320435499 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd40a8990 con 0x7fdce406b210 2024-04-25T00:51:00.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdce8937640 1 -- 172.21.15.162:0/3320435499 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd40a8d60 con 0x7fdce406b210 2024-04-25T00:51:00.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdcebb9d640 1 -- 172.21.15.162:0/3320435499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdce406b210 msgr2=0x7fdce406d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:00.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdcebb9d640 1 --2- 172.21.15.162:0/3320435499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdce406b210 0x7fdce406d9d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdce4158580 tx=0x7fdcd401ec90 comp rx=0 tx=0).stop 2024-04-25T00:51:00.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdcebb9d640 1 -- 172.21.15.162:0/3320435499 shutdown_connections 2024-04-25T00:51:00.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdcebb9d640 1 --2- 172.21.15.162:0/3320435499 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce406df10 0x7fdce40c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:00.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdcebb9d640 1 --2- 172.21.15.162:0/3320435499 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdce406b210 0x7fdce406d9d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:00.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdcebb9d640 1 -- 172.21.15.162:0/3320435499 >> 172.21.15.162:0/3320435499 conn(0x7fdce406fab0 msgr2=0x7fdce406fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:00.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdcebb9d640 1 -- 172.21.15.162:0/3320435499 shutdown_connections 2024-04-25T00:51:00.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdcebb9d640 1 -- 172.21.15.162:0/3320435499 wait complete. 2024-04-25T00:51:00.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdcebb9d640 1 Processor -- start 2024-04-25T00:51:00.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdcebb9d640 1 -- start start 2024-04-25T00:51:00.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdcebb9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdce406b210 0x7fdce40c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:00.295 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdcebb9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdce406df10 0x7fdce40c4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:00.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdcebb9d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce415c140 0x7fdce4153780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:00.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdcebb9d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdce40c7350 con 0x7fdce406df10 2024-04-25T00:51:00.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdcebb9d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdce40c7070 con 0x7fdce406b210 2024-04-25T00:51:00.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.289+0000 7fdcebb9d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdce415c520 con 0x7fdce415c140 2024-04-25T00:51:00.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.293+0000 7fdcea13a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce415c140 0x7fdce4153780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:00.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.293+0000 7fdce9939640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdce406b210 0x7fdce40c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:00.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.293+0000 7fdce9138640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdce406df10 0x7fdce40c4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:00.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.293+0000 7fdce9939640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdce406b210 0x7fdce40c3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:60756/0 (socket says 172.21.15.162:60756) 2024-04-25T00:51:00.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.293+0000 7fdce9939640 1 -- 172.21.15.162:0/1681275615 learned_addr learned my addr 172.21.15.162:0/1681275615 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:00.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.297+0000 7fdce9138640 1 -- 172.21.15.162:0/1681275615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce415c140 msgr2=0x7fdce4153780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:00.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.297+0000 7fdce9138640 1 --2- 172.21.15.162:0/1681275615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce415c140 0x7fdce4153780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:00.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.297+0000 7fdce9138640 1 -- 172.21.15.162:0/1681275615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdce406b210 msgr2=0x7fdce40c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:00.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.297+0000 7fdce9138640 1 --2- 172.21.15.162:0/1681275615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdce406b210 0x7fdce40c3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:00.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.297+0000 7fdce9138640 1 -- 172.21.15.162:0/1681275615 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce40c32d0 con 0x7fdce406df10 2024-04-25T00:51:00.299 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.297+0000 7fdce9138640 1 --2- 172.21.15.162:0/1681275615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdce406df10 0x7fdce40c4a90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40af000 tx=0x7fdcd401ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:00.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.301+0000 7fdcda7fc640 1 -- 172.21.15.162:0/1681275615 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd40bf070 con 0x7fdce406df10 2024-04-25T00:51:00.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.301+0000 7fdcda7fc640 1 -- 172.21.15.162:0/1681275615 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd40b0720 con 0x7fdce406df10 2024-04-25T00:51:00.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.301+0000 7fdcda7fc640 1 -- 172.21.15.162:0/1681275615 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd40b5040 con 0x7fdce406df10 2024-04-25T00:51:00.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.301+0000 7fdcebb9d640 1 -- 172.21.15.162:0/1681275615 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce40c5090 con 0x7fdce406df10 2024-04-25T00:51:00.304 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.301+0000 7fdcebb9d640 1 -- 172.21.15.162:0/1681275615 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce40c3570 con 0x7fdce406df10 2024-04-25T00:51:00.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.301+0000 7fdcebb9d640 1 -- 172.21.15.162:0/1681275615 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce404f5f0 con 0x7fdce406df10 2024-04-25T00:51:00.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.321+0000 7fdcda7fc640 1 -- 172.21.15.162:0/1681275615 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdcd40b0b10 con 0x7fdce406df10 2024-04-25T00:51:00.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.321+0000 7fdcda7fc640 1 --2- 172.21.15.162:0/1681275615 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdcc80678c0 0x7fdcc8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:00.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.321+0000 7fdce9939640 1 --2- 172.21.15.162:0/1681275615 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdcc80678c0 0x7fdcc8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:00.325 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.321+0000 7fdce9939640 1 --2- 172.21.15.162:0/1681275615 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdcc80678c0 0x7fdcc8069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdce00011f0 tx=0x7fdce0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:00.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.325+0000 7fdcda7fc640 1 -- 172.21.15.162:0/1681275615 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fdcd40b0e00 con 0x7fdce406df10 2024-04-25T00:51:00.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.637+0000 7fdcda7fc640 1 -- 172.21.15.162:0/1681275615 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fdcd40187f0 con 0x7fdce406df10 2024-04-25T00:51:00.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.841+0000 7fdcebb9d640 1 -- 172.21.15.162:0/1681275615 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdce406e4f0 con 0x7fdce406df10 2024-04-25T00:51:00.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.957+0000 7fdcda7fc640 1 -- 172.21.15.162:0/1681275615 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6919 (secure 0 0 0) 0x7fdcd40f2980 con 0x7fdce406df10 2024-04-25T00:51:00.958 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:51:00.959 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/560649188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":560649188},{"type":"v1","addr":"172.21.15.179:6833","nonce":560649188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T00:50:35.645685+0000","modified":"2024-04-25T00:50:58.084533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4246,"mds_1":4244,"mds_2":4241,"mds_3":4240,"mds_4":4233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4233":{"gid":4233,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":11,"addr":"172.21.15.179:6835/1339390327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1339390327},{"type":"v1","addr":"172.21.15.179:6835","nonce":1339390327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4240":{"gid":4240,"name":"e","rank":3,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.162:6835/191105979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":191105979},{"type":"v1","addr":"172.21.15.162:6835","nonce":191105979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4241":{"gid":4241,"name":"c","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2357127318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2357127318},{"type":"v1","addr":"172.21.15.162:6839","nonce":2357127318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4244":{"gid":4244,"name":"f","rank":1,"incarnation":8,"state":"up:active","state_seq":7,"addr":"172.21.15.179:6837/2607965795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2607965795},{"type":"v1","addr":"172.21.15.179:6837","nonce":2607965795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4246":{"gid":4246,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":6,"addr":"172.21.15.162:6837/1743481688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1743481688},{"type":"v1","addr":"172.21.15.162:6837","nonce":1743481688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4233,4246,4240,4241,4244]},"id":1}]} 2024-04-25T00:51:00.959 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 17 2024-04-25T00:51:00.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.961+0000 7fdcebb9d640 1 -- 172.21.15.162:0/1681275615 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdcc80678c0 msgr2=0x7fdcc8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:00.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.961+0000 7fdcebb9d640 1 --2- 172.21.15.162:0/1681275615 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdcc80678c0 0x7fdcc8069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdce00011f0 tx=0x7fdce0009040 comp rx=0 tx=0).stop 2024-04-25T00:51:00.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.961+0000 7fdcebb9d640 1 -- 172.21.15.162:0/1681275615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdce406df10 msgr2=0x7fdce40c4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:00.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.961+0000 7fdcebb9d640 1 --2- 172.21.15.162:0/1681275615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdce406df10 0x7fdce40c4a90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdcd40af000 tx=0x7fdcd401ba30 comp rx=0 tx=0).stop 2024-04-25T00:51:00.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.961+0000 7fdcebb9d640 1 -- 172.21.15.162:0/1681275615 shutdown_connections 2024-04-25T00:51:00.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.961+0000 7fdcebb9d640 1 --2- 172.21.15.162:0/1681275615 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdce415c140 0x7fdce4153780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:00.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.961+0000 7fdcebb9d640 1 --2- 172.21.15.162:0/1681275615 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdcc80678c0 0x7fdcc8069d80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:00.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.961+0000 7fdcebb9d640 1 --2- 172.21.15.162:0/1681275615 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdce406df10 0x7fdce40c4a90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:00.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.961+0000 7fdcebb9d640 1 --2- 172.21.15.162:0/1681275615 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdce406b210 0x7fdce40c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:00.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.961+0000 7fdcebb9d640 1 -- 172.21.15.162:0/1681275615 >> 172.21.15.162:0/1681275615 conn(0x7fdce406fab0 msgr2=0x7fdce4159cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:00.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.961+0000 7fdcebb9d640 1 -- 172.21.15.162:0/1681275615 shutdown_connections 2024-04-25T00:51:00.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:00.961+0000 7fdcebb9d640 1 -- 172.21.15.162:0/1681275615 wait complete. 2024-04-25T00:51:00.981 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T00:51:01.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.089+0000 7f2fd9b3b640 1 Processor -- start 2024-04-25T00:51:01.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.089+0000 7f2fd9b3b640 1 -- start start 2024-04-25T00:51:01.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.089+0000 7f2fd9b3b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2fd4154650 0x7f2fd40cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:01.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.089+0000 7f2fd9b3b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd40cf550 0x7f2fd415bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:01.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.089+0000 7f2fd9b3b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fd415c490 con 0x7f2fd415c000 2024-04-25T00:51:01.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.089+0000 7f2fd9b3b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2fd40cd9e0 con 0x7f2fd4154650 2024-04-25T00:51:01.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.089+0000 7f2fd9b3b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2fd40cdcc0 con 0x7f2fd40cf550 2024-04-25T00:51:01.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.089+0000 7f2fd37fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2fd4154650 0x7f2fd40cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:01.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.089+0000 7f2fd37fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2fd4154650 0x7f2fd40cf010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40336/0 (socket says 172.21.15.162:40336) 2024-04-25T00:51:01.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.089+0000 7f2fd37fe640 1 -- 172.21.15.162:0/3014750652 learned_addr learned my addr 172.21.15.162:0/3014750652 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:01.092 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.089+0000 7f2fd2ffd640 1 --2- 172.21.15.162:0/3014750652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd40cf550 0x7f2fd415bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:01.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.093+0000 7f2fd37fe640 1 -- 172.21.15.162:0/3014750652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd40cf550 msgr2=0x7f2fd415bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:01.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.093+0000 7f2fd37fe640 1 --2- 172.21.15.162:0/3014750652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd40cf550 0x7f2fd415bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:01.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.093+0000 7f2fd37fe640 1 -- 172.21.15.162:0/3014750652 >> v1:172.21.15.162:6789/0 conn(0x7f2fd415c000 legacy=0x7f2fd406c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:01.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.093+0000 7f2fd37fe640 1 -- 172.21.15.162:0/3014750652 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd40cdfa0 con 0x7f2fd4154650 2024-04-25T00:51:01.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.101+0000 7f2fd37fe640 1 --2- 172.21.15.162:0/3014750652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4154650 0x7f2fd40cf010 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8009870 tx=0x7f2fc801ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfabd14253ce640 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:01.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd27fc640 1 -- 172.21.15.162:0/3014750652 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80b5070 con 0x7f2fd4154650 2024-04-25T00:51:01.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd27fc640 1 -- 172.21.15.162:0/3014750652 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc80a8a50 con 0x7f2fd4154650 2024-04-25T00:51:01.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd27fc640 1 -- 172.21.15.162:0/3014750652 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80a8e20 con 0x7f2fd4154650 2024-04-25T00:51:01.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd9b3b640 1 -- 172.21.15.162:0/3014750652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4154650 msgr2=0x7f2fd40cf010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:01.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd9b3b640 1 --2- 172.21.15.162:0/3014750652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4154650 0x7f2fd40cf010 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2fc8009870 tx=0x7f2fc801ed50 comp rx=0 tx=0).stop 2024-04-25T00:51:01.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd9b3b640 1 -- 172.21.15.162:0/3014750652 shutdown_connections 2024-04-25T00:51:01.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd9b3b640 1 --2- 172.21.15.162:0/3014750652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd40cf550 0x7f2fd415bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:01.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd9b3b640 1 --2- 172.21.15.162:0/3014750652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4154650 0x7f2fd40cf010 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:01.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd9b3b640 1 -- 172.21.15.162:0/3014750652 >> 172.21.15.162:0/3014750652 conn(0x7f2fd40b1710 msgr2=0x7f2fd40b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:01.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd9b3b640 1 -- 172.21.15.162:0/3014750652 shutdown_connections 2024-04-25T00:51:01.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd9b3b640 1 -- 172.21.15.162:0/3014750652 wait complete. 2024-04-25T00:51:01.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd9b3b640 1 Processor -- start 2024-04-25T00:51:01.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd9b3b640 1 -- start start 2024-04-25T00:51:01.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd9b3b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd40cf550 0x7f2fd40c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:01.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd9b3b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4154650 0x7f2fd41f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:01.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd9b3b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fd415c000 0x7f2fd414dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:01.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd9b3b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd40ce840 con 0x7f2fd4154650 2024-04-25T00:51:01.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd9b3b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd40ce560 con 0x7f2fd415c000 2024-04-25T00:51:01.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.105+0000 7f2fd9b3b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2fd4154a30 con 0x7f2fd40cf550 2024-04-25T00:51:01.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.109+0000 7f2fd2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4154650 0x7f2fd41f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:01.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.109+0000 7f2fd2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4154650 0x7f2fd41f0120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:40350/0 (socket says 172.21.15.162:40350) 2024-04-25T00:51:01.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.109+0000 7f2fd2ffd640 1 -- 172.21.15.162:0/495930967 learned_addr learned my addr 172.21.15.162:0/495930967 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:01.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.109+0000 7f2fd3fff640 1 --2- 172.21.15.162:0/495930967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fd415c000 0x7f2fd414dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:01.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.109+0000 7f2fd37fe640 1 --2- 172.21.15.162:0/495930967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd40cf550 0x7f2fd40c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:01.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.109+0000 7f2fd2ffd640 1 -- 172.21.15.162:0/495930967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd40cf550 msgr2=0x7f2fd40c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:01.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.109+0000 7f2fd2ffd640 1 --2- 172.21.15.162:0/495930967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd40cf550 0x7f2fd40c72e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:01.112 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.109+0000 7f2fd2ffd640 1 -- 172.21.15.162:0/495930967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fd415c000 msgr2=0x7f2fd414dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:01.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.109+0000 7f2fd2ffd640 1 --2- 172.21.15.162:0/495930967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fd415c000 0x7f2fd414dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:01.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.109+0000 7f2fd2ffd640 1 -- 172.21.15.162:0/495930967 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd41f3810 con 0x7f2fd4154650 2024-04-25T00:51:01.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.113+0000 7f2fd2ffd640 1 --2- 172.21.15.162:0/495930967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4154650 0x7f2fd41f0120 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2fc400e960 tx=0x7f2fc400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:01.118 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.117+0000 7f2fbbfff640 1 -- 172.21.15.162:0/495930967 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc4017070 con 0x7f2fd4154650 2024-04-25T00:51:01.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.117+0000 7f2fbbfff640 1 -- 172.21.15.162:0/495930967 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fc400ca00 con 0x7f2fd4154650 2024-04-25T00:51:01.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.117+0000 7f2fbbfff640 1 -- 172.21.15.162:0/495930967 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fc400cdb0 con 0x7f2fd4154650 2024-04-25T00:51:01.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.117+0000 7f2fd9b3b640 1 -- 172.21.15.162:0/495930967 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fd41f0660 con 0x7f2fd4154650 2024-04-25T00:51:01.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.117+0000 7f2fd9b3b640 1 -- 172.21.15.162:0/495930967 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fd40c8ba0 con 0x7f2fd4154650 2024-04-25T00:51:01.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.117+0000 7f2fd9b3b640 1 -- 172.21.15.162:0/495930967 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fd4068a20 con 0x7f2fd4154650 2024-04-25T00:51:01.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.385+0000 7f2fbbfff640 1 -- 172.21.15.162:0/495930967 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2fc401a070 con 0x7f2fd4154650 2024-04-25T00:51:01.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.385+0000 7f2fbbfff640 1 --2- 172.21.15.162:0/495930967 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2fc0067910 0x7f2fc0069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:01.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.385+0000 7f2fd37fe640 1 --2- 172.21.15.162:0/495930967 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2fc0067910 0x7f2fc0069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:01.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.389+0000 7f2fd37fe640 1 --2- 172.21.15.162:0/495930967 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2fc0067910 0x7f2fc0069dd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80b2000 tx=0x7f2fc80aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:01.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.409+0000 7f2fbbfff640 1 -- 172.21.15.162:0/495930967 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f2fc4054990 con 0x7f2fd4154650 2024-04-25T00:51:01.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.409+0000 7f2fbbfff640 1 -- 172.21.15.162:0/495930967 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f2fc40568f0 con 0x7f2fd4154650 2024-04-25T00:51:01.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.573+0000 7f2fd9b3b640 1 -- 172.21.15.162:0/495930967 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2fd404f5f0 con 0x7f2fd4154650 2024-04-25T00:51:01.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.617+0000 7f2fbbfff640 1 -- 172.21.15.162:0/495930967 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+16641 (secure 0 0 0) 0x7f2fc405abf0 con 0x7f2fd4154650 2024-04-25T00:51:01.618 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:51:01.618 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":26,"fsid":"e141deed-4794-4a17-83c9-f6e6e8875f5e","created":"2024-04-25T00:49:29.904605+0000","modified":"2024-04-25T00:50:37.007717+0000","last_up_change":"2024-04-25T00:49:51.119342+0000","last_in_change":"2024-04-25T00:49:39.898293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T00:49:52.297093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T00:50:31.644475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T00:50:33.242786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e20986cc-3664-4988-959c-c0b02e380775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6811","nonce":2734546478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6813","nonce":2734546478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6817","nonce":2734546478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6815","nonce":2734546478}]},"public_addr":"172.21.15.162:6811/2734546478","cluster_addr":"172.21.15.162:6813/2734546478","heartbeat_back_addr":"172.21.15.162:6817/2734546478","heartbeat_front_addr":"172.21.15.162:6815/2734546478","state":["exists","up"]},{"osd":1,"uuid":"60f1608a-ecb7-4978-b816-ce6f419e275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6803","nonce":3488816098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6805","nonce":3488816098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6809","nonce":3488816098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6807","nonce":3488816098}]},"public_addr":"172.21.15.162:6803/3488816098","cluster_addr":"172.21.15.162:6805/3488816098","heartbeat_back_addr":"172.21.15.162:6809/3488816098","heartbeat_front_addr":"172.21.15.162:6807/3488816098","state":["exists","up"]},{"osd":2,"uuid":"77552061-8e19-4f49-bc3f-1300955a07b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6819","nonce":234337516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6821","nonce":234337516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6825","nonce":234337516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6823","nonce":234337516}]},"public_addr":"172.21.15.162:6819/234337516","cluster_addr":"172.21.15.162:6821/234337516","heartbeat_back_addr":"172.21.15.162:6825/234337516","heartbeat_front_addr":"172.21.15.162:6823/234337516","state":["exists","up"]},{"osd":3,"uuid":"5b105720-6e6d-4143-b5c4-0a3b1e4a687c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6827","nonce":1726903362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6829","nonce":1726903362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6833","nonce":1726903362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6831","nonce":1726903362}]},"public_addr":"172.21.15.162:6827/1726903362","cluster_addr":"172.21.15.162:6829/1726903362","heartbeat_back_addr":"172.21.15.162:6833/1726903362","heartbeat_front_addr":"172.21.15.162:6831/1726903362","state":["exists","up"]},{"osd":4,"uuid":"611eafc5-2fe0-4c96-ba8c-b1efc3930de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6817","nonce":3338082657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6819","nonce":3338082657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6823","nonce":3338082657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6821","nonce":3338082657}]},"public_addr":"172.21.15.179:6817/3338082657","cluster_addr":"172.21.15.179:6819/3338082657","heartbeat_back_addr":"172.21.15.179:6823/3338082657","heartbeat_front_addr":"172.21.15.179:6821/3338082657","state":["exists","up"]},{"osd":5,"uuid":"b39487f5-c314-4026-90bd-02e30ecca04f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6825","nonce":4129338239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6827","nonce":4129338239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6831","nonce":4129338239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6829","nonce":4129338239}]},"public_addr":"172.21.15.179:6825/4129338239","cluster_addr":"172.21.15.179:6827/4129338239","heartbeat_back_addr":"172.21.15.179:6831/4129338239","heartbeat_front_addr":"172.21.15.179:6829/4129338239","state":["exists","up"]},{"osd":6,"uuid":"1d902755-f992-4070-b30e-e79f5fb22d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6801","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6802","nonce":823843016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6806","nonce":823843016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6815","nonce":823843016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6810","nonce":823843016}]},"public_addr":"172.21.15.179:6802/823843016","cluster_addr":"172.21.15.179:6806/823843016","heartbeat_back_addr":"172.21.15.179:6815/823843016","heartbeat_front_addr":"172.21.15.179:6810/823843016","state":["exists","up"]},{"osd":7,"uuid":"ea529f85-28fd-4dc3-a584-314e71999061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6803","nonce":3403659125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6807","nonce":3403659125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6814","nonce":3403659125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6811","nonce":3403659125}]},"public_addr":"172.21.15.179:6803/3403659125","cluster_addr":"172.21.15.179:6807/3403659125","heartbeat_back_addr":"172.21.15.179:6814/3403659125","heartbeat_front_addr":"172.21.15.179:6811/3403659125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.684518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.583123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.644576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.815957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.787155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.814409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.657210+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.676697+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T00:51:01.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.617+0000 7f2fd9b3b640 1 -- 172.21.15.162:0/495930967 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2fc0067910 msgr2=0x7f2fc0069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:01.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.617+0000 7f2fd9b3b640 1 --2- 172.21.15.162:0/495930967 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2fc0067910 0x7f2fc0069dd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80b2000 tx=0x7f2fc80aa070 comp rx=0 tx=0).stop 2024-04-25T00:51:01.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.617+0000 7f2fd9b3b640 1 -- 172.21.15.162:0/495930967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4154650 msgr2=0x7f2fd41f0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:01.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.617+0000 7f2fd9b3b640 1 --2- 172.21.15.162:0/495930967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4154650 0x7f2fd41f0120 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2fc400e960 tx=0x7f2fc400ee20 comp rx=0 tx=0).stop 2024-04-25T00:51:01.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.617+0000 7f2fd9b3b640 1 -- 172.21.15.162:0/495930967 shutdown_connections 2024-04-25T00:51:01.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.617+0000 7f2fd9b3b640 1 --2- 172.21.15.162:0/495930967 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2fd415c000 0x7f2fd414dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:01.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.617+0000 7f2fd9b3b640 1 --2- 172.21.15.162:0/495930967 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2fc0067910 0x7f2fc0069dd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:01.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.617+0000 7f2fd9b3b640 1 --2- 172.21.15.162:0/495930967 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2fd4154650 0x7f2fd41f0120 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:01.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.617+0000 7f2fd9b3b640 1 --2- 172.21.15.162:0/495930967 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2fd40cf550 0x7f2fd40c72e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:01.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.617+0000 7f2fd9b3b640 1 -- 172.21.15.162:0/495930967 >> 172.21.15.162:0/495930967 conn(0x7f2fd40b1710 msgr2=0x7f2fd4150060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:01.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.617+0000 7f2fd9b3b640 1 -- 172.21.15.162:0/495930967 shutdown_connections 2024-04-25T00:51:01.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.617+0000 7f2fd9b3b640 1 -- 172.21.15.162:0/495930967 wait complete. 2024-04-25T00:51:01.636 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T00:49:52.297093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T00:50:31.644475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T00:50:33.242786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T00:51:01.636 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T00:51:01.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.745+0000 7f00b58e8640 1 Processor -- start 2024-04-25T00:51:01.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.745+0000 7f00b58e8640 1 -- start start 2024-04-25T00:51:01.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.749+0000 7f00b58e8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f00b00c5f80 0x7f00b00670e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:01.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.749+0000 7f00b58e8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00b00c6360 0x7f00b013cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:01.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.749+0000 7f00b58e8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b0067620 con 0x7f00b006c390 2024-04-25T00:51:01.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.749+0000 7f00b58e8640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f00b01581f0 con 0x7f00b00c5f80 2024-04-25T00:51:01.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.749+0000 7f00b58e8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f00b00c38c0 con 0x7f00b00c6360 2024-04-25T00:51:01.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.749+0000 7f00aeffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f00b00c5f80 0x7f00b00670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:01.750 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.749+0000 7f00aeffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f00b00c5f80 0x7f00b00670e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55346/0 (socket says 172.21.15.162:55346) 2024-04-25T00:51:01.750 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.749+0000 7f00aeffd640 1 -- 172.21.15.162:0/1872343031 learned_addr learned my addr 172.21.15.162:0/1872343031 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:01.750 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.749+0000 7f00a7fff640 1 --2- 172.21.15.162:0/1872343031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00b00c6360 0x7f00b013cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:01.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.749+0000 7f00aeffd640 1 -- 172.21.15.162:0/1872343031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00b00c6360 msgr2=0x7f00b013cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:01.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.749+0000 7f00aeffd640 1 --2- 172.21.15.162:0/1872343031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00b00c6360 0x7f00b013cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:01.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.749+0000 7f00aeffd640 1 -- 172.21.15.162:0/1872343031 >> v1:172.21.15.179:6789/0 conn(0x7f00b006c390 legacy=0x7f00b01587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:01.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.749+0000 7f00aeffd640 1 -- 172.21.15.162:0/1872343031 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b00c3ba0 con 0x7f00b00c5f80 2024-04-25T00:51:01.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.753+0000 7f00aeffd640 1 --2- 172.21.15.162:0/1872343031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00b00c5f80 0x7f00b00670e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009870 tx=0x7f00a001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758707b011f909ac server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:01.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.757+0000 7f00ae7fc640 1 -- 172.21.15.162:0/1872343031 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a00a95f0 con 0x7f00b00c5f80 2024-04-25T00:51:01.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.757+0000 7f00ae7fc640 1 -- 172.21.15.162:0/1872343031 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a00a9790 con 0x7f00b00c5f80 2024-04-25T00:51:01.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.757+0000 7f00ae7fc640 1 -- 172.21.15.162:0/1872343031 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a00a9b60 con 0x7f00b00c5f80 2024-04-25T00:51:01.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00b58e8640 1 -- 172.21.15.162:0/1872343031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00b00c5f80 msgr2=0x7f00b00670e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:01.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00b58e8640 1 --2- 172.21.15.162:0/1872343031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00b00c5f80 0x7f00b00670e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f00a0009870 tx=0x7f00a001c530 comp rx=0 tx=0).stop 2024-04-25T00:51:01.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00b58e8640 1 -- 172.21.15.162:0/1872343031 shutdown_connections 2024-04-25T00:51:01.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00b58e8640 1 --2- 172.21.15.162:0/1872343031 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00b00c6360 0x7f00b013cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:01.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00b58e8640 1 --2- 172.21.15.162:0/1872343031 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00b00c5f80 0x7f00b00670e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:01.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00b58e8640 1 -- 172.21.15.162:0/1872343031 >> 172.21.15.162:0/1872343031 conn(0x7f00b006fa80 msgr2=0x7f00b006fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:01.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00b58e8640 1 -- 172.21.15.162:0/1872343031 shutdown_connections 2024-04-25T00:51:01.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00b58e8640 1 -- 172.21.15.162:0/1872343031 wait complete. 2024-04-25T00:51:01.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00b58e8640 1 Processor -- start 2024-04-25T00:51:01.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00b58e8640 1 -- start start 2024-04-25T00:51:01.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00b58e8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00b006c390 0x7f00b00cc800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:01.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00b58e8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00b00c5f80 0x7f00b0151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:01.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00b58e8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00b00c6360 0x7f00b0152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:01.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00b58e8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f00b013d230 con 0x7f00b00c6360 2024-04-25T00:51:01.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00b58e8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f00b013d0b0 con 0x7f00b00c5f80 2024-04-25T00:51:01.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00b58e8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f00b013d3b0 con 0x7f00b006c390 2024-04-25T00:51:01.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00af7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00b00c6360 0x7f00b0152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:01.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00af7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00b00c6360 0x7f00b0152380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55358/0 (socket says 172.21.15.162:55358) 2024-04-25T00:51:01.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.761+0000 7f00af7fe640 1 -- 172.21.15.162:0/544081968 learned_addr learned my addr 172.21.15.162:0/544081968 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:01.765 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.765+0000 7f00a7fff640 1 --2- 172.21.15.162:0/544081968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00b00c5f80 0x7f00b0151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:01.765 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.765+0000 7f00aeffd640 1 --2- 172.21.15.162:0/544081968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00b006c390 0x7f00b00cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:01.767 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.765+0000 7f00af7fe640 1 -- 172.21.15.162:0/544081968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00b006c390 msgr2=0x7f00b00cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:01.767 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.765+0000 7f00af7fe640 1 --2- 172.21.15.162:0/544081968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00b006c390 0x7f00b00cc800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:01.767 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.765+0000 7f00af7fe640 1 -- 172.21.15.162:0/544081968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00b00c5f80 msgr2=0x7f00b0151e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:01.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.765+0000 7f00af7fe640 1 --2- 172.21.15.162:0/544081968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00b00c5f80 0x7f00b0151e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:01.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.765+0000 7f00af7fe640 1 -- 172.21.15.162:0/544081968 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b0155b60 con 0x7f00b00c6360 2024-04-25T00:51:01.770 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.769+0000 7f00af7fe640 1 --2- 172.21.15.162:0/544081968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00b00c6360 0x7f00b0152380 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f00a800e9a0 tx=0x7f00a800ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:01.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.773+0000 7f00acff9640 1 -- 172.21.15.162:0/544081968 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8001f60 con 0x7f00b00c6360 2024-04-25T00:51:01.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.773+0000 7f00acff9640 1 -- 172.21.15.162:0/544081968 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00a8003980 con 0x7f00b00c6360 2024-04-25T00:51:01.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.773+0000 7f00acff9640 1 -- 172.21.15.162:0/544081968 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a8003d30 con 0x7f00b00c6360 2024-04-25T00:51:01.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.773+0000 7f00b58e8640 1 -- 172.21.15.162:0/544081968 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00b01f42e0 con 0x7f00b00c6360 2024-04-25T00:51:01.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.773+0000 7f00b58e8640 1 -- 172.21.15.162:0/544081968 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00b0155880 con 0x7f00b00c6360 2024-04-25T00:51:01.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.773+0000 7f00b58e8640 1 -- 172.21.15.162:0/544081968 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00b0075110 con 0x7f00b00c6360 2024-04-25T00:51:01.794 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.793+0000 7f00acff9640 1 -- 172.21.15.162:0/544081968 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f00a8005090 con 0x7f00b00c6360 2024-04-25T00:51:01.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.793+0000 7f00acff9640 1 --2- 172.21.15.162:0/544081968 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f00900678c0 0x7f0090069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:01.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.793+0000 7f00aeffd640 1 --2- 172.21.15.162:0/544081968 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f00900678c0 0x7f0090069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:01.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.793+0000 7f00aeffd640 1 --2- 172.21.15.162:0/544081968 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f00900678c0 0x7f0090069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f00a00ae000 tx=0x7f00a00b3040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:01.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:01.797+0000 7f00acff9640 1 -- 172.21.15.162:0/544081968 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f00a8056b60 con 0x7f00b00c6360 2024-04-25T00:51:02.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.085+0000 7f00acff9640 1 -- 172.21.15.162:0/544081968 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f00a8016020 con 0x7f00b00c6360 2024-04-25T00:51:02.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.265+0000 7f00b58e8640 1 -- 172.21.15.162:0/544081968 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f00b0136030 con 0x7f00b00c6360 2024-04-25T00:51:02.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.337+0000 7f00acff9640 1 -- 172.21.15.162:0/544081968 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f00a8058ac0 con 0x7f00b00c6360 2024-04-25T00:51:02.338 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-04-25T00:51:02.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.341+0000 7f00b58e8640 1 -- 172.21.15.162:0/544081968 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f00900678c0 msgr2=0x7f0090069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:02.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.341+0000 7f00b58e8640 1 --2- 172.21.15.162:0/544081968 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f00900678c0 0x7f0090069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f00a00ae000 tx=0x7f00a00b3040 comp rx=0 tx=0).stop 2024-04-25T00:51:02.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.341+0000 7f00b58e8640 1 -- 172.21.15.162:0/544081968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00b00c6360 msgr2=0x7f00b0152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:02.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.341+0000 7f00b58e8640 1 --2- 172.21.15.162:0/544081968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00b00c6360 0x7f00b0152380 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f00a800e9a0 tx=0x7f00a800ee60 comp rx=0 tx=0).stop 2024-04-25T00:51:02.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.341+0000 7f00b58e8640 1 -- 172.21.15.162:0/544081968 shutdown_connections 2024-04-25T00:51:02.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.341+0000 7f00b58e8640 1 --2- 172.21.15.162:0/544081968 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f00900678c0 0x7f0090069d80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:02.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.341+0000 7f00b58e8640 1 --2- 172.21.15.162:0/544081968 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f00b00c6360 0x7f00b0152380 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:02.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.341+0000 7f00b58e8640 1 --2- 172.21.15.162:0/544081968 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f00b00c5f80 0x7f00b0151e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:02.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.341+0000 7f00b58e8640 1 --2- 172.21.15.162:0/544081968 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f00b006c390 0x7f00b00cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:02.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.341+0000 7f00b58e8640 1 -- 172.21.15.162:0/544081968 >> 172.21.15.162:0/544081968 conn(0x7f00b006fa80 msgr2=0x7f00b0150f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:02.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.341+0000 7f00b58e8640 1 -- 172.21.15.162:0/544081968 shutdown_connections 2024-04-25T00:51:02.342 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.341+0000 7f00b58e8640 1 -- 172.21.15.162:0/544081968 wait complete. 2024-04-25T00:51:02.363 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T00:51:02.483 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.481+0000 7f1d929cf640 1 Processor -- start 2024-04-25T00:51:02.484 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.481+0000 7f1d929cf640 1 -- start start 2024-04-25T00:51:02.484 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.485+0000 7f1d929cf640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1d8c06d6f0 0x7f1d8c0c7530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:02.484 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.485+0000 7f1d929cf640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1d8c06e7d0 0x7f1d8c06ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:02.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.485+0000 7f1d929cf640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d8c06f140 con 0x7f1d8c13e060 2024-04-25T00:51:02.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.485+0000 7f1d929cf640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1d8c158540 con 0x7f1d8c06d6f0 2024-04-25T00:51:02.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.485+0000 7f1d929cf640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f1d8c158820 con 0x7f1d8c06e7d0 2024-04-25T00:51:02.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.485+0000 7f1d8b7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1d8c06d6f0 0x7f1d8c0c7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:02.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.485+0000 7f1d8b7fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1d8c06d6f0 0x7f1d8c0c7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55370/0 (socket says 172.21.15.162:55370) 2024-04-25T00:51:02.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.485+0000 7f1d8b7fe640 1 -- 172.21.15.162:0/1357737005 learned_addr learned my addr 172.21.15.162:0/1357737005 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:02.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.485+0000 7f1d8b7fe640 1 -- 172.21.15.162:0/1357737005 >> v2:172.21.15.179:3300/0 conn(0x7f1d8c06e7d0 msgr2=0x7f1d8c06ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:02.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.485+0000 7f1d8b7fe640 1 --2- 172.21.15.162:0/1357737005 >> v2:172.21.15.179:3300/0 conn(0x7f1d8c06e7d0 0x7f1d8c06ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:02.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.485+0000 7f1d8b7fe640 1 -- 172.21.15.162:0/1357737005 >> v1:172.21.15.179:6789/0 conn(0x7f1d8c13e060 legacy=0x7f1d8c0c5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:02.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.485+0000 7f1d8b7fe640 1 -- 172.21.15.162:0/1357737005 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d8c158b00 con 0x7f1d8c06d6f0 2024-04-25T00:51:02.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.489+0000 7f1d8b7fe640 1 --2- 172.21.15.162:0/1357737005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d8c06d6f0 0x7f1d8c0c7530 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c15c820 tx=0x7f1d8001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5413fd9d889044de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:02.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d8affd640 1 -- 172.21.15.162:0/1357737005 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d800b1070 con 0x7f1d8c06d6f0 2024-04-25T00:51:02.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d8affd640 1 -- 172.21.15.162:0/1357737005 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d800ac630 con 0x7f1d8c06d6f0 2024-04-25T00:51:02.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d8affd640 1 -- 172.21.15.162:0/1357737005 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d800a8050 con 0x7f1d8c06d6f0 2024-04-25T00:51:02.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d929cf640 1 -- 172.21.15.162:0/1357737005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d8c06d6f0 msgr2=0x7f1d8c0c7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:02.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d929cf640 1 --2- 172.21.15.162:0/1357737005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d8c06d6f0 0x7f1d8c0c7530 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c15c820 tx=0x7f1d8001c4e0 comp rx=0 tx=0).stop 2024-04-25T00:51:02.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d929cf640 1 -- 172.21.15.162:0/1357737005 shutdown_connections 2024-04-25T00:51:02.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d929cf640 1 --2- 172.21.15.162:0/1357737005 >> v2:172.21.15.179:3300/0 conn(0x7f1d8c06e7d0 0x7f1d8c06ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:02.498 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d929cf640 1 --2- 172.21.15.162:0/1357737005 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d8c06d6f0 0x7f1d8c0c7530 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:02.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d929cf640 1 -- 172.21.15.162:0/1357737005 >> 172.21.15.162:0/1357737005 conn(0x7f1d8c070290 msgr2=0x7f1d8c0c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:02.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d929cf640 1 -- 172.21.15.162:0/1357737005 shutdown_connections 2024-04-25T00:51:02.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d929cf640 1 -- 172.21.15.162:0/1357737005 wait complete. 2024-04-25T00:51:02.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d929cf640 1 Processor -- start 2024-04-25T00:51:02.499 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d929cf640 1 -- start start 2024-04-25T00:51:02.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d929cf640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d8c06d6f0 0x7f1d8c152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:02.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d929cf640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d8c06e7d0 0x7f1d8c153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:02.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d929cf640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d8c13e060 0x7f1d8c0ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:02.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d929cf640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8c158190 con 0x7f1d8c13e060 2024-04-25T00:51:02.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d929cf640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1d8c0c9950 con 0x7f1d8c06d6f0 2024-04-25T00:51:02.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.497+0000 7f1d929cf640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1d8c137c00 con 0x7f1d8c06e7d0 2024-04-25T00:51:02.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.501+0000 7f1d90f6c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d8c13e060 0x7f1d8c0ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:02.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.501+0000 7f1d90f6c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d8c13e060 0x7f1d8c0ca8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55374/0 (socket says 172.21.15.162:55374) 2024-04-25T00:51:02.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.501+0000 7f1d90f6c640 1 -- 172.21.15.162:0/3977845113 learned_addr learned my addr 172.21.15.162:0/3977845113 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:02.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.505+0000 7f1d90f6c640 1 -- 172.21.15.162:0/3977845113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d8c06e7d0 msgr2=0x7f1d8c153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:02.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.505+0000 7f1d90f6c640 1 --2- 172.21.15.162:0/3977845113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d8c06e7d0 0x7f1d8c153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:02.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.505+0000 7f1d90f6c640 1 -- 172.21.15.162:0/3977845113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d8c06d6f0 msgr2=0x7f1d8c152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:02.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.505+0000 7f1d90f6c640 1 --2- 172.21.15.162:0/3977845113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d8c06d6f0 0x7f1d8c152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:02.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.505+0000 7f1d90f6c640 1 -- 172.21.15.162:0/3977845113 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d8c138520 con 0x7f1d8c13e060 2024-04-25T00:51:02.508 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.505+0000 7f1d90f6c640 1 --2- 172.21.15.162:0/3977845113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d8c13e060 0x7f1d8c0ca8c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400b970 tx=0x7f1d8400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:02.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.509+0000 7f1d88ff9640 1 -- 172.21.15.162:0/3977845113 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d84019070 con 0x7f1d8c13e060 2024-04-25T00:51:02.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.509+0000 7f1d88ff9640 1 -- 172.21.15.162:0/3977845113 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d8400cb60 con 0x7f1d8c13e060 2024-04-25T00:51:02.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.509+0000 7f1d88ff9640 1 -- 172.21.15.162:0/3977845113 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d84014440 con 0x7f1d8c13e060 2024-04-25T00:51:02.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.509+0000 7f1d929cf640 1 -- 172.21.15.162:0/3977845113 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d8c0ca0c0 con 0x7f1d8c13e060 2024-04-25T00:51:02.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.509+0000 7f1d929cf640 1 -- 172.21.15.162:0/3977845113 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d8c151be0 con 0x7f1d8c13e060 2024-04-25T00:51:02.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.513+0000 7f1d929cf640 1 -- 172.21.15.162:0/3977845113 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d8c075110 con 0x7f1d8c13e060 2024-04-25T00:51:02.542 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.541+0000 7f1d88ff9640 1 -- 172.21.15.162:0/3977845113 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d8401c070 con 0x7f1d8c13e060 2024-04-25T00:51:02.543 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.541+0000 7f1d88ff9640 1 --2- 172.21.15.162:0/3977845113 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1d78067910 0x7f1d78069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:02.543 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.541+0000 7f1d8bfff640 1 --2- 172.21.15.162:0/3977845113 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1d78067910 0x7f1d78069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:02.543 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.541+0000 7f1d8bfff640 1 --2- 172.21.15.162:0/3977845113 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1d78067910 0x7f1d78069dd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c009650 tx=0x7f1d7c006bb0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:02.545 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.545+0000 7f1d88ff9640 1 -- 172.21.15.162:0/3977845113 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f1d84054370 con 0x7f1d8c13e060 2024-04-25T00:51:02.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.817+0000 7f1d88ff9640 1 -- 172.21.15.162:0/3977845113 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f1d84023020 con 0x7f1d8c13e060 2024-04-25T00:51:02.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.977+0000 7f1d929cf640 1 -- 172.21.15.162:0/3977845113 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1d8c0ccf40 con 0x7f1d8c13e060 2024-04-25T00:51:02.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.989+0000 7f1d88ff9640 1 -- 172.21.15.162:0/3977845113 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f1d840569d0 con 0x7f1d8c13e060 2024-04-25T00:51:02.991 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-04-25T00:51:02.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.993+0000 7f1d929cf640 1 -- 172.21.15.162:0/3977845113 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1d78067910 msgr2=0x7f1d78069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:02.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.993+0000 7f1d929cf640 1 --2- 172.21.15.162:0/3977845113 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1d78067910 0x7f1d78069dd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c009650 tx=0x7f1d7c006bb0 comp rx=0 tx=0).stop 2024-04-25T00:51:02.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.993+0000 7f1d929cf640 1 -- 172.21.15.162:0/3977845113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d8c13e060 msgr2=0x7f1d8c0ca8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:02.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.993+0000 7f1d929cf640 1 --2- 172.21.15.162:0/3977845113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d8c13e060 0x7f1d8c0ca8c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400b970 tx=0x7f1d8400be30 comp rx=0 tx=0).stop 2024-04-25T00:51:02.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.993+0000 7f1d929cf640 1 -- 172.21.15.162:0/3977845113 shutdown_connections 2024-04-25T00:51:02.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.993+0000 7f1d929cf640 1 --2- 172.21.15.162:0/3977845113 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1d78067910 0x7f1d78069dd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:02.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.993+0000 7f1d929cf640 1 --2- 172.21.15.162:0/3977845113 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1d8c13e060 0x7f1d8c0ca8c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:02.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.993+0000 7f1d929cf640 1 --2- 172.21.15.162:0/3977845113 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1d8c06e7d0 0x7f1d8c153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:02.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.993+0000 7f1d929cf640 1 --2- 172.21.15.162:0/3977845113 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1d8c06d6f0 0x7f1d8c152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:02.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.993+0000 7f1d929cf640 1 -- 172.21.15.162:0/3977845113 >> 172.21.15.162:0/3977845113 conn(0x7f1d8c070290 msgr2=0x7f1d8c13c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:02.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.993+0000 7f1d929cf640 1 -- 172.21.15.162:0/3977845113 shutdown_connections 2024-04-25T00:51:02.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:02.993+0000 7f1d929cf640 1 -- 172.21.15.162:0/3977845113 wait complete. 2024-04-25T00:51:03.012 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T00:51:03.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.137+0000 7f970533b640 1 Processor -- start 2024-04-25T00:51:03.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.137+0000 7f970533b640 1 -- start start 2024-04-25T00:51:03.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.137+0000 7f970533b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f97000c62e0 0x7f970015b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:03.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.137+0000 7f970533b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f97000c66c0 0x7f9700158c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:03.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.137+0000 7f970533b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97000c9c80 0x7f9700151e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:03.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.137+0000 7f970533b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f97000c9260 con 0x7f97000c66c0 2024-04-25T00:51:03.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.137+0000 7f970533b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f97000c97f0 con 0x7f97000c62e0 2024-04-25T00:51:03.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.137+0000 7f970533b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f970015bd30 con 0x7f97000c9c80 2024-04-25T00:51:03.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.137+0000 7f96fe7fc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f97000c66c0 0x7f9700158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:03.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.137+0000 7f96fe7fc640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f97000c66c0 0x7f9700158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55382/0 (socket says 172.21.15.162:55382) 2024-04-25T00:51:03.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.137+0000 7f96fe7fc640 1 -- 172.21.15.162:0/2928910452 learned_addr learned my addr 172.21.15.162:0/2928910452 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:03.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.137+0000 7f96feffd640 1 --2- 172.21.15.162:0/2928910452 >> v2:172.21.15.179:3300/0 conn(0x7f97000c62e0 0x7f970015b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:03.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.137+0000 7f96ff7fe640 1 --2- 172.21.15.162:0/2928910452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97000c9c80 0x7f9700151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:03.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.141+0000 7f96fe7fc640 1 -- 172.21.15.162:0/2928910452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97000c9c80 msgr2=0x7f9700151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:03.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.141+0000 7f96fe7fc640 1 --2- 172.21.15.162:0/2928910452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97000c9c80 0x7f9700151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.141+0000 7f96fe7fc640 1 -- 172.21.15.162:0/2928910452 >> v2:172.21.15.179:3300/0 conn(0x7f97000c62e0 msgr2=0x7f970015b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:03.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.141+0000 7f96fe7fc640 1 --2- 172.21.15.162:0/2928910452 >> v2:172.21.15.179:3300/0 conn(0x7f97000c62e0 0x7f970015b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.142 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.141+0000 7f96fe7fc640 1 -- 172.21.15.162:0/2928910452 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97001591c0 con 0x7f97000c66c0 2024-04-25T00:51:03.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.141+0000 7f96ff7fe640 1 --2- 172.21.15.162:0/2928910452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97000c9c80 0x7f9700151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T00:51:03.144 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.141+0000 7f96fe7fc640 1 --2- 172.21.15.162:0/2928910452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97000c66c0 0x7f9700158c80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f97000c6b80 tx=0x7f96f401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c23ce0cf4d246c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:03.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.145+0000 7f96fdffb640 1 -- 172.21.15.162:0/2928910452 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f40b5070 con 0x7f97000c66c0 2024-04-25T00:51:03.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.145+0000 7f96fdffb640 1 -- 172.21.15.162:0/2928910452 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96f40a89d0 con 0x7f97000c66c0 2024-04-25T00:51:03.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.145+0000 7f96fdffb640 1 -- 172.21.15.162:0/2928910452 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f40a8da0 con 0x7f97000c66c0 2024-04-25T00:51:03.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f970533b640 1 -- 172.21.15.162:0/2928910452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97000c66c0 msgr2=0x7f9700158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:03.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f970533b640 1 --2- 172.21.15.162:0/2928910452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97000c66c0 0x7f9700158c80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f97000c6b80 tx=0x7f96f401ed10 comp rx=0 tx=0).stop 2024-04-25T00:51:03.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f970533b640 1 -- 172.21.15.162:0/2928910452 shutdown_connections 2024-04-25T00:51:03.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f970533b640 1 --2- 172.21.15.162:0/2928910452 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97000c9c80 0x7f9700151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f970533b640 1 --2- 172.21.15.162:0/2928910452 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97000c66c0 0x7f9700158c80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f970533b640 1 --2- 172.21.15.162:0/2928910452 >> v2:172.21.15.179:3300/0 conn(0x7f97000c62e0 0x7f970015b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f970533b640 1 -- 172.21.15.162:0/2928910452 >> 172.21.15.162:0/2928910452 conn(0x7f9700070370 msgr2=0x7f9700070780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:03.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f970533b640 1 -- 172.21.15.162:0/2928910452 shutdown_connections 2024-04-25T00:51:03.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f970533b640 1 -- 172.21.15.162:0/2928910452 wait complete. 2024-04-25T00:51:03.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f970533b640 1 Processor -- start 2024-04-25T00:51:03.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f970533b640 1 -- start start 2024-04-25T00:51:03.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f970533b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97000c62e0 0x7f97000c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:03.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f970533b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97000c66c0 0x7f97001579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:03.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f970533b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97000c9c80 0x7f9700149db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:03.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f970533b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f970015c260 con 0x7f97000c9c80 2024-04-25T00:51:03.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f970533b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f970015bf80 con 0x7f97000c62e0 2024-04-25T00:51:03.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f970533b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f970015c540 con 0x7f97000c66c0 2024-04-25T00:51:03.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f96ff7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97000c9c80 0x7f9700149db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:03.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f96ff7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97000c9c80 0x7f9700149db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55386/0 (socket says 172.21.15.162:55386) 2024-04-25T00:51:03.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f96ff7fe640 1 -- 172.21.15.162:0/3028590190 learned_addr learned my addr 172.21.15.162:0/3028590190 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:03.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f96feffd640 1 --2- 172.21.15.162:0/3028590190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97000c62e0 0x7f97000c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:03.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.149+0000 7f96fe7fc640 1 --2- 172.21.15.162:0/3028590190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97000c66c0 0x7f97001579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:03.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.153+0000 7f96ff7fe640 1 -- 172.21.15.162:0/3028590190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97000c66c0 msgr2=0x7f97001579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:03.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.153+0000 7f96ff7fe640 1 --2- 172.21.15.162:0/3028590190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97000c66c0 0x7f97001579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.153+0000 7f96ff7fe640 1 -- 172.21.15.162:0/3028590190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97000c62e0 msgr2=0x7f97000c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:03.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.153+0000 7f96ff7fe640 1 --2- 172.21.15.162:0/3028590190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97000c62e0 0x7f97000c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.153+0000 7f96ff7fe640 1 -- 172.21.15.162:0/3028590190 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97000c4180 con 0x7f97000c9c80 2024-04-25T00:51:03.157 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.157+0000 7f96ff7fe640 1 --2- 172.21.15.162:0/3028590190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97000c9c80 0x7f9700149db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f96f8007e20 tx=0x7f96f800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:03.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.161+0000 7f96e77fe640 1 -- 172.21.15.162:0/3028590190 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f801a070 con 0x7f97000c9c80 2024-04-25T00:51:03.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.161+0000 7f96e77fe640 1 -- 172.21.15.162:0/3028590190 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96f8003ba0 con 0x7f97000c9c80 2024-04-25T00:51:03.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.161+0000 7f970533b640 1 -- 172.21.15.162:0/3028590190 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97001f07c0 con 0x7f97000c9c80 2024-04-25T00:51:03.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.161+0000 7f96e77fe640 1 -- 172.21.15.162:0/3028590190 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f800de80 con 0x7f97000c9c80 2024-04-25T00:51:03.161 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.161+0000 7f970533b640 1 -- 172.21.15.162:0/3028590190 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97001562c0 con 0x7f97000c9c80 2024-04-25T00:51:03.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.161+0000 7f970533b640 1 -- 172.21.15.162:0/3028590190 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9700075110 con 0x7f97000c9c80 2024-04-25T00:51:03.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.181+0000 7f96e77fe640 1 -- 172.21.15.162:0/3028590190 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f96f801d070 con 0x7f97000c9c80 2024-04-25T00:51:03.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.181+0000 7f96e77fe640 1 --2- 172.21.15.162:0/3028590190 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f96ec067910 0x7f96ec069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:03.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.181+0000 7f96feffd640 1 --2- 172.21.15.162:0/3028590190 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f96ec067910 0x7f96ec069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:03.182 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.181+0000 7f96feffd640 1 --2- 172.21.15.162:0/3028590190 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f96ec067910 0x7f96ec069dd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f96f00045f0 tx=0x7f96f0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:03.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.185+0000 7f96e77fe640 1 -- 172.21.15.162:0/3028590190 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f96f80548b0 con 0x7f97000c9c80 2024-04-25T00:51:03.456 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.453+0000 7f96e77fe640 1 -- 172.21.15.162:0/3028590190 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f96f8024020 con 0x7f97000c9c80 2024-04-25T00:51:03.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.629+0000 7f970533b640 1 -- 172.21.15.162:0/3028590190 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9700070750 con 0x7f97000c9c80 2024-04-25T00:51:03.649 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.649+0000 7f96e77fe640 1 -- 172.21.15.162:0/3028590190 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f96f8010070 con 0x7f97000c9c80 2024-04-25T00:51:03.649 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-04-25T00:51:03.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.649+0000 7f970533b640 1 -- 172.21.15.162:0/3028590190 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f96ec067910 msgr2=0x7f96ec069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:03.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.649+0000 7f970533b640 1 --2- 172.21.15.162:0/3028590190 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f96ec067910 0x7f96ec069dd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f96f00045f0 tx=0x7f96f0008040 comp rx=0 tx=0).stop 2024-04-25T00:51:03.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.649+0000 7f970533b640 1 -- 172.21.15.162:0/3028590190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97000c9c80 msgr2=0x7f9700149db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:03.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.649+0000 7f970533b640 1 --2- 172.21.15.162:0/3028590190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97000c9c80 0x7f9700149db0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f96f8007e20 tx=0x7f96f800d4a0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.649+0000 7f970533b640 1 -- 172.21.15.162:0/3028590190 shutdown_connections 2024-04-25T00:51:03.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.649+0000 7f970533b640 1 --2- 172.21.15.162:0/3028590190 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f96ec067910 0x7f96ec069dd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.649+0000 7f970533b640 1 --2- 172.21.15.162:0/3028590190 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f97000c9c80 0x7f9700149db0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.649+0000 7f970533b640 1 --2- 172.21.15.162:0/3028590190 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f97000c66c0 0x7f97001579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.649+0000 7f970533b640 1 --2- 172.21.15.162:0/3028590190 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f97000c62e0 0x7f97000c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.649+0000 7f970533b640 1 -- 172.21.15.162:0/3028590190 >> 172.21.15.162:0/3028590190 conn(0x7f9700070370 msgr2=0x7f97000726b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:03.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.649+0000 7f970533b640 1 -- 172.21.15.162:0/3028590190 shutdown_connections 2024-04-25T00:51:03.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.649+0000 7f970533b640 1 -- 172.21.15.162:0/3028590190 wait complete. 2024-04-25T00:51:03.669 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T00:51:03.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.781+0000 7f3c2e380640 1 Processor -- start 2024-04-25T00:51:03.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.781+0000 7f3c2e380640 1 -- start start 2024-04-25T00:51:03.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.781+0000 7f3c2e380640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3c280c62e0 0x7f3c280c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:03.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.781+0000 7f3c2e380640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3c280c66c0 0x7f3c28072790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:03.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.781+0000 7f3c2e380640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c2815c5c0 0x7f3c28158350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:03.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.781+0000 7f3c2e380640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3c280cd650 con 0x7f3c280c66c0 2024-04-25T00:51:03.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.781+0000 7f3c2e380640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f3c28072cd0 con 0x7f3c280c62e0 2024-04-25T00:51:03.782 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.781+0000 7f3c2e380640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3c28159350 con 0x7f3c2815c5c0 2024-04-25T00:51:03.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.781+0000 7f3c277fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3c280c66c0 0x7f3c28072790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:03.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.781+0000 7f3c2c91d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c2815c5c0 0x7f3c28158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:03.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.781+0000 7f3c27fff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3c280c62e0 0x7f3c280c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:03.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.781+0000 7f3c277fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3c280c66c0 0x7f3c28072790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55396/0 (socket says 172.21.15.162:55396) 2024-04-25T00:51:03.783 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.781+0000 7f3c277fe640 1 -- 172.21.15.162:0/76530837 learned_addr learned my addr 172.21.15.162:0/76530837 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:03.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.785+0000 7f3c277fe640 1 -- 172.21.15.162:0/76530837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c2815c5c0 msgr2=0x7f3c28158350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:03.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.785+0000 7f3c277fe640 1 --2- 172.21.15.162:0/76530837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c2815c5c0 0x7f3c28158350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.785+0000 7f3c277fe640 1 -- 172.21.15.162:0/76530837 >> v2:172.21.15.179:3300/0 conn(0x7f3c280c62e0 msgr2=0x7f3c280c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:03.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.785+0000 7f3c277fe640 1 --2- 172.21.15.162:0/76530837 >> v2:172.21.15.179:3300/0 conn(0x7f3c280c62e0 0x7f3c280c7d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.787 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.785+0000 7f3c277fe640 1 -- 172.21.15.162:0/76530837 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c28158d90 con 0x7f3c280c66c0 2024-04-25T00:51:03.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.789+0000 7f3c277fe640 1 --2- 172.21.15.162:0/76530837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c280c66c0 0x7f3c28072790 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3c280712f0 tx=0x7f3c1c01ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2375cddf889c9e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:03.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.793+0000 7f3c26ffd640 1 -- 172.21.15.162:0/76530837 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0b5070 con 0x7f3c280c66c0 2024-04-25T00:51:03.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.793+0000 7f3c26ffd640 1 -- 172.21.15.162:0/76530837 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c1c0a89d0 con 0x7f3c280c66c0 2024-04-25T00:51:03.795 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.793+0000 7f3c26ffd640 1 -- 172.21.15.162:0/76530837 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0a8da0 con 0x7f3c280c66c0 2024-04-25T00:51:03.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.793+0000 7f3c2e380640 1 -- 172.21.15.162:0/76530837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c280c66c0 msgr2=0x7f3c28072790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:03.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.793+0000 7f3c2e380640 1 --2- 172.21.15.162:0/76530837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c280c66c0 0x7f3c28072790 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3c280712f0 tx=0x7f3c1c01ed10 comp rx=0 tx=0).stop 2024-04-25T00:51:03.796 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.793+0000 7f3c2e380640 1 -- 172.21.15.162:0/76530837 shutdown_connections 2024-04-25T00:51:03.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.793+0000 7f3c2e380640 1 --2- 172.21.15.162:0/76530837 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c2815c5c0 0x7f3c28158350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.793+0000 7f3c2e380640 1 --2- 172.21.15.162:0/76530837 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c280c66c0 0x7f3c28072790 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.793+0000 7f3c2e380640 1 --2- 172.21.15.162:0/76530837 >> v2:172.21.15.179:3300/0 conn(0x7f3c280c62e0 0x7f3c280c7d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.793+0000 7f3c2e380640 1 -- 172.21.15.162:0/76530837 >> 172.21.15.162:0/76530837 conn(0x7f3c28070350 msgr2=0x7f3c28070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:03.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.793+0000 7f3c2e380640 1 -- 172.21.15.162:0/76530837 shutdown_connections 2024-04-25T00:51:03.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.793+0000 7f3c2e380640 1 -- 172.21.15.162:0/76530837 wait complete. 2024-04-25T00:51:03.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.797+0000 7f3c2e380640 1 Processor -- start 2024-04-25T00:51:03.797 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.797+0000 7f3c2e380640 1 -- start start 2024-04-25T00:51:03.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.797+0000 7f3c2e380640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c280c62e0 0x7f3c281f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:03.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.797+0000 7f3c2e380640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c280c66c0 0x7f3c2814c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:03.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.797+0000 7f3c2e380640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2815c5c0 0x7f3c28151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:03.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.797+0000 7f3c2e380640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2815bdc0 con 0x7f3c2815c5c0 2024-04-25T00:51:03.798 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.797+0000 7f3c2e380640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2815bae0 con 0x7f3c280c62e0 2024-04-25T00:51:03.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.797+0000 7f3c2e380640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3c2815c0a0 con 0x7f3c280c66c0 2024-04-25T00:51:03.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.797+0000 7f3c2c91d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2815c5c0 0x7f3c28151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:03.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.797+0000 7f3c2c91d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2815c5c0 0x7f3c28151180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55410/0 (socket says 172.21.15.162:55410) 2024-04-25T00:51:03.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.797+0000 7f3c2c91d640 1 -- 172.21.15.162:0/2037516750 learned_addr learned my addr 172.21.15.162:0/2037516750 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:03.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.797+0000 7f3c27fff640 1 --2- 172.21.15.162:0/2037516750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c280c62e0 0x7f3c281f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:03.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.797+0000 7f3c277fe640 1 --2- 172.21.15.162:0/2037516750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c280c66c0 0x7f3c2814c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:03.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.801+0000 7f3c2c91d640 1 -- 172.21.15.162:0/2037516750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c280c66c0 msgr2=0x7f3c2814c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:03.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.801+0000 7f3c2c91d640 1 --2- 172.21.15.162:0/2037516750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c280c66c0 0x7f3c2814c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.801+0000 7f3c2c91d640 1 -- 172.21.15.162:0/2037516750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c280c62e0 msgr2=0x7f3c281f1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:03.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.801+0000 7f3c2c91d640 1 --2- 172.21.15.162:0/2037516750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c280c62e0 0x7f3c281f1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:03.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.801+0000 7f3c2c91d640 1 -- 172.21.15.162:0/2037516750 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c28146430 con 0x7f3c2815c5c0 2024-04-25T00:51:03.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.805+0000 7f3c2c91d640 1 --2- 172.21.15.162:0/2037516750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2815c5c0 0x7f3c28151180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000efc0 tx=0x7f3c2000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:03.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.809+0000 7f3c24ff9640 1 -- 172.21.15.162:0/2037516750 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20018020 con 0x7f3c2815c5c0 2024-04-25T00:51:03.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.809+0000 7f3c24ff9640 1 -- 172.21.15.162:0/2037516750 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c20014480 con 0x7f3c2815c5c0 2024-04-25T00:51:03.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.809+0000 7f3c24ff9640 1 -- 172.21.15.162:0/2037516750 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20014870 con 0x7f3c2815c5c0 2024-04-25T00:51:03.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.809+0000 7f3c2e380640 1 -- 172.21.15.162:0/2037516750 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c28146710 con 0x7f3c2815c5c0 2024-04-25T00:51:03.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.809+0000 7f3c2e380640 1 -- 172.21.15.162:0/2037516750 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c281f1280 con 0x7f3c2815c5c0 2024-04-25T00:51:03.810 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.809+0000 7f3c2e380640 1 -- 172.21.15.162:0/2037516750 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c2804f5f0 con 0x7f3c2815c5c0 2024-04-25T00:51:03.830 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.829+0000 7f3c24ff9640 1 -- 172.21.15.162:0/2037516750 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3c2001b020 con 0x7f3c2815c5c0 2024-04-25T00:51:03.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.829+0000 7f3c24ff9640 1 --2- 172.21.15.162:0/2037516750 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3c14067940 0x7f3c14069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:03.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.829+0000 7f3c27fff640 1 --2- 172.21.15.162:0/2037516750 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3c14067940 0x7f3c14069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:03.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:03.829+0000 7f3c27fff640 1 --2- 172.21.15.162:0/2037516750 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3c14067940 0x7f3c14069e00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009ae0 tx=0x7f3c18009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:04.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.093+0000 7f3c24ff9640 1 -- 172.21.15.162:0/2037516750 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f3c20055400 con 0x7f3c2815c5c0 2024-04-25T00:51:04.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.093+0000 7f3c24ff9640 1 -- 172.21.15.162:0/2037516750 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f3c20022030 con 0x7f3c2815c5c0 2024-04-25T00:51:04.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.293+0000 7f3c2e380640 1 -- 172.21.15.162:0/2037516750 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3c280c9570 con 0x7f3c2815c5c0 2024-04-25T00:51:04.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.313+0000 7f3c24ff9640 1 -- 172.21.15.162:0/2037516750 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6919 (secure 0 0 0) 0x7f3c20010040 con 0x7f3c2815c5c0 2024-04-25T00:51:04.315 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:51:04.316 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/560649188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":560649188},{"type":"v1","addr":"172.21.15.179:6833","nonce":560649188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T00:50:35.645685+0000","modified":"2024-04-25T00:50:58.084533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4246,"mds_1":4244,"mds_2":4241,"mds_3":4240,"mds_4":4233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4233":{"gid":4233,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":11,"addr":"172.21.15.179:6835/1339390327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1339390327},{"type":"v1","addr":"172.21.15.179:6835","nonce":1339390327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4240":{"gid":4240,"name":"e","rank":3,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.162:6835/191105979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":191105979},{"type":"v1","addr":"172.21.15.162:6835","nonce":191105979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4241":{"gid":4241,"name":"c","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2357127318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2357127318},{"type":"v1","addr":"172.21.15.162:6839","nonce":2357127318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4244":{"gid":4244,"name":"f","rank":1,"incarnation":8,"state":"up:active","state_seq":7,"addr":"172.21.15.179:6837/2607965795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2607965795},{"type":"v1","addr":"172.21.15.179:6837","nonce":2607965795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4246":{"gid":4246,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":6,"addr":"172.21.15.162:6837/1743481688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1743481688},{"type":"v1","addr":"172.21.15.162:6837","nonce":1743481688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4233,4246,4240,4241,4244]},"id":1}]} 2024-04-25T00:51:04.316 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 17 2024-04-25T00:51:04.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.317+0000 7f3c2e380640 1 -- 172.21.15.162:0/2037516750 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3c14067940 msgr2=0x7f3c14069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:04.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.317+0000 7f3c2e380640 1 --2- 172.21.15.162:0/2037516750 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3c14067940 0x7f3c14069e00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3c18009ae0 tx=0x7f3c18009190 comp rx=0 tx=0).stop 2024-04-25T00:51:04.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.317+0000 7f3c2e380640 1 -- 172.21.15.162:0/2037516750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2815c5c0 msgr2=0x7f3c28151180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:04.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.317+0000 7f3c2e380640 1 --2- 172.21.15.162:0/2037516750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2815c5c0 0x7f3c28151180 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3c2000efc0 tx=0x7f3c2000c490 comp rx=0 tx=0).stop 2024-04-25T00:51:04.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.317+0000 7f3c2e380640 1 -- 172.21.15.162:0/2037516750 shutdown_connections 2024-04-25T00:51:04.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.317+0000 7f3c2e380640 1 --2- 172.21.15.162:0/2037516750 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3c14067940 0x7f3c14069e00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:04.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.317+0000 7f3c2e380640 1 --2- 172.21.15.162:0/2037516750 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c2815c5c0 0x7f3c28151180 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:04.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.317+0000 7f3c2e380640 1 --2- 172.21.15.162:0/2037516750 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c280c66c0 0x7f3c2814c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:04.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.317+0000 7f3c2e380640 1 --2- 172.21.15.162:0/2037516750 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c280c62e0 0x7f3c281f1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:04.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.317+0000 7f3c2e380640 1 -- 172.21.15.162:0/2037516750 >> 172.21.15.162:0/2037516750 conn(0x7f3c28070350 msgr2=0x7f3c280c7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:04.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.317+0000 7f3c2e380640 1 -- 172.21.15.162:0/2037516750 shutdown_connections 2024-04-25T00:51:04.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.317+0000 7f3c2e380640 1 -- 172.21.15.162:0/2037516750 wait complete. 2024-04-25T00:51:04.342 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T00:51:04.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.457+0000 7fb05f057640 1 Processor -- start 2024-04-25T00:51:04.460 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.457+0000 7fb05f057640 1 -- start start 2024-04-25T00:51:04.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.461+0000 7fb05f057640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb058152320 0x7fb0580c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:04.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.461+0000 7fb05f057640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb05815c200 0x7fb0580c6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:04.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.461+0000 7fb05f057640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb058072f60 con 0x7fb0581581c0 2024-04-25T00:51:04.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.461+0000 7fb05f057640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb0580c3070 con 0x7fb05815c200 2024-04-25T00:51:04.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.461+0000 7fb05f057640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb05815b7b0 con 0x7fb058152320 2024-04-25T00:51:04.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.461+0000 7fb05cdf3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb058152320 0x7fb0580c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:04.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.461+0000 7fb057fff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fb0581581c0 0x7fb058072790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:55638/0 (socket says 172.21.15.162:55638) 2024-04-25T00:51:04.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.461+0000 7fb057fff640 1 -- 172.21.15.162:0/703465048 learned_addr learned my addr 172.21.15.162:0/703465048 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:51:04.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.461+0000 7fb05d5f4640 1 --2- 172.21.15.162:0/703465048 >> v2:172.21.15.162:3300/0 conn(0x7fb05815c200 0x7fb0580c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:04.464 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:51:04.466 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:51:04.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.465+0000 7fb05d5f4640 1 -- 172.21.15.162:0/703465048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb058152320 msgr2=0x7fb0580c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:04.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.465+0000 7fb05d5f4640 1 --2- 172.21.15.162:0/703465048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb058152320 0x7fb0580c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:04.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.465+0000 7fb05d5f4640 1 -- 172.21.15.162:0/703465048 >> v1:172.21.15.179:6789/0 conn(0x7fb0581581c0 legacy=0x7fb058072790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:04.467 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.465+0000 7fb05d5f4640 1 -- 172.21.15.162:0/703465048 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb058073240 con 0x7fb05815c200 2024-04-25T00:51:04.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.469+0000 7fb05d5f4640 1 --2- 172.21.15.162:0/703465048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb05815c200 0x7fb0580c6080 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb0480097c0 tx=0x7fb04801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1b790ae2e5648e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:04.473 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.473+0000 7fb0577fe640 1 -- 172.21.15.162:0/703465048 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0480b5070 con 0x7fb05815c200 2024-04-25T00:51:04.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.473+0000 7fb0577fe640 1 -- 172.21.15.162:0/703465048 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0480a8990 con 0x7fb05815c200 2024-04-25T00:51:04.475 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.473+0000 7fb0577fe640 1 -- 172.21.15.162:0/703465048 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0480a8d60 con 0x7fb05815c200 2024-04-25T00:51:04.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.473+0000 7fb05f057640 1 -- 172.21.15.162:0/703465048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb05815c200 msgr2=0x7fb0580c6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:04.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.473+0000 7fb05f057640 1 --2- 172.21.15.162:0/703465048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb05815c200 0x7fb0580c6080 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb0480097c0 tx=0x7fb04801ec90 comp rx=0 tx=0).stop 2024-04-25T00:51:04.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.477+0000 7fb05f057640 1 -- 172.21.15.162:0/703465048 shutdown_connections 2024-04-25T00:51:04.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.477+0000 7fb05f057640 1 --2- 172.21.15.162:0/703465048 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb05815c200 0x7fb0580c6080 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:04.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.477+0000 7fb05f057640 1 --2- 172.21.15.162:0/703465048 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb058152320 0x7fb0580c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:04.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.477+0000 7fb05f057640 1 -- 172.21.15.162:0/703465048 >> 172.21.15.162:0/703465048 conn(0x7fb058070350 msgr2=0x7fb058070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:04.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.477+0000 7fb05f057640 1 -- 172.21.15.162:0/703465048 shutdown_connections 2024-04-25T00:51:04.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.477+0000 7fb05f057640 1 -- 172.21.15.162:0/703465048 wait complete. 2024-04-25T00:51:04.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.477+0000 7fb05f057640 1 Processor -- start 2024-04-25T00:51:04.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.477+0000 7fb05f057640 1 -- start start 2024-04-25T00:51:04.480 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.477+0000 7fb05f057640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb058152320 0x7fb0581ee980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:04.480 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.477+0000 7fb05f057640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0581581c0 0x7fb058074ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:04.480 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.477+0000 7fb05f057640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb05815c200 0x7fb058146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:04.480 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.477+0000 7fb05f057640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb05815bce0 con 0x7fb05815c200 2024-04-25T00:51:04.480 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.477+0000 7fb05f057640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb05815ba00 con 0x7fb0581581c0 2024-04-25T00:51:04.480 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.477+0000 7fb05f057640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb05815c680 con 0x7fb058152320 2024-04-25T00:51:04.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.481+0000 7fb05cdf3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb058152320 0x7fb0581ee980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:04.481 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.481+0000 7fb05d5f4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb05815c200 0x7fb058146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:04.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.481+0000 7fb05cdf3640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb058152320 0x7fb0581ee980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:60872/0 (socket says 172.21.15.162:60872) 2024-04-25T00:51:04.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.481+0000 7fb05cdf3640 1 -- 172.21.15.162:0/958930087 learned_addr learned my addr 172.21.15.162:0/958930087 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:04.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.481+0000 7fb057fff640 1 --2- 172.21.15.162:0/958930087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0581581c0 0x7fb058074ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:04.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.485+0000 7fb05d5f4640 1 -- 172.21.15.162:0/958930087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb058152320 msgr2=0x7fb0581ee980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:04.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.485+0000 7fb05d5f4640 1 --2- 172.21.15.162:0/958930087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb058152320 0x7fb0581ee980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:04.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.485+0000 7fb05d5f4640 1 -- 172.21.15.162:0/958930087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0581581c0 msgr2=0x7fb058074ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:04.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.485+0000 7fb05d5f4640 1 --2- 172.21.15.162:0/958930087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0581581c0 0x7fb058074ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:04.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.485+0000 7fb05d5f4640 1 -- 172.21.15.162:0/958930087 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb058155a70 con 0x7fb05815c200 2024-04-25T00:51:04.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.485+0000 7fb05d5f4640 1 --2- 172.21.15.162:0/958930087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb05815c200 0x7fb058146320 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb0480af000 tx=0x7fb04801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:04.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.489+0000 7fb0557fa640 1 -- 172.21.15.162:0/958930087 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0480c1070 con 0x7fb05815c200 2024-04-25T00:51:04.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.489+0000 7fb0557fa640 1 -- 172.21.15.162:0/958930087 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0480b0720 con 0x7fb05815c200 2024-04-25T00:51:04.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.489+0000 7fb05f057640 1 -- 172.21.15.162:0/958930087 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb058155170 con 0x7fb05815c200 2024-04-25T00:51:04.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.489+0000 7fb0557fa640 1 -- 172.21.15.162:0/958930087 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0480b5040 con 0x7fb05815c200 2024-04-25T00:51:04.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.489+0000 7fb05f057640 1 -- 172.21.15.162:0/958930087 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb058155730 con 0x7fb05815c200 2024-04-25T00:51:04.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.493+0000 7fb05f057640 1 -- 172.21.15.162:0/958930087 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb05804f5f0 con 0x7fb05815c200 2024-04-25T00:51:04.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.517+0000 7fb0557fa640 1 -- 172.21.15.162:0/958930087 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb0480c4070 con 0x7fb05815c200 2024-04-25T00:51:04.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.517+0000 7fb0557fa640 1 --2- 172.21.15.162:0/958930087 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb0380678c0 0x7fb038069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:04.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.517+0000 7fb05cdf3640 1 --2- 172.21.15.162:0/958930087 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb0380678c0 0x7fb038069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:04.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.517+0000 7fb05cdf3640 1 --2- 172.21.15.162:0/958930087 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb0380678c0 0x7fb038069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb050003bd0 tx=0x7fb050009970 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:04.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.873+0000 7fb0557fa640 1 -- 172.21.15.162:0/958930087 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fb0480f1250 con 0x7fb05815c200 2024-04-25T00:51:04.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:04.873+0000 7fb0557fa640 1 -- 172.21.15.162:0/958930087 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fb058155a70 con 0x7fb05815c200 2024-04-25T00:51:05.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.049+0000 7fb05f057640 1 -- 172.21.15.162:0/958930087 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0581572e0 con 0x7fb05815c200 2024-04-25T00:51:05.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.177+0000 7fb0557fa640 1 -- 172.21.15.162:0/958930087 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+16641 (secure 0 0 0) 0x7fb0480187f0 con 0x7fb05815c200 2024-04-25T00:51:05.177 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:51:05.177 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":26,"fsid":"e141deed-4794-4a17-83c9-f6e6e8875f5e","created":"2024-04-25T00:49:29.904605+0000","modified":"2024-04-25T00:50:37.007717+0000","last_up_change":"2024-04-25T00:49:51.119342+0000","last_in_change":"2024-04-25T00:49:39.898293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T00:49:52.297093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T00:50:31.644475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T00:50:33.242786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e20986cc-3664-4988-959c-c0b02e380775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6811","nonce":2734546478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6813","nonce":2734546478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6817","nonce":2734546478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6815","nonce":2734546478}]},"public_addr":"172.21.15.162:6811/2734546478","cluster_addr":"172.21.15.162:6813/2734546478","heartbeat_back_addr":"172.21.15.162:6817/2734546478","heartbeat_front_addr":"172.21.15.162:6815/2734546478","state":["exists","up"]},{"osd":1,"uuid":"60f1608a-ecb7-4978-b816-ce6f419e275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6803","nonce":3488816098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6805","nonce":3488816098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6809","nonce":3488816098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6807","nonce":3488816098}]},"public_addr":"172.21.15.162:6803/3488816098","cluster_addr":"172.21.15.162:6805/3488816098","heartbeat_back_addr":"172.21.15.162:6809/3488816098","heartbeat_front_addr":"172.21.15.162:6807/3488816098","state":["exists","up"]},{"osd":2,"uuid":"77552061-8e19-4f49-bc3f-1300955a07b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6819","nonce":234337516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6821","nonce":234337516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6825","nonce":234337516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6823","nonce":234337516}]},"public_addr":"172.21.15.162:6819/234337516","cluster_addr":"172.21.15.162:6821/234337516","heartbeat_back_addr":"172.21.15.162:6825/234337516","heartbeat_front_addr":"172.21.15.162:6823/234337516","state":["exists","up"]},{"osd":3,"uuid":"5b105720-6e6d-4143-b5c4-0a3b1e4a687c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6827","nonce":1726903362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6829","nonce":1726903362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6833","nonce":1726903362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6831","nonce":1726903362}]},"public_addr":"172.21.15.162:6827/1726903362","cluster_addr":"172.21.15.162:6829/1726903362","heartbeat_back_addr":"172.21.15.162:6833/1726903362","heartbeat_front_addr":"172.21.15.162:6831/1726903362","state":["exists","up"]},{"osd":4,"uuid":"611eafc5-2fe0-4c96-ba8c-b1efc3930de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6817","nonce":3338082657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6819","nonce":3338082657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6823","nonce":3338082657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6821","nonce":3338082657}]},"public_addr":"172.21.15.179:6817/3338082657","cluster_addr":"172.21.15.179:6819/3338082657","heartbeat_back_addr":"172.21.15.179:6823/3338082657","heartbeat_front_addr":"172.21.15.179:6821/3338082657","state":["exists","up"]},{"osd":5,"uuid":"b39487f5-c314-4026-90bd-02e30ecca04f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6825","nonce":4129338239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6827","nonce":4129338239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6831","nonce":4129338239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6829","nonce":4129338239}]},"public_addr":"172.21.15.179:6825/4129338239","cluster_addr":"172.21.15.179:6827/4129338239","heartbeat_back_addr":"172.21.15.179:6831/4129338239","heartbeat_front_addr":"172.21.15.179:6829/4129338239","state":["exists","up"]},{"osd":6,"uuid":"1d902755-f992-4070-b30e-e79f5fb22d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6801","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6802","nonce":823843016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6806","nonce":823843016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6815","nonce":823843016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6810","nonce":823843016}]},"public_addr":"172.21.15.179:6802/823843016","cluster_addr":"172.21.15.179:6806/823843016","heartbeat_back_addr":"172.21.15.179:6815/823843016","heartbeat_front_addr":"172.21.15.179:6810/823843016","state":["exists","up"]},{"osd":7,"uuid":"ea529f85-28fd-4dc3-a584-314e71999061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6803","nonce":3403659125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6807","nonce":3403659125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6814","nonce":3403659125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6811","nonce":3403659125}]},"public_addr":"172.21.15.179:6803/3403659125","cluster_addr":"172.21.15.179:6807/3403659125","heartbeat_back_addr":"172.21.15.179:6814/3403659125","heartbeat_front_addr":"172.21.15.179:6811/3403659125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.684518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.583123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.644576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.815957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.787155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.814409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.657210+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.676697+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T00:51:05.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.177+0000 7fb05f057640 1 -- 172.21.15.162:0/958930087 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb0380678c0 msgr2=0x7fb038069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:05.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.177+0000 7fb05f057640 1 --2- 172.21.15.162:0/958930087 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb0380678c0 0x7fb038069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb050003bd0 tx=0x7fb050009970 comp rx=0 tx=0).stop 2024-04-25T00:51:05.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.177+0000 7fb05f057640 1 -- 172.21.15.162:0/958930087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb05815c200 msgr2=0x7fb058146320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:05.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.177+0000 7fb05f057640 1 --2- 172.21.15.162:0/958930087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb05815c200 0x7fb058146320 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fb0480af000 tx=0x7fb04801ba30 comp rx=0 tx=0).stop 2024-04-25T00:51:05.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.177+0000 7fb05f057640 1 -- 172.21.15.162:0/958930087 shutdown_connections 2024-04-25T00:51:05.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.177+0000 7fb05f057640 1 --2- 172.21.15.162:0/958930087 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb0380678c0 0x7fb038069d80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:05.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.177+0000 7fb05f057640 1 --2- 172.21.15.162:0/958930087 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb05815c200 0x7fb058146320 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:05.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.177+0000 7fb05f057640 1 --2- 172.21.15.162:0/958930087 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb0581581c0 0x7fb058074ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:05.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.177+0000 7fb05f057640 1 --2- 172.21.15.162:0/958930087 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb058152320 0x7fb0581ee980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:05.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.177+0000 7fb05f057640 1 -- 172.21.15.162:0/958930087 >> 172.21.15.162:0/958930087 conn(0x7fb058070350 msgr2=0x7fb0580cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:05.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.177+0000 7fb05f057640 1 -- 172.21.15.162:0/958930087 shutdown_connections 2024-04-25T00:51:05.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.177+0000 7fb05f057640 1 -- 172.21.15.162:0/958930087 wait complete. 2024-04-25T00:51:05.199 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T00:51:05.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.361+0000 7f3386bab640 1 Processor -- start 2024-04-25T00:51:05.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.361+0000 7f3386bab640 1 -- start start 2024-04-25T00:51:05.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.361+0000 7f3386bab640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f338015aa50 0x7f338015aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:05.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.361+0000 7f3386bab640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f338006d210 con 0x7f33801544e0 2024-04-25T00:51:05.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.361+0000 7f3386bab640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f338006d4b0 con 0x7f33801548c0 2024-04-25T00:51:05.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.361+0000 7f3386bab640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f338006e380 con 0x7f338015aa50 2024-04-25T00:51:05.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.361+0000 7f3384947640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f33801544e0 0x7f3380072150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:52468/0 (socket says 172.21.15.162:52468) 2024-04-25T00:51:05.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.361+0000 7f3384947640 1 -- 172.21.15.162:0/3034955592 learned_addr learned my addr 172.21.15.162:0/3034955592 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:51:05.365 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.365+0000 7f3385148640 1 --2- 172.21.15.162:0/3034955592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f338015aa50 0x7f338015aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:05.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.365+0000 7f337f7fe640 1 -- 172.21.15.162:0/3034955592 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3836897904 0 0) 0x7f338006d210 con 0x7f33801544e0 2024-04-25T00:51:05.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.365+0000 7f337f7fe640 1 -- 172.21.15.162:0/3034955592 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3368003530 con 0x7f33801544e0 2024-04-25T00:51:05.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.369+0000 7f337f7fe640 1 -- 172.21.15.162:0/3034955592 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3749956774 0 0) 0x7f3368003530 con 0x7f33801544e0 2024-04-25T00:51:05.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.369+0000 7f337f7fe640 1 -- 172.21.15.162:0/3034955592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f338015aa50 msgr2=0x7f338015aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:05.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.369+0000 7f337f7fe640 1 --2- 172.21.15.162:0/3034955592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f338015aa50 0x7f338015aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:05.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.369+0000 7f337f7fe640 1 -- 172.21.15.162:0/3034955592 >> v1:172.21.15.179:6789/0 conn(0x7f33801548c0 legacy=0x7f338015a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:05.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.369+0000 7f337f7fe640 1 -- 172.21.15.162:0/3034955592 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f338006d770 con 0x7f33801544e0 2024-04-25T00:51:05.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.369+0000 7f337f7fe640 1 -- 172.21.15.162:0/3034955592 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7f3370001680 con 0x7f33801544e0 2024-04-25T00:51:05.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.369+0000 7f337f7fe640 1 -- 172.21.15.162:0/3034955592 >> v1:172.21.15.162:6789/0 conn(0x7f33801544e0 legacy=0x7f3380072150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:05.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.369+0000 7f337f7fe640 1 --2- 172.21.15.162:0/3034955592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33680039f0 0x7f3368003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:05.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.369+0000 7f337f7fe640 1 --2- 172.21.15.162:0/3034955592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3368004810 0x7f3368004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:05.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.369+0000 7f337f7fe640 1 --2- 172.21.15.162:0/3034955592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33680051d0 0x7f336800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:05.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.369+0000 7f337f7fe640 1 -- 172.21.15.162:0/3034955592 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f338006e380 con 0x7f3368004810 2024-04-25T00:51:05.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.369+0000 7f337f7fe640 1 -- 172.21.15.162:0/3034955592 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f336800bf10 con 0x7f33680039f0 2024-04-25T00:51:05.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.369+0000 7f337f7fe640 1 -- 172.21.15.162:0/3034955592 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f336800c0e0 con 0x7f33680051d0 2024-04-25T00:51:05.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.373+0000 7f337ffff640 1 --2- 172.21.15.162:0/3034955592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3368004810 0x7f3368004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:05.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.373+0000 7f3384947640 1 --2- 172.21.15.162:0/3034955592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33680039f0 0x7f3368003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:05.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.377+0000 7f337ffff640 1 -- 172.21.15.162:0/3034955592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33680051d0 msgr2=0x7f336800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:05.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.377+0000 7f337ffff640 1 --2- 172.21.15.162:0/3034955592 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33680051d0 0x7f336800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:05.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.377+0000 7f337ffff640 1 -- 172.21.15.162:0/3034955592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33680039f0 msgr2=0x7f3368003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:05.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.377+0000 7f337ffff640 1 --2- 172.21.15.162:0/3034955592 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f33680039f0 0x7f3368003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:05.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.377+0000 7f337ffff640 1 -- 172.21.15.162:0/3034955592 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3368003530 con 0x7f3368004810 2024-04-25T00:51:05.380 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.377+0000 7f337ffff640 1 --2- 172.21.15.162:0/3034955592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3368004810 0x7f3368004c90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f33740017b0 tx=0x7f337401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a4fd1da739f606 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:05.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.381+0000 7f337f7fe640 1 -- 172.21.15.162:0/3034955592 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33740013a0 con 0x7f3368004810 2024-04-25T00:51:05.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.385+0000 7f337f7fe640 1 -- 172.21.15.162:0/3034955592 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33740052f0 con 0x7f3368004810 2024-04-25T00:51:05.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.385+0000 7f337f7fe640 1 -- 172.21.15.162:0/3034955592 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374003840 con 0x7f3368004810 2024-04-25T00:51:05.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.385+0000 7f3386bab640 1 -- 172.21.15.162:0/3034955592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3368004810 msgr2=0x7f3368004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:05.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.385+0000 7f3386bab640 1 --2- 172.21.15.162:0/3034955592 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3368004810 0x7f3368004c90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f33740017b0 tx=0x7f337401c3b0 comp rx=0 tx=0).stop 2024-04-25T00:51:05.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.385+0000 7f3385148640 1 -- 172.21.15.162:0/3034955592 reap_dead start 2024-04-25T00:51:05.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.385+0000 7f3386bab640 1 -- 172.21.15.162:0/3034955592 shutdown_connections 2024-04-25T00:51:05.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.385+0000 7f3386bab640 1 -- 172.21.15.162:0/3034955592 >> 172.21.15.162:0/3034955592 conn(0x7f33800c83c0 msgr2=0x7f33800c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:05.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.385+0000 7f3386bab640 1 -- 172.21.15.162:0/3034955592 shutdown_connections 2024-04-25T00:51:05.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.385+0000 7f3386bab640 1 -- 172.21.15.162:0/3034955592 wait complete. 2024-04-25T00:51:05.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.385+0000 7f3386bab640 1 Processor -- start 2024-04-25T00:51:05.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.385+0000 7f3386bab640 1 -- start start 2024-04-25T00:51:05.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.385+0000 7f3386bab640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3380154f10 0x7f33801591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:05.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.385+0000 7f3386bab640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33801552f0 0x7f3380159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:05.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.385+0000 7f3386bab640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33801e03e0 0x7f33801508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:05.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.385+0000 7f3386bab640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f338006e010 con 0x7f33801e03e0 2024-04-25T00:51:05.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.385+0000 7f3386bab640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f338006dd30 con 0x7f3380154f10 2024-04-25T00:51:05.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.389+0000 7f3386bab640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f338015aeb0 con 0x7f33801552f0 2024-04-25T00:51:05.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.389+0000 7f3385148640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33801e03e0 0x7f33801508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:05.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.389+0000 7f3385148640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33801e03e0 0x7f33801508a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55434/0 (socket says 172.21.15.162:55434) 2024-04-25T00:51:05.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.389+0000 7f3385148640 1 -- 172.21.15.162:0/4006066494 learned_addr learned my addr 172.21.15.162:0/4006066494 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:05.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.389+0000 7f3384947640 1 --2- 172.21.15.162:0/4006066494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3380154f10 0x7f33801591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:05.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.389+0000 7f337ffff640 1 --2- 172.21.15.162:0/4006066494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33801552f0 0x7f3380159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:05.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.393+0000 7f3385148640 1 -- 172.21.15.162:0/4006066494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33801552f0 msgr2=0x7f3380159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:05.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.393+0000 7f3385148640 1 --2- 172.21.15.162:0/4006066494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33801552f0 0x7f3380159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:05.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.393+0000 7f3385148640 1 -- 172.21.15.162:0/4006066494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3380154f10 msgr2=0x7f33801591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:05.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.393+0000 7f3385148640 1 --2- 172.21.15.162:0/4006066494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3380154f10 0x7f33801591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:05.393 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.393+0000 7f3385148640 1 -- 172.21.15.162:0/4006066494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3380158140 con 0x7f33801e03e0 2024-04-25T00:51:05.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.393+0000 7f3385148640 1 --2- 172.21.15.162:0/4006066494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33801e03e0 0x7f33801508a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3380070140 tx=0x7f337800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:05.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.397+0000 7f337d7fa640 1 -- 172.21.15.162:0/4006066494 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337800bae0 con 0x7f33801e03e0 2024-04-25T00:51:05.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.397+0000 7f337d7fa640 1 -- 172.21.15.162:0/4006066494 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3378019070 con 0x7f33801e03e0 2024-04-25T00:51:05.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.397+0000 7f337d7fa640 1 -- 172.21.15.162:0/4006066494 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33780039a0 con 0x7f33801e03e0 2024-04-25T00:51:05.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.397+0000 7f3386bab640 1 -- 172.21.15.162:0/4006066494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3380158420 con 0x7f33801e03e0 2024-04-25T00:51:05.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.397+0000 7f3386bab640 1 -- 172.21.15.162:0/4006066494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33801589e0 con 0x7f33801e03e0 2024-04-25T00:51:05.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.401+0000 7f3386bab640 1 -- 172.21.15.162:0/4006066494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3380072d50 con 0x7f33801e03e0 2024-04-25T00:51:05.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.417+0000 7f337d7fa640 1 -- 172.21.15.162:0/4006066494 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3378013070 con 0x7f33801e03e0 2024-04-25T00:51:05.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.421+0000 7f337d7fa640 1 --2- 172.21.15.162:0/4006066494 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f336c067940 0x7f336c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:05.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.421+0000 7f3384947640 1 --2- 172.21.15.162:0/4006066494 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f336c067940 0x7f336c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:05.421 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.421+0000 7f3384947640 1 --2- 172.21.15.162:0/4006066494 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f336c067940 0x7f336c069e00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3370001060 tx=0x7f33700014c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:05.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.697+0000 7f337d7fa640 1 -- 172.21.15.162:0/4006066494 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f33780551a0 con 0x7f33801e03e0 2024-04-25T00:51:05.698 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.697+0000 7f337d7fa640 1 -- 172.21.15.162:0/4006066494 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f3378023020 con 0x7f33801e03e0 2024-04-25T00:51:05.899 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.897+0000 7f3386bab640 1 -- 172.21.15.162:0/4006066494 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f338004f5f0 con 0x7f33801e03e0 2024-04-25T00:51:05.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.945+0000 7f337d7fa640 1 -- 172.21.15.162:0/4006066494 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6919 (secure 0 0 0) 0x7f3378057100 con 0x7f33801e03e0 2024-04-25T00:51:05.946 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T00:51:05.946 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/560649188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":560649188},{"type":"v1","addr":"172.21.15.179:6833","nonce":560649188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T00:50:35.645685+0000","modified":"2024-04-25T00:50:58.084533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4246,"mds_1":4244,"mds_2":4241,"mds_3":4240,"mds_4":4233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4233":{"gid":4233,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":11,"addr":"172.21.15.179:6835/1339390327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1339390327},{"type":"v1","addr":"172.21.15.179:6835","nonce":1339390327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4240":{"gid":4240,"name":"e","rank":3,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.162:6835/191105979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":191105979},{"type":"v1","addr":"172.21.15.162:6835","nonce":191105979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4241":{"gid":4241,"name":"c","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2357127318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2357127318},{"type":"v1","addr":"172.21.15.162:6839","nonce":2357127318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4244":{"gid":4244,"name":"f","rank":1,"incarnation":8,"state":"up:active","state_seq":7,"addr":"172.21.15.179:6837/2607965795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2607965795},{"type":"v1","addr":"172.21.15.179:6837","nonce":2607965795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4246":{"gid":4246,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":6,"addr":"172.21.15.162:6837/1743481688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1743481688},{"type":"v1","addr":"172.21.15.162:6837","nonce":1743481688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4233,4246,4240,4241,4244]},"id":1}]} 2024-04-25T00:51:05.947 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 17 2024-04-25T00:51:05.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.945+0000 7f3386bab640 1 -- 172.21.15.162:0/4006066494 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f336c067940 msgr2=0x7f336c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:05.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.945+0000 7f3386bab640 1 --2- 172.21.15.162:0/4006066494 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f336c067940 0x7f336c069e00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3370001060 tx=0x7f33700014c0 comp rx=0 tx=0).stop 2024-04-25T00:51:05.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.945+0000 7f3386bab640 1 -- 172.21.15.162:0/4006066494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33801e03e0 msgr2=0x7f33801508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:05.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.945+0000 7f3386bab640 1 --2- 172.21.15.162:0/4006066494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33801e03e0 0x7f33801508a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3380070140 tx=0x7f337800b480 comp rx=0 tx=0).stop 2024-04-25T00:51:05.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.945+0000 7f3386bab640 1 -- 172.21.15.162:0/4006066494 shutdown_connections 2024-04-25T00:51:05.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.945+0000 7f3386bab640 1 --2- 172.21.15.162:0/4006066494 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f336c067940 0x7f336c069e00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:05.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.945+0000 7f3386bab640 1 --2- 172.21.15.162:0/4006066494 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f33801e03e0 0x7f33801508a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:05.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.945+0000 7f3386bab640 1 --2- 172.21.15.162:0/4006066494 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f33801552f0 0x7f3380159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:05.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.945+0000 7f3386bab640 1 --2- 172.21.15.162:0/4006066494 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3380154f10 0x7f33801591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:05.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.945+0000 7f3386bab640 1 -- 172.21.15.162:0/4006066494 >> 172.21.15.162:0/4006066494 conn(0x7f33800c83c0 msgr2=0x7f33800c7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:05.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.945+0000 7f3386bab640 1 -- 172.21.15.162:0/4006066494 shutdown_connections 2024-04-25T00:51:05.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:05.945+0000 7f3386bab640 1 -- 172.21.15.162:0/4006066494 wait complete. 2024-04-25T00:51:06.570 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T00:50:35.645685+0000', 'modified': '2024-04-25T00:50:58.084533+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4246, 'mds_1': 4244, 'mds_2': 4241, 'mds_3': 4240, 'mds_4': 4233}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4233': {'gid': 4233, 'name': 'b', 'rank': 4, 'incarnation': 16, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.179:6835/1339390327', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6834', 'nonce': 1339390327}, {'type': 'v1', 'addr': '172.21.15.179:6835', 'nonce': 1339390327}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4240': {'gid': 4240, 'name': 'e', 'rank': 3, 'incarnation': 14, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.162:6835/191105979', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6834', 'nonce': 191105979}, {'type': 'v1', 'addr': '172.21.15.162:6835', 'nonce': 191105979}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4241': {'gid': 4241, 'name': 'c', 'rank': 2, 'incarnation': 12, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.162:6839/2357127318', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6838', 'nonce': 2357127318}, {'type': 'v1', 'addr': '172.21.15.162:6839', 'nonce': 2357127318}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4244': {'gid': 4244, 'name': 'f', 'rank': 1, 'incarnation': 8, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.179:6837/2607965795', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.179:6836', 'nonce': 2607965795}, {'type': 'v1', 'addr': '172.21.15.179:6837', 'nonce': 2607965795}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4246': {'gid': 4246, 'name': 'a', 'rank': 0, 'incarnation': 5, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.162:6837/1743481688', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.162:6836', 'nonce': 1743481688}, {'type': 'v1', 'addr': '172.21.15.162:6837', 'nonce': 1743481688}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4246, 'qdb_cluster': [4233, 4246, 4240, 4241, 4244]} 2024-04-25T00:51:06.571 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-25T00:51:06.571 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T00:51:06.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.701+0000 7f3c30043640 1 Processor -- start 2024-04-25T00:51:06.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.701+0000 7f3c30043640 1 -- start start 2024-04-25T00:51:06.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.701+0000 7f3c30043640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3c280c4730 0x7f3c2815af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:06.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.701+0000 7f3c30043640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c28072100 con 0x7f3c281545e0 2024-04-25T00:51:06.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.701+0000 7f3c30043640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c2806cdf0 con 0x7f3c281549c0 2024-04-25T00:51:06.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.701+0000 7f3c30043640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f3c2806d0b0 con 0x7f3c280c4730 2024-04-25T00:51:06.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.701+0000 7f3c2dddf640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f3c281545e0 0x7f3c280c4020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:52474/0 (socket says 172.21.15.162:52474) 2024-04-25T00:51:06.704 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.701+0000 7f3c2dddf640 1 -- 172.21.15.162:0/1463447776 learned_addr learned my addr 172.21.15.162:0/1463447776 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:51:06.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.709+0000 7f3c2e5e0640 1 --2- 172.21.15.162:0/1463447776 >> v2:172.21.15.179:3300/0 conn(0x7f3c280c4730 0x7f3c2815af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:06.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.709+0000 7f3c2cddd640 1 -- 172.21.15.162:0/1463447776 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4127227777 0 0) 0x7f3c28072100 con 0x7f3c281545e0 2024-04-25T00:51:06.710 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.709+0000 7f3c2cddd640 1 -- 172.21.15.162:0/1463447776 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c14003530 con 0x7f3c281545e0 2024-04-25T00:51:06.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.713+0000 7f3c2cddd640 1 -- 172.21.15.162:0/1463447776 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2347807584 0 0) 0x7f3c14003530 con 0x7f3c281545e0 2024-04-25T00:51:06.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.713+0000 7f3c2cddd640 1 -- 172.21.15.162:0/1463447776 >> v2:172.21.15.179:3300/0 conn(0x7f3c280c4730 msgr2=0x7f3c2815af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:06.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.713+0000 7f3c2cddd640 1 --2- 172.21.15.162:0/1463447776 >> v2:172.21.15.179:3300/0 conn(0x7f3c280c4730 0x7f3c2815af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:06.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.713+0000 7f3c2cddd640 1 -- 172.21.15.162:0/1463447776 >> v1:172.21.15.179:6789/0 conn(0x7f3c281549c0 legacy=0x7f3c280c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:06.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.713+0000 7f3c2cddd640 1 -- 172.21.15.162:0/1463447776 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c2806d390 con 0x7f3c281545e0 2024-04-25T00:51:06.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.713+0000 7f3c2cddd640 1 -- 172.21.15.162:0/1463447776 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7f3c180016a0 con 0x7f3c281545e0 2024-04-25T00:51:06.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.713+0000 7f3c2cddd640 1 -- 172.21.15.162:0/1463447776 >> v1:172.21.15.162:6789/0 conn(0x7f3c281545e0 legacy=0x7f3c280c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:06.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.713+0000 7f3c2cddd640 1 --2- 172.21.15.162:0/1463447776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c14003a10 0x7f3c14003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:06.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.713+0000 7f3c2cddd640 1 --2- 172.21.15.162:0/1463447776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c14004810 0x7f3c14004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:06.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.713+0000 7f3c2cddd640 1 --2- 172.21.15.162:0/1463447776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c140052f0 0x7f3c1400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:06.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.713+0000 7f3c2cddd640 1 -- 172.21.15.162:0/1463447776 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2806d0b0 con 0x7f3c140052f0 2024-04-25T00:51:06.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.713+0000 7f3c2cddd640 1 -- 172.21.15.162:0/1463447776 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3c1400c210 con 0x7f3c14004810 2024-04-25T00:51:06.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.713+0000 7f3c2cddd640 1 -- 172.21.15.162:0/1463447776 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3c1400c410 con 0x7f3c14003a10 2024-04-25T00:51:06.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.713+0000 7f3c2e5e0640 1 --2- 172.21.15.162:0/1463447776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c140052f0 0x7f3c1400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:06.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.713+0000 7f3c2dddf640 1 --2- 172.21.15.162:0/1463447776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c14003a10 0x7f3c14003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:06.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.717+0000 7f3c2e5e0640 1 -- 172.21.15.162:0/1463447776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c14003a10 msgr2=0x7f3c14003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:06.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.717+0000 7f3c2e5e0640 1 --2- 172.21.15.162:0/1463447776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c14003a10 0x7f3c14003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:06.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.717+0000 7f3c2e5e0640 1 -- 172.21.15.162:0/1463447776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c14004810 msgr2=0x7f3c14004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:06.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.717+0000 7f3c2e5e0640 1 --2- 172.21.15.162:0/1463447776 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c14004810 0x7f3c14004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:06.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.717+0000 7f3c2e5e0640 1 -- 172.21.15.162:0/1463447776 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c14003530 con 0x7f3c140052f0 2024-04-25T00:51:06.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.721+0000 7f3c2e5e0640 1 -- 172.21.15.162:0/1463447776 reap_dead start 2024-04-25T00:51:06.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.721+0000 7f3c2e5e0640 1 --2- 172.21.15.162:0/1463447776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c140052f0 0x7f3c1400b9d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3c20007360 tx=0x7f3c2001ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0babf920606cedb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:06.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c2cddd640 1 -- 172.21.15.162:0/1463447776 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20009be0 con 0x7f3c140052f0 2024-04-25T00:51:06.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c2cddd640 1 -- 172.21.15.162:0/1463447776 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c200a5dc0 con 0x7f3c140052f0 2024-04-25T00:51:06.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c2cddd640 1 -- 172.21.15.162:0/1463447776 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18007e60 con 0x7f3c140052f0 2024-04-25T00:51:06.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c30043640 1 -- 172.21.15.162:0/1463447776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c140052f0 msgr2=0x7f3c1400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:06.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c30043640 1 --2- 172.21.15.162:0/1463447776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c140052f0 0x7f3c1400b9d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3c20007360 tx=0x7f3c2001ce80 comp rx=0 tx=0).stop 2024-04-25T00:51:06.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c30043640 1 -- 172.21.15.162:0/1463447776 shutdown_connections 2024-04-25T00:51:06.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c30043640 1 --2- 172.21.15.162:0/1463447776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c140052f0 0x7f3c1400b9d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:06.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c30043640 1 -- 172.21.15.162:0/1463447776 >> 172.21.15.162:0/1463447776 conn(0x7f3c2806b210 msgr2=0x7f3c2806b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:06.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c30043640 1 -- 172.21.15.162:0/1463447776 shutdown_connections 2024-04-25T00:51:06.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c30043640 1 -- 172.21.15.162:0/1463447776 wait complete. 2024-04-25T00:51:06.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c30043640 1 Processor -- start 2024-04-25T00:51:06.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c30043640 1 -- start start 2024-04-25T00:51:06.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c30043640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c140052f0 0x7f3c281f2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:06.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c30043640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c280c2280 0x7f3c281f3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:06.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c30043640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c28155160 0x7f3c28155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:06.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c30043640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c28071d40 con 0x7f3c280c2280 2024-04-25T00:51:06.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c30043640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3c28071bc0 con 0x7f3c140052f0 2024-04-25T00:51:06.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c30043640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3c28071ec0 con 0x7f3c28155160 2024-04-25T00:51:06.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c2d5de640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c280c2280 0x7f3c281f3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:06.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c2d5de640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c280c2280 0x7f3c281f3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55452/0 (socket says 172.21.15.162:55452) 2024-04-25T00:51:06.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.729+0000 7f3c2d5de640 1 -- 172.21.15.162:0/1549646333 learned_addr learned my addr 172.21.15.162:0/1549646333 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:06.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.733+0000 7f3c2e5e0640 1 --2- 172.21.15.162:0/1549646333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c28155160 0x7f3c28155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:06.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.733+0000 7f3c2dddf640 1 --2- 172.21.15.162:0/1549646333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c140052f0 0x7f3c281f2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:06.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.733+0000 7f3c2d5de640 1 -- 172.21.15.162:0/1549646333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c28155160 msgr2=0x7f3c28155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:06.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.733+0000 7f3c2d5de640 1 --2- 172.21.15.162:0/1549646333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c28155160 0x7f3c28155e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:06.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.733+0000 7f3c2d5de640 1 -- 172.21.15.162:0/1549646333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c140052f0 msgr2=0x7f3c281f2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:06.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.733+0000 7f3c2d5de640 1 --2- 172.21.15.162:0/1549646333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c140052f0 0x7f3c281f2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:06.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.733+0000 7f3c2d5de640 1 -- 172.21.15.162:0/1549646333 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c28154e10 con 0x7f3c280c2280 2024-04-25T00:51:06.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.737+0000 7f3c2d5de640 1 --2- 172.21.15.162:0/1549646333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c280c2280 0x7f3c281f3480 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400c420 tx=0x7f3c2400c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:06.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.741+0000 7f3c1e7fc640 1 -- 172.21.15.162:0/1549646333 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c24017070 con 0x7f3c280c2280 2024-04-25T00:51:06.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.741+0000 7f3c1e7fc640 1 -- 172.21.15.162:0/1549646333 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c240052d0 con 0x7f3c280c2280 2024-04-25T00:51:06.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.741+0000 7f3c1e7fc640 1 -- 172.21.15.162:0/1549646333 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c240054c0 con 0x7f3c280c2280 2024-04-25T00:51:06.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.741+0000 7f3c30043640 1 -- 172.21.15.162:0/1549646333 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c28155640 con 0x7f3c280c2280 2024-04-25T00:51:06.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.741+0000 7f3c30043640 1 -- 172.21.15.162:0/1549646333 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c281f3d50 con 0x7f3c280c2280 2024-04-25T00:51:06.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.745+0000 7f3c331bc000 1 Processor -- start 2024-04-25T00:51:06.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.745+0000 7f3c331bc000 1 -- start start 2024-04-25T00:51:06.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.745+0000 7f3c331bc000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0174da0 0x564ba0175180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:06.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.745+0000 7f3c331bc000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba01800d0 0x564ba01824c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:06.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.745+0000 7f3c331bc000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba0182a00 0x564ba0184df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:06.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.745+0000 7f3c331bc000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564b9ff875e0 con 0x564ba0182a00 2024-04-25T00:51:06.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.745+0000 7f3c331bc000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564b9ff0ec50 con 0x564ba0174da0 2024-04-25T00:51:06.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.745+0000 7f3c331bc000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564b9ff835a0 con 0x564ba01800d0 2024-04-25T00:51:06.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.749+0000 7f3c2dddf640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba01800d0 0x564ba01824c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:06.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.749+0000 7f3c2dddf640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba01800d0 0x564ba01824c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:60938/0 (socket says 172.21.15.162:60938) 2024-04-25T00:51:06.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.749+0000 7f3c2dddf640 1 -- 172.21.15.162:0/4258040421 learned_addr learned my addr 172.21.15.162:0/4258040421 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:06.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.753+0000 7f3c2e5e0640 1 --2- 172.21.15.162:0/4258040421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0174da0 0x564ba0175180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:06.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.753+0000 7f3c2dddf640 1 -- 172.21.15.162:0/4258040421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0174da0 msgr2=0x564ba0175180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:06.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.753+0000 7f3c2dddf640 1 --2- 172.21.15.162:0/4258040421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0174da0 0x564ba0175180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:06.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.757+0000 7f3c2dddf640 1 -- 172.21.15.162:0/4258040421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba0182a00 msgr2=0x564ba0184df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:06.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.757+0000 7f3c2dddf640 1 --2- 172.21.15.162:0/4258040421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba0182a00 0x564ba0184df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:06.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.757+0000 7f3c2dddf640 1 -- 172.21.15.162:0/4258040421 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b9ff0cd10 con 0x564ba01800d0 2024-04-25T00:51:06.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.761+0000 7f3c2dddf640 1 --2- 172.21.15.162:0/4258040421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba01800d0 0x564ba01824c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c18000fd0 tx=0x7f3c18005550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9451f158ce32b269 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:06.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.761+0000 7f3c1e7fc640 1 -- 172.21.15.162:0/1549646333 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3c2401a070 con 0x7f3c280c2280 2024-04-25T00:51:06.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.761+0000 7f3c1e7fc640 1 --2- 172.21.15.162:0/1549646333 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3c0c0678f0 0x7f3c0c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:06.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.761+0000 7f3c2e5e0640 1 --2- 172.21.15.162:0/1549646333 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3c0c0678f0 0x7f3c0c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:06.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.761+0000 7f3c2e5e0640 1 --2- 172.21.15.162:0/1549646333 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3c0c0678f0 0x7f3c0c069db0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3c1400c1e0 tx=0x7f3c20004a50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:06.767 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.765+0000 7f3c1e7fc640 1 -- 172.21.15.162:0/1549646333 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f3c240534e0 con 0x7f3c280c2280 2024-04-25T00:51:06.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.769+0000 7f3c0b7fe640 1 -- 172.21.15.162:0/4258040421 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18015930 con 0x564ba01800d0 2024-04-25T00:51:06.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.769+0000 7f3c0b7fe640 1 -- 172.21.15.162:0/4258040421 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c1801c020 con 0x564ba01800d0 2024-04-25T00:51:06.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.769+0000 7f3c0b7fe640 1 -- 172.21.15.162:0/4258040421 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18015ad0 con 0x564ba01800d0 2024-04-25T00:51:06.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c331bc000 1 -- 172.21.15.162:0/4258040421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba01800d0 msgr2=0x564ba01824c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:06.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c331bc000 1 --2- 172.21.15.162:0/4258040421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba01800d0 0x564ba01824c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3c18000fd0 tx=0x7f3c18005550 comp rx=0 tx=0).stop 2024-04-25T00:51:06.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c331bc000 1 -- 172.21.15.162:0/4258040421 shutdown_connections 2024-04-25T00:51:06.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c331bc000 1 --2- 172.21.15.162:0/4258040421 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba0182a00 0x564ba0184df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:06.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c331bc000 1 --2- 172.21.15.162:0/4258040421 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba01800d0 0x564ba01824c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:06.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c331bc000 1 --2- 172.21.15.162:0/4258040421 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0174da0 0x564ba0175180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:06.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c331bc000 1 -- 172.21.15.162:0/4258040421 >> 172.21.15.162:0/4258040421 conn(0x564ba0175c10 msgr2=0x564ba0178000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:06.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c331bc000 1 -- 172.21.15.162:0/4258040421 shutdown_connections 2024-04-25T00:51:06.774 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c331bc000 1 -- 172.21.15.162:0/4258040421 wait complete. 2024-04-25T00:51:06.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c331bc000 1 -- start start 2024-04-25T00:51:06.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c331bc000 1 Processor -- start 2024-04-25T00:51:06.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c331bc000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba0174da0 0x564ba017cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:06.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c331bc000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba01800d0 0x564ba017d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:06.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c331bc000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0182a00 0x564ba017d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:06.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c331bc000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564b9ff41520 con 0x564ba01800d0 2024-04-25T00:51:06.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c331bc000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x564b9ff2d810 con 0x564ba0182a00 2024-04-25T00:51:06.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c331bc000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564b9ff54340 con 0x564ba0174da0 2024-04-25T00:51:06.775 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c331bc000 10 client.0 _ll_register_callbacks cb 0x564ba01245c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T00:51:06.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c2d5de640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba01800d0 0x564ba017d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:06.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c2d5de640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba01800d0 0x564ba017d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55472/0 (socket says 172.21.15.162:55472) 2024-04-25T00:51:06.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c2d5de640 1 -- 172.21.15.162:0/4067358554 learned_addr learned my addr 172.21.15.162:0/4067358554 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:06.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.773+0000 7f3c2e5e0640 1 --2- 172.21.15.162:0/4067358554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0182a00 0x564ba017d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:06.778 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.777+0000 7f3c2dddf640 1 --2- 172.21.15.162:0/4067358554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba0174da0 0x564ba017cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:06.779 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.777+0000 7f3c2d5de640 1 -- 172.21.15.162:0/4067358554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba0174da0 msgr2=0x564ba017cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:06.779 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.777+0000 7f3c2d5de640 1 --2- 172.21.15.162:0/4067358554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba0174da0 0x564ba017cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:06.779 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.777+0000 7f3c2d5de640 1 -- 172.21.15.162:0/4067358554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0182a00 msgr2=0x564ba017d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:06.779 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.777+0000 7f3c2d5de640 1 --2- 172.21.15.162:0/4067358554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0182a00 0x564ba017d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:06.779 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.777+0000 7f3c2d5de640 1 -- 172.21.15.162:0/4067358554 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b9ff1f7b0 con 0x564ba01800d0 2024-04-25T00:51:06.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.781+0000 7f3c2d5de640 1 --2- 172.21.15.162:0/4067358554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba01800d0 0x564ba017d2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3c240518a0 tx=0x7f3c24051d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f97d25bfa881fb8d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:06.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.781+0000 7f3c08ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-04-25T00:51:06.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.785+0000 7f3c08ff9640 1 -- 172.21.15.162:0/4067358554 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2406d180 con 0x564ba01800d0 2024-04-25T00:51:06.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.785+0000 7f3c08ff9640 1 -- 172.21.15.162:0/4067358554 <== mon.0 v2:172.21.15.162:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f3c2406d320 con 0x564ba01800d0 2024-04-25T00:51:06.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.785+0000 7f3c331bc000 1 -- 172.21.15.162:0/4067358554 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c1801c020 con 0x564ba01800d0 2024-04-25T00:51:06.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.785+0000 7f3c08ff9640 1 -- 172.21.15.162:0/4067358554 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f3c24054da0 con 0x564ba01800d0 2024-04-25T00:51:06.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.785+0000 7f3c331bc000 10 client.4503 fetch_fsmap learned FSMap version 17 2024-04-25T00:51:06.788 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.785+0000 7f3c331bc000 1 -- 172.21.15.162:0/4067358554 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x564b9ff0eea0 con 0x564ba01800d0 2024-04-25T00:51:06.790 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.789+0000 7f3c08ff9640 1 -- 172.21.15.162:0/4067358554 <== mon.0 v2:172.21.15.162:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c1801c020 con 0x564ba01800d0 2024-04-25T00:51:06.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.793+0000 7f3c08ff9640 1 -- 172.21.15.162:0/4067358554 <== mon.0 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) ==== 4784+0+0 (secure 0 0 0) 0x7f3c24051190 con 0x564ba01800d0 2024-04-25T00:51:06.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.793+0000 7f3c331bc000 10 client.4503 fetch_fsmap finished waiting for FSMap version 17 2024-04-25T00:51:06.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.793+0000 7f3c331bc000 10 client.4503 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T00:51:06.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.793+0000 7f3c331bc000 20 client.4503 populate_metadata read hostname 'smithi162' 2024-04-25T00:51:06.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.793+0000 7f3c331bc000 1 --2- 172.21.15.162:0/4067358554 >> [v2:172.21.15.179:6834/1339390327,v1:172.21.15.179:6835/1339390327] conn(0x564ba017e240 0x564ba0190150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:06.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.793+0000 7f3c331bc000 4 client.4503 mds_command: new command op to 4233 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T00:51:06.793 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.793+0000 7f3c331bc000 1 -- 172.21.15.162:0/4067358554 --> [v2:172.21.15.179:6834/1339390327,v1:172.21.15.179:6835/1339390327] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b9ff22ab0 con 0x564ba017e240 2024-04-25T00:51:06.818 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.817+0000 7f3c2dddf640 1 --2- 172.21.15.162:0/4067358554 >> [v2:172.21.15.179:6834/1339390327,v1:172.21.15.179:6835/1339390327] conn(0x564ba017e240 0x564ba0190150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:06.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.965+0000 7f3c2dddf640 1 --2- 172.21.15.162:0/4067358554 >> [v2:172.21.15.179:6834/1339390327,v1:172.21.15.179:6835/1339390327] conn(0x564ba017e240 0x564ba0190150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=70d187dbd5189590 server_cookie=79e72bb48832485 in_seq=0 out_seq=0 2024-04-25T00:51:06.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:06.965+0000 7f3c08ff9640 10 client.4503 ms_handle_connect on v2:172.21.15.179:6834/1339390327 2024-04-25T00:51:07.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.201+0000 7f3c08ff9640 1 -- 172.21.15.162:0/4067358554 <== mds.4 v2:172.21.15.179:6834/1339390327 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564b9ff22ab0 con 0x564ba017e240 2024-04-25T00:51:07.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.201+0000 7f3c08ff9640 10 client.4503 handle_command_reply: tid=0 2024-04-25T00:51:07.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.205+0000 7f3c331bc000 1 client.4503 shutdown 2024-04-25T00:51:07.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.205+0000 7f3c331bc000 1 -- 172.21.15.162:0/4067358554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba01800d0 msgr2=0x564ba017d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:07.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.205+0000 7f3c331bc000 1 --2- 172.21.15.162:0/4067358554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba01800d0 0x564ba017d2f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f3c240518a0 tx=0x7f3c24051d60 comp rx=0 tx=0).stop 2024-04-25T00:51:07.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.205+0000 7f3c331bc000 1 -- 172.21.15.162:0/4067358554 shutdown_connections 2024-04-25T00:51:07.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.205+0000 7f3c331bc000 1 --2- 172.21.15.162:0/4067358554 >> [v2:172.21.15.179:6834/1339390327,v1:172.21.15.179:6835/1339390327] conn(0x564ba017e240 0x564ba0190150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.205+0000 7f3c331bc000 1 --2- 172.21.15.162:0/4067358554 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0182a00 0x564ba017d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.205+0000 7f3c08ff9640 0 client.4503 ms_handle_reset on v2:172.21.15.179:6834/1339390327 2024-04-25T00:51:07.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.205+0000 7f3c331bc000 1 --2- 172.21.15.162:0/4067358554 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba01800d0 0x564ba017d2f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.205+0000 7f3c331bc000 1 --2- 172.21.15.162:0/4067358554 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba0174da0 0x564ba017cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.205+0000 7f3c331bc000 1 -- 172.21.15.162:0/4067358554 >> 172.21.15.162:0/4067358554 conn(0x564ba0175c10 msgr2=0x564ba0178000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:07.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.205+0000 7f3c331bc000 1 -- 172.21.15.162:0/4067358554 shutdown_connections 2024-04-25T00:51:07.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.205+0000 7f3c331bc000 1 -- 172.21.15.162:0/4067358554 wait complete. 2024-04-25T00:51:07.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.205+0000 7f3c331bc000 20 client.4503 trim_cache size 0 max 16384 2024-04-25T00:51:07.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.245+0000 7f3c331bc000 1 Processor -- start 2024-04-25T00:51:07.248 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.245+0000 7f3c331bc000 1 -- start start 2024-04-25T00:51:07.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.249+0000 7f3c331bc000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0175c10 0x564ba013da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.249+0000 7f3c331bc000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba0174da0 0x564ba013df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.249+0000 7f3c331bc000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba01800d0 0x564ba01814c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.249+0000 7f3c331bc000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3c281fd420 con 0x564ba01800d0 2024-04-25T00:51:07.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.249+0000 7f3c331bc000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3c281fc680 con 0x564ba0175c10 2024-04-25T00:51:07.250 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.249+0000 7f3c331bc000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3c281fcd50 con 0x564ba0174da0 2024-04-25T00:51:07.251 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.249+0000 7f3c2e5e0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba01800d0 0x564ba01814c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.251 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.249+0000 7f3c2d5de640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba0174da0 0x564ba013df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.249+0000 7f3c2e5e0640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba01800d0 0x564ba01814c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55478/0 (socket says 172.21.15.162:55478) 2024-04-25T00:51:07.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.249+0000 7f3c2e5e0640 1 -- 172.21.15.162:0/3506952211 learned_addr learned my addr 172.21.15.162:0/3506952211 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:07.252 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.249+0000 7f3c2dddf640 1 --2- 172.21.15.162:0/3506952211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0175c10 0x564ba013da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.253+0000 7f3c2e5e0640 1 -- 172.21.15.162:0/3506952211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba0174da0 msgr2=0x564ba013df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:07.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.253+0000 7f3c2e5e0640 1 --2- 172.21.15.162:0/3506952211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba0174da0 0x564ba013df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.253+0000 7f3c2e5e0640 1 -- 172.21.15.162:0/3506952211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0175c10 msgr2=0x564ba013da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:07.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.253+0000 7f3c2e5e0640 1 --2- 172.21.15.162:0/3506952211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0175c10 0x564ba013da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.255 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.253+0000 7f3c2e5e0640 1 -- 172.21.15.162:0/3506952211 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b9ff0fe80 con 0x564ba01800d0 2024-04-25T00:51:07.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.257+0000 7f3c2e5e0640 1 --2- 172.21.15.162:0/3506952211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba01800d0 0x564ba01814c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3c2001cec0 tx=0x7f3c200af040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e50ada00c2cb93d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:07.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.265+0000 7f3c0affd640 1 -- 172.21.15.162:0/3506952211 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20003c60 con 0x564ba01800d0 2024-04-25T00:51:07.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.265+0000 7f3c0affd640 1 -- 172.21.15.162:0/3506952211 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c200c8070 con 0x564ba01800d0 2024-04-25T00:51:07.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.265+0000 7f3c0affd640 1 -- 172.21.15.162:0/3506952211 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20004040 con 0x564ba01800d0 2024-04-25T00:51:07.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.265+0000 7f3c331bc000 1 -- 172.21.15.162:0/3506952211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba01800d0 msgr2=0x564ba01814c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:07.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.265+0000 7f3c331bc000 1 --2- 172.21.15.162:0/3506952211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba01800d0 0x564ba01814c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3c2001cec0 tx=0x7f3c200af040 comp rx=0 tx=0).stop 2024-04-25T00:51:07.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.265+0000 7f3c331bc000 1 -- 172.21.15.162:0/3506952211 shutdown_connections 2024-04-25T00:51:07.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.265+0000 7f3c331bc000 1 --2- 172.21.15.162:0/3506952211 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba01800d0 0x564ba01814c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.265+0000 7f3c331bc000 1 --2- 172.21.15.162:0/3506952211 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba0174da0 0x564ba013df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.265+0000 7f3c331bc000 1 --2- 172.21.15.162:0/3506952211 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0175c10 0x564ba013da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.265+0000 7f3c331bc000 1 -- 172.21.15.162:0/3506952211 >> 172.21.15.162:0/3506952211 conn(0x564ba01749c0 msgr2=0x564ba013d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:07.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.265+0000 7f3c331bc000 1 -- 172.21.15.162:0/3506952211 shutdown_connections 2024-04-25T00:51:07.267 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.265+0000 7f3c331bc000 1 -- 172.21.15.162:0/3506952211 wait complete. 2024-04-25T00:51:07.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.265+0000 7f3c331bc000 1 -- start start 2024-04-25T00:51:07.268 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.265+0000 7f3c331bc000 1 Processor -- start 2024-04-25T00:51:07.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.269+0000 7f3c331bc000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0174da0 0x564ba01ef7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.269+0000 7f3c331bc000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba0175c10 0x564ba0192470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.269+0000 7f3c331bc000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba01800d0 0x564ba01929b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.269+0000 7f3c331bc000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x564b9ff868f0 con 0x564ba0175c10 2024-04-25T00:51:07.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.269+0000 7f3c331bc000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3c281f0450 con 0x564ba0174da0 2024-04-25T00:51:07.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.269+0000 7f3c331bc000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x564b9ff3bc40 con 0x564ba01800d0 2024-04-25T00:51:07.270 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.269+0000 7f3c331bc000 10 client.0 _ll_register_callbacks cb 0x7f3c24055210 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T00:51:07.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.269+0000 7f3c2d5de640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba0175c10 0x564ba0192470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.269+0000 7f3c2e5e0640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba01800d0 0x564ba01929b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.269+0000 7f3c2d5de640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba0175c10 0x564ba0192470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55486/0 (socket says 172.21.15.162:55486) 2024-04-25T00:51:07.271 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.269+0000 7f3c2d5de640 1 -- 172.21.15.162:0/1582190019 learned_addr learned my addr 172.21.15.162:0/1582190019 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:07.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.269+0000 7f3c2dddf640 1 --2- 172.21.15.162:0/1582190019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0174da0 0x564ba01ef7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.273+0000 7f3c2d5de640 1 -- 172.21.15.162:0/1582190019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba01800d0 msgr2=0x564ba01929b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:07.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.273+0000 7f3c2d5de640 1 --2- 172.21.15.162:0/1582190019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba01800d0 0x564ba01929b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.273+0000 7f3c2d5de640 1 -- 172.21.15.162:0/1582190019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0174da0 msgr2=0x564ba01ef7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:07.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.273+0000 7f3c2d5de640 1 --2- 172.21.15.162:0/1582190019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0174da0 0x564ba01ef7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.273+0000 7f3c2d5de640 1 -- 172.21.15.162:0/1582190019 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b9ff54760 con 0x564ba0175c10 2024-04-25T00:51:07.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.277+0000 7f3c2d5de640 1 --2- 172.21.15.162:0/1582190019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba0175c10 0x564ba0192470 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c24000c10 tx=0x7f3c2400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce2a4a2d3c6732e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:07.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.277+0000 7f3c08ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-04-25T00:51:07.282 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.281+0000 7f3c08ff9640 1 -- 172.21.15.162:0/1582190019 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c24055440 con 0x564ba0175c10 2024-04-25T00:51:07.283 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.281+0000 7f3c08ff9640 1 -- 172.21.15.162:0/1582190019 <== mon.0 v2:172.21.15.162:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f3c2406d180 con 0x564ba0175c10 2024-04-25T00:51:07.283 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.281+0000 7f3c331bc000 1 -- 172.21.15.162:0/1582190019 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c200c8070 con 0x564ba0175c10 2024-04-25T00:51:07.284 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.281+0000 7f3c08ff9640 1 -- 172.21.15.162:0/1582190019 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f3c2405df70 con 0x564ba0175c10 2024-04-25T00:51:07.284 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.281+0000 7f3c331bc000 10 client.4509 fetch_fsmap learned FSMap version 17 2024-04-25T00:51:07.284 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.281+0000 7f3c331bc000 1 -- 172.21.15.162:0/1582190019 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x564b9ffe09e0 con 0x564ba0175c10 2024-04-25T00:51:07.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.289+0000 7f3c08ff9640 1 -- 172.21.15.162:0/1582190019 <== mon.0 v2:172.21.15.162:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c200c8070 con 0x564ba0175c10 2024-04-25T00:51:07.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.289+0000 7f3c08ff9640 1 -- 172.21.15.162:0/1582190019 <== mon.0 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) ==== 4784+0+0 (secure 0 0 0) 0x7f3c24054380 con 0x564ba0175c10 2024-04-25T00:51:07.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.289+0000 7f3c331bc000 10 client.4509 fetch_fsmap finished waiting for FSMap version 17 2024-04-25T00:51:07.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.289+0000 7f3c331bc000 10 client.4509 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T00:51:07.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.289+0000 7f3c331bc000 20 client.4509 populate_metadata read hostname 'smithi162' 2024-04-25T00:51:07.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.289+0000 7f3c331bc000 1 --2- 172.21.15.162:0/1582190019 >> [v2:172.21.15.179:6834/1339390327,v1:172.21.15.179:6835/1339390327] conn(0x564ba0182a00 0x564ba01ec0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.289+0000 7f3c331bc000 4 client.4509 mds_command: new command op to 4233 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T00:51:07.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.289+0000 7f3c331bc000 1 -- 172.21.15.162:0/1582190019 --> [v2:172.21.15.179:6834/1339390327,v1:172.21.15.179:6835/1339390327] -- command(tid 0: {"prefix": "status"}) -- 0x564b9ff94b20 con 0x564ba0182a00 2024-04-25T00:51:07.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.289+0000 7f3c2dddf640 1 --2- 172.21.15.162:0/1582190019 >> [v2:172.21.15.179:6834/1339390327,v1:172.21.15.179:6835/1339390327] conn(0x564ba0182a00 0x564ba01ec0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.297+0000 7f3c2dddf640 1 --2- 172.21.15.162:0/1582190019 >> [v2:172.21.15.179:6834/1339390327,v1:172.21.15.179:6835/1339390327] conn(0x564ba0182a00 0x564ba01ec0d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=53f7e89f21b3f7b0 server_cookie=2a6cee3d81670518 in_seq=0 out_seq=0 2024-04-25T00:51:07.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.297+0000 7f3c08ff9640 10 client.4509 ms_handle_connect on v2:172.21.15.179:6834/1339390327 2024-04-25T00:51:07.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c08ff9640 1 -- 172.21.15.162:0/1582190019 <== mds.4 v2:172.21.15.179:6834/1339390327 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x564b9ff94b20 con 0x564ba0182a00 2024-04-25T00:51:07.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c08ff9640 10 client.4509 handle_command_reply: tid=0 2024-04-25T00:51:07.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c331bc000 1 client.4509 shutdown 2024-04-25T00:51:07.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c331bc000 1 -- 172.21.15.162:0/1582190019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba0175c10 msgr2=0x564ba0192470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:07.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c331bc000 1 --2- 172.21.15.162:0/1582190019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba0175c10 0x564ba0192470 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3c24000c10 tx=0x7f3c2400cf20 comp rx=0 tx=0).stop 2024-04-25T00:51:07.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c331bc000 1 -- 172.21.15.162:0/1582190019 shutdown_connections 2024-04-25T00:51:07.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c331bc000 1 --2- 172.21.15.162:0/1582190019 >> [v2:172.21.15.179:6834/1339390327,v1:172.21.15.179:6835/1339390327] conn(0x564ba0182a00 0x564ba01ec0d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c331bc000 1 --2- 172.21.15.162:0/1582190019 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x564ba01800d0 0x564ba01929b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c08ff9640 0 client.4509 ms_handle_reset on v2:172.21.15.179:6834/1339390327 2024-04-25T00:51:07.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c331bc000 1 --2- 172.21.15.162:0/1582190019 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x564ba0175c10 0x564ba0192470 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c331bc000 1 --2- 172.21.15.162:0/1582190019 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x564ba0174da0 0x564ba01ef7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c331bc000 1 -- 172.21.15.162:0/1582190019 >> 172.21.15.162:0/1582190019 conn(0x564ba01749c0 msgr2=0x564ba013dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:07.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c331bc000 1 -- 172.21.15.162:0/1582190019 shutdown_connections 2024-04-25T00:51:07.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c331bc000 1 -- 172.21.15.162:0/1582190019 wait complete. 2024-04-25T00:51:07.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c331bc000 20 client.4509 trim_cache size 0 max 16384 2024-04-25T00:51:07.325 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-04-25T00:51:07.325 INFO:teuthology.orchestra.run.smithi162.stdout: "cluster_fsid": "e141deed-4794-4a17-83c9-f6e6e8875f5e", 2024-04-25T00:51:07.325 INFO:teuthology.orchestra.run.smithi162.stdout: "whoami": 4, 2024-04-25T00:51:07.325 INFO:teuthology.orchestra.run.smithi162.stdout: "id": 4233, 2024-04-25T00:51:07.325 INFO:teuthology.orchestra.run.smithi162.stdout: "want_state": "up:active", 2024-04-25T00:51:07.325 INFO:teuthology.orchestra.run.smithi162.stdout: "state": "up:active", 2024-04-25T00:51:07.325 INFO:teuthology.orchestra.run.smithi162.stdout: "fs_name": "cephfs", 2024-04-25T00:51:07.325 INFO:teuthology.orchestra.run.smithi162.stdout: "rank_uptime": 10.793919009, 2024-04-25T00:51:07.325 INFO:teuthology.orchestra.run.smithi162.stdout: "mdsmap_epoch": 17, 2024-04-25T00:51:07.325 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_epoch": 26, 2024-04-25T00:51:07.325 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T00:51:07.325 INFO:teuthology.orchestra.run.smithi162.stdout: "uptime": 48.476733193999998 2024-04-25T00:51:07.325 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-04-25T00:51:07.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c30043640 1 -- 172.21.15.162:0/1549646333 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3c0c0678f0 msgr2=0x7f3c0c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:07.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c30043640 1 --2- 172.21.15.162:0/1549646333 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3c0c0678f0 0x7f3c0c069db0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3c1400c1e0 tx=0x7f3c20004a50 comp rx=0 tx=0).stop 2024-04-25T00:51:07.326 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c30043640 1 -- 172.21.15.162:0/1549646333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c280c2280 msgr2=0x7f3c281f3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:07.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.321+0000 7f3c30043640 1 --2- 172.21.15.162:0/1549646333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c280c2280 0x7f3c281f3480 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3c2400c420 tx=0x7f3c2400c820 comp rx=0 tx=0).stop 2024-04-25T00:51:07.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.325+0000 7f3c30043640 1 -- 172.21.15.162:0/1549646333 shutdown_connections 2024-04-25T00:51:07.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.325+0000 7f3c30043640 1 --2- 172.21.15.162:0/1549646333 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3c28155160 0x7f3c28155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.325+0000 7f3c30043640 1 --2- 172.21.15.162:0/1549646333 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3c0c0678f0 0x7f3c0c069db0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.325+0000 7f3c30043640 1 --2- 172.21.15.162:0/1549646333 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3c280c2280 0x7f3c281f3480 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.325+0000 7f3c30043640 1 --2- 172.21.15.162:0/1549646333 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3c140052f0 0x7f3c281f2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.325+0000 7f3c30043640 1 -- 172.21.15.162:0/1549646333 >> 172.21.15.162:0/1549646333 conn(0x7f3c2806b210 msgr2=0x7f3c280c8230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:07.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.325+0000 7f3c30043640 1 -- 172.21.15.162:0/1549646333 shutdown_connections 2024-04-25T00:51:07.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.325+0000 7f3c30043640 1 -- 172.21.15.162:0/1549646333 wait complete. 2024-04-25T00:51:07.349 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-25T00:51:07.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.477+0000 7f9bd17cc640 1 Processor -- start 2024-04-25T00:51:07.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.477+0000 7f9bd17cc640 1 -- start start 2024-04-25T00:51:07.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.477+0000 7f9bd17cc640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f9bcc151410 0x7f9bcc1570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.477+0000 7f9bd17cc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bcc15b1d0 0x7f9bcc0c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.477+0000 7f9bd17cc640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bcc15a760 con 0x7f9bcc0c65c0 2024-04-25T00:51:07.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.477+0000 7f9bd17cc640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f9bcc0c3200 con 0x7f9bcc151410 2024-04-25T00:51:07.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.477+0000 7f9bd17cc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9bcc15b5f0 con 0x7f9bcc15b1d0 2024-04-25T00:51:07.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.477+0000 7f9bcb7fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f9bcc0c65c0 0x7f9bcc072c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:52488/0 (socket says 172.21.15.162:52488) 2024-04-25T00:51:07.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.477+0000 7f9bcb7fe640 1 -- 172.21.15.162:0/2343161103 learned_addr learned my addr 172.21.15.162:0/2343161103 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:51:07.479 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.477+0000 7f9bca7fc640 1 --2- 172.21.15.162:0/2343161103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bcc15b1d0 0x7f9bcc0c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.480 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.477+0000 7f9bcaffd640 1 --2- 172.21.15.162:0/2343161103 >> v2:172.21.15.179:3300/0 conn(0x7f9bcc151410 0x7f9bcc1570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.481+0000 7f9bc9ffb640 1 -- 172.21.15.162:0/2343161103 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3173732318 0 0) 0x7f9bcc15a760 con 0x7f9bcc0c65c0 2024-04-25T00:51:07.482 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.481+0000 7f9bc9ffb640 1 -- 172.21.15.162:0/2343161103 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bb4005740 con 0x7f9bcc0c65c0 2024-04-25T00:51:07.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.485+0000 7f9bc9ffb640 1 -- 172.21.15.162:0/2343161103 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3454229479 0 0) 0x7f9bb4005740 con 0x7f9bcc0c65c0 2024-04-25T00:51:07.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.485+0000 7f9bc9ffb640 1 -- 172.21.15.162:0/2343161103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bcc15b1d0 msgr2=0x7f9bcc0c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:07.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.485+0000 7f9bc9ffb640 1 --2- 172.21.15.162:0/2343161103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bcc15b1d0 0x7f9bcc0c2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.485+0000 7f9bc9ffb640 1 -- 172.21.15.162:0/2343161103 >> v2:172.21.15.179:3300/0 conn(0x7f9bcc151410 msgr2=0x7f9bcc1570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:07.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.485+0000 7f9bc9ffb640 1 --2- 172.21.15.162:0/2343161103 >> v2:172.21.15.179:3300/0 conn(0x7f9bcc151410 0x7f9bcc1570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.485+0000 7f9bc9ffb640 1 -- 172.21.15.162:0/2343161103 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bcc1517f0 con 0x7f9bcc0c65c0 2024-04-25T00:51:07.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.485+0000 7f9bc9ffb640 1 -- 172.21.15.162:0/2343161103 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7f9bc4001a00 con 0x7f9bcc0c65c0 2024-04-25T00:51:07.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.485+0000 7f9bc9ffb640 1 -- 172.21.15.162:0/2343161103 >> v1:172.21.15.162:6789/0 conn(0x7f9bcc0c65c0 legacy=0x7f9bcc072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:07.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.485+0000 7f9bc9ffb640 1 --2- 172.21.15.162:0/2343161103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4005bd0 0x7f9bb4005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.485+0000 7f9bc9ffb640 1 --2- 172.21.15.162:0/2343161103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bcc15b1d0 0x7f9bb4006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.485+0000 7f9bc9ffb640 1 --2- 172.21.15.162:0/2343161103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bb4006f60 0x7f9bb40073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.485+0000 7f9bc9ffb640 1 -- 172.21.15.162:0/2343161103 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc15b5f0 con 0x7f9bb4006f60 2024-04-25T00:51:07.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.485+0000 7f9bc9ffb640 1 -- 172.21.15.162:0/2343161103 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb400dbe0 con 0x7f9bb4005bd0 2024-04-25T00:51:07.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.485+0000 7f9bc9ffb640 1 -- 172.21.15.162:0/2343161103 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9bb400dd60 con 0x7f9bcc15b1d0 2024-04-25T00:51:07.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.489+0000 7f9bcb7fe640 1 --2- 172.21.15.162:0/2343161103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bb4006f60 0x7f9bb40073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.493+0000 7f9bca7fc640 1 --2- 172.21.15.162:0/2343161103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bcc15b1d0 0x7f9bb4006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.493+0000 7f9bcaffd640 1 --2- 172.21.15.162:0/2343161103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4005bd0 0x7f9bb4005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.493+0000 7f9bcb7fe640 1 -- 172.21.15.162:0/2343161103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bcc15b1d0 msgr2=0x7f9bb4006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:07.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.493+0000 7f9bcb7fe640 1 --2- 172.21.15.162:0/2343161103 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bcc15b1d0 0x7f9bb4006a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.493+0000 7f9bcb7fe640 1 -- 172.21.15.162:0/2343161103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4005bd0 msgr2=0x7f9bb4005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:07.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.493+0000 7f9bcb7fe640 1 --2- 172.21.15.162:0/2343161103 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4005bd0 0x7f9bb4005ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.494 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.493+0000 7f9bcb7fe640 1 -- 172.21.15.162:0/2343161103 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb4005740 con 0x7f9bb4006f60 2024-04-25T00:51:07.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.497+0000 7f9bcb7fe640 1 --2- 172.21.15.162:0/2343161103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bb4006f60 0x7f9bb40073e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400a7a0 tx=0x7f9bc401d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1186487347e45f84 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:07.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.501+0000 7f9bc9ffb640 1 -- 172.21.15.162:0/2343161103 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc400a3f0 con 0x7f9bb4006f60 2024-04-25T00:51:07.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.501+0000 7f9bc9ffb640 1 -- 172.21.15.162:0/2343161103 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc40ad630 con 0x7f9bb4006f60 2024-04-25T00:51:07.501 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.501+0000 7f9bc9ffb640 1 -- 172.21.15.162:0/2343161103 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc40adac0 con 0x7f9bb4006f60 2024-04-25T00:51:07.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.501+0000 7f9bd17cc640 1 -- 172.21.15.162:0/2343161103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bb4006f60 msgr2=0x7f9bb40073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:07.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.501+0000 7f9bd17cc640 1 --2- 172.21.15.162:0/2343161103 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bb4006f60 0x7f9bb40073e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9bc400a7a0 tx=0x7f9bc401d2e0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.502 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.501+0000 7f9bcb7fe640 1 -- 172.21.15.162:0/2343161103 reap_dead start 2024-04-25T00:51:07.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.501+0000 7f9bd17cc640 1 -- 172.21.15.162:0/2343161103 shutdown_connections 2024-04-25T00:51:07.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.501+0000 7f9bd17cc640 1 -- 172.21.15.162:0/2343161103 >> 172.21.15.162:0/2343161103 conn(0x7f9bcc06b210 msgr2=0x7f9bcc06b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:07.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.501+0000 7f9bd17cc640 1 -- 172.21.15.162:0/2343161103 shutdown_connections 2024-04-25T00:51:07.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.501+0000 7f9bd17cc640 1 -- 172.21.15.162:0/2343161103 wait complete. 2024-04-25T00:51:07.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.501+0000 7f9bd17cc640 1 Processor -- start 2024-04-25T00:51:07.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.501+0000 7f9bd17cc640 1 -- start start 2024-04-25T00:51:07.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.501+0000 7f9bd17cc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4006f60 0x7f9bcc0c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.501+0000 7f9bd17cc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bcc149610 0x7f9bcc149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.501+0000 7f9bd17cc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc143c90 0x7f9bcc144140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.501+0000 7f9bd17cc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc15a9d0 con 0x7f9bcc143c90 2024-04-25T00:51:07.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.501+0000 7f9bd17cc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc0c3710 con 0x7f9bb4006f60 2024-04-25T00:51:07.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.501+0000 7f9bd17cc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9bcc15acb0 con 0x7f9bcc149610 2024-04-25T00:51:07.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.505+0000 7f9bcb7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc143c90 0x7f9bcc144140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.505+0000 7f9bcb7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc143c90 0x7f9bcc144140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55496/0 (socket says 172.21.15.162:55496) 2024-04-25T00:51:07.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.505+0000 7f9bcb7fe640 1 -- 172.21.15.162:0/1832028202 learned_addr learned my addr 172.21.15.162:0/1832028202 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:07.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.505+0000 7f9bcaffd640 1 --2- 172.21.15.162:0/1832028202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4006f60 0x7f9bcc0c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.506 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.505+0000 7f9bca7fc640 1 --2- 172.21.15.162:0/1832028202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bcc149610 0x7f9bcc149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.509+0000 7f9bcb7fe640 1 -- 172.21.15.162:0/1832028202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bcc149610 msgr2=0x7f9bcc149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:07.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.509+0000 7f9bcb7fe640 1 --2- 172.21.15.162:0/1832028202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bcc149610 0x7f9bcc149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.509+0000 7f9bcb7fe640 1 -- 172.21.15.162:0/1832028202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4006f60 msgr2=0x7f9bcc0c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:07.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.509+0000 7f9bcb7fe640 1 --2- 172.21.15.162:0/1832028202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4006f60 0x7f9bcc0c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.509 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.509+0000 7f9bcb7fe640 1 -- 172.21.15.162:0/1832028202 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bcc0c8a90 con 0x7f9bcc143c90 2024-04-25T00:51:07.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.509+0000 7f9bcb7fe640 1 --2- 172.21.15.162:0/1832028202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc143c90 0x7f9bcc144140 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9bc401d110 tx=0x7f9bb4007a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:07.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.513+0000 7f9bb37fe640 1 -- 172.21.15.162:0/1832028202 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc40bc070 con 0x7f9bcc143c90 2024-04-25T00:51:07.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.513+0000 7f9bb37fe640 1 -- 172.21.15.162:0/1832028202 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc400a3d0 con 0x7f9bcc143c90 2024-04-25T00:51:07.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.513+0000 7f9bb37fe640 1 -- 172.21.15.162:0/1832028202 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc40b2040 con 0x7f9bcc143c90 2024-04-25T00:51:07.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.513+0000 7f9bd17cc640 1 -- 172.21.15.162:0/1832028202 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bcc149f90 con 0x7f9bcc143c90 2024-04-25T00:51:07.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.513+0000 7f9bd17cc640 1 -- 172.21.15.162:0/1832028202 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bcc0c7f20 con 0x7f9bcc143c90 2024-04-25T00:51:07.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.517+0000 7f9bd4945000 1 Processor -- start 2024-04-25T00:51:07.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.517+0000 7f9bd4945000 1 -- start start 2024-04-25T00:51:07.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.517+0000 7f9bd4945000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787dcda0 0x55d5787dd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.517+0000 7f9bd4945000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787e80d0 0x55d5787ea4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.517+0000 7f9bd4945000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787eaa00 0x55d5787ecdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.517+0000 7f9bd4945000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d5785ef5e0 con 0x55d5787dcda0 2024-04-25T00:51:07.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.517+0000 7f9bd4945000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d578576c50 con 0x55d5787e80d0 2024-04-25T00:51:07.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.517+0000 7f9bd4945000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55d5785eb5a0 con 0x55d5787eaa00 2024-04-25T00:51:07.522 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.521+0000 7f9bca7fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787eaa00 0x55d5787ecdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.521+0000 7f9bcaffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787e80d0 0x55d5787ea4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.521+0000 7f9bca7fc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787eaa00 0x55d5787ecdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:32770/0 (socket says 172.21.15.162:32770) 2024-04-25T00:51:07.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.521+0000 7f9bca7fc640 1 -- 172.21.15.162:0/2849589413 learned_addr learned my addr 172.21.15.162:0/2849589413 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:07.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.529+0000 7f9bca7fc640 1 -- 172.21.15.162:0/2849589413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787e80d0 msgr2=0x55d5787ea4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:07.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.529+0000 7f9bca7fc640 1 --2- 172.21.15.162:0/2849589413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787e80d0 0x55d5787ea4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.529+0000 7f9bca7fc640 1 -- 172.21.15.162:0/2849589413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787dcda0 msgr2=0x55d5787dd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:07.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.529+0000 7f9bca7fc640 1 --2- 172.21.15.162:0/2849589413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787dcda0 0x55d5787dd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.529+0000 7f9bca7fc640 1 -- 172.21.15.162:0/2849589413 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d578574d10 con 0x55d5787eaa00 2024-04-25T00:51:07.534 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.533+0000 7f9bca7fc640 1 --2- 172.21.15.162:0/2849589413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787eaa00 0x55d5787ecdf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009bc0 tx=0x7f9bc0016740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=544231423a58a1c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:07.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.537+0000 7f9bb37fe640 1 -- 172.21.15.162:0/1832028202 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9bc40bf070 con 0x7f9bcc143c90 2024-04-25T00:51:07.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.537+0000 7f9bb37fe640 1 --2- 172.21.15.162:0/1832028202 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9bb8067940 0x7f9bb8069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.537+0000 7f9bcaffd640 1 --2- 172.21.15.162:0/1832028202 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9bb8067940 0x7f9bb8069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.537 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.537+0000 7f9bcaffd640 1 --2- 172.21.15.162:0/1832028202 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9bb8067940 0x7f9bb8069e00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009c10 tx=0x7f9bbc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:07.540 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.537+0000 7f9bb37fe640 1 -- 172.21.15.162:0/1832028202 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f9bc40019c0 con 0x7f9bcc143c90 2024-04-25T00:51:07.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.541+0000 7f9bb0ff9640 1 -- 172.21.15.162:0/2849589413 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc001c070 con 0x55d5787eaa00 2024-04-25T00:51:07.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.541+0000 7f9bb0ff9640 1 -- 172.21.15.162:0/2849589413 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc0009cb0 con 0x55d5787eaa00 2024-04-25T00:51:07.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.541+0000 7f9bb0ff9640 1 -- 172.21.15.162:0/2849589413 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0009e60 con 0x55d5787eaa00 2024-04-25T00:51:07.545 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bd4945000 1 -- 172.21.15.162:0/2849589413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787eaa00 msgr2=0x55d5787ecdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:07.545 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bd4945000 1 --2- 172.21.15.162:0/2849589413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787eaa00 0x55d5787ecdf0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009bc0 tx=0x7f9bc0016740 comp rx=0 tx=0).stop 2024-04-25T00:51:07.545 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bd4945000 1 -- 172.21.15.162:0/2849589413 shutdown_connections 2024-04-25T00:51:07.545 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bd4945000 1 --2- 172.21.15.162:0/2849589413 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787eaa00 0x55d5787ecdf0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.545 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bd4945000 1 --2- 172.21.15.162:0/2849589413 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787e80d0 0x55d5787ea4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.545 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bd4945000 1 --2- 172.21.15.162:0/2849589413 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787dcda0 0x55d5787dd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.545 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bd4945000 1 -- 172.21.15.162:0/2849589413 >> 172.21.15.162:0/2849589413 conn(0x55d5787ddc10 msgr2=0x55d5787e0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:07.545 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bd4945000 1 -- 172.21.15.162:0/2849589413 shutdown_connections 2024-04-25T00:51:07.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bd4945000 1 -- 172.21.15.162:0/2849589413 wait complete. 2024-04-25T00:51:07.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bd4945000 1 -- start start 2024-04-25T00:51:07.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bd4945000 1 Processor -- start 2024-04-25T00:51:07.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bd4945000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787dcda0 0x55d5787e4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bd4945000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787e80d0 0x55d5787e52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bd4945000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787eaa00 0x55d5787e5830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bd4945000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d5785a9520 con 0x55d5787e80d0 2024-04-25T00:51:07.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bd4945000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d5785bc340 con 0x55d5787eaa00 2024-04-25T00:51:07.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bd4945000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55d5785ee8f0 con 0x55d5787dcda0 2024-04-25T00:51:07.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bd4945000 10 client.0 _ll_register_callbacks cb 0x55d57878c5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T00:51:07.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bca7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787e80d0 0x55d5787e52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bca7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787e80d0 0x55d5787e52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55520/0 (socket says 172.21.15.162:55520) 2024-04-25T00:51:07.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bca7fc640 1 -- 172.21.15.162:0/4198214781 learned_addr learned my addr 172.21.15.162:0/4198214781 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:07.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.545+0000 7f9bcb7fe640 1 --2- 172.21.15.162:0/4198214781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787eaa00 0x55d5787e5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.549 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.549+0000 7f9bcaffd640 1 --2- 172.21.15.162:0/4198214781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787dcda0 0x55d5787e4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.549+0000 7f9bca7fc640 1 -- 172.21.15.162:0/4198214781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787dcda0 msgr2=0x55d5787e4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:07.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.549+0000 7f9bca7fc640 1 --2- 172.21.15.162:0/4198214781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787dcda0 0x55d5787e4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.549+0000 7f9bca7fc640 1 -- 172.21.15.162:0/4198214781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787eaa00 msgr2=0x55d5787e5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:07.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.549+0000 7f9bca7fc640 1 --2- 172.21.15.162:0/4198214781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787eaa00 0x55d5787e5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.549+0000 7f9bca7fc640 1 -- 172.21.15.162:0/4198214781 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5785877b0 con 0x55d5787e80d0 2024-04-25T00:51:07.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.549+0000 7f9bca7fc640 1 --2- 172.21.15.162:0/4198214781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787e80d0 0x55d5787e52f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55d5786be910 tx=0x7f9bc0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9b8d062a21265d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:07.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.549+0000 7f9ba9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-04-25T00:51:07.554 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.553+0000 7f9ba9ffb640 1 -- 172.21.15.162:0/4198214781 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc001c070 con 0x55d5787e80d0 2024-04-25T00:51:07.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.553+0000 7f9bd4945000 1 -- 172.21.15.162:0/4198214781 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bc0009cb0 con 0x55d5787e80d0 2024-04-25T00:51:07.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.553+0000 7f9ba9ffb640 1 -- 172.21.15.162:0/4198214781 <== mon.0 v2:172.21.15.162:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f9bc0018450 con 0x55d5787e80d0 2024-04-25T00:51:07.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.557+0000 7f9ba9ffb640 1 -- 172.21.15.162:0/4198214781 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f9bc0009e60 con 0x55d5787e80d0 2024-04-25T00:51:07.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.557+0000 7f9bd4945000 10 client.4518 fetch_fsmap learned FSMap version 17 2024-04-25T00:51:07.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.557+0000 7f9bd4945000 1 -- 172.21.15.162:0/4198214781 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55d578576ea0 con 0x55d5787e80d0 2024-04-25T00:51:07.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.557+0000 7f9ba9ffb640 1 -- 172.21.15.162:0/4198214781 <== mon.0 v2:172.21.15.162:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc0009cb0 con 0x55d5787e80d0 2024-04-25T00:51:07.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.561+0000 7f9ba9ffb640 1 -- 172.21.15.162:0/4198214781 <== mon.0 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) ==== 4784+0+0 (secure 0 0 0) 0x7f9bc0015040 con 0x55d5787e80d0 2024-04-25T00:51:07.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.561+0000 7f9bd4945000 10 client.4518 fetch_fsmap finished waiting for FSMap version 17 2024-04-25T00:51:07.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.561+0000 7f9bd4945000 10 client.4518 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-25T00:51:07.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.561+0000 7f9bd4945000 20 client.4518 populate_metadata read hostname 'smithi162' 2024-04-25T00:51:07.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.561+0000 7f9bd4945000 1 --2- 172.21.15.162:0/4198214781 >> [v2:172.21.15.162:6834/191105979,v1:172.21.15.162:6835/191105979] conn(0x55d5787e6240 0x55d5787f8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.561+0000 7f9bd4945000 4 client.4518 mds_command: new command op to 4240 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T00:51:07.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.561+0000 7f9bd4945000 1 -- 172.21.15.162:0/4198214781 --> [v2:172.21.15.162:6834/191105979,v1:172.21.15.162:6835/191105979] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d57858aab0 con 0x55d5787e6240 2024-04-25T00:51:07.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.561+0000 7f9bcaffd640 1 --2- 172.21.15.162:0/4198214781 >> [v2:172.21.15.162:6834/191105979,v1:172.21.15.162:6835/191105979] conn(0x55d5787e6240 0x55d5787f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.605+0000 7f9bcaffd640 1 --2- 172.21.15.162:0/4198214781 >> [v2:172.21.15.162:6834/191105979,v1:172.21.15.162:6835/191105979] conn(0x55d5787e6240 0x55d5787f8150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e0856b84ac999a3d server_cookie=de6753752996b516 in_seq=0 out_seq=0 2024-04-25T00:51:07.606 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.605+0000 7f9ba9ffb640 10 client.4518 ms_handle_connect on v2:172.21.15.162:6834/191105979 2024-04-25T00:51:07.807 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.805+0000 7f9ba9ffb640 1 -- 172.21.15.162:0/4198214781 <== mds.3 v2:172.21.15.162:6834/191105979 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d57858aab0 con 0x55d5787e6240 2024-04-25T00:51:07.807 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.805+0000 7f9ba9ffb640 10 client.4518 handle_command_reply: tid=0 2024-04-25T00:51:07.807 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.805+0000 7f9bd4945000 1 client.4518 shutdown 2024-04-25T00:51:07.807 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.805+0000 7f9bd4945000 1 -- 172.21.15.162:0/4198214781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787e80d0 msgr2=0x55d5787e52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:07.807 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.805+0000 7f9bd4945000 1 --2- 172.21.15.162:0/4198214781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787e80d0 0x55d5787e52f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55d5786be910 tx=0x7f9bc0008040 comp rx=0 tx=0).stop 2024-04-25T00:51:07.807 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.805+0000 7f9bd4945000 1 -- 172.21.15.162:0/4198214781 shutdown_connections 2024-04-25T00:51:07.807 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.805+0000 7f9bd4945000 1 --2- 172.21.15.162:0/4198214781 >> [v2:172.21.15.162:6834/191105979,v1:172.21.15.162:6835/191105979] conn(0x55d5787e6240 0x55d5787f8150 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.807 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.805+0000 7f9bd4945000 1 --2- 172.21.15.162:0/4198214781 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787eaa00 0x55d5787e5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.807 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.805+0000 7f9bd4945000 1 --2- 172.21.15.162:0/4198214781 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787e80d0 0x55d5787e52f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.807 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.805+0000 7f9ba9ffb640 0 client.4518 ms_handle_reset on v2:172.21.15.162:6834/191105979 2024-04-25T00:51:07.807 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.805+0000 7f9bd4945000 1 --2- 172.21.15.162:0/4198214781 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787dcda0 0x55d5787e4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.805+0000 7f9bd4945000 1 -- 172.21.15.162:0/4198214781 >> 172.21.15.162:0/4198214781 conn(0x55d5787ddc10 msgr2=0x55d5787e0000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:07.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.805+0000 7f9bd4945000 1 -- 172.21.15.162:0/4198214781 shutdown_connections 2024-04-25T00:51:07.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.805+0000 7f9bd4945000 1 -- 172.21.15.162:0/4198214781 wait complete. 2024-04-25T00:51:07.808 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.805+0000 7f9bd4945000 20 client.4518 trim_cache size 0 max 16384 2024-04-25T00:51:07.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.845+0000 7f9bd4945000 1 Processor -- start 2024-04-25T00:51:07.846 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.845+0000 7f9bd4945000 1 -- start start 2024-04-25T00:51:07.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.845+0000 7f9bd4945000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787dcda0 0x55d5787fb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.845+0000 7f9bd4945000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787e80d0 0x55d5787e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.845+0000 7f9bd4945000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787eaa00 0x55d5787e7410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.845+0000 7f9bd4945000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc1f7ea0 con 0x55d5787e80d0 2024-04-25T00:51:07.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.845+0000 7f9bd4945000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f9bcc1f8570 con 0x55d5787dcda0 2024-04-25T00:51:07.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.845+0000 7f9bd4945000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f9bcc1ebc70 con 0x55d5787eaa00 2024-04-25T00:51:07.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.845+0000 7f9bcb7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787eaa00 0x55d5787e7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.845+0000 7f9bcaffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787dcda0 0x55d5787fb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.848 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.849+0000 7f9bca7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787e80d0 0x55d5787e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.849+0000 7f9bca7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787e80d0 0x55d5787e6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55534/0 (socket says 172.21.15.162:55534) 2024-04-25T00:51:07.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.849+0000 7f9bca7fc640 1 -- 172.21.15.162:0/374074466 learned_addr learned my addr 172.21.15.162:0/374074466 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:07.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.853+0000 7f9bca7fc640 1 -- 172.21.15.162:0/374074466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787eaa00 msgr2=0x55d5787e7410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:07.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.853+0000 7f9bca7fc640 1 --2- 172.21.15.162:0/374074466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787eaa00 0x55d5787e7410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.853+0000 7f9bca7fc640 1 -- 172.21.15.162:0/374074466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787dcda0 msgr2=0x55d5787fb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:07.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.853+0000 7f9bca7fc640 1 --2- 172.21.15.162:0/374074466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787dcda0 0x55d5787fb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.853+0000 7f9bca7fc640 1 -- 172.21.15.162:0/374074466 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d578577e80 con 0x55d5787e80d0 2024-04-25T00:51:07.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.853+0000 7f9bca7fc640 1 --2- 172.21.15.162:0/374074466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787e80d0 0x55d5787e6ed0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009670 tx=0x7f9bc0025000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2064d219f4a86c65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:07.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.861+0000 7f9babfff640 1 -- 172.21.15.162:0/374074466 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0009cb0 con 0x55d5787e80d0 2024-04-25T00:51:07.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.861+0000 7f9babfff640 1 -- 172.21.15.162:0/374074466 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc0000e50 con 0x55d5787e80d0 2024-04-25T00:51:07.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.861+0000 7f9babfff640 1 -- 172.21.15.162:0/374074466 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc0021760 con 0x55d5787e80d0 2024-04-25T00:51:07.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.861+0000 7f9bd4945000 1 -- 172.21.15.162:0/374074466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787e80d0 msgr2=0x55d5787e6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:07.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.861+0000 7f9bd4945000 1 --2- 172.21.15.162:0/374074466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787e80d0 0x55d5787e6ed0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f9bc0009670 tx=0x7f9bc0025000 comp rx=0 tx=0).stop 2024-04-25T00:51:07.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.861+0000 7f9bd4945000 1 -- 172.21.15.162:0/374074466 shutdown_connections 2024-04-25T00:51:07.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.861+0000 7f9bd4945000 1 --2- 172.21.15.162:0/374074466 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787eaa00 0x55d5787e7410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.861+0000 7f9bd4945000 1 --2- 172.21.15.162:0/374074466 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787e80d0 0x55d5787e6ed0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.861+0000 7f9bd4945000 1 --2- 172.21.15.162:0/374074466 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787dcda0 0x55d5787fb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.861+0000 7f9bd4945000 1 -- 172.21.15.162:0/374074466 >> 172.21.15.162:0/374074466 conn(0x55d5787ddc10 msgr2=0x55d5787dc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:07.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.861+0000 7f9bd4945000 1 -- 172.21.15.162:0/374074466 shutdown_connections 2024-04-25T00:51:07.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.861+0000 7f9bd4945000 1 -- 172.21.15.162:0/374074466 wait complete. 2024-04-25T00:51:07.865 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.865+0000 7f9bd4945000 1 -- start start 2024-04-25T00:51:07.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.865+0000 7f9bd4945000 1 Processor -- start 2024-04-25T00:51:07.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.865+0000 7f9bd4945000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787dcda0 0x55d578855d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.865+0000 7f9bd4945000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787e80d0 0x55d578856240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.865+0000 7f9bd4945000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787eaa00 0x55d5787fb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.865+0000 7f9bd4945000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55d5785b83c0 con 0x55d5787dcda0 2024-04-25T00:51:07.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.865+0000 7f9bd4945000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55d578595810 con 0x55d5787e80d0 2024-04-25T00:51:07.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.865+0000 7f9bd4945000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55d5785ecb90 con 0x55d5787eaa00 2024-04-25T00:51:07.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.865+0000 7f9bd4945000 10 client.0 _ll_register_callbacks cb 0x7f9bbc0095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T00:51:07.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.865+0000 7f9bcaffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787dcda0 0x55d578855d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.865+0000 7f9bcaffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787dcda0 0x55d578855d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55536/0 (socket says 172.21.15.162:55536) 2024-04-25T00:51:07.867 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.865+0000 7f9bcaffd640 1 -- 172.21.15.162:0/3974588046 learned_addr learned my addr 172.21.15.162:0/3974588046 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:07.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.865+0000 7f9bca7fc640 1 --2- 172.21.15.162:0/3974588046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787e80d0 0x55d578856240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.865+0000 7f9bcb7fe640 1 --2- 172.21.15.162:0/3974588046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787eaa00 0x55d5787fb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.870 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.869+0000 7f9bcaffd640 1 -- 172.21.15.162:0/3974588046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787eaa00 msgr2=0x55d5787fb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:07.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.869+0000 7f9bcaffd640 1 --2- 172.21.15.162:0/3974588046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787eaa00 0x55d5787fb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.869+0000 7f9bcaffd640 1 -- 172.21.15.162:0/3974588046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787e80d0 msgr2=0x55d578856240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:07.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.869+0000 7f9bcaffd640 1 --2- 172.21.15.162:0/3974588046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787e80d0 0x55d578856240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.869+0000 7f9bcaffd640 1 -- 172.21.15.162:0/3974588046 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5785bc760 con 0x55d5787dcda0 2024-04-25T00:51:07.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.873+0000 7f9bcaffd640 1 --2- 172.21.15.162:0/3974588046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787dcda0 0x55d578855d00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc016c30 tx=0x7f9bbc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da3a41f9649d2ef5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:07.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.873+0000 7f9ba9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-04-25T00:51:07.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.877+0000 7f9ba9ffb640 1 -- 172.21.15.162:0/3974588046 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bbc00f040 con 0x55d5787dcda0 2024-04-25T00:51:07.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.877+0000 7f9ba9ffb640 1 -- 172.21.15.162:0/3974588046 <== mon.0 v2:172.21.15.162:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f9bbc02d890 con 0x55d5787dcda0 2024-04-25T00:51:07.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.877+0000 7f9bd4945000 1 -- 172.21.15.162:0/3974588046 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bc0000e50 con 0x55d5787dcda0 2024-04-25T00:51:07.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.893+0000 7f9ba9ffb640 1 -- 172.21.15.162:0/3974588046 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f9bbc0059a0 con 0x55d5787dcda0 2024-04-25T00:51:07.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.893+0000 7f9bd4945000 10 client.4524 fetch_fsmap learned FSMap version 17 2024-04-25T00:51:07.896 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.893+0000 7f9bd4945000 1 -- 172.21.15.162:0/3974588046 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55d5786489e0 con 0x55d5787dcda0 2024-04-25T00:51:07.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.897+0000 7f9ba9ffb640 1 -- 172.21.15.162:0/3974588046 <== mon.0 v2:172.21.15.162:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bc0000e50 con 0x55d5787dcda0 2024-04-25T00:51:07.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.897+0000 7f9ba9ffb640 1 -- 172.21.15.162:0/3974588046 <== mon.0 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) ==== 4784+0+0 (secure 0 0 0) 0x7f9bbc005b40 con 0x55d5787dcda0 2024-04-25T00:51:07.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.901+0000 7f9bd4945000 10 client.4524 fetch_fsmap finished waiting for FSMap version 17 2024-04-25T00:51:07.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.901+0000 7f9bd4945000 10 client.4524 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-25T00:51:07.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.901+0000 7f9bd4945000 20 client.4524 populate_metadata read hostname 'smithi162' 2024-04-25T00:51:07.902 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.901+0000 7f9bd4945000 1 --2- 172.21.15.162:0/3974588046 >> [v2:172.21.15.162:6834/191105979,v1:172.21.15.162:6835/191105979] conn(0x55d578852790 0x55d578852b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:07.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.901+0000 7f9bd4945000 4 client.4524 mds_command: new command op to 4240 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T00:51:07.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.901+0000 7f9bd4945000 1 -- 172.21.15.162:0/3974588046 --> [v2:172.21.15.162:6834/191105979,v1:172.21.15.162:6835/191105979] -- command(tid 0: {"prefix": "status"}) -- 0x55d5785fcb20 con 0x55d578852790 2024-04-25T00:51:07.903 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.901+0000 7f9bca7fc640 1 --2- 172.21.15.162:0/3974588046 >> [v2:172.21.15.162:6834/191105979,v1:172.21.15.162:6835/191105979] conn(0x55d578852790 0x55d578852b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:07.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.905+0000 7f9bca7fc640 1 --2- 172.21.15.162:0/3974588046 >> [v2:172.21.15.162:6834/191105979,v1:172.21.15.162:6835/191105979] conn(0x55d578852790 0x55d578852b70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=43657fbfebb73795 server_cookie=764a337d29cddc5c in_seq=0 out_seq=0 2024-04-25T00:51:07.905 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.905+0000 7f9ba9ffb640 10 client.4524 ms_handle_connect on v2:172.21.15.162:6834/191105979 2024-04-25T00:51:07.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.925+0000 7f9ba9ffb640 1 -- 172.21.15.162:0/3974588046 <== mds.3 v2:172.21.15.162:6834/191105979 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55d5785fcb20 con 0x55d578852790 2024-04-25T00:51:07.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.925+0000 7f9ba9ffb640 10 client.4524 handle_command_reply: tid=0 2024-04-25T00:51:07.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.925+0000 7f9bd4945000 1 client.4524 shutdown 2024-04-25T00:51:07.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.925+0000 7f9bd4945000 1 -- 172.21.15.162:0/3974588046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787dcda0 msgr2=0x55d578855d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:07.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.925+0000 7f9bd4945000 1 --2- 172.21.15.162:0/3974588046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787dcda0 0x55d578855d00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc016c30 tx=0x7f9bbc004740 comp rx=0 tx=0).stop 2024-04-25T00:51:07.928 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.925+0000 7f9bd4945000 1 -- 172.21.15.162:0/3974588046 shutdown_connections 2024-04-25T00:51:07.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.925+0000 7f9bd4945000 1 --2- 172.21.15.162:0/3974588046 >> [v2:172.21.15.162:6834/191105979,v1:172.21.15.162:6835/191105979] conn(0x55d578852790 0x55d578852b70 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.925+0000 7f9bd4945000 1 --2- 172.21.15.162:0/3974588046 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55d5787eaa00 0x55d5787fb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.925+0000 7f9bd4945000 1 --2- 172.21.15.162:0/3974588046 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55d5787e80d0 0x55d578856240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.925+0000 7f9bd4945000 1 --2- 172.21.15.162:0/3974588046 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55d5787dcda0 0x55d578855d00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.925+0000 7f9ba9ffb640 0 client.4524 ms_handle_reset on v2:172.21.15.162:6834/191105979 2024-04-25T00:51:07.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.925+0000 7f9bd4945000 1 -- 172.21.15.162:0/3974588046 >> 172.21.15.162:0/3974588046 conn(0x55d5787ddc10 msgr2=0x55d5787e6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:07.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.925+0000 7f9bd4945000 1 -- 172.21.15.162:0/3974588046 shutdown_connections 2024-04-25T00:51:07.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.929+0000 7f9bd4945000 1 -- 172.21.15.162:0/3974588046 wait complete. 2024-04-25T00:51:07.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.929+0000 7f9bd4945000 20 client.4524 trim_cache size 0 max 16384 2024-04-25T00:51:07.930 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-04-25T00:51:07.930 INFO:teuthology.orchestra.run.smithi162.stdout: "cluster_fsid": "e141deed-4794-4a17-83c9-f6e6e8875f5e", 2024-04-25T00:51:07.930 INFO:teuthology.orchestra.run.smithi162.stdout: "whoami": 3, 2024-04-25T00:51:07.930 INFO:teuthology.orchestra.run.smithi162.stdout: "id": 4240, 2024-04-25T00:51:07.930 INFO:teuthology.orchestra.run.smithi162.stdout: "want_state": "up:active", 2024-04-25T00:51:07.930 INFO:teuthology.orchestra.run.smithi162.stdout: "state": "up:active", 2024-04-25T00:51:07.930 INFO:teuthology.orchestra.run.smithi162.stdout: "fs_name": "cephfs", 2024-04-25T00:51:07.930 INFO:teuthology.orchestra.run.smithi162.stdout: "rank_uptime": 14.647912413, 2024-04-25T00:51:07.930 INFO:teuthology.orchestra.run.smithi162.stdout: "mdsmap_epoch": 17, 2024-04-25T00:51:07.930 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_epoch": 26, 2024-04-25T00:51:07.931 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T00:51:07.931 INFO:teuthology.orchestra.run.smithi162.stdout: "uptime": 50.618137724999997 2024-04-25T00:51:07.931 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-04-25T00:51:07.931 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.929+0000 7f9bd17cc640 1 -- 172.21.15.162:0/1832028202 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9bb8067940 msgr2=0x7f9bb8069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.929+0000 7f9bd17cc640 1 --2- 172.21.15.162:0/1832028202 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9bb8067940 0x7f9bb8069e00 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9bbc009c10 tx=0x7f9bbc008040 comp rx=0 tx=0).stop 2024-04-25T00:51:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.929+0000 7f9bd17cc640 1 -- 172.21.15.162:0/1832028202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc143c90 msgr2=0x7f9bcc144140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.929+0000 7f9bd17cc640 1 --2- 172.21.15.162:0/1832028202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc143c90 0x7f9bcc144140 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9bc401d110 tx=0x7f9bb4007a50 comp rx=0 tx=0).stop 2024-04-25T00:51:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.929+0000 7f9bd17cc640 1 -- 172.21.15.162:0/1832028202 shutdown_connections 2024-04-25T00:51:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.929+0000 7f9bd17cc640 1 --2- 172.21.15.162:0/1832028202 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f9bb8067940 0x7f9bb8069e00 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.929+0000 7f9bd17cc640 1 --2- 172.21.15.162:0/1832028202 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f9bcc143c90 0x7f9bcc144140 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.929+0000 7f9bd17cc640 1 --2- 172.21.15.162:0/1832028202 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f9bcc149610 0x7f9bcc149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.929+0000 7f9bd17cc640 1 --2- 172.21.15.162:0/1832028202 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f9bb4006f60 0x7f9bcc0c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.929+0000 7f9bd17cc640 1 -- 172.21.15.162:0/1832028202 >> 172.21.15.162:0/1832028202 conn(0x7f9bcc06b210 msgr2=0x7f9bcc1576a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.929+0000 7f9bd17cc640 1 -- 172.21.15.162:0/1832028202 shutdown_connections 2024-04-25T00:51:07.932 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:07.929+0000 7f9bd17cc640 1 -- 172.21.15.162:0/1832028202 wait complete. 2024-04-25T00:51:07.956 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T00:51:08.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.081+0000 7f0351738640 1 Processor -- start 2024-04-25T00:51:08.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.081+0000 7f0351738640 1 -- start start 2024-04-25T00:51:08.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.081+0000 7f0351738640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f034c0c96a0 0x7f034c06d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.081+0000 7f0351738640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034c15a670 con 0x7f034c0cea50 2024-04-25T00:51:08.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.081+0000 7f0351738640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034c15a950 con 0x7f034c0ce520 2024-04-25T00:51:08.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.081+0000 7f0351738640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f034c15ac30 con 0x7f034c0c96a0 2024-04-25T00:51:08.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.081+0000 7f034a7fc640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f034c0cea50 0x7f034c0ca6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:52498/0 (socket says 172.21.15.162:52498) 2024-04-25T00:51:08.083 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.081+0000 7f034a7fc640 1 -- 172.21.15.162:0/2610298180 learned_addr learned my addr 172.21.15.162:0/2610298180 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:51:08.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.085+0000 7f0349ffb640 1 -- 172.21.15.162:0/2610298180 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 148984328 0 0) 0x7f034c15a670 con 0x7f034c0cea50 2024-04-25T00:51:08.086 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.085+0000 7f0349ffb640 1 -- 172.21.15.162:0/2610298180 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0334003530 con 0x7f034c0cea50 2024-04-25T00:51:08.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.089+0000 7f0349ffb640 1 -- 172.21.15.162:0/2610298180 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3954430275 0 0) 0x7f0334003530 con 0x7f034c0cea50 2024-04-25T00:51:08.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.089+0000 7f0349ffb640 1 -- 172.21.15.162:0/2610298180 >> v2:172.21.15.179:3300/0 conn(0x7f034c0c96a0 msgr2=0x7f034c06d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:08.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.089+0000 7f0349ffb640 1 --2- 172.21.15.162:0/2610298180 >> v2:172.21.15.179:3300/0 conn(0x7f034c0c96a0 0x7f034c06d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.089+0000 7f0349ffb640 1 -- 172.21.15.162:0/2610298180 >> v1:172.21.15.179:6789/0 conn(0x7f034c0ce520 legacy=0x7f034c15db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:08.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.089+0000 7f0349ffb640 1 -- 172.21.15.162:0/2610298180 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034c15af10 con 0x7f034c0cea50 2024-04-25T00:51:08.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.089+0000 7f0349ffb640 1 -- 172.21.15.162:0/2610298180 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7f0340001680 con 0x7f034c0cea50 2024-04-25T00:51:08.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.089+0000 7f0349ffb640 1 -- 172.21.15.162:0/2610298180 >> v1:172.21.15.162:6789/0 conn(0x7f034c0cea50 legacy=0x7f034c0ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:08.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.089+0000 7f0349ffb640 1 --2- 172.21.15.162:0/2610298180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0334003a10 0x7f0334003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.089+0000 7f0349ffb640 1 --2- 172.21.15.162:0/2610298180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0334004810 0x7f0334004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.089+0000 7f0349ffb640 1 --2- 172.21.15.162:0/2610298180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03340052f0 0x7f033400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.089+0000 7f0349ffb640 1 -- 172.21.15.162:0/2610298180 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f034c15ac30 con 0x7f0334003a10 2024-04-25T00:51:08.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.089+0000 7f0349ffb640 1 -- 172.21.15.162:0/2610298180 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f033400c240 con 0x7f03340052f0 2024-04-25T00:51:08.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.089+0000 7f0349ffb640 1 -- 172.21.15.162:0/2610298180 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f033400c440 con 0x7f0334004810 2024-04-25T00:51:08.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.089+0000 7f034affd640 1 --2- 172.21.15.162:0/2610298180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0334003a10 0x7f0334003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.097+0000 7f034affd640 1 -- 172.21.15.162:0/2610298180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0334004810 msgr2=0x7f0334004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:08.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.097+0000 7f034affd640 1 --2- 172.21.15.162:0/2610298180 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f0334004810 0x7f0334004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.098 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.097+0000 7f034affd640 1 -- 172.21.15.162:0/2610298180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03340052f0 msgr2=0x7f033400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:08.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.097+0000 7f034affd640 1 --2- 172.21.15.162:0/2610298180 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f03340052f0 0x7f033400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.097+0000 7f034affd640 1 -- 172.21.15.162:0/2610298180 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0334003530 con 0x7f0334003a10 2024-04-25T00:51:08.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.097+0000 7f034b7fe640 1 -- 172.21.15.162:0/2610298180 reap_dead start 2024-04-25T00:51:08.101 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.101+0000 7f034affd640 1 --2- 172.21.15.162:0/2610298180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0334003a10 0x7f0334003e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f033c009860 tx=0x7f033c01c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a344b80cdc0e4dc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:08.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.105+0000 7f0349ffb640 1 -- 172.21.15.162:0/2610298180 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c0b0070 con 0x7f0334003a10 2024-04-25T00:51:08.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.105+0000 7f0349ffb640 1 -- 172.21.15.162:0/2610298180 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f033c0ab620 con 0x7f0334003a10 2024-04-25T00:51:08.105 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.105+0000 7f0349ffb640 1 -- 172.21.15.162:0/2610298180 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c009460 con 0x7f0334003a10 2024-04-25T00:51:08.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.105+0000 7f0351738640 1 -- 172.21.15.162:0/2610298180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0334003a10 msgr2=0x7f0334003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:08.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.105+0000 7f0351738640 1 --2- 172.21.15.162:0/2610298180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0334003a10 0x7f0334003e10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f033c009860 tx=0x7f033c01c360 comp rx=0 tx=0).stop 2024-04-25T00:51:08.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.105+0000 7f0351738640 1 -- 172.21.15.162:0/2610298180 shutdown_connections 2024-04-25T00:51:08.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.105+0000 7f0351738640 1 --2- 172.21.15.162:0/2610298180 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0334003a10 0x7f0334003e10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.105+0000 7f0351738640 1 -- 172.21.15.162:0/2610298180 >> 172.21.15.162:0/2610298180 conn(0x7f034c06ca60 msgr2=0x7f034c066fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:08.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.105+0000 7f0351738640 1 -- 172.21.15.162:0/2610298180 shutdown_connections 2024-04-25T00:51:08.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.105+0000 7f0351738640 1 -- 172.21.15.162:0/2610298180 wait complete. 2024-04-25T00:51:08.107 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.105+0000 7f0351738640 1 Processor -- start 2024-04-25T00:51:08.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.105+0000 7f0351738640 1 -- start start 2024-04-25T00:51:08.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.109+0000 7f0351738640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0334003a10 0x7f034c0b2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.109+0000 7f0351738640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f034c0b41b0 0x7f034c152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.109+0000 7f0351738640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f034c0b4610 0x7f034c1534e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.109+0000 7f0351738640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f034c15dec0 con 0x7f0334003a10 2024-04-25T00:51:08.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.109+0000 7f0351738640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f034c15dd40 con 0x7f034c0b4610 2024-04-25T00:51:08.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.109+0000 7f0351738640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f034c15e040 con 0x7f034c0b41b0 2024-04-25T00:51:08.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.109+0000 7f034affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0334003a10 0x7f034c0b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.109+0000 7f034affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0334003a10 0x7f034c0b2920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55566/0 (socket says 172.21.15.162:55566) 2024-04-25T00:51:08.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.109+0000 7f034affd640 1 -- 172.21.15.162:0/3892954490 learned_addr learned my addr 172.21.15.162:0/3892954490 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:08.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.113+0000 7f034affd640 1 -- 172.21.15.162:0/3892954490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f034c0b41b0 msgr2=0x7f034c152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:08.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.113+0000 7f034affd640 1 --2- 172.21.15.162:0/3892954490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f034c0b41b0 0x7f034c152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.113+0000 7f034affd640 1 -- 172.21.15.162:0/3892954490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f034c0b4610 msgr2=0x7f034c1534e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:08.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.113+0000 7f034affd640 1 --2- 172.21.15.162:0/3892954490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f034c0b4610 0x7f034c1534e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.113+0000 7f034affd640 1 -- 172.21.15.162:0/3892954490 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034c0c8620 con 0x7f0334003a10 2024-04-25T00:51:08.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.113+0000 7f034affd640 1 --2- 172.21.15.162:0/3892954490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0334003a10 0x7f034c0b2920 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f033c000c10 tx=0x7f0334005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:08.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.117+0000 7f03337fe640 1 -- 172.21.15.162:0/3892954490 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c0b0040 con 0x7f0334003a10 2024-04-25T00:51:08.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.117+0000 7f03337fe640 1 -- 172.21.15.162:0/3892954490 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f033c0abe30 con 0x7f0334003a10 2024-04-25T00:51:08.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.117+0000 7f03337fe640 1 -- 172.21.15.162:0/3892954490 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c0b5480 con 0x7f0334003a10 2024-04-25T00:51:08.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.117+0000 7f0351738640 1 -- 172.21.15.162:0/3892954490 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f034c0cc060 con 0x7f0334003a10 2024-04-25T00:51:08.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.117+0000 7f0351738640 1 -- 172.21.15.162:0/3892954490 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f034c0b5420 con 0x7f0334003a10 2024-04-25T00:51:08.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.121+0000 7f03548b1000 1 Processor -- start 2024-04-25T00:51:08.122 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.121+0000 7f03548b1000 1 -- start start 2024-04-25T00:51:08.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.121+0000 7f03548b1000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e29da0 0x5596c3e2a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.121+0000 7f03548b1000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e350d0 0x5596c3e374c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.121+0000 7f03548b1000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e37a00 0x5596c3e39df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.121+0000 7f03548b1000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5596c3c3c5e0 con 0x5596c3e37a00 2024-04-25T00:51:08.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.121+0000 7f03548b1000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5596c3bc3c50 con 0x5596c3e350d0 2024-04-25T00:51:08.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.121+0000 7f03548b1000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5596c3c385a0 con 0x5596c3e29da0 2024-04-25T00:51:08.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.137+0000 7f03337fe640 1 -- 172.21.15.162:0/3892954490 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f033c0b3070 con 0x7f0334003a10 2024-04-25T00:51:08.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.141+0000 7f03337fe640 1 --2- 172.21.15.162:0/3892954490 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f0338067910 0x7f0338069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.140 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.141+0000 7f034b7fe640 1 --2- 172.21.15.162:0/3892954490 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f0338067910 0x7f0338069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.141 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.141+0000 7f034b7fe640 1 --2- 172.21.15.162:0/3892954490 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f0338067910 0x7f0338069dd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f034c0ce900 tx=0x7f0344009ce0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:08.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.141+0000 7f03337fe640 1 -- 172.21.15.162:0/3892954490 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f033c0ef8f0 con 0x7f0334003a10 2024-04-25T00:51:08.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.141+0000 7f034a7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e37a00 0x5596c3e39df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.143 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.141+0000 7f034a7fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e37a00 0x5596c3e39df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55578/0 (socket says 172.21.15.162:55578) 2024-04-25T00:51:08.144 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.141+0000 7f034a7fc640 1 -- 172.21.15.162:0/3005165357 learned_addr learned my addr 172.21.15.162:0/3005165357 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:08.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.145+0000 7f034a7fc640 1 -- 172.21.15.162:0/3005165357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e29da0 msgr2=0x5596c3e2a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:08.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.145+0000 7f034a7fc640 1 --2- 172.21.15.162:0/3005165357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e29da0 0x5596c3e2a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.145+0000 7f034a7fc640 1 -- 172.21.15.162:0/3005165357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e350d0 msgr2=0x5596c3e374c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:08.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.145+0000 7f034a7fc640 1 --2- 172.21.15.162:0/3005165357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e350d0 0x5596c3e374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.145+0000 7f034a7fc640 1 -- 172.21.15.162:0/3005165357 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596c3bc1d10 con 0x5596c3e37a00 2024-04-25T00:51:08.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.145+0000 7f034a7fc640 1 --2- 172.21.15.162:0/3005165357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e37a00 0x5596c3e39df0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0340007ba0 tx=0x7f034000c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45f222fd2023ead server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:08.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.149+0000 7f0330ff9640 1 -- 172.21.15.162:0/3005165357 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f034000cdc0 con 0x5596c3e37a00 2024-04-25T00:51:08.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.149+0000 7f0330ff9640 1 -- 172.21.15.162:0/3005165357 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03400070d0 con 0x5596c3e37a00 2024-04-25T00:51:08.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.149+0000 7f0330ff9640 1 -- 172.21.15.162:0/3005165357 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03400074c0 con 0x5596c3e37a00 2024-04-25T00:51:08.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.153+0000 7f03548b1000 1 -- 172.21.15.162:0/3005165357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e37a00 msgr2=0x5596c3e39df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:08.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.153+0000 7f03548b1000 1 --2- 172.21.15.162:0/3005165357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e37a00 0x5596c3e39df0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0340007ba0 tx=0x7f034000c4b0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.153+0000 7f03548b1000 1 -- 172.21.15.162:0/3005165357 shutdown_connections 2024-04-25T00:51:08.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.153+0000 7f03548b1000 1 --2- 172.21.15.162:0/3005165357 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e37a00 0x5596c3e39df0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.153+0000 7f03548b1000 1 --2- 172.21.15.162:0/3005165357 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e350d0 0x5596c3e374c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.153+0000 7f03548b1000 1 --2- 172.21.15.162:0/3005165357 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e29da0 0x5596c3e2a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.153+0000 7f03548b1000 1 -- 172.21.15.162:0/3005165357 >> 172.21.15.162:0/3005165357 conn(0x5596c3e2ac10 msgr2=0x5596c3e2d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:08.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.153+0000 7f03548b1000 1 -- 172.21.15.162:0/3005165357 shutdown_connections 2024-04-25T00:51:08.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.153+0000 7f03548b1000 1 -- 172.21.15.162:0/3005165357 wait complete. 2024-04-25T00:51:08.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.153+0000 7f03548b1000 1 -- start start 2024-04-25T00:51:08.154 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.153+0000 7f03548b1000 1 Processor -- start 2024-04-25T00:51:08.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.153+0000 7f03548b1000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e29da0 0x5596c3e31d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.153+0000 7f03548b1000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e350d0 0x5596c3e32290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.153+0000 7f03548b1000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e37a00 0x5596c3e327d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.153+0000 7f03548b1000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5596c3bf6520 con 0x5596c3e350d0 2024-04-25T00:51:08.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.153+0000 7f03548b1000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x5596c3be2810 con 0x5596c3e29da0 2024-04-25T00:51:08.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.153+0000 7f03548b1000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5596c3c09340 con 0x5596c3e37a00 2024-04-25T00:51:08.155 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.153+0000 7f03548b1000 10 client.0 _ll_register_callbacks cb 0x5596c3dd95c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T00:51:08.162 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.161+0000 7f034b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e37a00 0x5596c3e327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.165+0000 7f034b7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e37a00 0x5596c3e327d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:32842/0 (socket says 172.21.15.162:32842) 2024-04-25T00:51:08.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.165+0000 7f034b7fe640 1 -- 172.21.15.162:0/3202450506 learned_addr learned my addr 172.21.15.162:0/3202450506 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:08.169 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.169+0000 7f034a7fc640 1 --2- 172.21.15.162:0/3202450506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e350d0 0x5596c3e32290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.170 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.169+0000 7f034affd640 1 --2- 172.21.15.162:0/3202450506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e29da0 0x5596c3e31d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.173+0000 7f034b7fe640 1 -- 172.21.15.162:0/3202450506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e29da0 msgr2=0x5596c3e31d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:08.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.173+0000 7f034b7fe640 1 --2- 172.21.15.162:0/3202450506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e29da0 0x5596c3e31d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.173+0000 7f034b7fe640 1 -- 172.21.15.162:0/3202450506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e350d0 msgr2=0x5596c3e32290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:08.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.173+0000 7f034b7fe640 1 --2- 172.21.15.162:0/3202450506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e350d0 0x5596c3e32290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.173+0000 7f034b7fe640 1 -- 172.21.15.162:0/3202450506 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x5596c3bd47b0 con 0x5596c3e37a00 2024-04-25T00:51:08.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.173+0000 7f034b7fe640 1 --2- 172.21.15.162:0/3202450506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e37a00 0x5596c3e327d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f034c0af770 tx=0x7f033c0046d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8572c4d64de8bc49 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:08.176 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.173+0000 7f0329ffb640 10 client.0 ms_handle_connect on v2:172.21.15.179:3301/0 2024-04-25T00:51:08.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.193+0000 7f0329ffb640 1 -- 172.21.15.162:0/3202450506 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03440095e0 con 0x5596c3e37a00 2024-04-25T00:51:08.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.193+0000 7f0329ffb640 1 -- 172.21.15.162:0/3202450506 <== mon.2 v2:172.21.15.179:3301/0 2 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f03440077c0 con 0x5596c3e37a00 2024-04-25T00:51:08.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.193+0000 7f03548b1000 1 -- 172.21.15.162:0/3202450506 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f03400070d0 con 0x5596c3e37a00 2024-04-25T00:51:08.305 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.305+0000 7f0329ffb640 1 -- 172.21.15.162:0/3202450506 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f0344009780 con 0x5596c3e37a00 2024-04-25T00:51:08.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.305+0000 7f03548b1000 10 client.4481 fetch_fsmap learned FSMap version 17 2024-04-25T00:51:08.306 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.305+0000 7f03548b1000 1 -- 172.21.15.162:0/3202450506 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5596c3bc3ea0 con 0x5596c3e37a00 2024-04-25T00:51:08.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.337+0000 7f0329ffb640 1 -- 172.21.15.162:0/3202450506 <== mon.2 v2:172.21.15.179:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03400070d0 con 0x5596c3e37a00 2024-04-25T00:51:08.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.337+0000 7f0329ffb640 1 -- 172.21.15.162:0/3202450506 <== mon.2 v2:172.21.15.179:3301/0 5 ==== fsmap(e 17) ==== 4784+0+0 (secure 0 0 0) 0x7f034402b080 con 0x5596c3e37a00 2024-04-25T00:51:08.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.337+0000 7f03548b1000 10 client.4481 fetch_fsmap finished waiting for FSMap version 17 2024-04-25T00:51:08.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.337+0000 7f03548b1000 10 client.4481 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T00:51:08.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.337+0000 7f03548b1000 20 client.4481 populate_metadata read hostname 'smithi162' 2024-04-25T00:51:08.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.337+0000 7f03548b1000 1 --2- 172.21.15.162:0/3202450506 >> [v2:172.21.15.162:6838/2357127318,v1:172.21.15.162:6839/2357127318] conn(0x5596c3e331e0 0x5596c3e45150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.337+0000 7f03548b1000 4 client.4481 mds_command: new command op to 4241 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T00:51:08.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.337+0000 7f03548b1000 1 -- 172.21.15.162:0/3202450506 --> [v2:172.21.15.162:6838/2357127318,v1:172.21.15.162:6839/2357127318] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596c3bd7ab0 con 0x5596c3e331e0 2024-04-25T00:51:08.362 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.361+0000 7f034affd640 1 --2- 172.21.15.162:0/3202450506 >> [v2:172.21.15.162:6838/2357127318,v1:172.21.15.162:6839/2357127318] conn(0x5596c3e331e0 0x5596c3e45150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.493+0000 7f034affd640 1 --2- 172.21.15.162:0/3202450506 >> [v2:172.21.15.162:6838/2357127318,v1:172.21.15.162:6839/2357127318] conn(0x5596c3e331e0 0x5596c3e45150 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=894006366fb20795 server_cookie=ad383360548bfa44 in_seq=0 out_seq=0 2024-04-25T00:51:08.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.493+0000 7f0329ffb640 10 client.4481 ms_handle_connect on v2:172.21.15.162:6838/2357127318 2024-04-25T00:51:08.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.705+0000 7f0329ffb640 1 -- 172.21.15.162:0/3202450506 <== mds.2 v2:172.21.15.162:6838/2357127318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5596c3bd7ab0 con 0x5596c3e331e0 2024-04-25T00:51:08.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.705+0000 7f0329ffb640 10 client.4481 handle_command_reply: tid=0 2024-04-25T00:51:08.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.705+0000 7f03548b1000 1 client.4481 shutdown 2024-04-25T00:51:08.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.705+0000 7f03548b1000 1 -- 172.21.15.162:0/3202450506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e37a00 msgr2=0x5596c3e327d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:08.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.705+0000 7f03548b1000 1 --2- 172.21.15.162:0/3202450506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e37a00 0x5596c3e327d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f034c0af770 tx=0x7f033c0046d0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.705+0000 7f03548b1000 1 -- 172.21.15.162:0/3202450506 shutdown_connections 2024-04-25T00:51:08.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.705+0000 7f03548b1000 1 --2- 172.21.15.162:0/3202450506 >> [v2:172.21.15.162:6838/2357127318,v1:172.21.15.162:6839/2357127318] conn(0x5596c3e331e0 0x5596c3e45150 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.705+0000 7f03548b1000 1 --2- 172.21.15.162:0/3202450506 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e37a00 0x5596c3e327d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.705+0000 7f03548b1000 1 --2- 172.21.15.162:0/3202450506 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e350d0 0x5596c3e32290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.705+0000 7f03548b1000 1 --2- 172.21.15.162:0/3202450506 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e29da0 0x5596c3e31d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.705+0000 7f0329ffb640 0 client.4481 ms_handle_reset on v2:172.21.15.162:6838/2357127318 2024-04-25T00:51:08.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.705+0000 7f03548b1000 1 -- 172.21.15.162:0/3202450506 >> 172.21.15.162:0/3202450506 conn(0x5596c3e2ac10 msgr2=0x5596c3e2d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:08.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.705+0000 7f03548b1000 1 -- 172.21.15.162:0/3202450506 shutdown_connections 2024-04-25T00:51:08.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.705+0000 7f03548b1000 1 -- 172.21.15.162:0/3202450506 wait complete. 2024-04-25T00:51:08.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.705+0000 7f03548b1000 20 client.4481 trim_cache size 0 max 16384 2024-04-25T00:51:08.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.741+0000 7f03548b1000 1 Processor -- start 2024-04-25T00:51:08.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.741+0000 7f03548b1000 1 -- start start 2024-04-25T00:51:08.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.741+0000 7f03548b1000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e2ac10 0x5596c3e34580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.741+0000 7f03548b1000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e29da0 0x5596c3e34ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.741+0000 7f03548b1000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e350d0 0x5596c3e364c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.741+0000 7f03548b1000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f034c200960 con 0x5596c3e2ac10 2024-04-25T00:51:08.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.741+0000 7f03548b1000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f034c1ffbc0 con 0x5596c3e350d0 2024-04-25T00:51:08.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.741+0000 7f03548b1000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f034c200290 con 0x5596c3e29da0 2024-04-25T00:51:08.744 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.741+0000 7f034affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e2ac10 0x5596c3e34580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.744 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.745+0000 7f034affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e2ac10 0x5596c3e34580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55610/0 (socket says 172.21.15.162:55610) 2024-04-25T00:51:08.744 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.745+0000 7f034affd640 1 -- 172.21.15.162:0/2288567652 learned_addr learned my addr 172.21.15.162:0/2288567652 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:08.744 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.745+0000 7f034b7fe640 1 --2- 172.21.15.162:0/2288567652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e350d0 0x5596c3e364c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.745+0000 7f034a7fc640 1 --2- 172.21.15.162:0/2288567652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e29da0 0x5596c3e34ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.745+0000 7f034affd640 1 -- 172.21.15.162:0/2288567652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e29da0 msgr2=0x5596c3e34ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:08.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.745+0000 7f034affd640 1 --2- 172.21.15.162:0/2288567652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e29da0 0x5596c3e34ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.745+0000 7f034affd640 1 -- 172.21.15.162:0/2288567652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e350d0 msgr2=0x5596c3e364c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:08.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.745+0000 7f034affd640 1 --2- 172.21.15.162:0/2288567652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e350d0 0x5596c3e364c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.745+0000 7f034affd640 1 -- 172.21.15.162:0/2288567652 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596c3bc4e80 con 0x5596c3e2ac10 2024-04-25T00:51:08.749 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.749+0000 7f034affd640 1 --2- 172.21.15.162:0/2288567652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e2ac10 0x5596c3e34580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f033c0f1790 tx=0x7f033c01c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5abb9c41bb3254bf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:08.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.753+0000 7f032bfff640 1 -- 172.21.15.162:0/2288567652 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c0efb50 con 0x5596c3e2ac10 2024-04-25T00:51:08.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.753+0000 7f032bfff640 1 -- 172.21.15.162:0/2288567652 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f033c0edec0 con 0x5596c3e2ac10 2024-04-25T00:51:08.755 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.753+0000 7f032bfff640 1 -- 172.21.15.162:0/2288567652 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c0f1cf0 con 0x5596c3e2ac10 2024-04-25T00:51:08.756 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.753+0000 7f03548b1000 1 -- 172.21.15.162:0/2288567652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e2ac10 msgr2=0x5596c3e34580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:08.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.753+0000 7f03548b1000 1 --2- 172.21.15.162:0/2288567652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e2ac10 0x5596c3e34580 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f033c0f1790 tx=0x7f033c01c5b0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.753+0000 7f03548b1000 1 -- 172.21.15.162:0/2288567652 shutdown_connections 2024-04-25T00:51:08.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.753+0000 7f03548b1000 1 --2- 172.21.15.162:0/2288567652 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e350d0 0x5596c3e364c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.753+0000 7f03548b1000 1 --2- 172.21.15.162:0/2288567652 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e29da0 0x5596c3e34ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.753+0000 7f03548b1000 1 --2- 172.21.15.162:0/2288567652 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e2ac10 0x5596c3e34580 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.753+0000 7f03548b1000 1 -- 172.21.15.162:0/2288567652 >> 172.21.15.162:0/2288567652 conn(0x5596c3e299c0 msgr2=0x5596c3e33e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:08.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.757+0000 7f03548b1000 1 -- 172.21.15.162:0/2288567652 shutdown_connections 2024-04-25T00:51:08.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.757+0000 7f03548b1000 1 -- 172.21.15.162:0/2288567652 wait complete. 2024-04-25T00:51:08.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.757+0000 7f03548b1000 1 -- start start 2024-04-25T00:51:08.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.757+0000 7f03548b1000 1 Processor -- start 2024-04-25T00:51:08.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.757+0000 7f03548b1000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e29da0 0x5596c3e481d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.757+0000 7f03548b1000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e2ac10 0x5596c3ea13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.757+0000 7f03548b1000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e350d0 0x5596c3ea1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.757+0000 7f03548b1000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x5596c3c3b8f0 con 0x5596c3e29da0 2024-04-25T00:51:08.758 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.757+0000 7f03548b1000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f034c1f3b80 con 0x5596c3e350d0 2024-04-25T00:51:08.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.757+0000 7f03548b1000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x5596c3c39b90 con 0x5596c3e2ac10 2024-04-25T00:51:08.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.757+0000 7f03548b1000 10 client.0 _ll_register_callbacks cb 0x7f0344002120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T00:51:08.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.757+0000 7f034affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e29da0 0x5596c3e481d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.757+0000 7f034affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e29da0 0x5596c3e481d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55612/0 (socket says 172.21.15.162:55612) 2024-04-25T00:51:08.759 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.757+0000 7f034affd640 1 -- 172.21.15.162:0/3791067611 learned_addr learned my addr 172.21.15.162:0/3791067611 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:08.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.757+0000 7f034a7fc640 1 --2- 172.21.15.162:0/3791067611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e2ac10 0x5596c3ea13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.757+0000 7f034b7fe640 1 --2- 172.21.15.162:0/3791067611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e350d0 0x5596c3ea1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.761+0000 7f034affd640 1 -- 172.21.15.162:0/3791067611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e2ac10 msgr2=0x5596c3ea13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:08.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.761+0000 7f034affd640 1 --2- 172.21.15.162:0/3791067611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e2ac10 0x5596c3ea13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.761+0000 7f034affd640 1 -- 172.21.15.162:0/3791067611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e350d0 msgr2=0x5596c3ea1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:08.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.761+0000 7f034affd640 1 --2- 172.21.15.162:0/3791067611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e350d0 0x5596c3ea1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.761+0000 7f034affd640 1 -- 172.21.15.162:0/3791067611 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596c3c09760 con 0x5596c3e29da0 2024-04-25T00:51:08.765 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.765+0000 7f034affd640 1 --2- 172.21.15.162:0/3791067611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e29da0 0x5596c3e481d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f033c0f17e0 tx=0x7f0344011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5319e32cc4bd0dd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:08.765 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.765+0000 7f0329ffb640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-04-25T00:51:08.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.769+0000 7f0329ffb640 1 -- 172.21.15.162:0/3791067611 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f033c109040 con 0x5596c3e29da0 2024-04-25T00:51:08.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.769+0000 7f0329ffb640 1 -- 172.21.15.162:0/3791067611 <== mon.0 v2:172.21.15.162:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7f033c0f1cb0 con 0x5596c3e29da0 2024-04-25T00:51:08.769 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.769+0000 7f03548b1000 1 -- 172.21.15.162:0/3791067611 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f033c0edec0 con 0x5596c3e29da0 2024-04-25T00:51:08.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.769+0000 7f0329ffb640 1 -- 172.21.15.162:0/3791067611 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f033c0f1390 con 0x5596c3e29da0 2024-04-25T00:51:08.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.769+0000 7f03548b1000 10 client.4542 fetch_fsmap learned FSMap version 17 2024-04-25T00:51:08.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.769+0000 7f03548b1000 1 -- 172.21.15.162:0/3791067611 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x5596c3c959e0 con 0x5596c3e29da0 2024-04-25T00:51:08.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.773+0000 7f0329ffb640 1 -- 172.21.15.162:0/3791067611 <== mon.0 v2:172.21.15.162:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f033c0edec0 con 0x5596c3e29da0 2024-04-25T00:51:08.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.773+0000 7f0329ffb640 1 -- 172.21.15.162:0/3791067611 <== mon.0 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) ==== 4784+0+0 (secure 0 0 0) 0x7f033c105ce0 con 0x5596c3e29da0 2024-04-25T00:51:08.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.773+0000 7f03548b1000 10 client.4542 fetch_fsmap finished waiting for FSMap version 17 2024-04-25T00:51:08.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.773+0000 7f03548b1000 10 client.4542 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-25T00:51:08.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.773+0000 7f03548b1000 20 client.4542 populate_metadata read hostname 'smithi162' 2024-04-25T00:51:08.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.773+0000 7f03548b1000 1 --2- 172.21.15.162:0/3791067611 >> [v2:172.21.15.162:6838/2357127318,v1:172.21.15.162:6839/2357127318] conn(0x5596c3e37a00 0x5596c3ea43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.773+0000 7f03548b1000 4 client.4542 mds_command: new command op to 4241 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T00:51:08.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.773+0000 7f03548b1000 1 -- 172.21.15.162:0/3791067611 --> [v2:172.21.15.162:6838/2357127318,v1:172.21.15.162:6839/2357127318] -- command(tid 0: {"prefix": "status"}) -- 0x5596c3c49b20 con 0x5596c3e37a00 2024-04-25T00:51:08.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.773+0000 7f034a7fc640 1 --2- 172.21.15.162:0/3791067611 >> [v2:172.21.15.162:6838/2357127318,v1:172.21.15.162:6839/2357127318] conn(0x5596c3e37a00 0x5596c3ea43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.779 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.777+0000 7f034a7fc640 1 --2- 172.21.15.162:0/3791067611 >> [v2:172.21.15.162:6838/2357127318,v1:172.21.15.162:6839/2357127318] conn(0x5596c3e37a00 0x5596c3ea43f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3f6785344d186b5 server_cookie=86e54cfb54af0777 in_seq=0 out_seq=0 2024-04-25T00:51:08.779 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.777+0000 7f0329ffb640 10 client.4542 ms_handle_connect on v2:172.21.15.162:6838/2357127318 2024-04-25T00:51:08.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f0329ffb640 1 -- 172.21.15.162:0/3791067611 <== mds.2 v2:172.21.15.162:6838/2357127318 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x7f03400047f0 con 0x5596c3e37a00 2024-04-25T00:51:08.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f0329ffb640 10 client.4542 handle_command_reply: tid=0 2024-04-25T00:51:08.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f03548b1000 1 client.4542 shutdown 2024-04-25T00:51:08.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f03548b1000 1 -- 172.21.15.162:0/3791067611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e29da0 msgr2=0x5596c3e481d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:08.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f03548b1000 1 --2- 172.21.15.162:0/3791067611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e29da0 0x5596c3e481d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f033c0f17e0 tx=0x7f0344011000 comp rx=0 tx=0).stop 2024-04-25T00:51:08.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f03548b1000 1 -- 172.21.15.162:0/3791067611 shutdown_connections 2024-04-25T00:51:08.799 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f03548b1000 1 --2- 172.21.15.162:0/3791067611 >> [v2:172.21.15.162:6838/2357127318,v1:172.21.15.162:6839/2357127318] conn(0x5596c3e37a00 0x5596c3ea43f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f03548b1000 1 --2- 172.21.15.162:0/3791067611 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x5596c3e350d0 0x5596c3ea1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f03548b1000 1 --2- 172.21.15.162:0/3791067611 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x5596c3e2ac10 0x5596c3ea13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f0329ffb640 0 client.4542 ms_handle_reset on v2:172.21.15.162:6838/2357127318 2024-04-25T00:51:08.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f03548b1000 1 --2- 172.21.15.162:0/3791067611 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x5596c3e29da0 0x5596c3e481d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f03548b1000 1 -- 172.21.15.162:0/3791067611 >> 172.21.15.162:0/3791067611 conn(0x5596c3e299c0 msgr2=0x5596c3e34700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:08.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f03548b1000 1 -- 172.21.15.162:0/3791067611 shutdown_connections 2024-04-25T00:51:08.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f03548b1000 1 -- 172.21.15.162:0/3791067611 wait complete. 2024-04-25T00:51:08.800 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f03548b1000 20 client.4542 trim_cache size 0 max 16384 2024-04-25T00:51:08.800 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-04-25T00:51:08.800 INFO:teuthology.orchestra.run.smithi162.stdout: "cluster_fsid": "e141deed-4794-4a17-83c9-f6e6e8875f5e", 2024-04-25T00:51:08.800 INFO:teuthology.orchestra.run.smithi162.stdout: "whoami": 2, 2024-04-25T00:51:08.801 INFO:teuthology.orchestra.run.smithi162.stdout: "id": 4241, 2024-04-25T00:51:08.801 INFO:teuthology.orchestra.run.smithi162.stdout: "want_state": "up:active", 2024-04-25T00:51:08.801 INFO:teuthology.orchestra.run.smithi162.stdout: "state": "up:active", 2024-04-25T00:51:08.801 INFO:teuthology.orchestra.run.smithi162.stdout: "fs_name": "cephfs", 2024-04-25T00:51:08.801 INFO:teuthology.orchestra.run.smithi162.stdout: "rank_uptime": 19.730832092, 2024-04-25T00:51:08.801 INFO:teuthology.orchestra.run.smithi162.stdout: "mdsmap_epoch": 17, 2024-04-25T00:51:08.801 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_epoch": 26, 2024-04-25T00:51:08.801 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T00:51:08.801 INFO:teuthology.orchestra.run.smithi162.stdout: "uptime": 47.562013700000001 2024-04-25T00:51:08.801 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-04-25T00:51:08.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f0351738640 1 -- 172.21.15.162:0/3892954490 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f0338067910 msgr2=0x7f0338069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:08.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f0351738640 1 --2- 172.21.15.162:0/3892954490 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f0338067910 0x7f0338069dd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f034c0ce900 tx=0x7f0344009ce0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f0351738640 1 -- 172.21.15.162:0/3892954490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0334003a10 msgr2=0x7f034c0b2920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:08.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f0351738640 1 --2- 172.21.15.162:0/3892954490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0334003a10 0x7f034c0b2920 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f033c000c10 tx=0x7f0334005840 comp rx=0 tx=0).stop 2024-04-25T00:51:08.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f0351738640 1 -- 172.21.15.162:0/3892954490 shutdown_connections 2024-04-25T00:51:08.802 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f0351738640 1 --2- 172.21.15.162:0/3892954490 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f034c0b4610 0x7f034c1534e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f0351738640 1 --2- 172.21.15.162:0/3892954490 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f034c0b41b0 0x7f034c152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f0351738640 1 --2- 172.21.15.162:0/3892954490 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f0338067910 0x7f0338069dd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f0351738640 1 --2- 172.21.15.162:0/3892954490 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f0334003a10 0x7f034c0b2920 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f0351738640 1 -- 172.21.15.162:0/3892954490 >> 172.21.15.162:0/3892954490 conn(0x7f034c06ca60 msgr2=0x7f034c0b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:08.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f0351738640 1 -- 172.21.15.162:0/3892954490 shutdown_connections 2024-04-25T00:51:08.803 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.797+0000 7f0351738640 1 -- 172.21.15.162:0/3892954490 wait complete. 2024-04-25T00:51:08.819 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-25T00:51:08.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.937+0000 7fb388087640 1 Processor -- start 2024-04-25T00:51:08.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.937+0000 7fb388087640 1 -- start start 2024-04-25T00:51:08.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.937+0000 7fb388087640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb380154460 0x7fb38006b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.937+0000 7fb388087640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb380072b70 con 0x7fb380073500 2024-04-25T00:51:08.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.937+0000 7fb388087640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb38015a650 con 0x7fb38015e2f0 2024-04-25T00:51:08.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.937+0000 7fb388087640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb38015a930 con 0x7fb380154460 2024-04-25T00:51:08.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.937+0000 7fb385622640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fb380073500 0x7fb38015dbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:52502/0 (socket says 172.21.15.162:52502) 2024-04-25T00:51:08.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.937+0000 7fb385622640 1 -- 172.21.15.162:0/2401083740 learned_addr learned my addr 172.21.15.162:0/2401083740 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:51:08.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.937+0000 7fb385e23640 1 --2- 172.21.15.162:0/2401083740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb380154460 0x7fb38006b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.941+0000 7fb384e21640 1 -- 172.21.15.162:0/2401083740 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2998138124 0 0) 0x7fb380072b70 con 0x7fb380073500 2024-04-25T00:51:08.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.941+0000 7fb384e21640 1 -- 172.21.15.162:0/2401083740 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb36c003530 con 0x7fb380073500 2024-04-25T00:51:08.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.945+0000 7fb384e21640 1 -- 172.21.15.162:0/2401083740 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1102276337 0 0) 0x7fb36c003530 con 0x7fb380073500 2024-04-25T00:51:08.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.945+0000 7fb384e21640 1 -- 172.21.15.162:0/2401083740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb380154460 msgr2=0x7fb38006b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:08.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.945+0000 7fb384e21640 1 --2- 172.21.15.162:0/2401083740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb380154460 0x7fb38006b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.945+0000 7fb384e21640 1 -- 172.21.15.162:0/2401083740 >> v1:172.21.15.179:6789/0 conn(0x7fb38015e2f0 legacy=0x7fb380164dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:08.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.945+0000 7fb384e21640 1 -- 172.21.15.162:0/2401083740 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb38015ac10 con 0x7fb380073500 2024-04-25T00:51:08.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.945+0000 7fb384e21640 1 -- 172.21.15.162:0/2401083740 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7fb370001680 con 0x7fb380073500 2024-04-25T00:51:08.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.945+0000 7fb384e21640 1 -- 172.21.15.162:0/2401083740 >> v1:172.21.15.162:6789/0 conn(0x7fb380073500 legacy=0x7fb38015dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:08.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.945+0000 7fb384e21640 1 --2- 172.21.15.162:0/2401083740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb36c0039f0 0x7fb36c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.945+0000 7fb384e21640 1 --2- 172.21.15.162:0/2401083740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb36c004810 0x7fb36c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.945+0000 7fb384e21640 1 --2- 172.21.15.162:0/2401083740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb380154460 0x7fb36c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.945+0000 7fb384e21640 1 -- 172.21.15.162:0/2401083740 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb38015a930 con 0x7fb36c004810 2024-04-25T00:51:08.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.945+0000 7fb384e21640 1 -- 172.21.15.162:0/2401083740 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb36c005530 con 0x7fb36c0039f0 2024-04-25T00:51:08.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.945+0000 7fb384e21640 1 -- 172.21.15.162:0/2401083740 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb36c00bf10 con 0x7fb380154460 2024-04-25T00:51:08.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.949+0000 7fb385622640 1 --2- 172.21.15.162:0/2401083740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb36c004810 0x7fb36c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.949+0000 7fb385622640 1 -- 172.21.15.162:0/2401083740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb380154460 msgr2=0x7fb36c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:08.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.949+0000 7fb385622640 1 --2- 172.21.15.162:0/2401083740 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb380154460 0x7fb36c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.949+0000 7fb385622640 1 -- 172.21.15.162:0/2401083740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb36c0039f0 msgr2=0x7fb36c003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:08.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.949+0000 7fb385622640 1 --2- 172.21.15.162:0/2401083740 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb36c0039f0 0x7fb36c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.949+0000 7fb385622640 1 -- 172.21.15.162:0/2401083740 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb36c003530 con 0x7fb36c004810 2024-04-25T00:51:08.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.953+0000 7fb385622640 1 --2- 172.21.15.162:0/2401083740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb36c004810 0x7fb36c004c90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb37000c160 tx=0x7fb37001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b998bda4cf350c43 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:08.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.957+0000 7fb384e21640 1 -- 172.21.15.162:0/2401083740 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb370007c70 con 0x7fb36c004810 2024-04-25T00:51:08.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.957+0000 7fb384e21640 1 -- 172.21.15.162:0/2401083740 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3700a9070 con 0x7fb36c004810 2024-04-25T00:51:08.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.957+0000 7fb384e21640 1 -- 172.21.15.162:0/2401083740 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb370005de0 con 0x7fb36c004810 2024-04-25T00:51:08.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.957+0000 7fb388087640 1 -- 172.21.15.162:0/2401083740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb36c004810 msgr2=0x7fb36c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:08.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.957+0000 7fb388087640 1 --2- 172.21.15.162:0/2401083740 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb36c004810 0x7fb36c004c90 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb37000c160 tx=0x7fb37001cba0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.957+0000 7fb386624640 1 -- 172.21.15.162:0/2401083740 reap_dead start 2024-04-25T00:51:08.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.957+0000 7fb388087640 1 -- 172.21.15.162:0/2401083740 shutdown_connections 2024-04-25T00:51:08.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.957+0000 7fb388087640 1 -- 172.21.15.162:0/2401083740 >> 172.21.15.162:0/2401083740 conn(0x7fb380070350 msgr2=0x7fb380070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:08.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.957+0000 7fb388087640 1 -- 172.21.15.162:0/2401083740 shutdown_connections 2024-04-25T00:51:08.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.957+0000 7fb388087640 1 -- 172.21.15.162:0/2401083740 wait complete. 2024-04-25T00:51:08.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.961+0000 7fb388087640 1 Processor -- start 2024-04-25T00:51:08.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.961+0000 7fb388087640 1 -- start start 2024-04-25T00:51:08.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.961+0000 7fb388087640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb36c004810 0x7fb380147100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.961+0000 7fb388087640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3801509d0 0x7fb3801577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.961+0000 7fb388087640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb38015cf00 0x7fb38015d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.961+0000 7fb388087640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb380166660 con 0x7fb36c004810 2024-04-25T00:51:08.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.961+0000 7fb388087640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb3801664e0 con 0x7fb3801509d0 2024-04-25T00:51:08.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.961+0000 7fb388087640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb3801667e0 con 0x7fb38015cf00 2024-04-25T00:51:08.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.961+0000 7fb385e23640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb36c004810 0x7fb380147100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.961+0000 7fb385e23640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb36c004810 0x7fb380147100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55632/0 (socket says 172.21.15.162:55632) 2024-04-25T00:51:08.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.961+0000 7fb385e23640 1 -- 172.21.15.162:0/3534490855 learned_addr learned my addr 172.21.15.162:0/3534490855 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:08.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.961+0000 7fb385622640 1 --2- 172.21.15.162:0/3534490855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3801509d0 0x7fb3801577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.961+0000 7fb386624640 1 --2- 172.21.15.162:0/3534490855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb38015cf00 0x7fb38015d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.965+0000 7fb385e23640 1 -- 172.21.15.162:0/3534490855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb38015cf00 msgr2=0x7fb38015d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:08.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.965+0000 7fb385e23640 1 --2- 172.21.15.162:0/3534490855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb38015cf00 0x7fb38015d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.965+0000 7fb385e23640 1 -- 172.21.15.162:0/3534490855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3801509d0 msgr2=0x7fb3801577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:08.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.965+0000 7fb385e23640 1 --2- 172.21.15.162:0/3534490855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3801509d0 0x7fb3801577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.967 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.965+0000 7fb385e23640 1 -- 172.21.15.162:0/3534490855 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb380151510 con 0x7fb36c004810 2024-04-25T00:51:08.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.969+0000 7fb385e23640 1 --2- 172.21.15.162:0/3534490855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb36c004810 0x7fb380147100 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00e920 tx=0x7fb37c00ede0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:08.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.973+0000 7fb3767fc640 1 -- 172.21.15.162:0/3534490855 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37c017070 con 0x7fb36c004810 2024-04-25T00:51:08.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.973+0000 7fb3767fc640 1 -- 172.21.15.162:0/3534490855 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb37c00ca00 con 0x7fb36c004810 2024-04-25T00:51:08.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.973+0000 7fb3767fc640 1 -- 172.21.15.162:0/3534490855 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37c00cdf0 con 0x7fb36c004810 2024-04-25T00:51:08.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.973+0000 7fb388087640 1 -- 172.21.15.162:0/3534490855 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3801517f0 con 0x7fb36c004810 2024-04-25T00:51:08.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.973+0000 7fb388087640 1 -- 172.21.15.162:0/3534490855 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb38014f480 con 0x7fb36c004810 2024-04-25T00:51:08.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.973+0000 7fb38b200000 1 Processor -- start 2024-04-25T00:51:08.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.973+0000 7fb38b200000 1 -- start start 2024-04-25T00:51:08.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.977+0000 7fb38b200000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80652da0 0x55ee80653180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.977+0000 7fb38b200000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee8065e0d0 0x55ee806604c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.977+0000 7fb38b200000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee80660a00 0x55ee80662df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.977+0000 7fb38b200000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ee804655e0 con 0x55ee80660a00 2024-04-25T00:51:08.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.977+0000 7fb38b200000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ee803ecc50 con 0x55ee80652da0 2024-04-25T00:51:08.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.977+0000 7fb38b200000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55ee804615a0 con 0x55ee8065e0d0 2024-04-25T00:51:08.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.981+0000 7fb386624640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80652da0 0x55ee80653180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.981+0000 7fb385e23640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee8065e0d0 0x55ee806604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.981+0000 7fb385e23640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee8065e0d0 0x55ee806604c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:32900/0 (socket says 172.21.15.162:32900) 2024-04-25T00:51:08.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.981+0000 7fb385e23640 1 -- 172.21.15.162:0/3585508912 learned_addr learned my addr 172.21.15.162:0/3585508912 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:08.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.985+0000 7fb386624640 1 -- 172.21.15.162:0/3585508912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee8065e0d0 msgr2=0x55ee806604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:08.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.985+0000 7fb386624640 1 --2- 172.21.15.162:0/3585508912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee8065e0d0 0x55ee806604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.985+0000 7fb386624640 1 -- 172.21.15.162:0/3585508912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee80660a00 msgr2=0x55ee80662df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:08.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.985+0000 7fb386624640 1 --2- 172.21.15.162:0/3585508912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee80660a00 0x55ee80662df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:08.988 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.985+0000 7fb386624640 1 -- 172.21.15.162:0/3585508912 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee803ead10 con 0x55ee80652da0 2024-04-25T00:51:08.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.993+0000 7fb3767fc640 1 -- 172.21.15.162:0/3534490855 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb37c01a070 con 0x7fb36c004810 2024-04-25T00:51:08.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.993+0000 7fb386624640 1 --2- 172.21.15.162:0/3585508912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80652da0 0x55ee80653180 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb38006c1f0 tx=0x7fb37c004740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d843b714aa461965 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:08.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.993+0000 7fb3767fc640 1 --2- 172.21.15.162:0/3534490855 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb364067940 0x7fb364069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:08.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.993+0000 7fb385e23640 1 --2- 172.21.15.162:0/3534490855 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb364067940 0x7fb364069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:08.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.993+0000 7fb385e23640 1 --2- 172.21.15.162:0/3534490855 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb364067940 0x7fb364069e00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb37c000c10 tx=0x7fb37c0046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:08.998 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:08.997+0000 7fb3767fc640 1 -- 172.21.15.162:0/3534490855 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fb37c0846a0 con 0x7fb36c004810 2024-04-25T00:51:09.003 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.001+0000 7fb3637fe640 1 -- 172.21.15.162:0/3585508912 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb378005b50 con 0x55ee80652da0 2024-04-25T00:51:09.003 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.001+0000 7fb3637fe640 1 -- 172.21.15.162:0/3585508912 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb378018070 con 0x55ee80652da0 2024-04-25T00:51:09.003 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.001+0000 7fb3637fe640 1 -- 172.21.15.162:0/3585508912 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37800fb90 con 0x55ee80652da0 2024-04-25T00:51:09.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.001+0000 7fb38b200000 1 -- 172.21.15.162:0/3585508912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80652da0 msgr2=0x55ee80653180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:09.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.001+0000 7fb38b200000 1 --2- 172.21.15.162:0/3585508912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80652da0 0x55ee80653180 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb38006c1f0 tx=0x7fb37c004740 comp rx=0 tx=0).stop 2024-04-25T00:51:09.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.001+0000 7fb38b200000 1 -- 172.21.15.162:0/3585508912 shutdown_connections 2024-04-25T00:51:09.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.001+0000 7fb38b200000 1 --2- 172.21.15.162:0/3585508912 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee80660a00 0x55ee80662df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.001+0000 7fb38b200000 1 --2- 172.21.15.162:0/3585508912 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee8065e0d0 0x55ee806604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.001+0000 7fb38b200000 1 --2- 172.21.15.162:0/3585508912 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80652da0 0x55ee80653180 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.001+0000 7fb38b200000 1 -- 172.21.15.162:0/3585508912 >> 172.21.15.162:0/3585508912 conn(0x55ee80653c10 msgr2=0x55ee80656000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:09.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.001+0000 7fb38b200000 1 -- 172.21.15.162:0/3585508912 shutdown_connections 2024-04-25T00:51:09.004 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.001+0000 7fb38b200000 1 -- 172.21.15.162:0/3585508912 wait complete. 2024-04-25T00:51:09.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.001+0000 7fb38b200000 1 -- start start 2024-04-25T00:51:09.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.005+0000 7fb38b200000 1 Processor -- start 2024-04-25T00:51:09.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.005+0000 7fb38b200000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee80652da0 0x55ee8065ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.005+0000 7fb38b200000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee8065e0d0 0x55ee8065b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.005+0000 7fb38b200000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80660a00 0x55ee8065b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.005+0000 7fb38b200000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ee8041f520 con 0x55ee8065e0d0 2024-04-25T00:51:09.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.005+0000 7fb38b200000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55ee8040b810 con 0x55ee80660a00 2024-04-25T00:51:09.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.005+0000 7fb38b200000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55ee80432340 con 0x55ee80652da0 2024-04-25T00:51:09.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.005+0000 7fb38b200000 10 client.0 _ll_register_callbacks cb 0x55ee806025c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T00:51:09.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.005+0000 7fb385622640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee8065e0d0 0x55ee8065b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.005+0000 7fb385622640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee8065e0d0 0x55ee8065b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55658/0 (socket says 172.21.15.162:55658) 2024-04-25T00:51:09.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.005+0000 7fb385622640 1 -- 172.21.15.162:0/3045361754 learned_addr learned my addr 172.21.15.162:0/3045361754 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:09.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.009+0000 7fb386624640 1 --2- 172.21.15.162:0/3045361754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee80652da0 0x55ee8065ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.009 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.009+0000 7fb386624640 1 --2- 172.21.15.162:0/3045361754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80660a00 0x55ee8065b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.009+0000 7fb385622640 1 -- 172.21.15.162:0/3045361754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee80652da0 msgr2=0x55ee8065ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:09.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.009+0000 7fb385622640 1 --2- 172.21.15.162:0/3045361754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee80652da0 0x55ee8065ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.009+0000 7fb385622640 1 -- 172.21.15.162:0/3045361754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80660a00 msgr2=0x55ee8065b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:09.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.009+0000 7fb385622640 1 --2- 172.21.15.162:0/3045361754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80660a00 0x55ee8065b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.010 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.009+0000 7fb385622640 1 -- 172.21.15.162:0/3045361754 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee803fd7b0 con 0x55ee8065e0d0 2024-04-25T00:51:09.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.013+0000 7fb385622640 1 --2- 172.21.15.162:0/3045361754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee8065e0d0 0x55ee8065b260 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb3700983a0 tx=0x7fb36c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e949e621c0236b9d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:09.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.013+0000 7fb360ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-04-25T00:51:09.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.017+0000 7fb360ff9640 1 -- 172.21.15.162:0/3045361754 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb370007c70 con 0x55ee8065e0d0 2024-04-25T00:51:09.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.017+0000 7fb360ff9640 1 -- 172.21.15.162:0/3045361754 <== mon.0 v2:172.21.15.162:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fb3700baae0 con 0x55ee8065e0d0 2024-04-25T00:51:09.018 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.017+0000 7fb38b200000 1 -- 172.21.15.162:0/3045361754 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb378018070 con 0x55ee8065e0d0 2024-04-25T00:51:09.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.017+0000 7fb360ff9640 1 -- 172.21.15.162:0/3045361754 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fb3700bace0 con 0x55ee8065e0d0 2024-04-25T00:51:09.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.017+0000 7fb38b200000 10 client.4551 fetch_fsmap learned FSMap version 17 2024-04-25T00:51:09.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.017+0000 7fb38b200000 1 -- 172.21.15.162:0/3045361754 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55ee803ecea0 con 0x55ee8065e0d0 2024-04-25T00:51:09.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.021+0000 7fb360ff9640 1 -- 172.21.15.162:0/3045361754 <== mon.0 v2:172.21.15.162:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb378018070 con 0x55ee8065e0d0 2024-04-25T00:51:09.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.021+0000 7fb360ff9640 1 -- 172.21.15.162:0/3045361754 <== mon.0 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) ==== 4784+0+0 (secure 0 0 0) 0x7fb3700047f0 con 0x55ee8065e0d0 2024-04-25T00:51:09.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.021+0000 7fb38b200000 10 client.4551 fetch_fsmap finished waiting for FSMap version 17 2024-04-25T00:51:09.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.021+0000 7fb38b200000 10 client.4551 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T00:51:09.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.021+0000 7fb38b200000 20 client.4551 populate_metadata read hostname 'smithi162' 2024-04-25T00:51:09.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.021+0000 7fb38b200000 1 --2- 172.21.15.162:0/3045361754 >> [v2:172.21.15.179:6836/2607965795,v1:172.21.15.179:6837/2607965795] conn(0x55ee8065c1b0 0x55ee8066e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.021+0000 7fb38b200000 4 client.4551 mds_command: new command op to 4244 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T00:51:09.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.021+0000 7fb38b200000 1 -- 172.21.15.162:0/3045361754 --> [v2:172.21.15.179:6836/2607965795,v1:172.21.15.179:6837/2607965795] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee80400ab0 con 0x55ee8065c1b0 2024-04-25T00:51:09.026 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.025+0000 7fb386624640 1 --2- 172.21.15.162:0/3045361754 >> [v2:172.21.15.179:6836/2607965795,v1:172.21.15.179:6837/2607965795] conn(0x55ee8065c1b0 0x55ee8066e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.117+0000 7fb386624640 1 --2- 172.21.15.162:0/3045361754 >> [v2:172.21.15.179:6836/2607965795,v1:172.21.15.179:6837/2607965795] conn(0x55ee8065c1b0 0x55ee8066e150 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a1788a6e5bb1009d server_cookie=bb6ac8ebd1b1a5a7 in_seq=0 out_seq=0 2024-04-25T00:51:09.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.117+0000 7fb360ff9640 10 client.4551 ms_handle_connect on v2:172.21.15.179:6836/2607965795 2024-04-25T00:51:09.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.325+0000 7fb360ff9640 1 -- 172.21.15.162:0/3045361754 <== mds.1 v2:172.21.15.179:6836/2607965795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55ee80400ab0 con 0x55ee8065c1b0 2024-04-25T00:51:09.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.325+0000 7fb360ff9640 10 client.4551 handle_command_reply: tid=0 2024-04-25T00:51:09.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.325+0000 7fb38b200000 1 client.4551 shutdown 2024-04-25T00:51:09.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.325+0000 7fb38b200000 1 -- 172.21.15.162:0/3045361754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee8065e0d0 msgr2=0x55ee8065b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:09.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.325+0000 7fb38b200000 1 --2- 172.21.15.162:0/3045361754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee8065e0d0 0x55ee8065b260 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb3700983a0 tx=0x7fb36c005840 comp rx=0 tx=0).stop 2024-04-25T00:51:09.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.325+0000 7fb38b200000 1 -- 172.21.15.162:0/3045361754 shutdown_connections 2024-04-25T00:51:09.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.325+0000 7fb38b200000 1 --2- 172.21.15.162:0/3045361754 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80660a00 0x55ee8065b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.325+0000 7fb38b200000 1 --2- 172.21.15.162:0/3045361754 >> [v2:172.21.15.179:6836/2607965795,v1:172.21.15.179:6837/2607965795] conn(0x55ee8065c1b0 0x55ee8066e150 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.325+0000 7fb38b200000 1 --2- 172.21.15.162:0/3045361754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee8065e0d0 0x55ee8065b260 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.325+0000 7fb38b200000 1 --2- 172.21.15.162:0/3045361754 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee80652da0 0x55ee8065ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.325+0000 7fb360ff9640 0 client.4551 ms_handle_reset on v2:172.21.15.179:6836/2607965795 2024-04-25T00:51:09.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.325+0000 7fb38b200000 1 -- 172.21.15.162:0/3045361754 >> 172.21.15.162:0/3045361754 conn(0x55ee80653c10 msgr2=0x55ee80656000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:09.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.325+0000 7fb38b200000 1 -- 172.21.15.162:0/3045361754 shutdown_connections 2024-04-25T00:51:09.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.325+0000 7fb38b200000 1 -- 172.21.15.162:0/3045361754 wait complete. 2024-04-25T00:51:09.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.325+0000 7fb38b200000 20 client.4551 trim_cache size 0 max 16384 2024-04-25T00:51:09.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.365+0000 7fb38b200000 1 Processor -- start 2024-04-25T00:51:09.367 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.365+0000 7fb38b200000 1 -- start start 2024-04-25T00:51:09.368 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.365+0000 7fb38b200000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80652da0 0x55ee80671180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.365+0000 7fb38b200000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee8065e0d0 0x55ee806716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.365+0000 7fb38b200000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee80660a00 0x55ee8065e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.365+0000 7fb38b200000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb380200ac0 con 0x55ee8065e0d0 2024-04-25T00:51:09.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.365+0000 7fb38b200000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb3801ffd20 con 0x55ee80652da0 2024-04-25T00:51:09.369 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.365+0000 7fb38b200000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb3802003f0 con 0x55ee80660a00 2024-04-25T00:51:09.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.369+0000 7fb385622640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee8065e0d0 0x55ee806716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.369+0000 7fb386624640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80652da0 0x55ee80671180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.369+0000 7fb385622640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee8065e0d0 0x55ee806716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55672/0 (socket says 172.21.15.162:55672) 2024-04-25T00:51:09.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.369+0000 7fb385622640 1 -- 172.21.15.162:0/2763293792 learned_addr learned my addr 172.21.15.162:0/2763293792 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:09.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.369+0000 7fb386624640 1 --2- 172.21.15.162:0/2763293792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee80660a00 0x55ee8065e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.373+0000 7fb385622640 1 -- 172.21.15.162:0/2763293792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee80660a00 msgr2=0x55ee8065e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:09.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.373+0000 7fb385622640 1 --2- 172.21.15.162:0/2763293792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee80660a00 0x55ee8065e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.373+0000 7fb385622640 1 -- 172.21.15.162:0/2763293792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80652da0 msgr2=0x55ee80671180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:09.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.373+0000 7fb385622640 1 --2- 172.21.15.162:0/2763293792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80652da0 0x55ee80671180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.373+0000 7fb385622640 1 -- 172.21.15.162:0/2763293792 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee803ede80 con 0x55ee8065e0d0 2024-04-25T00:51:09.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.373+0000 7fb385622640 1 --2- 172.21.15.162:0/2763293792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee8065e0d0 0x55ee806716c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb3700018b0 tx=0x7fb3700af000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbb7acff60a221cf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:09.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.381+0000 7fb362ffd640 1 -- 172.21.15.162:0/2763293792 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3700bae80 con 0x55ee8065e0d0 2024-04-25T00:51:09.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.381+0000 7fb362ffd640 1 -- 172.21.15.162:0/2763293792 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3700a9040 con 0x55ee8065e0d0 2024-04-25T00:51:09.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.381+0000 7fb362ffd640 1 -- 172.21.15.162:0/2763293792 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3700047f0 con 0x55ee8065e0d0 2024-04-25T00:51:09.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.381+0000 7fb38b200000 1 -- 172.21.15.162:0/2763293792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee8065e0d0 msgr2=0x55ee806716c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:09.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.381+0000 7fb38b200000 1 --2- 172.21.15.162:0/2763293792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee8065e0d0 0x55ee806716c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb3700018b0 tx=0x7fb3700af000 comp rx=0 tx=0).stop 2024-04-25T00:51:09.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.381+0000 7fb38b200000 1 -- 172.21.15.162:0/2763293792 shutdown_connections 2024-04-25T00:51:09.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.381+0000 7fb38b200000 1 --2- 172.21.15.162:0/2763293792 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee80660a00 0x55ee8065e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.381+0000 7fb38b200000 1 --2- 172.21.15.162:0/2763293792 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee8065e0d0 0x55ee806716c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.381+0000 7fb38b200000 1 --2- 172.21.15.162:0/2763293792 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80652da0 0x55ee80671180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.381+0000 7fb38b200000 1 -- 172.21.15.162:0/2763293792 >> 172.21.15.162:0/2763293792 conn(0x55ee80653c10 msgr2=0x55ee8061b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:09.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.381+0000 7fb38b200000 1 -- 172.21.15.162:0/2763293792 shutdown_connections 2024-04-25T00:51:09.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.381+0000 7fb38b200000 1 -- 172.21.15.162:0/2763293792 wait complete. 2024-04-25T00:51:09.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.381+0000 7fb38b200000 1 -- start start 2024-04-25T00:51:09.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.385+0000 7fb38b200000 1 Processor -- start 2024-04-25T00:51:09.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.385+0000 7fb38b200000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee80652da0 0x55ee80670470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.385+0000 7fb38b200000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee8065e0d0 0x55ee806709b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.385+0000 7fb38b200000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80660a00 0x55ee8068dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.385+0000 7fb38b200000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55ee804648f0 con 0x55ee80652da0 2024-04-25T00:51:09.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.385+0000 7fb38b200000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb3801f7020 con 0x55ee80660a00 2024-04-25T00:51:09.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.385+0000 7fb38b200000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55ee8046c1f0 con 0x55ee8065e0d0 2024-04-25T00:51:09.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.385+0000 7fb38b200000 10 client.0 _ll_register_callbacks cb 0x7fb37c009060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T00:51:09.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.385+0000 7fb386624640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee80652da0 0x55ee80670470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.385+0000 7fb386624640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee80652da0 0x55ee80670470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55682/0 (socket says 172.21.15.162:55682) 2024-04-25T00:51:09.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.385+0000 7fb386624640 1 -- 172.21.15.162:0/3135110213 learned_addr learned my addr 172.21.15.162:0/3135110213 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:09.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.385+0000 7fb385622640 1 --2- 172.21.15.162:0/3135110213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee8065e0d0 0x55ee806709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.385+0000 7fb386624640 1 --2- 172.21.15.162:0/3135110213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80660a00 0x55ee8068dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.389+0000 7fb386624640 1 -- 172.21.15.162:0/3135110213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee8065e0d0 msgr2=0x55ee806709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:09.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.389+0000 7fb386624640 1 --2- 172.21.15.162:0/3135110213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee8065e0d0 0x55ee806709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.389+0000 7fb386624640 1 -- 172.21.15.162:0/3135110213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80660a00 msgr2=0x55ee8068dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:09.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.389+0000 7fb386624640 1 --2- 172.21.15.162:0/3135110213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80660a00 0x55ee8068dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.389+0000 7fb386624640 1 -- 172.21.15.162:0/3135110213 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee80432760 con 0x55ee80652da0 2024-04-25T00:51:09.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.393+0000 7fb386624640 1 --2- 172.21.15.162:0/3135110213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee80652da0 0x55ee80670470 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb378009010 tx=0x7fb378021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b44f20f81cc135d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:09.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.393+0000 7fb360ff9640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-04-25T00:51:09.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.397+0000 7fb360ff9640 1 -- 172.21.15.162:0/3135110213 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb378027d50 con 0x55ee80652da0 2024-04-25T00:51:09.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.397+0000 7fb360ff9640 1 -- 172.21.15.162:0/3135110213 <== mon.0 v2:172.21.15.162:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fb3780271d0 con 0x55ee80652da0 2024-04-25T00:51:09.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.397+0000 7fb38b200000 1 -- 172.21.15.162:0/3135110213 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3700a9040 con 0x55ee80652da0 2024-04-25T00:51:09.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.401+0000 7fb360ff9640 1 -- 172.21.15.162:0/3135110213 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fb378035050 con 0x55ee80652da0 2024-04-25T00:51:09.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.401+0000 7fb38b200000 10 client.4557 fetch_fsmap learned FSMap version 17 2024-04-25T00:51:09.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.401+0000 7fb38b200000 1 -- 172.21.15.162:0/3135110213 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55ee804be9e0 con 0x55ee80652da0 2024-04-25T00:51:09.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.405+0000 7fb360ff9640 1 -- 172.21.15.162:0/3135110213 <== mon.0 v2:172.21.15.162:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3700a9040 con 0x55ee80652da0 2024-04-25T00:51:09.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.405+0000 7fb360ff9640 1 -- 172.21.15.162:0/3135110213 <== mon.0 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) ==== 4784+0+0 (secure 0 0 0) 0x7fb378038020 con 0x55ee80652da0 2024-04-25T00:51:09.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.405+0000 7fb38b200000 10 client.4557 fetch_fsmap finished waiting for FSMap version 17 2024-04-25T00:51:09.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.405+0000 7fb38b200000 10 client.4557 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T00:51:09.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.405+0000 7fb38b200000 20 client.4557 populate_metadata read hostname 'smithi162' 2024-04-25T00:51:09.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.405+0000 7fb38b200000 1 --2- 172.21.15.162:0/3135110213 >> [v2:172.21.15.179:6836/2607965795,v1:172.21.15.179:6837/2607965795] conn(0x55ee8068e250 0x55ee8068e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.405+0000 7fb38b200000 4 client.4557 mds_command: new command op to 4244 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T00:51:09.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.405+0000 7fb38b200000 1 -- 172.21.15.162:0/3135110213 --> [v2:172.21.15.179:6836/2607965795,v1:172.21.15.179:6837/2607965795] -- command(tid 0: {"prefix": "status"}) -- 0x55ee80472b20 con 0x55ee8068e250 2024-04-25T00:51:09.408 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.405+0000 7fb385622640 1 --2- 172.21.15.162:0/3135110213 >> [v2:172.21.15.179:6836/2607965795,v1:172.21.15.179:6837/2607965795] conn(0x55ee8068e250 0x55ee8068e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.417+0000 7fb385622640 1 --2- 172.21.15.162:0/3135110213 >> [v2:172.21.15.179:6836/2607965795,v1:172.21.15.179:6837/2607965795] conn(0x55ee8068e250 0x55ee8068e630 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=27a541b8866714cc server_cookie=cdb299deda60faf2 in_seq=0 out_seq=0 2024-04-25T00:51:09.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.417+0000 7fb360ff9640 10 client.4557 ms_handle_connect on v2:172.21.15.179:6836/2607965795 2024-04-25T00:51:09.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.437+0000 7fb360ff9640 1 -- 172.21.15.162:0/3135110213 <== mds.1 v2:172.21.15.179:6836/2607965795 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55ee80472b20 con 0x55ee8068e250 2024-04-25T00:51:09.440 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.437+0000 7fb360ff9640 10 client.4557 handle_command_reply: tid=0 2024-04-25T00:51:09.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.437+0000 7fb38b200000 1 client.4557 shutdown 2024-04-25T00:51:09.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.437+0000 7fb38b200000 1 -- 172.21.15.162:0/3135110213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee80652da0 msgr2=0x55ee80670470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:09.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.437+0000 7fb38b200000 1 --2- 172.21.15.162:0/3135110213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee80652da0 0x55ee80670470 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb378009010 tx=0x7fb378021040 comp rx=0 tx=0).stop 2024-04-25T00:51:09.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.437+0000 7fb38b200000 1 -- 172.21.15.162:0/3135110213 shutdown_connections 2024-04-25T00:51:09.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.437+0000 7fb38b200000 1 --2- 172.21.15.162:0/3135110213 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55ee80660a00 0x55ee8068dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.437+0000 7fb38b200000 1 --2- 172.21.15.162:0/3135110213 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55ee8065e0d0 0x55ee806709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.437+0000 7fb38b200000 1 --2- 172.21.15.162:0/3135110213 >> [v2:172.21.15.179:6836/2607965795,v1:172.21.15.179:6837/2607965795] conn(0x55ee8068e250 0x55ee8068e630 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.437+0000 7fb38b200000 1 --2- 172.21.15.162:0/3135110213 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55ee80652da0 0x55ee80670470 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.441 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.437+0000 7fb360ff9640 0 client.4557 ms_handle_reset on v2:172.21.15.179:6836/2607965795 2024-04-25T00:51:09.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.437+0000 7fb38b200000 1 -- 172.21.15.162:0/3135110213 >> 172.21.15.162:0/3135110213 conn(0x55ee80653c10 msgr2=0x55ee8065ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:09.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.437+0000 7fb38b200000 1 -- 172.21.15.162:0/3135110213 shutdown_connections 2024-04-25T00:51:09.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.437+0000 7fb38b200000 1 -- 172.21.15.162:0/3135110213 wait complete. 2024-04-25T00:51:09.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.437+0000 7fb38b200000 20 client.4557 trim_cache size 0 max 16384 2024-04-25T00:51:09.442 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-04-25T00:51:09.443 INFO:teuthology.orchestra.run.smithi162.stdout: "cluster_fsid": "e141deed-4794-4a17-83c9-f6e6e8875f5e", 2024-04-25T00:51:09.443 INFO:teuthology.orchestra.run.smithi162.stdout: "whoami": 1, 2024-04-25T00:51:09.443 INFO:teuthology.orchestra.run.smithi162.stdout: "id": 4244, 2024-04-25T00:51:09.443 INFO:teuthology.orchestra.run.smithi162.stdout: "want_state": "up:active", 2024-04-25T00:51:09.443 INFO:teuthology.orchestra.run.smithi162.stdout: "state": "up:active", 2024-04-25T00:51:09.443 INFO:teuthology.orchestra.run.smithi162.stdout: "fs_name": "cephfs", 2024-04-25T00:51:09.443 INFO:teuthology.orchestra.run.smithi162.stdout: "rank_uptime": 27.260094555999999, 2024-04-25T00:51:09.443 INFO:teuthology.orchestra.run.smithi162.stdout: "mdsmap_epoch": 17, 2024-04-25T00:51:09.444 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_epoch": 26, 2024-04-25T00:51:09.444 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T00:51:09.444 INFO:teuthology.orchestra.run.smithi162.stdout: "uptime": 48.127416803000003 2024-04-25T00:51:09.444 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-04-25T00:51:09.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.441+0000 7fb388087640 1 -- 172.21.15.162:0/3534490855 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb364067940 msgr2=0x7fb364069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:09.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.441+0000 7fb388087640 1 --2- 172.21.15.162:0/3534490855 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb364067940 0x7fb364069e00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb37c000c10 tx=0x7fb37c0046d0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.441+0000 7fb388087640 1 -- 172.21.15.162:0/3534490855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb36c004810 msgr2=0x7fb380147100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:09.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.441+0000 7fb388087640 1 --2- 172.21.15.162:0/3534490855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb36c004810 0x7fb380147100 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00e920 tx=0x7fb37c00ede0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.441+0000 7fb388087640 1 -- 172.21.15.162:0/3534490855 shutdown_connections 2024-04-25T00:51:09.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.441+0000 7fb388087640 1 --2- 172.21.15.162:0/3534490855 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb38015cf00 0x7fb38015d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.441+0000 7fb388087640 1 --2- 172.21.15.162:0/3534490855 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb3801509d0 0x7fb3801577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.441+0000 7fb388087640 1 --2- 172.21.15.162:0/3534490855 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb364067940 0x7fb364069e00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.441+0000 7fb388087640 1 --2- 172.21.15.162:0/3534490855 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb36c004810 0x7fb380147100 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.441+0000 7fb388087640 1 -- 172.21.15.162:0/3534490855 >> 172.21.15.162:0/3534490855 conn(0x7fb380070350 msgr2=0x7fb38014e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:09.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.441+0000 7fb388087640 1 -- 172.21.15.162:0/3534490855 shutdown_connections 2024-04-25T00:51:09.446 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.441+0000 7fb388087640 1 -- 172.21.15.162:0/3534490855 wait complete. 2024-04-25T00:51:09.465 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-25T00:51:09.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.589+0000 7fe0d219b640 1 Processor -- start 2024-04-25T00:51:09.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.589+0000 7fe0d219b640 1 -- start start 2024-04-25T00:51:09.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.589+0000 7fe0d219b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe0cc0cd440 0x7fe0cc0cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.589+0000 7fe0d219b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0cc15b790 con 0x7fe0cc15c230 2024-04-25T00:51:09.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.589+0000 7fe0d219b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0cc158a60 con 0x7fe0cc1523e0 2024-04-25T00:51:09.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.589+0000 7fe0d219b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fe0cc15c6a0 con 0x7fe0cc0cd440 2024-04-25T00:51:09.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.589+0000 7fe0cbfff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe0cc15c230 0x7fe0cc071380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:52518/0 (socket says 172.21.15.162:52518) 2024-04-25T00:51:09.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.589+0000 7fe0cbfff640 1 -- 172.21.15.162:0/407261540 learned_addr learned my addr 172.21.15.162:0/407261540 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T00:51:09.592 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.589+0000 7fe0caffd640 1 --2- 172.21.15.162:0/407261540 >> v2:172.21.15.179:3300/0 conn(0x7fe0cc0cd440 0x7fe0cc0cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.595 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.593+0000 7fe0ca7fc640 1 -- 172.21.15.162:0/407261540 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 765735847 0 0) 0x7fe0cc15b790 con 0x7fe0cc15c230 2024-04-25T00:51:09.595 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.593+0000 7fe0ca7fc640 1 -- 172.21.15.162:0/407261540 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0b8003530 con 0x7fe0cc15c230 2024-04-25T00:51:09.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.597+0000 7fe0caffd640 1 -- 172.21.15.162:0/407261540 >> v1:172.21.15.179:6789/0 conn(0x7fe0cc1523e0 legacy=0x7fe0cc1581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:09.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.597+0000 7fe0caffd640 1 -- 172.21.15.162:0/407261540 >> v1:172.21.15.162:6789/0 conn(0x7fe0cc15c230 legacy=0x7fe0cc071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:09.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.597+0000 7fe0caffd640 1 -- 172.21.15.162:0/407261540 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0cc158d40 con 0x7fe0cc0cd440 2024-04-25T00:51:09.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.605+0000 7fe0caffd640 1 --2- 172.21.15.162:0/407261540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0cc0cd440 0x7fe0cc0cb830 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40097c0 tx=0x7fe0b401eaf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=193561791a4f737c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:09.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.617+0000 7fe0ca7fc640 1 -- 172.21.15.162:0/407261540 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b40b5070 con 0x7fe0cc0cd440 2024-04-25T00:51:09.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.617+0000 7fe0ca7fc640 1 -- 172.21.15.162:0/407261540 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0b40a85b0 con 0x7fe0cc0cd440 2024-04-25T00:51:09.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.617+0000 7fe0ca7fc640 1 -- 172.21.15.162:0/407261540 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc0016a0 con 0x7fe0cc0cd440 2024-04-25T00:51:09.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.617+0000 7fe0d219b640 1 -- 172.21.15.162:0/407261540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0cc0cd440 msgr2=0x7fe0cc0cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:09.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.617+0000 7fe0d219b640 1 --2- 172.21.15.162:0/407261540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0cc0cd440 0x7fe0cc0cb830 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe0b40097c0 tx=0x7fe0b401eaf0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.617+0000 7fe0d219b640 1 -- 172.21.15.162:0/407261540 shutdown_connections 2024-04-25T00:51:09.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.617+0000 7fe0d219b640 1 --2- 172.21.15.162:0/407261540 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0cc0cd440 0x7fe0cc0cb830 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.617+0000 7fe0d219b640 1 -- 172.21.15.162:0/407261540 >> 172.21.15.162:0/407261540 conn(0x7fe0cc06b810 msgr2=0x7fe0cc06f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:09.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.617+0000 7fe0d219b640 1 -- 172.21.15.162:0/407261540 shutdown_connections 2024-04-25T00:51:09.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.617+0000 7fe0d219b640 1 -- 172.21.15.162:0/407261540 wait complete. 2024-04-25T00:51:09.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.621+0000 7fe0d219b640 1 Processor -- start 2024-04-25T00:51:09.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.621+0000 7fe0d219b640 1 -- start start 2024-04-25T00:51:09.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.621+0000 7fe0d219b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0cc0cd440 0x7fe0cc15a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.621+0000 7fe0d219b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0cc1523e0 0x7fe0cc157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.621+0000 7fe0d219b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0cc15c230 0x7fe0cc0cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.621+0000 7fe0d219b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc15bd10 con 0x7fe0cc0cd440 2024-04-25T00:51:09.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.621+0000 7fe0d219b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc15ba30 con 0x7fe0cc15c230 2024-04-25T00:51:09.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.621+0000 7fe0d219b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe0cc1527c0 con 0x7fe0cc1523e0 2024-04-25T00:51:09.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.621+0000 7fe0cb7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0cc0cd440 0x7fe0cc15a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.621+0000 7fe0cb7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0cc0cd440 0x7fe0cc15a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55688/0 (socket says 172.21.15.162:55688) 2024-04-25T00:51:09.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.621+0000 7fe0cb7fe640 1 -- 172.21.15.162:0/1274085288 learned_addr learned my addr 172.21.15.162:0/1274085288 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:09.624 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.621+0000 7fe0caffd640 1 --2- 172.21.15.162:0/1274085288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0cc1523e0 0x7fe0cc157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.625+0000 7fe0cbfff640 1 --2- 172.21.15.162:0/1274085288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0cc15c230 0x7fe0cc0cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.629+0000 7fe0cb7fe640 1 -- 172.21.15.162:0/1274085288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0cc1523e0 msgr2=0x7fe0cc157e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:09.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.629+0000 7fe0cb7fe640 1 --2- 172.21.15.162:0/1274085288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0cc1523e0 0x7fe0cc157e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.629+0000 7fe0cb7fe640 1 -- 172.21.15.162:0/1274085288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0cc15c230 msgr2=0x7fe0cc0cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:09.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.629+0000 7fe0cb7fe640 1 --2- 172.21.15.162:0/1274085288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0cc15c230 0x7fe0cc0cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.629+0000 7fe0cb7fe640 1 -- 172.21.15.162:0/1274085288 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0cc0c2fa0 con 0x7fe0cc0cd440 2024-04-25T00:51:09.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.633+0000 7fe0cb7fe640 1 --2- 172.21.15.162:0/1274085288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0cc0cd440 0x7fe0cc15a180 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400c7d0 tx=0x7fe0c400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:09.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.637+0000 7fe0c3fff640 1 -- 172.21.15.162:0/1274085288 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4017070 con 0x7fe0cc0cd440 2024-04-25T00:51:09.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.637+0000 7fe0c3fff640 1 -- 172.21.15.162:0/1274085288 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c4003db0 con 0x7fe0cc0cd440 2024-04-25T00:51:09.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.637+0000 7fe0c3fff640 1 -- 172.21.15.162:0/1274085288 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c40052b0 con 0x7fe0cc0cd440 2024-04-25T00:51:09.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.637+0000 7fe0d219b640 1 -- 172.21.15.162:0/1274085288 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0cc150e30 con 0x7fe0cc0cd440 2024-04-25T00:51:09.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.637+0000 7fe0d219b640 1 -- 172.21.15.162:0/1274085288 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0cc1507a0 con 0x7fe0cc0cd440 2024-04-25T00:51:09.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.641+0000 7fe0d5314000 1 Processor -- start 2024-04-25T00:51:09.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.641+0000 7fe0d5314000 1 -- start start 2024-04-25T00:51:09.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.641+0000 7fe0d5314000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b853901da0 0x55b853902180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.641+0000 7fe0d5314000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b85390d0d0 0x55b85390f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.641+0000 7fe0d5314000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b85390fa00 0x55b853911df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.641+0000 7fe0d5314000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b8537145e0 con 0x55b85390fa00 2024-04-25T00:51:09.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.641+0000 7fe0d5314000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b85369bc50 con 0x55b85390d0d0 2024-04-25T00:51:09.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.641+0000 7fe0d5314000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55b8537105a0 con 0x55b853901da0 2024-04-25T00:51:09.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.641+0000 7fe0cb7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b85390d0d0 0x55b85390f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.641+0000 7fe0cbfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b853901da0 0x55b853902180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.645+0000 7fe0cbfff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b853901da0 0x55b853902180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:32936/0 (socket says 172.21.15.162:32936) 2024-04-25T00:51:09.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.645+0000 7fe0cbfff640 1 -- 172.21.15.162:0/829748132 learned_addr learned my addr 172.21.15.162:0/829748132 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:09.645 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.645+0000 7fe0cb7fe640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b85390d0d0 0x55b85390f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:36222/0 (socket says 172.21.15.162:36222) 2024-04-25T00:51:09.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.649+0000 7fe0cb7fe640 1 -- 172.21.15.162:0/829748132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b853901da0 msgr2=0x55b853902180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:09.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.649+0000 7fe0cb7fe640 1 --2- 172.21.15.162:0/829748132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b853901da0 0x55b853902180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.649+0000 7fe0cb7fe640 1 -- 172.21.15.162:0/829748132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b85390fa00 msgr2=0x55b853911df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:09.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.649+0000 7fe0cb7fe640 1 --2- 172.21.15.162:0/829748132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b85390fa00 0x55b853911df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.649+0000 7fe0cb7fe640 1 -- 172.21.15.162:0/829748132 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b853699d10 con 0x55b85390d0d0 2024-04-25T00:51:09.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.653+0000 7fe0cb7fe640 1 --2- 172.21.15.162:0/829748132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b85390d0d0 0x55b85390f4c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4014000 tx=0x7fe0c4005000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5de6f5c054ba00c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:09.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.657+0000 7fe0c3fff640 1 -- 172.21.15.162:0/1274085288 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe0c401a070 con 0x7fe0cc0cd440 2024-04-25T00:51:09.660 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.657+0000 7fe0c3fff640 1 --2- 172.21.15.162:0/1274085288 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe0ac067910 0x7fe0ac069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.660 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.657+0000 7fe0cbfff640 1 --2- 172.21.15.162:0/1274085288 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe0ac067910 0x7fe0ac069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.661+0000 7fe0cbfff640 1 --2- 172.21.15.162:0/1274085288 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe0ac067910 0x7fe0ac069dd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc001810 tx=0x7fe0bc007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:09.662 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.661+0000 7fe0c3fff640 1 -- 172.21.15.162:0/1274085288 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fe0c40562b0 con 0x7fe0cc0cd440 2024-04-25T00:51:09.664 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.661+0000 7fe0c17fa640 1 -- 172.21.15.162:0/829748132 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c40544b0 con 0x55b85390d0d0 2024-04-25T00:51:09.664 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.661+0000 7fe0c17fa640 1 -- 172.21.15.162:0/829748132 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c402c070 con 0x55b85390d0d0 2024-04-25T00:51:09.664 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.661+0000 7fe0c17fa640 1 -- 172.21.15.162:0/829748132 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4057b70 con 0x55b85390d0d0 2024-04-25T00:51:09.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0d5314000 1 -- 172.21.15.162:0/829748132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b85390d0d0 msgr2=0x55b85390f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:09.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0d5314000 1 --2- 172.21.15.162:0/829748132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b85390d0d0 0x55b85390f4c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4014000 tx=0x7fe0c4005000 comp rx=0 tx=0).stop 2024-04-25T00:51:09.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0d5314000 1 -- 172.21.15.162:0/829748132 shutdown_connections 2024-04-25T00:51:09.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0d5314000 1 --2- 172.21.15.162:0/829748132 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b85390fa00 0x55b853911df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0d5314000 1 --2- 172.21.15.162:0/829748132 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b85390d0d0 0x55b85390f4c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0d5314000 1 --2- 172.21.15.162:0/829748132 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b853901da0 0x55b853902180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0d5314000 1 -- 172.21.15.162:0/829748132 >> 172.21.15.162:0/829748132 conn(0x55b853902c10 msgr2=0x55b853905000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:09.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0d5314000 1 -- 172.21.15.162:0/829748132 shutdown_connections 2024-04-25T00:51:09.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0d5314000 1 -- 172.21.15.162:0/829748132 wait complete. 2024-04-25T00:51:09.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0d5314000 1 -- start start 2024-04-25T00:51:09.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0d5314000 1 Processor -- start 2024-04-25T00:51:09.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0d5314000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b853901da0 0x55b853909de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0d5314000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b85390d0d0 0x55b85390a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0d5314000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b85390fa00 0x55b85390a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0d5314000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b8536ce520 con 0x55b853901da0 2024-04-25T00:51:09.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0d5314000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b8536e1340 con 0x55b85390fa00 2024-04-25T00:51:09.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0d5314000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55b8536ba810 con 0x55b85390d0d0 2024-04-25T00:51:09.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0d5314000 10 client.0 _ll_register_callbacks cb 0x55b8538b15c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T00:51:09.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0cb7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b853901da0 0x55b853909de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0cb7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b853901da0 0x55b853909de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55714/0 (socket says 172.21.15.162:55714) 2024-04-25T00:51:09.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0cb7fe640 1 -- 172.21.15.162:0/663418731 learned_addr learned my addr 172.21.15.162:0/663418731 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:09.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.665+0000 7fe0caffd640 1 --2- 172.21.15.162:0/663418731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b85390d0d0 0x55b85390a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.669+0000 7fe0cbfff640 1 --2- 172.21.15.162:0/663418731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b85390fa00 0x55b85390a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.669+0000 7fe0cb7fe640 1 -- 172.21.15.162:0/663418731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b85390d0d0 msgr2=0x55b85390a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:09.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.669+0000 7fe0cb7fe640 1 --2- 172.21.15.162:0/663418731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b85390d0d0 0x55b85390a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.669+0000 7fe0cb7fe640 1 -- 172.21.15.162:0/663418731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b85390fa00 msgr2=0x55b85390a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:09.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.669+0000 7fe0cb7fe640 1 --2- 172.21.15.162:0/663418731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b85390fa00 0x55b85390a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.669+0000 7fe0cb7fe640 1 -- 172.21.15.162:0/663418731 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8536ac7b0 con 0x55b853901da0 2024-04-25T00:51:09.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.673+0000 7fe0cb7fe640 1 --2- 172.21.15.162:0/663418731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b853901da0 0x55b853909de0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4054670 tx=0x7fe0c4060d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b56d76df76f53f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:09.673 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.673+0000 7fe0aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-04-25T00:51:09.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.677+0000 7fe0aa7fc640 1 -- 172.21.15.162:0/663418731 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0c4057d50 con 0x55b853901da0 2024-04-25T00:51:09.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.677+0000 7fe0aa7fc640 1 -- 172.21.15.162:0/663418731 <== mon.0 v2:172.21.15.162:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fe0c4058470 con 0x55b853901da0 2024-04-25T00:51:09.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.677+0000 7fe0d5314000 1 -- 172.21.15.162:0/663418731 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0c402c070 con 0x55b853901da0 2024-04-25T00:51:09.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.677+0000 7fe0aa7fc640 1 -- 172.21.15.162:0/663418731 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fe0c4057fe0 con 0x55b853901da0 2024-04-25T00:51:09.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.677+0000 7fe0d5314000 10 client.4566 fetch_fsmap learned FSMap version 17 2024-04-25T00:51:09.679 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.677+0000 7fe0d5314000 1 -- 172.21.15.162:0/663418731 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55b85369bea0 con 0x55b853901da0 2024-04-25T00:51:09.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.681+0000 7fe0aa7fc640 1 -- 172.21.15.162:0/663418731 <== mon.0 v2:172.21.15.162:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0c402c070 con 0x55b853901da0 2024-04-25T00:51:09.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.681+0000 7fe0aa7fc640 1 -- 172.21.15.162:0/663418731 <== mon.0 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) ==== 4784+0+0 (secure 0 0 0) 0x7fe0c40608b0 con 0x55b853901da0 2024-04-25T00:51:09.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.681+0000 7fe0d5314000 10 client.4566 fetch_fsmap finished waiting for FSMap version 17 2024-04-25T00:51:09.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.681+0000 7fe0d5314000 10 client.4566 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T00:51:09.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.681+0000 7fe0d5314000 20 client.4566 populate_metadata read hostname 'smithi162' 2024-04-25T00:51:09.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.681+0000 7fe0d5314000 1 --2- 172.21.15.162:0/663418731 >> [v2:172.21.15.162:6836/1743481688,v1:172.21.15.162:6837/1743481688] conn(0x55b85390b270 0x55b85391d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.681+0000 7fe0d5314000 4 client.4566 mds_command: new command op to 4246 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T00:51:09.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.681+0000 7fe0d5314000 1 -- 172.21.15.162:0/663418731 --> [v2:172.21.15.162:6836/1743481688,v1:172.21.15.162:6837/1743481688] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8536afab0 con 0x55b85390b270 2024-04-25T00:51:09.684 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.681+0000 7fe0caffd640 1 --2- 172.21.15.162:0/663418731 >> [v2:172.21.15.162:6836/1743481688,v1:172.21.15.162:6837/1743481688] conn(0x55b85390b270 0x55b85391d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.727 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.725+0000 7fe0aa7fc640 10 client.4566 ms_handle_connect on v2:172.21.15.162:6836/1743481688 2024-04-25T00:51:09.727 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.725+0000 7fe0caffd640 1 --2- 172.21.15.162:0/663418731 >> [v2:172.21.15.162:6836/1743481688,v1:172.21.15.162:6837/1743481688] conn(0x55b85390b270 0x55b85391d150 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d52de6a81c500fb8 server_cookie=6252b42b3e1bc287 in_seq=0 out_seq=0 2024-04-25T00:51:09.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.905+0000 7fe0aa7fc640 1 -- 172.21.15.162:0/663418731 <== mds.0 v2:172.21.15.162:6836/1743481688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b8536afab0 con 0x55b85390b270 2024-04-25T00:51:09.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.905+0000 7fe0aa7fc640 10 client.4566 handle_command_reply: tid=0 2024-04-25T00:51:09.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.905+0000 7fe0d5314000 1 client.4566 shutdown 2024-04-25T00:51:09.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.905+0000 7fe0d5314000 1 -- 172.21.15.162:0/663418731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b853901da0 msgr2=0x55b853909de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:09.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.905+0000 7fe0d5314000 1 --2- 172.21.15.162:0/663418731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b853901da0 0x55b853909de0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe0c4054670 tx=0x7fe0c4060d40 comp rx=0 tx=0).stop 2024-04-25T00:51:09.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.905+0000 7fe0d5314000 1 -- 172.21.15.162:0/663418731 shutdown_connections 2024-04-25T00:51:09.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.905+0000 7fe0d5314000 1 --2- 172.21.15.162:0/663418731 >> [v2:172.21.15.162:6836/1743481688,v1:172.21.15.162:6837/1743481688] conn(0x55b85390b270 0x55b85391d150 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.905+0000 7fe0d5314000 1 --2- 172.21.15.162:0/663418731 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b85390fa00 0x55b85390a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.909+0000 7fe0d5314000 1 --2- 172.21.15.162:0/663418731 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b85390d0d0 0x55b85390a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.909+0000 7fe0d5314000 1 --2- 172.21.15.162:0/663418731 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b853901da0 0x55b853909de0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.909+0000 7fe0aa7fc640 0 client.4566 ms_handle_reset on v2:172.21.15.162:6836/1743481688 2024-04-25T00:51:09.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.909+0000 7fe0d5314000 1 -- 172.21.15.162:0/663418731 >> 172.21.15.162:0/663418731 conn(0x55b853902c10 msgr2=0x55b853905000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:09.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.909+0000 7fe0d5314000 1 -- 172.21.15.162:0/663418731 shutdown_connections 2024-04-25T00:51:09.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.909+0000 7fe0d5314000 1 -- 172.21.15.162:0/663418731 wait complete. 2024-04-25T00:51:09.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.909+0000 7fe0d5314000 20 client.4566 trim_cache size 0 max 16384 2024-04-25T00:51:09.944 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.941+0000 7fe0d5314000 1 Processor -- start 2024-04-25T00:51:09.944 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.941+0000 7fe0d5314000 1 -- start start 2024-04-25T00:51:09.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.945+0000 7fe0d5314000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b853901da0 0x55b853920180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.945+0000 7fe0d5314000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b85390d0d0 0x55b8539206c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.945+0000 7fe0d5314000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b85390fa00 0x55b85390d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.945+0000 7fe0d5314000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe0cc1f12e0 con 0x55b85390fa00 2024-04-25T00:51:09.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.945+0000 7fe0d5314000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b8536ea2d0 con 0x55b853901da0 2024-04-25T00:51:09.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.945+0000 7fe0d5314000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55b8537138f0 con 0x55b85390d0d0 2024-04-25T00:51:09.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.945+0000 7fe0cbfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b85390fa00 0x55b85390d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.945+0000 7fe0cbfff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b85390fa00 0x55b85390d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55716/0 (socket says 172.21.15.162:55716) 2024-04-25T00:51:09.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.945+0000 7fe0cbfff640 1 -- 172.21.15.162:0/926471387 learned_addr learned my addr 172.21.15.162:0/926471387 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:09.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.945+0000 7fe0cb7fe640 1 --2- 172.21.15.162:0/926471387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b853901da0 0x55b853920180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.947 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.945+0000 7fe0caffd640 1 --2- 172.21.15.162:0/926471387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b85390d0d0 0x55b8539206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.949+0000 7fe0cbfff640 1 -- 172.21.15.162:0/926471387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b85390d0d0 msgr2=0x55b8539206c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:09.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.949+0000 7fe0cbfff640 1 --2- 172.21.15.162:0/926471387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b85390d0d0 0x55b8539206c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.949+0000 7fe0cbfff640 1 -- 172.21.15.162:0/926471387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b853901da0 msgr2=0x55b853920180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:09.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.949+0000 7fe0cbfff640 1 --2- 172.21.15.162:0/926471387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b853901da0 0x55b853920180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.949+0000 7fe0cbfff640 1 -- 172.21.15.162:0/926471387 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b85369ce80 con 0x55b85390fa00 2024-04-25T00:51:09.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.949+0000 7fe0cbfff640 1 --2- 172.21.15.162:0/926471387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b85390fa00 0x55b85390d4b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc011ab0 tx=0x7fe0bc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35411bd6b611cb13 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:09.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0c0ff9640 1 -- 172.21.15.162:0/926471387 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc028070 con 0x55b85390fa00 2024-04-25T00:51:09.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0c0ff9640 1 -- 172.21.15.162:0/926471387 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0bc005cb0 con 0x55b85390fa00 2024-04-25T00:51:09.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0c0ff9640 1 -- 172.21.15.162:0/926471387 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc01b070 con 0x55b85390fa00 2024-04-25T00:51:09.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0d5314000 1 -- 172.21.15.162:0/926471387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b85390fa00 msgr2=0x55b85390d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:09.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0d5314000 1 --2- 172.21.15.162:0/926471387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b85390fa00 0x55b85390d4b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc011ab0 tx=0x7fe0bc014000 comp rx=0 tx=0).stop 2024-04-25T00:51:09.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0d5314000 1 -- 172.21.15.162:0/926471387 shutdown_connections 2024-04-25T00:51:09.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0d5314000 1 --2- 172.21.15.162:0/926471387 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b85390fa00 0x55b85390d4b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0d5314000 1 --2- 172.21.15.162:0/926471387 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b85390d0d0 0x55b8539206c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0d5314000 1 --2- 172.21.15.162:0/926471387 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b853901da0 0x55b853920180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0d5314000 1 -- 172.21.15.162:0/926471387 >> 172.21.15.162:0/926471387 conn(0x55b853902c10 msgr2=0x55b85390bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:09.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0d5314000 1 -- 172.21.15.162:0/926471387 shutdown_connections 2024-04-25T00:51:09.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0d5314000 1 -- 172.21.15.162:0/926471387 wait complete. 2024-04-25T00:51:09.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0d5314000 1 -- start start 2024-04-25T00:51:09.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0d5314000 1 Processor -- start 2024-04-25T00:51:09.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0d5314000 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b853901da0 0x55b85391f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0d5314000 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b85390d0d0 0x55b85391f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0d5314000 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b85390fa00 0x55b853941120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0d5314000 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x55b8536e1340 con 0x55b85390fa00 2024-04-25T00:51:09.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0d5314000 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x55b8536ba810 con 0x55b85390d0d0 2024-04-25T00:51:09.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0d5314000 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x55b8536dd810 con 0x55b853901da0 2024-04-25T00:51:09.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.957+0000 7fe0d5314000 10 client.0 _ll_register_callbacks cb 0x7fe0c40018f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T00:51:09.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.961+0000 7fe0cb7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b853901da0 0x55b85391f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.961+0000 7fe0caffd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b85390d0d0 0x55b85391f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.961+0000 7fe0cb7fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b853901da0 0x55b85391f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:32950/0 (socket says 172.21.15.162:32950) 2024-04-25T00:51:09.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.961+0000 7fe0cb7fe640 1 -- 172.21.15.162:0/2888327688 learned_addr learned my addr 172.21.15.162:0/2888327688 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:09.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.961+0000 7fe0cbfff640 1 --2- 172.21.15.162:0/2888327688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b85390fa00 0x55b853941120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.965+0000 7fe0cbfff640 1 -- 172.21.15.162:0/2888327688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b853901da0 msgr2=0x55b85391f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:09.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.965+0000 7fe0cbfff640 1 --2- 172.21.15.162:0/2888327688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b853901da0 0x55b85391f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.965+0000 7fe0cbfff640 1 -- 172.21.15.162:0/2888327688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b85390d0d0 msgr2=0x55b85391f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:09.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.965+0000 7fe0cbfff640 1 --2- 172.21.15.162:0/2888327688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b85390d0d0 0x55b85391f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:09.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.965+0000 7fe0cbfff640 1 -- 172.21.15.162:0/2888327688 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8536e1760 con 0x55b85390fa00 2024-04-25T00:51:09.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.965+0000 7fe0cbfff640 1 --2- 172.21.15.162:0/2888327688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b85390fa00 0x55b853941120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc025000 tx=0x7fe0bc001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4cc8e3d7023372 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:09.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.965+0000 7fe0aa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.162:3300/0 2024-04-25T00:51:09.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.977+0000 7fe0aa7fc640 1 -- 172.21.15.162:0/2888327688 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc005e60 con 0x55b85390fa00 2024-04-25T00:51:09.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.977+0000 7fe0aa7fc640 1 -- 172.21.15.162:0/2888327688 <== mon.0 v2:172.21.15.162:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fe0bc023b40 con 0x55b85390fa00 2024-04-25T00:51:09.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.977+0000 7fe0d5314000 1 -- 172.21.15.162:0/2888327688 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0bc005cb0 con 0x55b85390fa00 2024-04-25T00:51:09.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.981+0000 7fe0aa7fc640 1 -- 172.21.15.162:0/2888327688 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fe0bc039050 con 0x55b85390fa00 2024-04-25T00:51:09.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.981+0000 7fe0d5314000 10 client.4572 fetch_fsmap learned FSMap version 17 2024-04-25T00:51:09.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.981+0000 7fe0d5314000 1 -- 172.21.15.162:0/2888327688 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55b85376d9e0 con 0x55b85390fa00 2024-04-25T00:51:09.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.989+0000 7fe0aa7fc640 1 -- 172.21.15.162:0/2888327688 <== mon.0 v2:172.21.15.162:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0bc005cb0 con 0x55b85390fa00 2024-04-25T00:51:09.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.989+0000 7fe0aa7fc640 1 -- 172.21.15.162:0/2888327688 <== mon.0 v2:172.21.15.162:3300/0 5 ==== fsmap(e 17) ==== 4784+0+0 (secure 0 0 0) 0x7fe0bc03c020 con 0x55b85390fa00 2024-04-25T00:51:09.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.989+0000 7fe0d5314000 10 client.4572 fetch_fsmap finished waiting for FSMap version 17 2024-04-25T00:51:09.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.989+0000 7fe0d5314000 10 client.4572 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-25T00:51:09.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.989+0000 7fe0d5314000 20 client.4572 populate_metadata read hostname 'smithi162' 2024-04-25T00:51:09.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.989+0000 7fe0d5314000 1 --2- 172.21.15.162:0/2888327688 >> [v2:172.21.15.162:6836/1743481688,v1:172.21.15.162:6837/1743481688] conn(0x55b853941660 0x55b853941a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:09.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.989+0000 7fe0d5314000 4 client.4572 mds_command: new command op to 4246 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T00:51:09.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.989+0000 7fe0d5314000 1 -- 172.21.15.162:0/2888327688 --> [v2:172.21.15.162:6836/1743481688,v1:172.21.15.162:6837/1743481688] -- command(tid 0: {"prefix": "status"}) -- 0x55b853721b20 con 0x55b853941660 2024-04-25T00:51:09.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.989+0000 7fe0cb7fe640 1 --2- 172.21.15.162:0/2888327688 >> [v2:172.21.15.162:6836/1743481688,v1:172.21.15.162:6837/1743481688] conn(0x55b853941660 0x55b853941a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:09.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.993+0000 7fe0cb7fe640 1 --2- 172.21.15.162:0/2888327688 >> [v2:172.21.15.162:6836/1743481688,v1:172.21.15.162:6837/1743481688] conn(0x55b853941660 0x55b853941a40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f77d4c112828c18f server_cookie=4ffaeab504a3cff5 in_seq=0 out_seq=0 2024-04-25T00:51:09.995 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:09.993+0000 7fe0aa7fc640 10 client.4572 ms_handle_connect on v2:172.21.15.162:6836/1743481688 2024-04-25T00:51:10.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.017+0000 7fe0aa7fc640 1 -- 172.21.15.162:0/2888327688 <== mds.0 v2:172.21.15.162:6836/1743481688 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55b853721b20 con 0x55b853941660 2024-04-25T00:51:10.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.017+0000 7fe0aa7fc640 10 client.4572 handle_command_reply: tid=0 2024-04-25T00:51:10.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.017+0000 7fe0d5314000 1 client.4572 shutdown 2024-04-25T00:51:10.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.017+0000 7fe0d5314000 1 -- 172.21.15.162:0/2888327688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b85390fa00 msgr2=0x55b853941120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:10.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.017+0000 7fe0d5314000 1 --2- 172.21.15.162:0/2888327688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b85390fa00 0x55b853941120 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc025000 tx=0x7fe0bc001160 comp rx=0 tx=0).stop 2024-04-25T00:51:10.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.017+0000 7fe0d5314000 1 -- 172.21.15.162:0/2888327688 shutdown_connections 2024-04-25T00:51:10.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.017+0000 7fe0d5314000 1 --2- 172.21.15.162:0/2888327688 >> [v2:172.21.15.162:6836/1743481688,v1:172.21.15.162:6837/1743481688] conn(0x55b853941660 0x55b853941a40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.017+0000 7fe0d5314000 1 --2- 172.21.15.162:0/2888327688 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x55b85390fa00 0x55b853941120 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.017+0000 7fe0aa7fc640 0 client.4572 ms_handle_reset on v2:172.21.15.162:6836/1743481688 2024-04-25T00:51:10.020 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.017+0000 7fe0d5314000 1 --2- 172.21.15.162:0/2888327688 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x55b85390d0d0 0x55b85391f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.017+0000 7fe0d5314000 1 --2- 172.21.15.162:0/2888327688 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x55b853901da0 0x55b85391f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.017+0000 7fe0d5314000 1 -- 172.21.15.162:0/2888327688 >> 172.21.15.162:0/2888327688 conn(0x55b853902c10 msgr2=0x55b8538cafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:10.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.017+0000 7fe0d5314000 1 -- 172.21.15.162:0/2888327688 shutdown_connections 2024-04-25T00:51:10.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.017+0000 7fe0d5314000 1 -- 172.21.15.162:0/2888327688 wait complete. 2024-04-25T00:51:10.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.017+0000 7fe0d5314000 20 client.4572 trim_cache size 0 max 16384 2024-04-25T00:51:10.021 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-04-25T00:51:10.021 INFO:teuthology.orchestra.run.smithi162.stdout: "cluster_fsid": "e141deed-4794-4a17-83c9-f6e6e8875f5e", 2024-04-25T00:51:10.021 INFO:teuthology.orchestra.run.smithi162.stdout: "whoami": 0, 2024-04-25T00:51:10.022 INFO:teuthology.orchestra.run.smithi162.stdout: "id": 4246, 2024-04-25T00:51:10.022 INFO:teuthology.orchestra.run.smithi162.stdout: "want_state": "up:active", 2024-04-25T00:51:10.022 INFO:teuthology.orchestra.run.smithi162.stdout: "state": "up:active", 2024-04-25T00:51:10.022 INFO:teuthology.orchestra.run.smithi162.stdout: "fs_name": "cephfs", 2024-04-25T00:51:10.022 INFO:teuthology.orchestra.run.smithi162.stdout: "rank_uptime": 32.713005338000002, 2024-04-25T00:51:10.022 INFO:teuthology.orchestra.run.smithi162.stdout: "mdsmap_epoch": 17, 2024-04-25T00:51:10.022 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_epoch": 26, 2024-04-25T00:51:10.022 INFO:teuthology.orchestra.run.smithi162.stdout: "osdmap_epoch_barrier": 26, 2024-04-25T00:51:10.022 INFO:teuthology.orchestra.run.smithi162.stdout: "uptime": 51.091121803 2024-04-25T00:51:10.022 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-04-25T00:51:10.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.021+0000 7fe0d219b640 1 -- 172.21.15.162:0/1274085288 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe0ac067910 msgr2=0x7fe0ac069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:10.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.021+0000 7fe0d219b640 1 --2- 172.21.15.162:0/1274085288 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe0ac067910 0x7fe0ac069dd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc001810 tx=0x7fe0bc007040 comp rx=0 tx=0).stop 2024-04-25T00:51:10.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.021+0000 7fe0d219b640 1 -- 172.21.15.162:0/1274085288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0cc0cd440 msgr2=0x7fe0cc15a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:10.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.021+0000 7fe0d219b640 1 --2- 172.21.15.162:0/1274085288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0cc0cd440 0x7fe0cc15a180 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe0c400c7d0 tx=0x7fe0c400cc90 comp rx=0 tx=0).stop 2024-04-25T00:51:10.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.021+0000 7fe0d219b640 1 -- 172.21.15.162:0/1274085288 shutdown_connections 2024-04-25T00:51:10.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.021+0000 7fe0d219b640 1 --2- 172.21.15.162:0/1274085288 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe0cc15c230 0x7fe0cc0cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.021+0000 7fe0d219b640 1 --2- 172.21.15.162:0/1274085288 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe0cc1523e0 0x7fe0cc157e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.021+0000 7fe0d219b640 1 --2- 172.21.15.162:0/1274085288 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe0ac067910 0x7fe0ac069dd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.021+0000 7fe0d219b640 1 --2- 172.21.15.162:0/1274085288 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe0cc0cd440 0x7fe0cc15a180 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.021+0000 7fe0d219b640 1 -- 172.21.15.162:0/1274085288 >> 172.21.15.162:0/1274085288 conn(0x7fe0cc06b810 msgr2=0x7fe0cc0c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:10.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.021+0000 7fe0d219b640 1 -- 172.21.15.162:0/1274085288 shutdown_connections 2024-04-25T00:51:10.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.021+0000 7fe0d219b640 1 -- 172.21.15.162:0/1274085288 wait complete. 2024-04-25T00:51:10.047 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T00:51:10.056 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T00:51:10.057 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T00:51:10.057 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T00:51:10.057 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T00:51:10.101 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T00:51:10.101 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-25T00:51:10.101 INFO:tasks.ceph_fuse:client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-04-25T00:51:10.102 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T00:51:10.102 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T00:51:10.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:10.102 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-04-25T00:51:10.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:10.108 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-04-25T00:51:10.163 INFO:teuthology.orchestra.run.smithi162.stderr:Cannot find device "ceph-brx" 2024-04-25T00:51:10.165 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T00:51:10.165 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T00:51:10.165 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T00:51:10.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.333+0000 7fdc796fa640 1 Processor -- start 2024-04-25T00:51:10.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.333+0000 7fdc796fa640 1 -- start start 2024-04-25T00:51:10.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.333+0000 7fdc796fa640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fdc74152080 0x7fdc741580c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:10.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.333+0000 7fdc796fa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7406b9a0 0x7fdc740c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:10.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.333+0000 7fdc796fa640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdc7415be70 0x7fdc740c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:10.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.333+0000 7fdc796fa640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fdc741586e0 con 0x7fdc7415be70 2024-04-25T00:51:10.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.333+0000 7fdc796fa640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fdc7415b6b0 con 0x7fdc74152080 2024-04-25T00:51:10.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.333+0000 7fdc796fa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdc74070240 con 0x7fdc7406b9a0 2024-04-25T00:51:10.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.333+0000 7fdc737fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdc7415be70 0x7fdc740c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:10.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.333+0000 7fdc737fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fdc7415be70 0x7fdc740c60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55722/0 (socket says 172.21.15.162:55722) 2024-04-25T00:51:10.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.333+0000 7fdc737fe640 1 -- 172.21.15.162:0/4116158845 learned_addr learned my addr 172.21.15.162:0/4116158845 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:10.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.333+0000 7fdc72ffd640 1 --2- 172.21.15.162:0/4116158845 >> v2:172.21.15.179:3300/0 conn(0x7fdc74152080 0x7fdc741580c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:10.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.337+0000 7fdc737fe640 1 -- 172.21.15.162:0/4116158845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7406b9a0 msgr2=0x7fdc740c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:10.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.337+0000 7fdc737fe640 1 --2- 172.21.15.162:0/4116158845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7406b9a0 0x7fdc740c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.337+0000 7fdc737fe640 1 -- 172.21.15.162:0/4116158845 >> v2:172.21.15.179:3300/0 conn(0x7fdc74152080 msgr2=0x7fdc741580c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T00:51:10.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.337+0000 7fdc737fe640 1 --2- 172.21.15.162:0/4116158845 >> v2:172.21.15.179:3300/0 conn(0x7fdc74152080 0x7fdc741580c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.337+0000 7fdc737fe640 1 -- 172.21.15.162:0/4116158845 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc74158980 con 0x7fdc7415be70 2024-04-25T00:51:10.344 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.345+0000 7fdc737fe640 1 --2- 172.21.15.162:0/4116158845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7415be70 0x7fdc740c60f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdc740c6f50 tx=0x7fdc6c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b1d871cf2af5009 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:10.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.349+0000 7fdc71ffb640 1 -- 172.21.15.162:0/4116158845 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c0b4070 con 0x7fdc7415be70 2024-04-25T00:51:10.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.349+0000 7fdc71ffb640 1 -- 172.21.15.162:0/4116158845 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc6c0af400 con 0x7fdc7415be70 2024-04-25T00:51:10.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.349+0000 7fdc71ffb640 1 -- 172.21.15.162:0/4116158845 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c0af7d0 con 0x7fdc7415be70 2024-04-25T00:51:10.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.349+0000 7fdc796fa640 1 -- 172.21.15.162:0/4116158845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7415be70 msgr2=0x7fdc740c60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:10.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.349+0000 7fdc796fa640 1 --2- 172.21.15.162:0/4116158845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7415be70 0x7fdc740c60f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fdc740c6f50 tx=0x7fdc6c01f1e0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.349+0000 7fdc796fa640 1 -- 172.21.15.162:0/4116158845 shutdown_connections 2024-04-25T00:51:10.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.349+0000 7fdc796fa640 1 --2- 172.21.15.162:0/4116158845 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7415be70 0x7fdc740c60f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.349+0000 7fdc796fa640 1 --2- 172.21.15.162:0/4116158845 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc7406b9a0 0x7fdc740c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.349+0000 7fdc796fa640 1 --2- 172.21.15.162:0/4116158845 >> v2:172.21.15.179:3300/0 conn(0x7fdc74152080 0x7fdc741580c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.349+0000 7fdc796fa640 1 -- 172.21.15.162:0/4116158845 >> 172.21.15.162:0/4116158845 conn(0x7fdc740cc9e0 msgr2=0x7fdc740ccdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:10.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.349+0000 7fdc796fa640 1 -- 172.21.15.162:0/4116158845 shutdown_connections 2024-04-25T00:51:10.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.349+0000 7fdc796fa640 1 -- 172.21.15.162:0/4116158845 wait complete. 2024-04-25T00:51:10.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.349+0000 7fdc796fa640 1 Processor -- start 2024-04-25T00:51:10.352 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.349+0000 7fdc796fa640 1 -- start start 2024-04-25T00:51:10.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.353+0000 7fdc796fa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7406b9a0 0x7fdc740c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:10.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.353+0000 7fdc796fa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc74152080 0x7fdc741e3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:10.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.353+0000 7fdc796fa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc7415be70 0x7fdc741ee700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:10.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.353+0000 7fdc796fa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fdc74152460 con 0x7fdc7406b9a0 2024-04-25T00:51:10.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.353+0000 7fdc796fa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fdc74158f40 con 0x7fdc7415be70 2024-04-25T00:51:10.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.353+0000 7fdc796fa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fdc741525e0 con 0x7fdc74152080 2024-04-25T00:51:10.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.353+0000 7fdc72ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7406b9a0 0x7fdc740c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:10.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.353+0000 7fdc72ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7406b9a0 0x7fdc740c78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55728/0 (socket says 172.21.15.162:55728) 2024-04-25T00:51:10.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.353+0000 7fdc72ffd640 1 -- 172.21.15.162:0/2084137806 learned_addr learned my addr 172.21.15.162:0/2084137806 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T00:51:10.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.353+0000 7fdc737fe640 1 --2- 172.21.15.162:0/2084137806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc7415be70 0x7fdc741ee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:10.355 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.353+0000 7fdc727fc640 1 --2- 172.21.15.162:0/2084137806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc74152080 0x7fdc741e3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:10.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.357+0000 7fdc72ffd640 1 -- 172.21.15.162:0/2084137806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc74152080 msgr2=0x7fdc741e3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:10.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.357+0000 7fdc72ffd640 1 --2- 172.21.15.162:0/2084137806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc74152080 0x7fdc741e3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.357+0000 7fdc72ffd640 1 -- 172.21.15.162:0/2084137806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc7415be70 msgr2=0x7fdc741ee700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:10.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.357+0000 7fdc72ffd640 1 --2- 172.21.15.162:0/2084137806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc7415be70 0x7fdc741ee700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.357+0000 7fdc72ffd640 1 -- 172.21.15.162:0/2084137806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc741f1400 con 0x7fdc7406b9a0 2024-04-25T00:51:10.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.357+0000 7fdc72ffd640 1 --2- 172.21.15.162:0/2084137806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7406b9a0 0x7fdc740c78d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400e960 tx=0x7fdc6400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:10.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.361+0000 7fdc5b7fe640 1 -- 172.21.15.162:0/2084137806 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc64017070 con 0x7fdc7406b9a0 2024-04-25T00:51:10.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.361+0000 7fdc5b7fe640 1 -- 172.21.15.162:0/2084137806 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc6400ca00 con 0x7fdc7406b9a0 2024-04-25T00:51:10.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.361+0000 7fdc5b7fe640 1 -- 172.21.15.162:0/2084137806 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6400cdb0 con 0x7fdc7406b9a0 2024-04-25T00:51:10.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.361+0000 7fdc796fa640 1 -- 172.21.15.162:0/2084137806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc741f16a0 con 0x7fdc7406b9a0 2024-04-25T00:51:10.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.361+0000 7fdc796fa640 1 -- 172.21.15.162:0/2084137806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc741f1960 con 0x7fdc7406b9a0 2024-04-25T00:51:10.364 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.365+0000 7fdc796fa640 1 -- 172.21.15.162:0/2084137806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc740ccdc0 con 0x7fdc7406b9a0 2024-04-25T00:51:10.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.381+0000 7fdc5b7fe640 1 -- 172.21.15.162:0/2084137806 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdc6401a070 con 0x7fdc7406b9a0 2024-04-25T00:51:10.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.381+0000 7fdc5b7fe640 1 --2- 172.21.15.162:0/2084137806 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdc60067940 0x7fdc60069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T00:51:10.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.385+0000 7fdc727fc640 1 --2- 172.21.15.162:0/2084137806 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdc60067940 0x7fdc60069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T00:51:10.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.385+0000 7fdc727fc640 1 --2- 172.21.15.162:0/2084137806 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdc60067940 0x7fdc60069e00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdc741ebac0 tx=0x7fdc68009110 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T00:51:10.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.645+0000 7fdc5b7fe640 1 -- 172.21.15.162:0/2084137806 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5709+0+0 (secure 0 0 0) 0x7fdc64054920 con 0x7fdc7406b9a0 2024-04-25T00:51:10.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.645+0000 7fdc5b7fe640 1 -- 172.21.15.162:0/2084137806 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fdc64056880 con 0x7fdc7406b9a0 2024-04-25T00:51:10.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.853+0000 7fdc796fa640 1 -- 172.21.15.162:0/2084137806 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdc740ca2d0 con 0x7fdc7406b9a0 2024-04-25T00:51:10.875 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.873+0000 7fdc5b7fe640 1 -- 172.21.15.162:0/2084137806 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7fdc6405ab80 con 0x7fdc7406b9a0 2024-04-25T00:51:10.876 INFO:teuthology.orchestra.run.smithi162.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T00:51:10.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.877+0000 7fdc796fa640 1 -- 172.21.15.162:0/2084137806 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdc60067940 msgr2=0x7fdc60069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:10.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.877+0000 7fdc796fa640 1 --2- 172.21.15.162:0/2084137806 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdc60067940 0x7fdc60069e00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdc741ebac0 tx=0x7fdc68009110 comp rx=0 tx=0).stop 2024-04-25T00:51:10.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.877+0000 7fdc796fa640 1 -- 172.21.15.162:0/2084137806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7406b9a0 msgr2=0x7fdc740c78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T00:51:10.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.877+0000 7fdc796fa640 1 --2- 172.21.15.162:0/2084137806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7406b9a0 0x7fdc740c78d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400e960 tx=0x7fdc6400ee20 comp rx=0 tx=0).stop 2024-04-25T00:51:10.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.877+0000 7fdc796fa640 1 -- 172.21.15.162:0/2084137806 shutdown_connections 2024-04-25T00:51:10.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.877+0000 7fdc796fa640 1 --2- 172.21.15.162:0/2084137806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fdc7415be70 0x7fdc741ee700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.877+0000 7fdc796fa640 1 --2- 172.21.15.162:0/2084137806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fdc74152080 0x7fdc741e3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.877+0000 7fdc796fa640 1 --2- 172.21.15.162:0/2084137806 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fdc60067940 0x7fdc60069e00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.877+0000 7fdc796fa640 1 --2- 172.21.15.162:0/2084137806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fdc7406b9a0 0x7fdc740c78d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T00:51:10.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.877+0000 7fdc796fa640 1 -- 172.21.15.162:0/2084137806 >> 172.21.15.162:0/2084137806 conn(0x7fdc740cc9e0 msgr2=0x7fdc740ca7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T00:51:10.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.877+0000 7fdc796fa640 1 -- 172.21.15.162:0/2084137806 shutdown_connections 2024-04-25T00:51:10.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10.877+0000 7fdc796fa640 1 -- 172.21.15.162:0/2084137806 wait complete. 2024-04-25T00:51:10.895 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T00:51:10.896 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T00:51:10.896 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi162.front.sepia.ceph.com 2024-04-25T00:51:10.896 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T00:51:10.896 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T00:51:10.896 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T00:51:10.896 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T00:51:10.896 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T00:51:10.896 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T00:51:10.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:10.896 DEBUG:teuthology.orchestra.run.smithi162:> ip addr 2024-04-25T00:51:10.902 INFO:teuthology.orchestra.run.smithi162.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T00:51:10.902 INFO:teuthology.orchestra.run.smithi162.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T00:51:10.902 INFO:teuthology.orchestra.run.smithi162.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T00:51:10.902 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-04-25T00:51:10.902 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 ::1/128 scope host 2024-04-25T00:51:10.902 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-04-25T00:51:10.902 INFO:teuthology.orchestra.run.smithi162.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T00:51:10.902 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f8 brd ff:ff:ff:ff:ff:ff 2024-04-25T00:51:10.902 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f0 2024-04-25T00:51:10.903 INFO:teuthology.orchestra.run.smithi162.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T00:51:10.903 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:d9:37:f9 brd ff:ff:ff:ff:ff:ff 2024-04-25T00:51:10.903 INFO:teuthology.orchestra.run.smithi162.stdout: altname enp7s0f1 2024-04-25T00:51:10.903 INFO:teuthology.orchestra.run.smithi162.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-25T00:51:10.903 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:40 brd ff:ff:ff:ff:ff:ff 2024-04-25T00:51:10.903 INFO:teuthology.orchestra.run.smithi162.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T00:51:10.903 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 0c:c4:7a:88:7f:41 brd ff:ff:ff:ff:ff:ff 2024-04-25T00:51:10.903 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.21.15.162/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-25T00:51:10.903 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft 42006sec preferred_lft 42006sec 2024-04-25T00:51:10.903 INFO:teuthology.orchestra.run.smithi162.stdout: inet6 fe80::ec4:7aff:fe88:7f41/64 scope link 2024-04-25T00:51:10.903 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-04-25T00:51:10.903 INFO:teuthology.orchestra.run.smithi162.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-25T00:51:10.903 INFO:teuthology.orchestra.run.smithi162.stdout: link/ether 02:42:d9:9e:9a:37 brd ff:ff:ff:ff:ff:ff 2024-04-25T00:51:10.903 INFO:teuthology.orchestra.run.smithi162.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-25T00:51:10.904 INFO:teuthology.orchestra.run.smithi162.stdout: valid_lft forever preferred_lft forever 2024-04-25T00:51:10.906 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T00:51:10.906 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T00:51:10.906 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-04-25T00:51:10.906 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add name ceph-brx type bridge 2024-04-25T00:51:10.906 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr flush dev ceph-brx 2024-04-25T00:51:10.906 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set ceph-brx up 2024-04-25T00:51:10.906 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T00:51:10.906 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-04-25T00:51:10.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T00:51:11.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T00:51:11.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:11.029 DEBUG:teuthology.orchestra.run.smithi162:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T00:51:11.081 INFO:teuthology.orchestra.run.smithi162.stdout:1 2024-04-25T00:51:11.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:11.082 DEBUG:teuthology.orchestra.run.smithi162:> route 2024-04-25T00:51:11.180 INFO:teuthology.orchestra.run.smithi162.stdout:Kernel IP routing table 2024-04-25T00:51:11.181 INFO:teuthology.orchestra.run.smithi162.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T00:51:11.181 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-25T00:51:11.181 INFO:teuthology.orchestra.run.smithi162.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T00:51:11.181 INFO:teuthology.orchestra.run.smithi162.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-25T00:51:11.181 INFO:teuthology.orchestra.run.smithi162.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-25T00:51:11.181 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T00:51:11.181 INFO:teuthology.orchestra.run.smithi162.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T00:51:11.181 INFO:teuthology.orchestra.run.smithi162.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T00:51:11.181 INFO:teuthology.orchestra.run.smithi162.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-25T00:51:11.181 INFO:teuthology.orchestra.run.smithi162.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T00:51:11.182 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T00:51:11.182 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-04-25T00:51:11.182 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T00:51:11.182 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T00:51:11.182 DEBUG:teuthology.orchestra.run.smithi162:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T00:51:11.182 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-04-25T00:51:11.234 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T00:51:11.258 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T00:51:11.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:11.265 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-04-25T00:51:11.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:11.273 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list-id 2024-04-25T00:51:11.326 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T00:51:11.326 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-04-25T00:51:11.326 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:11.326 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T00:51:11.326 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-04-25T00:51:11.414 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T00:51:11.434 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T00:51:11.443 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T00:51:11.443 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T00:51:11.443 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-04-25T00:51:11.443 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T00:51:11.443 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T00:51:11.443 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T00:51:11.443 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T00:51:11.443 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T00:51:11.443 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-04-25T00:51:11.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T00:51:11.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T00:51:11.542 DEBUG:teuthology.orchestra.run.smithi162:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T00:51:11.542 DEBUG:teuthology.orchestra.run.smithi162:> set -e 2024-04-25T00:51:11.542 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set brx.0 up 2024-04-25T00:51:11.543 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T00:51:11.543 DEBUG:teuthology.orchestra.run.smithi162:> ') 2024-04-25T00:51:11.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T00:51:11.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T00:51:11.645 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'valgrind': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes']} 2024-04-25T00:51:11.645 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T00:51:11.645 DEBUG:teuthology.orchestra.run.smithi162:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T00:51:11.693 INFO:teuthology.orchestra.run.smithi162.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T00:51:11.693 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T00:51:11.693 DEBUG:teuthology.orchestra.run.smithi162:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T00:51:11.741 DEBUG:tasks.ceph_manager:running client.0 under valgrind with args ['sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/client.0.log', '--time-stamp=yes', '--vgdb=yes', '--exit-on-first-error=yes', '--error-exitcode=42', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2024-04-25T00:51:11.741 DEBUG:teuthology.orchestra.run.smithi162:> sudo modprobe fuse 2024-04-25T00:51:11.796 DEBUG:teuthology.orchestra.run.smithi162:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T00:51:11.849 INFO:teuthology.orchestra.run.smithi162.stdout:/sys 2024-04-25T00:51:11.849 INFO:teuthology.orchestra.run.smithi162.stdout:/proc 2024-04-25T00:51:11.849 INFO:teuthology.orchestra.run.smithi162.stdout:/dev 2024-04-25T00:51:11.849 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/pts 2024-04-25T00:51:11.850 INFO:teuthology.orchestra.run.smithi162.stdout:/run 2024-04-25T00:51:11.850 INFO:teuthology.orchestra.run.smithi162.stdout:/ 2024-04-25T00:51:11.850 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/security 2024-04-25T00:51:11.850 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/shm 2024-04-25T00:51:11.850 INFO:teuthology.orchestra.run.smithi162.stdout:/run/lock 2024-04-25T00:51:11.850 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/cgroup 2024-04-25T00:51:11.850 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/pstore 2024-04-25T00:51:11.850 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/bpf 2024-04-25T00:51:11.850 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T00:51:11.850 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/hugepages 2024-04-25T00:51:11.850 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/mqueue 2024-04-25T00:51:11.850 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/debug 2024-04-25T00:51:11.850 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/tracing 2024-04-25T00:51:11.851 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/fs/nfsd 2024-04-25T00:51:11.851 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/fuse/connections 2024-04-25T00:51:11.851 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/config 2024-04-25T00:51:11.851 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T00:51:11.851 INFO:teuthology.orchestra.run.smithi162.stdout:/run/rpc_pipefs 2024-04-25T00:51:11.851 INFO:teuthology.orchestra.run.smithi162.stdout:/run/user/1000 2024-04-25T00:51:11.851 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph 2024-04-25T00:51:11.851 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T00:51:11.851 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T00:51:11.851 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T00:51:11.851 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T00:51:11.851 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns 2024-04-25T00:51:11.851 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:11.851 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:11.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:11.852 DEBUG:teuthology.orchestra.run.smithi162:> ls /sys/fs/fuse/connections 2024-04-25T00:51:11.905 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T00:51:11.906 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/client.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck --leak-check=full --show-reachable=yes ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-25T00:51:11.950 DEBUG:teuthology.orchestra.run.smithi162:> sudo modprobe fuse 2024-04-25T00:51:11.963 DEBUG:teuthology.orchestra.run.smithi162:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T00:51:12.009 INFO:teuthology.orchestra.run.smithi162.stdout:/sys 2024-04-25T00:51:12.010 INFO:teuthology.orchestra.run.smithi162.stdout:/proc 2024-04-25T00:51:12.010 INFO:teuthology.orchestra.run.smithi162.stdout:/dev 2024-04-25T00:51:12.010 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/pts 2024-04-25T00:51:12.010 INFO:teuthology.orchestra.run.smithi162.stdout:/run 2024-04-25T00:51:12.010 INFO:teuthology.orchestra.run.smithi162.stdout:/ 2024-04-25T00:51:12.010 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/security 2024-04-25T00:51:12.010 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/shm 2024-04-25T00:51:12.010 INFO:teuthology.orchestra.run.smithi162.stdout:/run/lock 2024-04-25T00:51:12.010 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/cgroup 2024-04-25T00:51:12.010 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/pstore 2024-04-25T00:51:12.010 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/bpf 2024-04-25T00:51:12.011 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T00:51:12.011 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/hugepages 2024-04-25T00:51:12.011 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/mqueue 2024-04-25T00:51:12.011 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/debug 2024-04-25T00:51:12.011 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/tracing 2024-04-25T00:51:12.011 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/fs/nfsd 2024-04-25T00:51:12.011 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/fuse/connections 2024-04-25T00:51:12.011 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/config 2024-04-25T00:51:12.011 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T00:51:12.011 INFO:teuthology.orchestra.run.smithi162.stdout:/run/rpc_pipefs 2024-04-25T00:51:12.011 INFO:teuthology.orchestra.run.smithi162.stdout:/run/user/1000 2024-04-25T00:51:12.011 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph 2024-04-25T00:51:12.011 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T00:51:12.012 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T00:51:12.012 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T00:51:12.012 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T00:51:12.012 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns 2024-04-25T00:51:12.012 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:12.012 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:12.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:12.013 DEBUG:teuthology.orchestra.run.smithi162:> ls /sys/fs/fuse/connections 2024-04-25T00:51:13.162 DEBUG:teuthology.orchestra.run.smithi162:> sudo modprobe fuse 2024-04-25T00:51:13.175 DEBUG:teuthology.orchestra.run.smithi162:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T00:51:13.223 INFO:teuthology.orchestra.run.smithi162.stdout:/sys 2024-04-25T00:51:13.223 INFO:teuthology.orchestra.run.smithi162.stdout:/proc 2024-04-25T00:51:13.223 INFO:teuthology.orchestra.run.smithi162.stdout:/dev 2024-04-25T00:51:13.224 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/pts 2024-04-25T00:51:13.224 INFO:teuthology.orchestra.run.smithi162.stdout:/run 2024-04-25T00:51:13.224 INFO:teuthology.orchestra.run.smithi162.stdout:/ 2024-04-25T00:51:13.224 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/security 2024-04-25T00:51:13.224 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/shm 2024-04-25T00:51:13.224 INFO:teuthology.orchestra.run.smithi162.stdout:/run/lock 2024-04-25T00:51:13.224 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/cgroup 2024-04-25T00:51:13.224 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/pstore 2024-04-25T00:51:13.224 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/bpf 2024-04-25T00:51:13.224 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T00:51:13.224 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/hugepages 2024-04-25T00:51:13.224 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/mqueue 2024-04-25T00:51:13.224 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/debug 2024-04-25T00:51:13.224 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/tracing 2024-04-25T00:51:13.224 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/fs/nfsd 2024-04-25T00:51:13.224 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/fuse/connections 2024-04-25T00:51:13.225 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/config 2024-04-25T00:51:13.225 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T00:51:13.225 INFO:teuthology.orchestra.run.smithi162.stdout:/run/rpc_pipefs 2024-04-25T00:51:13.225 INFO:teuthology.orchestra.run.smithi162.stdout:/run/user/1000 2024-04-25T00:51:13.225 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph 2024-04-25T00:51:13.225 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T00:51:13.225 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T00:51:13.225 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T00:51:13.225 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T00:51:13.225 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns 2024-04-25T00:51:13.225 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:13.225 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:13.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:13.226 DEBUG:teuthology.orchestra.run.smithi162:> ls /sys/fs/fuse/connections 2024-04-25T00:51:14.373 DEBUG:teuthology.orchestra.run.smithi162:> sudo modprobe fuse 2024-04-25T00:51:14.387 DEBUG:teuthology.orchestra.run.smithi162:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T00:51:14.433 INFO:teuthology.orchestra.run.smithi162.stdout:/sys 2024-04-25T00:51:14.433 INFO:teuthology.orchestra.run.smithi162.stdout:/proc 2024-04-25T00:51:14.434 INFO:teuthology.orchestra.run.smithi162.stdout:/dev 2024-04-25T00:51:14.434 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/pts 2024-04-25T00:51:14.434 INFO:teuthology.orchestra.run.smithi162.stdout:/run 2024-04-25T00:51:14.434 INFO:teuthology.orchestra.run.smithi162.stdout:/ 2024-04-25T00:51:14.434 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/security 2024-04-25T00:51:14.434 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/shm 2024-04-25T00:51:14.434 INFO:teuthology.orchestra.run.smithi162.stdout:/run/lock 2024-04-25T00:51:14.434 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/cgroup 2024-04-25T00:51:14.434 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/pstore 2024-04-25T00:51:14.434 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/bpf 2024-04-25T00:51:14.434 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T00:51:14.434 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/hugepages 2024-04-25T00:51:14.434 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/mqueue 2024-04-25T00:51:14.435 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/debug 2024-04-25T00:51:14.435 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/tracing 2024-04-25T00:51:14.435 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/fs/nfsd 2024-04-25T00:51:14.435 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/fuse/connections 2024-04-25T00:51:14.435 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/config 2024-04-25T00:51:14.435 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T00:51:14.435 INFO:teuthology.orchestra.run.smithi162.stdout:/run/rpc_pipefs 2024-04-25T00:51:14.435 INFO:teuthology.orchestra.run.smithi162.stdout:/run/user/1000 2024-04-25T00:51:14.435 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph 2024-04-25T00:51:14.435 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T00:51:14.435 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T00:51:14.435 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T00:51:14.435 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T00:51:14.435 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns 2024-04-25T00:51:14.435 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:14.436 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:14.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:14.437 DEBUG:teuthology.orchestra.run.smithi162:> ls /sys/fs/fuse/connections 2024-04-25T00:51:15.586 DEBUG:teuthology.orchestra.run.smithi162:> sudo modprobe fuse 2024-04-25T00:51:15.599 DEBUG:teuthology.orchestra.run.smithi162:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T00:51:15.645 INFO:teuthology.orchestra.run.smithi162.stdout:/sys 2024-04-25T00:51:15.646 INFO:teuthology.orchestra.run.smithi162.stdout:/proc 2024-04-25T00:51:15.646 INFO:teuthology.orchestra.run.smithi162.stdout:/dev 2024-04-25T00:51:15.646 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/pts 2024-04-25T00:51:15.646 INFO:teuthology.orchestra.run.smithi162.stdout:/run 2024-04-25T00:51:15.646 INFO:teuthology.orchestra.run.smithi162.stdout:/ 2024-04-25T00:51:15.646 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/security 2024-04-25T00:51:15.646 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/shm 2024-04-25T00:51:15.646 INFO:teuthology.orchestra.run.smithi162.stdout:/run/lock 2024-04-25T00:51:15.646 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/cgroup 2024-04-25T00:51:15.646 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/pstore 2024-04-25T00:51:15.646 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/bpf 2024-04-25T00:51:15.646 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T00:51:15.646 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/hugepages 2024-04-25T00:51:15.646 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/mqueue 2024-04-25T00:51:15.647 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/debug 2024-04-25T00:51:15.647 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/tracing 2024-04-25T00:51:15.647 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/fs/nfsd 2024-04-25T00:51:15.647 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/fuse/connections 2024-04-25T00:51:15.647 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/config 2024-04-25T00:51:15.647 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T00:51:15.647 INFO:teuthology.orchestra.run.smithi162.stdout:/run/rpc_pipefs 2024-04-25T00:51:15.647 INFO:teuthology.orchestra.run.smithi162.stdout:/run/user/1000 2024-04-25T00:51:15.647 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph 2024-04-25T00:51:15.647 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T00:51:15.647 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T00:51:15.647 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T00:51:15.647 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T00:51:15.647 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns 2024-04-25T00:51:15.647 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:15.648 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:15.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:15.648 DEBUG:teuthology.orchestra.run.smithi162:> ls /sys/fs/fuse/connections 2024-04-25T00:51:16.798 DEBUG:teuthology.orchestra.run.smithi162:> sudo modprobe fuse 2024-04-25T00:51:16.811 DEBUG:teuthology.orchestra.run.smithi162:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T00:51:16.858 INFO:teuthology.orchestra.run.smithi162.stdout:/sys 2024-04-25T00:51:16.858 INFO:teuthology.orchestra.run.smithi162.stdout:/proc 2024-04-25T00:51:16.858 INFO:teuthology.orchestra.run.smithi162.stdout:/dev 2024-04-25T00:51:16.858 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/pts 2024-04-25T00:51:16.858 INFO:teuthology.orchestra.run.smithi162.stdout:/run 2024-04-25T00:51:16.858 INFO:teuthology.orchestra.run.smithi162.stdout:/ 2024-04-25T00:51:16.858 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/security 2024-04-25T00:51:16.858 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/shm 2024-04-25T00:51:16.858 INFO:teuthology.orchestra.run.smithi162.stdout:/run/lock 2024-04-25T00:51:16.858 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/cgroup 2024-04-25T00:51:16.859 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/pstore 2024-04-25T00:51:16.859 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/bpf 2024-04-25T00:51:16.859 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T00:51:16.859 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/hugepages 2024-04-25T00:51:16.859 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/mqueue 2024-04-25T00:51:16.859 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/debug 2024-04-25T00:51:16.859 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/tracing 2024-04-25T00:51:16.859 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/fs/nfsd 2024-04-25T00:51:16.859 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/fuse/connections 2024-04-25T00:51:16.859 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/config 2024-04-25T00:51:16.859 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T00:51:16.859 INFO:teuthology.orchestra.run.smithi162.stdout:/run/rpc_pipefs 2024-04-25T00:51:16.859 INFO:teuthology.orchestra.run.smithi162.stdout:/run/user/1000 2024-04-25T00:51:16.859 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph 2024-04-25T00:51:16.860 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T00:51:16.860 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T00:51:16.860 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T00:51:16.860 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T00:51:16.860 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns 2024-04-25T00:51:16.860 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:16.860 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:16.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:16.861 DEBUG:teuthology.orchestra.run.smithi162:> ls /sys/fs/fuse/connections 2024-04-25T00:51:18.011 DEBUG:teuthology.orchestra.run.smithi162:> sudo modprobe fuse 2024-04-25T00:51:18.025 DEBUG:teuthology.orchestra.run.smithi162:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T00:51:18.073 INFO:teuthology.orchestra.run.smithi162.stdout:/sys 2024-04-25T00:51:18.073 INFO:teuthology.orchestra.run.smithi162.stdout:/proc 2024-04-25T00:51:18.073 INFO:teuthology.orchestra.run.smithi162.stdout:/dev 2024-04-25T00:51:18.073 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/pts 2024-04-25T00:51:18.073 INFO:teuthology.orchestra.run.smithi162.stdout:/run 2024-04-25T00:51:18.074 INFO:teuthology.orchestra.run.smithi162.stdout:/ 2024-04-25T00:51:18.074 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/security 2024-04-25T00:51:18.074 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/shm 2024-04-25T00:51:18.074 INFO:teuthology.orchestra.run.smithi162.stdout:/run/lock 2024-04-25T00:51:18.074 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/cgroup 2024-04-25T00:51:18.074 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/pstore 2024-04-25T00:51:18.074 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/bpf 2024-04-25T00:51:18.074 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T00:51:18.074 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/hugepages 2024-04-25T00:51:18.074 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/mqueue 2024-04-25T00:51:18.074 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/debug 2024-04-25T00:51:18.074 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/tracing 2024-04-25T00:51:18.074 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/fs/nfsd 2024-04-25T00:51:18.075 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/fuse/connections 2024-04-25T00:51:18.075 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/config 2024-04-25T00:51:18.075 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T00:51:18.075 INFO:teuthology.orchestra.run.smithi162.stdout:/run/rpc_pipefs 2024-04-25T00:51:18.075 INFO:teuthology.orchestra.run.smithi162.stdout:/run/user/1000 2024-04-25T00:51:18.075 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph 2024-04-25T00:51:18.075 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T00:51:18.075 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T00:51:18.075 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T00:51:18.075 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T00:51:18.075 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns 2024-04-25T00:51:18.075 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:18.075 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:18.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:18.076 DEBUG:teuthology.orchestra.run.smithi162:> ls /sys/fs/fuse/connections 2024-04-25T00:51:18.747 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi162.stderr:ceph-fuse[35320]: starting ceph client 2024-04-25T00:51:18.838 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi162.stderr:2024-04-25T00:51:18.625+0000 690c100 -1 init, newargv = 0x7e819c0 newargc=15 2024-04-25T00:51:19.226 DEBUG:teuthology.orchestra.run.smithi162:> sudo modprobe fuse 2024-04-25T00:51:19.262 DEBUG:teuthology.orchestra.run.smithi162:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T00:51:19.315 INFO:teuthology.orchestra.run.smithi162.stdout:/sys 2024-04-25T00:51:19.315 INFO:teuthology.orchestra.run.smithi162.stdout:/proc 2024-04-25T00:51:19.315 INFO:teuthology.orchestra.run.smithi162.stdout:/dev 2024-04-25T00:51:19.315 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/pts 2024-04-25T00:51:19.315 INFO:teuthology.orchestra.run.smithi162.stdout:/run 2024-04-25T00:51:19.315 INFO:teuthology.orchestra.run.smithi162.stdout:/ 2024-04-25T00:51:19.315 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/security 2024-04-25T00:51:19.315 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/shm 2024-04-25T00:51:19.315 INFO:teuthology.orchestra.run.smithi162.stdout:/run/lock 2024-04-25T00:51:19.315 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/cgroup 2024-04-25T00:51:19.315 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/pstore 2024-04-25T00:51:19.315 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/bpf 2024-04-25T00:51:19.316 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T00:51:19.316 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/hugepages 2024-04-25T00:51:19.316 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/mqueue 2024-04-25T00:51:19.316 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/debug 2024-04-25T00:51:19.316 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/tracing 2024-04-25T00:51:19.316 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/fs/nfsd 2024-04-25T00:51:19.316 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/fuse/connections 2024-04-25T00:51:19.316 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/config 2024-04-25T00:51:19.316 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T00:51:19.316 INFO:teuthology.orchestra.run.smithi162.stdout:/run/rpc_pipefs 2024-04-25T00:51:19.316 INFO:teuthology.orchestra.run.smithi162.stdout:/run/user/1000 2024-04-25T00:51:19.316 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph 2024-04-25T00:51:19.316 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T00:51:19.317 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T00:51:19.317 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T00:51:19.317 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T00:51:19.317 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns 2024-04-25T00:51:19.317 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:19.317 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:19.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:19.318 DEBUG:teuthology.orchestra.run.smithi162:> ls /sys/fs/fuse/connections 2024-04-25T00:51:20.462 DEBUG:teuthology.orchestra.run.smithi162:> sudo modprobe fuse 2024-04-25T00:51:20.478 DEBUG:teuthology.orchestra.run.smithi162:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T00:51:20.526 INFO:teuthology.orchestra.run.smithi162.stdout:/sys 2024-04-25T00:51:20.526 INFO:teuthology.orchestra.run.smithi162.stdout:/proc 2024-04-25T00:51:20.526 INFO:teuthology.orchestra.run.smithi162.stdout:/dev 2024-04-25T00:51:20.526 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/pts 2024-04-25T00:51:20.526 INFO:teuthology.orchestra.run.smithi162.stdout:/run 2024-04-25T00:51:20.526 INFO:teuthology.orchestra.run.smithi162.stdout:/ 2024-04-25T00:51:20.526 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/security 2024-04-25T00:51:20.526 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/shm 2024-04-25T00:51:20.526 INFO:teuthology.orchestra.run.smithi162.stdout:/run/lock 2024-04-25T00:51:20.526 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/cgroup 2024-04-25T00:51:20.526 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/pstore 2024-04-25T00:51:20.527 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/bpf 2024-04-25T00:51:20.527 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T00:51:20.527 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/hugepages 2024-04-25T00:51:20.527 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/mqueue 2024-04-25T00:51:20.527 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/debug 2024-04-25T00:51:20.527 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/tracing 2024-04-25T00:51:20.527 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/fs/nfsd 2024-04-25T00:51:20.527 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/fuse/connections 2024-04-25T00:51:20.527 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/config 2024-04-25T00:51:20.527 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T00:51:20.527 INFO:teuthology.orchestra.run.smithi162.stdout:/run/rpc_pipefs 2024-04-25T00:51:20.527 INFO:teuthology.orchestra.run.smithi162.stdout:/run/user/1000 2024-04-25T00:51:20.527 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph 2024-04-25T00:51:20.527 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T00:51:20.527 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T00:51:20.528 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T00:51:20.528 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T00:51:20.528 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns 2024-04-25T00:51:20.528 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:20.528 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:20.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:20.529 DEBUG:teuthology.orchestra.run.smithi162:> ls /sys/fs/fuse/connections 2024-04-25T00:51:20.780 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi162.stderr:ceph-fuse[35320]: starting fuse 2024-04-25T00:51:21.678 DEBUG:teuthology.orchestra.run.smithi162:> sudo modprobe fuse 2024-04-25T00:51:21.695 DEBUG:teuthology.orchestra.run.smithi162:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T00:51:21.746 INFO:teuthology.orchestra.run.smithi162.stdout:/sys 2024-04-25T00:51:21.746 INFO:teuthology.orchestra.run.smithi162.stdout:/proc 2024-04-25T00:51:21.746 INFO:teuthology.orchestra.run.smithi162.stdout:/dev 2024-04-25T00:51:21.746 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/pts 2024-04-25T00:51:21.746 INFO:teuthology.orchestra.run.smithi162.stdout:/run 2024-04-25T00:51:21.746 INFO:teuthology.orchestra.run.smithi162.stdout:/ 2024-04-25T00:51:21.746 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/security 2024-04-25T00:51:21.746 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/shm 2024-04-25T00:51:21.746 INFO:teuthology.orchestra.run.smithi162.stdout:/run/lock 2024-04-25T00:51:21.747 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/cgroup 2024-04-25T00:51:21.747 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/pstore 2024-04-25T00:51:21.747 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/bpf 2024-04-25T00:51:21.747 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T00:51:21.747 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/hugepages 2024-04-25T00:51:21.747 INFO:teuthology.orchestra.run.smithi162.stdout:/dev/mqueue 2024-04-25T00:51:21.747 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/debug 2024-04-25T00:51:21.747 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/tracing 2024-04-25T00:51:21.747 INFO:teuthology.orchestra.run.smithi162.stdout:/proc/fs/nfsd 2024-04-25T00:51:21.747 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/fs/fuse/connections 2024-04-25T00:51:21.747 INFO:teuthology.orchestra.run.smithi162.stdout:/sys/kernel/config 2024-04-25T00:51:21.747 INFO:teuthology.orchestra.run.smithi162.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T00:51:21.747 INFO:teuthology.orchestra.run.smithi162.stdout:/run/rpc_pipefs 2024-04-25T00:51:21.747 INFO:teuthology.orchestra.run.smithi162.stdout:/run/user/1000 2024-04-25T00:51:21.747 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph 2024-04-25T00:51:21.747 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T00:51:21.747 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T00:51:21.748 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T00:51:21.748 INFO:teuthology.orchestra.run.smithi162.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T00:51:21.748 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns 2024-04-25T00:51:21.748 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:21.748 INFO:teuthology.orchestra.run.smithi162.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T00:51:21.748 INFO:teuthology.orchestra.run.smithi162.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-25T00:51:21.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:21.749 DEBUG:teuthology.orchestra.run.smithi162:> ls /sys/fs/fuse/connections 2024-04-25T00:51:21.797 INFO:teuthology.orchestra.run.smithi162.stdout:45 2024-04-25T00:51:21.797 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-25T00:51:21.798 DEBUG:teuthology.orchestra.run.smithi162:> sudo stdin-killer -- python3 -c ' 2024-04-25T00:51:21.798 DEBUG:teuthology.orchestra.run.smithi162:> import glob 2024-04-25T00:51:21.798 DEBUG:teuthology.orchestra.run.smithi162:> import re 2024-04-25T00:51:21.798 DEBUG:teuthology.orchestra.run.smithi162:> import os 2024-04-25T00:51:21.798 DEBUG:teuthology.orchestra.run.smithi162:> import subprocess 2024-04-25T00:51:21.798 DEBUG:teuthology.orchestra.run.smithi162:> 2024-04-25T00:51:21.798 DEBUG:teuthology.orchestra.run.smithi162:> def _find_admin_socket(client_name): 2024-04-25T00:51:21.798 DEBUG:teuthology.orchestra.run.smithi162:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T00:51:21.798 DEBUG:teuthology.orchestra.run.smithi162:> files = glob.glob(asok_path) 2024-04-25T00:51:21.798 DEBUG:teuthology.orchestra.run.smithi162:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T00:51:21.798 DEBUG:teuthology.orchestra.run.smithi162:> 2024-04-25T00:51:21.798 DEBUG:teuthology.orchestra.run.smithi162:> # Given a non-glob path, it better be there 2024-04-25T00:51:21.799 DEBUG:teuthology.orchestra.run.smithi162:> if "*" not in asok_path: 2024-04-25T00:51:21.799 DEBUG:teuthology.orchestra.run.smithi162:> assert(len(files) == 1) 2024-04-25T00:51:21.799 DEBUG:teuthology.orchestra.run.smithi162:> return files[0] 2024-04-25T00:51:21.799 DEBUG:teuthology.orchestra.run.smithi162:> 2024-04-25T00:51:21.799 DEBUG:teuthology.orchestra.run.smithi162:> for f in files: 2024-04-25T00:51:21.799 DEBUG:teuthology.orchestra.run.smithi162:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T00:51:21.799 DEBUG:teuthology.orchestra.run.smithi162:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T00:51:21.799 DEBUG:teuthology.orchestra.run.smithi162:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T00:51:21.799 DEBUG:teuthology.orchestra.run.smithi162:> contents = proc_f.read() 2024-04-25T00:51:21.799 DEBUG:teuthology.orchestra.run.smithi162:> if mountpoint in contents: 2024-04-25T00:51:21.799 DEBUG:teuthology.orchestra.run.smithi162:> return f 2024-04-25T00:51:21.799 DEBUG:teuthology.orchestra.run.smithi162:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T00:51:21.799 DEBUG:teuthology.orchestra.run.smithi162:> 2024-04-25T00:51:21.799 DEBUG:teuthology.orchestra.run.smithi162:> print(_find_admin_socket("client.0")) 2024-04-25T00:51:21.799 DEBUG:teuthology.orchestra.run.smithi162:> ' 2024-04-25T00:51:21.919 INFO:teuthology.orchestra.run.smithi162.stdout:/var/run/ceph/ceph-client.0.35320.asok 2024-04-25T00:51:21.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T00:51:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T00:51:21.930 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35320.asok 2024-04-25T00:51:21.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:21.930 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35320.asok status 2024-04-25T00:51:22.234 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-04-25T00:51:22.234 INFO:teuthology.orchestra.run.smithi162.stdout: "metadata": { 2024-04-25T00:51:22.235 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_sha1": "d2c45d977142e024a59b68a8f1dce8f0b9840551", 2024-04-25T00:51:22.235 INFO:teuthology.orchestra.run.smithi162.stdout: "ceph_version": "ceph version 19.0.0-2445-gd2c45d97 (d2c45d977142e024a59b68a8f1dce8f0b9840551) squid (dev)", 2024-04-25T00:51:22.235 INFO:teuthology.orchestra.run.smithi162.stdout: "entity_id": "0", 2024-04-25T00:51:22.235 INFO:teuthology.orchestra.run.smithi162.stdout: "hostname": "smithi162", 2024-04-25T00:51:22.235 INFO:teuthology.orchestra.run.smithi162.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T00:51:22.235 INFO:teuthology.orchestra.run.smithi162.stdout: "pid": "35320", 2024-04-25T00:51:22.235 INFO:teuthology.orchestra.run.smithi162.stdout: "root": "/" 2024-04-25T00:51:22.235 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-04-25T00:51:22.235 INFO:teuthology.orchestra.run.smithi162.stdout: "dentry_count": 0, 2024-04-25T00:51:22.235 INFO:teuthology.orchestra.run.smithi162.stdout: "dentry_pinned_count": 0, 2024-04-25T00:51:22.235 INFO:teuthology.orchestra.run.smithi162.stdout: "id": 4584, 2024-04-25T00:51:22.235 INFO:teuthology.orchestra.run.smithi162.stdout: "inst": { 2024-04-25T00:51:22.235 INFO:teuthology.orchestra.run.smithi162.stdout: "name": { 2024-04-25T00:51:22.236 INFO:teuthology.orchestra.run.smithi162.stdout: "type": "client", 2024-04-25T00:51:22.236 INFO:teuthology.orchestra.run.smithi162.stdout: "num": 4584 2024-04-25T00:51:22.236 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-04-25T00:51:22.236 INFO:teuthology.orchestra.run.smithi162.stdout: "addr": { 2024-04-25T00:51:22.236 INFO:teuthology.orchestra.run.smithi162.stdout: "type": "v1", 2024-04-25T00:51:22.236 INFO:teuthology.orchestra.run.smithi162.stdout: "addr": "192.168.0.1:0", 2024-04-25T00:51:22.236 INFO:teuthology.orchestra.run.smithi162.stdout: "nonce": 2313537343 2024-04-25T00:51:22.237 INFO:teuthology.orchestra.run.smithi162.stdout: } 2024-04-25T00:51:22.237 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-04-25T00:51:22.237 INFO:teuthology.orchestra.run.smithi162.stdout: "addr": { 2024-04-25T00:51:22.237 INFO:teuthology.orchestra.run.smithi162.stdout: "type": "v1", 2024-04-25T00:51:22.237 INFO:teuthology.orchestra.run.smithi162.stdout: "addr": "192.168.0.1:0", 2024-04-25T00:51:22.237 INFO:teuthology.orchestra.run.smithi162.stdout: "nonce": 2313537343 2024-04-25T00:51:22.237 INFO:teuthology.orchestra.run.smithi162.stdout: }, 2024-04-25T00:51:22.237 INFO:teuthology.orchestra.run.smithi162.stdout: "inst_str": "client.4584 192.168.0.1:0/2313537343", 2024-04-25T00:51:22.238 INFO:teuthology.orchestra.run.smithi162.stdout: "addr_str": "192.168.0.1:0/2313537343", 2024-04-25T00:51:22.238 INFO:teuthology.orchestra.run.smithi162.stdout: "inode_count": 1, 2024-04-25T00:51:22.238 INFO:teuthology.orchestra.run.smithi162.stdout: "mds_epoch": 17, 2024-04-25T00:51:22.238 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_epoch": 26, 2024-04-25T00:51:22.238 INFO:teuthology.orchestra.run.smithi162.stdout: "osd_epoch_barrier": 0, 2024-04-25T00:51:22.238 INFO:teuthology.orchestra.run.smithi162.stdout: "blocklisted": false, 2024-04-25T00:51:22.238 INFO:teuthology.orchestra.run.smithi162.stdout: "fs_name": "cephfs" 2024-04-25T00:51:22.238 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-04-25T00:51:22.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:22.253 DEBUG:teuthology.orchestra.run.smithi162:> stat --file-system '--printf=%T 2024-04-25T00:51:22.253 DEBUG:teuthology.orchestra.run.smithi162:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T00:51:22.367 INFO:teuthology.orchestra.run.smithi162.stdout:fuseblk 2024-04-25T00:51:22.367 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T00:51:22.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T00:51:22.367 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T00:51:22.892 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T00:51:22.912 INFO:tasks.workunit:Pulling workunits from ref d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T00:51:22.913 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T00:51:22.913 INFO:tasks.workunit:timeout=6h 2024-04-25T00:51:22.913 INFO:tasks.workunit:cleanup=True 2024-04-25T00:51:22.913 DEBUG:teuthology.orchestra.run.smithi162:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T00:51:23.015 INFO:teuthology.orchestra.run.smithi162.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T00:51:23.016 INFO:teuthology.orchestra.run.smithi162.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-25T00:51:23.016 INFO:teuthology.orchestra.run.smithi162.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-04-25T00:51:23.016 INFO:teuthology.orchestra.run.smithi162.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T00:51:23.016 INFO:teuthology.orchestra.run.smithi162.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T00:51:23.016 INFO:teuthology.orchestra.run.smithi162.stdout:Modify: 2024-04-25 00:50:37.622298448 +0000 2024-04-25T00:51:23.016 INFO:teuthology.orchestra.run.smithi162.stdout:Change: 2024-04-25 00:51:22.414685806 +0000 2024-04-25T00:51:23.016 INFO:teuthology.orchestra.run.smithi162.stdout: Birth: - 2024-04-25T00:51:23.016 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T00:51:23.017 DEBUG:teuthology.orchestra.run.smithi162:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T00:51:24.220 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T00:51:24.227 INFO:tasks.workunit.client.0.smithi162.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T00:51:34.587 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:51:34.590 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:52:04.717 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:52:04.721 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:52:32.475 INFO:tasks.workunit.client.0.smithi162.stderr:Note: switching to 'd2c45d977142e024a59b68a8f1dce8f0b9840551'. 2024-04-25T00:52:32.475 INFO:tasks.workunit.client.0.smithi162.stderr: 2024-04-25T00:52:32.475 INFO:tasks.workunit.client.0.smithi162.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T00:52:32.476 INFO:tasks.workunit.client.0.smithi162.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T00:52:32.476 INFO:tasks.workunit.client.0.smithi162.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T00:52:32.476 INFO:tasks.workunit.client.0.smithi162.stderr: 2024-04-25T00:52:32.476 INFO:tasks.workunit.client.0.smithi162.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T00:52:32.476 INFO:tasks.workunit.client.0.smithi162.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T00:52:32.476 INFO:tasks.workunit.client.0.smithi162.stderr: 2024-04-25T00:52:32.476 INFO:tasks.workunit.client.0.smithi162.stderr: git switch -c 2024-04-25T00:52:32.476 INFO:tasks.workunit.client.0.smithi162.stderr: 2024-04-25T00:52:32.476 INFO:tasks.workunit.client.0.smithi162.stderr:Or undo this operation with: 2024-04-25T00:52:32.476 INFO:tasks.workunit.client.0.smithi162.stderr: 2024-04-25T00:52:32.476 INFO:tasks.workunit.client.0.smithi162.stderr: git switch - 2024-04-25T00:52:32.476 INFO:tasks.workunit.client.0.smithi162.stderr: 2024-04-25T00:52:32.476 INFO:tasks.workunit.client.0.smithi162.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T00:52:32.476 INFO:tasks.workunit.client.0.smithi162.stderr: 2024-04-25T00:52:32.477 INFO:tasks.workunit.client.0.smithi162.stderr:HEAD is now at d2c45d97714 Merge pull request #56528 from adk3798/squid-mypy-bump 2024-04-25T00:52:32.479 DEBUG:teuthology.orchestra.run.smithi162:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T00:52:32.484 INFO:tasks.workunit.client.0.smithi162.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T00:52:32.488 INFO:tasks.workunit.client.0.smithi162.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T00:52:32.488 INFO:tasks.workunit.client.0.smithi162.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T00:52:33.271 INFO:tasks.workunit.client.0.smithi162.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T00:52:33.362 INFO:tasks.workunit.client.0.smithi162.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T00:52:33.411 INFO:tasks.workunit.client.0.smithi162.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T00:52:33.412 INFO:tasks.workunit.client.0.smithi162.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T00:52:33.412 INFO:tasks.workunit.client.0.smithi162.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T00:52:33.459 INFO:tasks.workunit.client.0.smithi162.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T00:52:33.463 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T00:52:33.463 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T00:52:33.508 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-25T00:52:33.510 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-25T00:52:33.510 DEBUG:teuthology.orchestra.run.smithi162:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2c45d977142e024a59b68a8f1dce8f0b9840551 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-25T00:52:33.976 INFO:tasks.workunit.client.0.smithi162.stderr:+ mkdir -p fsstress 2024-04-25T00:52:34.096 INFO:tasks.workunit.client.0.smithi162.stderr:+ pushd fsstress 2024-04-25T00:52:34.140 INFO:tasks.workunit.client.0.smithi162.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T00:52:34.140 INFO:tasks.workunit.client.0.smithi162.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-25T00:52:34.765 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:52:34.768 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:52:47.339 INFO:tasks.workunit.client.0.smithi162.stderr:+ tar xzf ltp-full.tgz 2024-04-25T00:53:04.880 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:53:04.884 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:53:35.664 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:53:35.667 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:54:05.709 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:54:05.712 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:54:35.760 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:54:35.763 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:55:06.024 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:55:06.028 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:55:36.136 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:55:36.139 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:56:06.277 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:56:06.281 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:56:36.634 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:56:36.638 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:57:06.840 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:57:06.843 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:57:36.951 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:57:36.955 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:58:07.006 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:58:07.010 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:58:37.120 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:58:37.124 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:58:41.467 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:09:30.907 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T00:58:41.572 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:09:31.012 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T00:58:41.646 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:09:31.004 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T00:58:41.672 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:09:31.031 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T00:58:41.787 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:09:31.146 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T00:58:41.800 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:09:31.159 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T00:58:42.098 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:09:31.538 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T00:58:42.335 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:09:31.694 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T00:58:42.422 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:09:31.781 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T00:59:07.361 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:59:07.364 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:59:37.476 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T00:59:37.480 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:00:07.586 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:00:07.589 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:00:37.723 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:00:37.727 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:01:07.826 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:01:07.829 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:01:15.509 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:12:04.948 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:01:15.531 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:12:04.970 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:01:15.565 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:12:04.924 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:01:15.569 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:12:04.928 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:01:15.583 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:12:04.941 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:01:15.584 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:12:04.943 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:01:15.713 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:12:05.152 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:01:15.772 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:12:05.130 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:01:15.781 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:12:05.139 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:01:37.872 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:01:37.875 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:02:08.000 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:02:08.003 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:02:38.117 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:02:38.120 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:03:08.324 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:03:08.328 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:03:38.396 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:03:38.400 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:04:08.505 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:04:08.509 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:04:38.606 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:04:38.609 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:05:08.685 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:05:08.688 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:05:25.325 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:16:14.768 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:05:25.329 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:16:14.773 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:05:25.432 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:16:14.797 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:05:25.434 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:16:14.799 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:05:25.436 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:16:14.801 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:05:25.443 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:16:14.808 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:05:25.466 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:16:14.910 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:05:25.590 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:16:14.955 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:05:25.603 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:16:14.968 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:05:38.833 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:05:38.837 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:06:08.942 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:06:08.945 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:06:38.988 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:06:38.992 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:07:04.465 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:17:53.911 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:07:04.469 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:17:53.915 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:07:04.524 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:17:53.971 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:07:04.589 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:17:53.955 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:07:04.594 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:17:53.961 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:07:04.598 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:17:53.964 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:07:04.601 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:17:53.968 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:07:04.659 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:17:54.025 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:07:04.685 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:17:54.051 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:07:09.166 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:07:09.169 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:07:39.295 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:07:39.298 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:08:09.427 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:08:09.430 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:08:39.573 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:08:39.576 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:09:09.620 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:09:09.624 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:09:33.289 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:20:22.738 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:09:33.294 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:20:22.743 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:09:33.392 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:20:22.840 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:09:33.405 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:20:22.772 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:09:33.406 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:20:22.773 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:09:33.407 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:20:22.775 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:09:33.410 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:20:22.777 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:09:33.538 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:20:22.905 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:09:33.551 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:20:22.918 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:09:39.951 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:09:39.954 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:10:09.998 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:10:10.002 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:10:40.279 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:10:40.283 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:11:10.377 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:11:10.380 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:11:40.499 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:11:40.502 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:12:10.638 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:12:10.643 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:12:40.761 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:12:40.764 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:13:10.816 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:13:10.820 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:13:40.924 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:13:40.927 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:14:10.985 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:14:10.988 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:14:12.179 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:25:01.630 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:14:12.184 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:25:01.636 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:14:12.243 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:25:01.614 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:14:12.246 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:25:01.617 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:14:12.247 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:25:01.618 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:14:12.251 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:25:01.622 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:14:12.330 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:25:01.781 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:14:12.388 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:25:01.759 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:14:12.397 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:25:01.768 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:14:41.092 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:14:41.096 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:15:11.230 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:15:11.233 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:15:27.679 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:26:17.130 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:15:27.688 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:26:17.141 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:15:27.751 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:26:17.203 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:15:27.787 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:26:17.158 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:15:27.802 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:26:17.173 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:15:27.806 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:26:17.177 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:15:27.811 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:26:17.182 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:15:27.845 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:26:17.216 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:15:27.852 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:26:17.222 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:15:41.488 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:15:41.492 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:16:11.626 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:16:11.629 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:16:41.689 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:16:41.691 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:17:11.795 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:17:11.799 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:17:41.918 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:17:41.921 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:17:46.084 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:28:35.538 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:17:46.139 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:28:35.510 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:17:46.147 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:28:35.601 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:17:46.151 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:28:35.522 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:17:46.172 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:28:35.543 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:17:46.194 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:28:35.565 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:17:46.280 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:28:35.650 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:17:46.323 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:28:35.694 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:17:46.346 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:28:35.799 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:18:12.032 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:18:12.035 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:18:42.153 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:18:42.156 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:19:12.276 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:19:12.279 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:19:42.322 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:19:42.326 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:20:12.371 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:20:12.374 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:20:42.430 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:20:42.433 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:21:12.493 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:21:12.497 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:21:42.630 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:21:42.634 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:21:54.229 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:32:43.684 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:21:54.259 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:32:43.714 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:21:54.268 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:32:43.640 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:21:54.270 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:32:43.641 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:21:54.278 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:32:43.649 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:21:54.286 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:32:43.657 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:21:54.417 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:32:43.872 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:21:54.418 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:32:43.789 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:21:54.464 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:32:43.835 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:22:12.695 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:22:12.698 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:22:35.494 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:33:24.949 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:22:35.502 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:33:24.958 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:22:35.514 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:33:24.885 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:22:35.518 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:33:24.889 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:22:35.540 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:33:24.995 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:22:35.559 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:33:24.930 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:22:35.616 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:33:24.988 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:22:35.623 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:33:24.994 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:22:35.674 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:33:25.045 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:22:42.800 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:22:42.803 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:23:12.948 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:23:12.951 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:23:43.084 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:23:43.091 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:24:13.217 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:24:13.220 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:24:43.317 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:24:43.321 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:25:13.570 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:25:13.574 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:25:43.716 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:25:43.719 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:26:00.097 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:36:49.553 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:26:00.134 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:36:49.591 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:26:00.146 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:36:49.518 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:26:00.146 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:36:49.519 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:26:00.161 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:36:49.533 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:26:00.164 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:36:49.536 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:26:00.257 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:36:49.714 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:26:00.339 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:36:49.711 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:26:00.343 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:36:49.715 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:26:13.775 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:26:13.778 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:26:43.973 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:26:43.976 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:27:14.061 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:27:14.065 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:27:44.238 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:27:44.241 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:28:14.347 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:28:14.350 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:28:44.454 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:28:44.457 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:29:14.509 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:29:14.513 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:29:44.560 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:29:44.564 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:30:08.679 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:40:58.137 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:30:08.697 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:40:58.156 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:30:08.727 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:40:58.101 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:30:08.729 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:40:58.103 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:30:08.735 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:40:58.109 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:30:08.736 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:40:58.110 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:30:08.845 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:40:58.220 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:30:08.862 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:40:58.320 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:30:08.885 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:40:58.259 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:30:14.681 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:30:14.686 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:30:44.762 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:30:44.766 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:30:54.230 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:41:43.688 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:30:54.235 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:41:43.694 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:30:54.298 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:41:43.757 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:30:54.352 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:41:43.726 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:30:54.352 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:41:43.726 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:30:54.354 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:41:43.729 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:30:54.355 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:41:43.730 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:30:54.420 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:41:43.794 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:30:54.422 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:41:43.797 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:31:14.817 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:31:14.821 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:31:44.956 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:31:44.959 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:32:14.742 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:43:04.201 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:32:14.787 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:43:04.246 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:32:14.864 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:43:04.239 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:32:14.865 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:43:04.240 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:32:14.869 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:43:04.245 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:32:14.870 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:43:04.245 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:32:14.947 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:43:04.322 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:32:14.962 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:43:04.421 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:32:14.981 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:43:04.356 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:32:15.068 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:32:15.071 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:32:45.239 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:32:45.242 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:33:15.357 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:33:15.361 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:33:45.490 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:33:45.493 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:34:13.934 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:45:03.393 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:34:13.973 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:45:03.349 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:34:13.975 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:45:03.434 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:34:13.985 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:45:03.361 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:34:14.025 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:45:03.401 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:34:14.035 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:45:03.411 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:34:14.118 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:45:03.578 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:34:14.126 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:45:03.502 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:34:14.249 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:45:03.625 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:34:15.635 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:34:15.638 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:34:45.942 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:34:45.945 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:35:15.996 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:35:15.999 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:35:46.394 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:35:46.397 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:36:16.438 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:36:16.441 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:36:46.557 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:36:46.560 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:37:16.689 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:37:16.692 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:37:46.795 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:37:46.798 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:38:16.964 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:38:16.967 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:38:23.381 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:49:12.837 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:38:23.395 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:49:12.852 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:38:23.437 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:49:12.810 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:38:23.440 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:49:12.814 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:38:23.448 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:49:12.821 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:38:23.454 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:49:12.828 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:38:23.541 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:49:12.998 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:38:23.623 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:49:12.996 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:38:23.678 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:49:13.051 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:38:47.144 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:38:47.147 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:39:17.217 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:39:17.220 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:39:44.759 INFO:tasks.workunit.client.0.smithi162.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-25T01:39:45.081 INFO:tasks.workunit.client.0.smithi162.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T01:39:45.082 INFO:tasks.workunit.client.0.smithi162.stderr:+ make 2024-04-25T01:39:47.283 INFO:tasks.workunit.client.0.smithi162.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-25T01:39:47.329 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:39:47.332 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:39:55.895 INFO:tasks.workunit.client.0.smithi162.stderr:++ readlink -f fsstress 2024-04-25T01:39:55.934 INFO:tasks.workunit.client.0.smithi162.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-25T01:39:55.934 INFO:tasks.workunit.client.0.smithi162.stderr:+ popd 2024-04-25T01:39:55.977 INFO:tasks.workunit.client.0.smithi162.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T01:39:55.977 INFO:tasks.workunit.client.0.smithi162.stderr:+ popd 2024-04-25T01:39:56.000 INFO:tasks.workunit.client.0.smithi162.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-25T01:39:56.001 INFO:tasks.workunit.client.0.smithi162.stderr:++ mktemp -d -p . 2024-04-25T01:39:56.059 INFO:tasks.workunit.client.0.smithi162.stderr:+ T=./tmp.18I1mlMutK 2024-04-25T01:39:56.059 INFO:tasks.workunit.client.0.smithi162.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.18I1mlMutK -l 1 -n 1000 -p 10 -v 2024-04-25T01:39:56.297 INFO:tasks.workunit.client.0.smithi162.stdout:seed = 1714251299 2024-04-25T01:39:56.666 INFO:tasks.workunit.client.0.smithi162.stdout:1/0: write - no filename 2024-04-25T01:39:56.666 INFO:tasks.workunit.client.0.smithi162.stdout:1/1: dread - no filename 2024-04-25T01:39:56.666 INFO:tasks.workunit.client.0.smithi162.stdout:1/2: read - no filename 2024-04-25T01:39:56.849 INFO:tasks.workunit.client.0.smithi162.stdout:1/3: mknod c0 0 2024-04-25T01:39:56.849 INFO:tasks.workunit.client.0.smithi162.stdout:1/4: fdatasync - no filename 2024-04-25T01:39:56.923 INFO:tasks.workunit.client.0.smithi162.stdout:3/0: dread - no filename 2024-04-25T01:39:56.923 INFO:tasks.workunit.client.0.smithi162.stdout:3/1: rmdir - no directory 2024-04-25T01:39:57.109 INFO:tasks.workunit.client.0.smithi162.stdout:4/0: rename - no filename 2024-04-25T01:39:57.110 INFO:tasks.workunit.client.0.smithi162.stdout:4/1: truncate - no filename 2024-04-25T01:39:57.295 INFO:tasks.workunit.client.0.smithi162.stdout:0/0: sync 2024-04-25T01:39:57.295 INFO:tasks.workunit.client.0.smithi162.stdout:0/1: readlink - no filename 2024-04-25T01:39:57.297 INFO:tasks.workunit.client.0.smithi162.stdout:0/2: chown . 215 1 2024-04-25T01:39:57.297 INFO:tasks.workunit.client.0.smithi162.stdout:0/3: dread - no filename 2024-04-25T01:39:57.297 INFO:tasks.workunit.client.0.smithi162.stdout:0/4: truncate - no filename 2024-04-25T01:39:57.297 INFO:tasks.workunit.client.0.smithi162.stdout:0/5: write - no filename 2024-04-25T01:39:57.297 INFO:tasks.workunit.client.0.smithi162.stdout:0/6: dread - no filename 2024-04-25T01:39:57.297 INFO:tasks.workunit.client.0.smithi162.stdout:0/7: link - no file 2024-04-25T01:39:57.297 INFO:tasks.workunit.client.0.smithi162.stdout:0/8: dread - no filename 2024-04-25T01:39:57.298 INFO:tasks.workunit.client.0.smithi162.stdout:0/9: rename - no filename 2024-04-25T01:39:57.298 INFO:tasks.workunit.client.0.smithi162.stdout:0/10: readlink - no filename 2024-04-25T01:39:57.298 INFO:tasks.workunit.client.0.smithi162.stdout:0/11: truncate - no filename 2024-04-25T01:39:57.298 INFO:tasks.workunit.client.0.smithi162.stdout:0/12: fdatasync - no filename 2024-04-25T01:39:57.298 INFO:tasks.workunit.client.0.smithi162.stdout:0/13: read - no filename 2024-04-25T01:39:57.298 INFO:tasks.workunit.client.0.smithi162.stdout:0/14: write - no filename 2024-04-25T01:39:57.298 INFO:tasks.workunit.client.0.smithi162.stdout:0/15: dread - no filename 2024-04-25T01:39:57.298 INFO:tasks.workunit.client.0.smithi162.stdout:0/16: truncate - no filename 2024-04-25T01:39:57.359 INFO:tasks.workunit.client.0.smithi162.stdout:2/0: sync 2024-04-25T01:39:57.363 INFO:tasks.workunit.client.0.smithi162.stdout:3/2: symlink l0 0 2024-04-25T01:39:57.363 INFO:tasks.workunit.client.0.smithi162.stdout:3/3: dwrite - no filename 2024-04-25T01:39:57.363 INFO:tasks.workunit.client.0.smithi162.stdout:3/4: write - no filename 2024-04-25T01:39:57.425 INFO:tasks.workunit.client.0.smithi162.stdout:4/2: sync 2024-04-25T01:39:57.425 INFO:tasks.workunit.client.0.smithi162.stdout:4/3: read - no filename 2024-04-25T01:39:57.469 INFO:tasks.workunit.client.0.smithi162.stdout:4/4: chown . 0 1 2024-04-25T01:39:57.469 INFO:tasks.workunit.client.0.smithi162.stdout:4/5: read - no filename 2024-04-25T01:39:57.469 INFO:tasks.workunit.client.0.smithi162.stdout:4/6: dwrite - no filename 2024-04-25T01:39:57.595 INFO:tasks.workunit.client.0.smithi162.stdout:1/5: getdents . 0 2024-04-25T01:39:57.665 INFO:tasks.workunit.client.0.smithi162.stdout:0/17: mkdir d0 0 2024-04-25T01:39:57.666 INFO:tasks.workunit.client.0.smithi162.stdout:0/18: dread - no filename 2024-04-25T01:39:57.898 INFO:tasks.workunit.client.0.smithi162.stdout:3/5: creat f1 x:0 0 0 2024-04-25T01:39:57.956 INFO:tasks.workunit.client.0.smithi162.stdout:1/6: mknod c1 0 2024-04-25T01:39:58.183 INFO:tasks.workunit.client.0.smithi162.stdout:2/1: mkdir d0 0 2024-04-25T01:39:58.196 INFO:tasks.workunit.client.0.smithi162.stdout:2/2: rename d0 to d0/d1 22 2024-04-25T01:39:58.208 INFO:tasks.workunit.client.0.smithi162.stdout:2/3: rename d0 to d0/d2 22 2024-04-25T01:39:58.208 INFO:tasks.workunit.client.0.smithi162.stdout:2/4: dread - no filename 2024-04-25T01:39:58.208 INFO:tasks.workunit.client.0.smithi162.stdout:2/5: dread - no filename 2024-04-25T01:39:58.209 INFO:tasks.workunit.client.0.smithi162.stdout:2/6: write - no filename 2024-04-25T01:39:58.209 INFO:tasks.workunit.client.0.smithi162.stdout:2/7: fsync - no filename 2024-04-25T01:39:58.209 INFO:tasks.workunit.client.0.smithi162.stdout:2/8: write - no filename 2024-04-25T01:39:58.209 INFO:tasks.workunit.client.0.smithi162.stdout:2/9: unlink - no file 2024-04-25T01:39:58.269 INFO:tasks.workunit.client.0.smithi162.stdout:4/7: creat f0 x:0 0 0 2024-04-25T01:39:58.326 INFO:tasks.workunit.client.0.smithi162.stdout:7/0: rename - no filename 2024-04-25T01:39:58.326 INFO:tasks.workunit.client.0.smithi162.stdout:7/1: fsync - no filename 2024-04-25T01:39:58.702 INFO:tasks.workunit.client.0.smithi162.stdout:5/0: creat f0 x:0 0 0 2024-04-25T01:39:58.780 INFO:tasks.workunit.client.0.smithi162.stdout:0/19: mkdir d0/d1 0 2024-04-25T01:39:58.780 INFO:tasks.workunit.client.0.smithi162.stdout:0/20: dread - no filename 2024-04-25T01:39:58.780 INFO:tasks.workunit.client.0.smithi162.stdout:0/21: dread - no filename 2024-04-25T01:39:58.780 INFO:tasks.workunit.client.0.smithi162.stdout:0/22: dwrite - no filename 2024-04-25T01:39:58.795 INFO:tasks.workunit.client.0.smithi162.stdout:1/7: mknod c2 0 2024-04-25T01:39:58.796 INFO:tasks.workunit.client.0.smithi162.stdout:1/8: dwrite - no filename 2024-04-25T01:39:58.796 INFO:tasks.workunit.client.0.smithi162.stdout:1/9: dread - no filename 2024-04-25T01:39:58.796 INFO:tasks.workunit.client.0.smithi162.stdout:1/10: dwrite - no filename 2024-04-25T01:39:58.807 INFO:tasks.workunit.client.0.smithi162.stdout:3/6: mkdir d2 0 2024-04-25T01:39:58.842 INFO:tasks.workunit.client.0.smithi162.stdout:4/8: mkdir d1 0 2024-04-25T01:39:58.880 INFO:tasks.workunit.client.0.smithi162.stdout:5/1: read - f0 zero size 2024-04-25T01:39:58.893 INFO:tasks.workunit.client.0.smithi162.stdout:0/23: sync 2024-04-25T01:39:58.893 INFO:tasks.workunit.client.0.smithi162.stdout:0/24: dread - no filename 2024-04-25T01:39:58.907 INFO:tasks.workunit.client.0.smithi162.stdout:8/0: dread - no filename 2024-04-25T01:39:58.915 INFO:tasks.workunit.client.0.smithi162.stdout:1/11: chown c0 295 1 2024-04-25T01:39:58.915 INFO:tasks.workunit.client.0.smithi162.stdout:1/12: dread - no filename 2024-04-25T01:39:58.915 INFO:tasks.workunit.client.0.smithi162.stdout:1/13: write - no filename 2024-04-25T01:39:58.956 INFO:tasks.workunit.client.0.smithi162.stdout:0/25: chown d0/d1 515974 1 2024-04-25T01:39:58.956 INFO:tasks.workunit.client.0.smithi162.stdout:0/26: dwrite - no filename 2024-04-25T01:39:58.970 INFO:tasks.workunit.client.0.smithi162.stdout:4/9: truncate f0 928167 0 2024-04-25T01:39:59.007 INFO:tasks.workunit.client.0.smithi162.stdout:6/0: mknod c0 0 2024-04-25T01:39:59.079 INFO:tasks.workunit.client.0.smithi162.stdout:4/10: chown d1 32 1 2024-04-25T01:39:59.082 INFO:tasks.workunit.client.0.smithi162.stdout:5/2: chown f0 67333 1 2024-04-25T01:39:59.099 INFO:tasks.workunit.client.0.smithi162.stdout:2/10: mkdir d0/d3 0 2024-04-25T01:39:59.111 INFO:tasks.workunit.client.0.smithi162.stdout:7/2: symlink l0 0 2024-04-25T01:39:59.117 INFO:tasks.workunit.client.0.smithi162.stdout:6/1: stat c0 0 2024-04-25T01:39:59.117 INFO:tasks.workunit.client.0.smithi162.stdout:6/2: truncate - no filename 2024-04-25T01:39:59.290 INFO:tasks.workunit.client.0.smithi162.stdout:1/14: creat f3 x:0 0 0 2024-04-25T01:39:59.304 INFO:tasks.workunit.client.0.smithi162.stdout:5/3: dread - f0 zero size 2024-04-25T01:39:59.309 INFO:tasks.workunit.client.0.smithi162.stdout:3/7: mknod d2/c3 0 2024-04-25T01:39:59.363 INFO:tasks.workunit.client.0.smithi162.stdout:7/3: creat f1 x:0 0 0 2024-04-25T01:39:59.392 INFO:tasks.workunit.client.0.smithi162.stdout:8/1: mkdir d0 0 2024-04-25T01:39:59.401 INFO:tasks.workunit.client.0.smithi162.stdout:3/8: chown d2 1768633 1 2024-04-25T01:39:59.421 INFO:tasks.workunit.client.0.smithi162.stdout:1/15: write f3 [785296,16510] 0 2024-04-25T01:39:59.446 INFO:tasks.workunit.client.0.smithi162.stdout:7/4: write f1 [280538,127627] 0 2024-04-25T01:39:59.452 INFO:tasks.workunit.client.0.smithi162.stdout:9/0: sync 2024-04-25T01:39:59.488 INFO:tasks.workunit.client.0.smithi162.stdout:0/27: mknod d0/d1/c2 0 2024-04-25T01:39:59.488 INFO:tasks.workunit.client.0.smithi162.stdout:0/28: write - no filename 2024-04-25T01:39:59.540 INFO:tasks.workunit.client.0.smithi162.stdout:5/4: unlink f0 0 2024-04-25T01:39:59.541 INFO:tasks.workunit.client.0.smithi162.stdout:5/5: fdatasync - no filename 2024-04-25T01:39:59.550 INFO:tasks.workunit.client.0.smithi162.stdout:0/29: stat d0 0 2024-04-25T01:39:59.558 INFO:tasks.workunit.client.0.smithi162.stdout:7/5: truncate f1 420351 0 2024-04-25T01:39:59.587 INFO:tasks.workunit.client.0.smithi162.stdout:1/16: creat f4 x:0 0 0 2024-04-25T01:39:59.913 INFO:tasks.workunit.client.0.smithi162.stdout:4/11: rmdir d1 0 2024-04-25T01:39:59.971 INFO:tasks.workunit.client.0.smithi162.stdout:3/9: rename l0 to d2/l4 0 2024-04-25T01:39:59.976 INFO:tasks.workunit.client.0.smithi162.stdout:2/11: mknod d0/d3/c4 0 2024-04-25T01:40:00.007 INFO:tasks.workunit.client.0.smithi162.stdout:8/2: mknod d0/c1 0 2024-04-25T01:40:00.007 INFO:tasks.workunit.client.0.smithi162.stdout:8/3: readlink - no filename 2024-04-25T01:40:00.029 INFO:tasks.workunit.client.0.smithi162.stdout:5/6: symlink l1 0 2024-04-25T01:40:00.029 INFO:tasks.workunit.client.0.smithi162.stdout:5/7: dwrite - no filename 2024-04-25T01:40:00.029 INFO:tasks.workunit.client.0.smithi162.stdout:5/8: dread - no filename 2024-04-25T01:40:00.029 INFO:tasks.workunit.client.0.smithi162.stdout:5/9: write - no filename 2024-04-25T01:40:00.074 INFO:tasks.workunit.client.0.smithi162.stdout:7/6: creat f2 x:0 0 0 2024-04-25T01:40:00.099 INFO:tasks.workunit.client.0.smithi162.stdout:0/30: symlink d0/l3 0 2024-04-25T01:40:00.100 INFO:tasks.workunit.client.0.smithi162.stdout:0/31: write - no filename 2024-04-25T01:40:00.100 INFO:tasks.workunit.client.0.smithi162.stdout:0/32: write - no filename 2024-04-25T01:40:00.100 INFO:tasks.workunit.client.0.smithi162.stdout:0/33: fsync - no filename 2024-04-25T01:40:00.100 INFO:tasks.workunit.client.0.smithi162.stdout:0/34: dwrite - no filename 2024-04-25T01:40:00.123 INFO:tasks.workunit.client.0.smithi162.stdout:1/17: symlink l5 0 2024-04-25T01:40:00.130 INFO:tasks.workunit.client.0.smithi162.stdout:5/10: stat l1 0 2024-04-25T01:40:00.183 INFO:tasks.workunit.client.0.smithi162.stdout:9/1: creat f0 x:0 0 0 2024-04-25T01:40:00.185 INFO:tasks.workunit.client.0.smithi162.stdout:5/11: stat l1 0 2024-04-25T01:40:00.186 INFO:tasks.workunit.client.0.smithi162.stdout:5/12: dread - no filename 2024-04-25T01:40:00.186 INFO:tasks.workunit.client.0.smithi162.stdout:5/13: write - no filename 2024-04-25T01:40:00.186 INFO:tasks.workunit.client.0.smithi162.stdout:5/14: write - no filename 2024-04-25T01:40:00.207 INFO:tasks.workunit.client.0.smithi162.stdout:0/35: stat d0/d1/c2 0 2024-04-25T01:40:00.208 INFO:tasks.workunit.client.0.smithi162.stdout:0/36: truncate - no filename 2024-04-25T01:40:00.239 INFO:tasks.workunit.client.0.smithi162.stdout:1/18: sync 2024-04-25T01:40:00.239 INFO:tasks.workunit.client.0.smithi162.stdout:1/19: rmdir - no directory 2024-04-25T01:40:00.254 INFO:tasks.workunit.client.0.smithi162.stdout:0/37: chown d0 3090 1 2024-04-25T01:40:00.277 INFO:tasks.workunit.client.0.smithi162.stdout:9/2: write f0 [668556,59560] 0 2024-04-25T01:40:00.285 INFO:tasks.workunit.client.0.smithi162.stdout:5/15: sync 2024-04-25T01:40:00.372 INFO:tasks.workunit.client.0.smithi162.stdout:1/20: write f3 [761307,14535] 0 2024-04-25T01:40:00.409 INFO:tasks.workunit.client.0.smithi162.stdout:4/12: symlink l2 0 2024-04-25T01:40:00.466 INFO:tasks.workunit.client.0.smithi162.stdout:1/21: chown f3 2177982 1 2024-04-25T01:40:00.500 INFO:tasks.workunit.client.0.smithi162.stdout:7/7: dwrite f1 [0,4194304] 0 2024-04-25T01:40:00.673 INFO:tasks.workunit.client.0.smithi162.stdout:3/10: unlink f1 0 2024-04-25T01:40:00.695 INFO:tasks.workunit.client.0.smithi162.stdout:8/4: mknod d0/c2 0 2024-04-25T01:40:00.696 INFO:tasks.workunit.client.0.smithi162.stdout:8/5: write - no filename 2024-04-25T01:40:00.816 INFO:tasks.workunit.client.0.smithi162.stdout:7/8: truncate f2 976347 0 2024-04-25T01:40:01.001 INFO:tasks.workunit.client.0.smithi162.stdout:2/12: unlink d0/d3/c4 0 2024-04-25T01:40:01.001 INFO:tasks.workunit.client.0.smithi162.stdout:2/13: dwrite - no filename 2024-04-25T01:40:01.001 INFO:tasks.workunit.client.0.smithi162.stdout:2/14: write - no filename 2024-04-25T01:40:01.002 INFO:tasks.workunit.client.0.smithi162.stdout:2/15: dwrite - no filename 2024-04-25T01:40:01.003 INFO:tasks.workunit.client.0.smithi162.stdout:6/3: getdents . 0 2024-04-25T01:40:01.051 INFO:tasks.workunit.client.0.smithi162.stdout:4/13: dwrite f0 [0,4194304] 0 2024-04-25T01:40:01.191 INFO:tasks.workunit.client.0.smithi162.stdout:5/16: creat f2 x:0 0 0 2024-04-25T01:40:01.223 INFO:tasks.workunit.client.0.smithi162.stdout:9/3: mknod c1 0 2024-04-25T01:40:01.245 INFO:tasks.workunit.client.0.smithi162.stdout:0/38: creat d0/d1/f4 x:0 0 0 2024-04-25T01:40:01.250 INFO:tasks.workunit.client.0.smithi162.stdout:4/14: stat f0 0 2024-04-25T01:40:01.283 INFO:tasks.workunit.client.0.smithi162.stdout:0/39: chown d0/d1 246 1 2024-04-25T01:40:01.311 INFO:tasks.workunit.client.0.smithi162.stdout:0/40: chown d0/d1/f4 7099691 1 2024-04-25T01:40:01.410 INFO:tasks.workunit.client.0.smithi162.stdout:3/11: symlink d2/l5 0 2024-04-25T01:40:01.431 INFO:tasks.workunit.client.0.smithi162.stdout:7/9: creat f3 x:0 0 0 2024-04-25T01:40:01.448 INFO:tasks.workunit.client.0.smithi162.stdout:8/6: rename d0/c1 to d0/c3 0 2024-04-25T01:40:01.448 INFO:tasks.workunit.client.0.smithi162.stdout:8/7: readlink - no filename 2024-04-25T01:40:01.448 INFO:tasks.workunit.client.0.smithi162.stdout:8/8: write - no filename 2024-04-25T01:40:01.448 INFO:tasks.workunit.client.0.smithi162.stdout:8/9: dwrite - no filename 2024-04-25T01:40:01.637 INFO:tasks.workunit.client.0.smithi162.stdout:3/12: chown d2/l5 2046 1 2024-04-25T01:40:01.637 INFO:tasks.workunit.client.0.smithi162.stdout:3/13: dread - no filename 2024-04-25T01:40:01.637 INFO:tasks.workunit.client.0.smithi162.stdout:3/14: fsync - no filename 2024-04-25T01:40:01.637 INFO:tasks.workunit.client.0.smithi162.stdout:3/15: write - no filename 2024-04-25T01:40:01.766 INFO:tasks.workunit.client.0.smithi162.stdout:0/41: dwrite d0/d1/f4 [0,4194304] 0 2024-04-25T01:40:01.945 INFO:tasks.workunit.client.0.smithi162.stdout:0/42: stat d0 0 2024-04-25T01:40:02.052 INFO:tasks.workunit.client.0.smithi162.stdout:2/16: mkdir d0/d3/d5 0 2024-04-25T01:40:02.090 INFO:tasks.workunit.client.0.smithi162.stdout:9/4: creat f2 x:0 0 0 2024-04-25T01:40:02.117 INFO:tasks.workunit.client.0.smithi162.stdout:5/17: creat f3 x:0 0 0 2024-04-25T01:40:02.172 INFO:tasks.workunit.client.0.smithi162.stdout:7/10: dwrite f1 [0,4194304] 0 2024-04-25T01:40:02.306 INFO:tasks.workunit.client.0.smithi162.stdout:9/5: fdatasync f0 0 2024-04-25T01:40:02.337 INFO:tasks.workunit.client.0.smithi162.stdout:3/16: rename d2/l5 to d2/l6 0 2024-04-25T01:40:02.348 INFO:tasks.workunit.client.0.smithi162.stdout:1/22: link l5 l6 0 2024-04-25T01:40:02.377 INFO:tasks.workunit.client.0.smithi162.stdout:6/4: getdents . 0 2024-04-25T01:40:02.377 INFO:tasks.workunit.client.0.smithi162.stdout:6/5: readlink - no filename 2024-04-25T01:40:02.377 INFO:tasks.workunit.client.0.smithi162.stdout:6/6: write - no filename 2024-04-25T01:40:02.408 INFO:tasks.workunit.client.0.smithi162.stdout:8/10: chown d0/c3 0 1 2024-04-25T01:40:02.409 INFO:tasks.workunit.client.0.smithi162.stdout:8/11: dread - no filename 2024-04-25T01:40:02.485 INFO:tasks.workunit.client.0.smithi162.stdout:7/11: write f2 [526376,86818] 0 2024-04-25T01:40:02.676 INFO:tasks.workunit.client.0.smithi162.stdout:0/43: mknod d0/d1/c5 0 2024-04-25T01:40:02.705 INFO:tasks.workunit.client.0.smithi162.stdout:0/44: fsync d0/d1/f4 0 2024-04-25T01:40:02.859 INFO:tasks.workunit.client.0.smithi162.stdout:5/18: rename l1 to l4 0 2024-04-25T01:40:02.991 INFO:tasks.workunit.client.0.smithi162.stdout:2/17: symlink d0/d3/l6 0 2024-04-25T01:40:02.991 INFO:tasks.workunit.client.0.smithi162.stdout:2/18: write - no filename 2024-04-25T01:40:03.017 INFO:tasks.workunit.client.0.smithi162.stdout:2/19: rename d0 to d0/d3/d7 22 2024-04-25T01:40:03.017 INFO:tasks.workunit.client.0.smithi162.stdout:2/20: write - no filename 2024-04-25T01:40:03.017 INFO:tasks.workunit.client.0.smithi162.stdout:2/21: dwrite - no filename 2024-04-25T01:40:03.276 INFO:tasks.workunit.client.0.smithi162.stdout:9/6: creat f3 x:0 0 0 2024-04-25T01:40:03.302 INFO:tasks.workunit.client.0.smithi162.stdout:1/23: creat f7 x:0 0 0 2024-04-25T01:40:03.356 INFO:tasks.workunit.client.0.smithi162.stdout:4/15: truncate f0 1177053 0 2024-04-25T01:40:03.532 INFO:tasks.workunit.client.0.smithi162.stdout:3/17: mkdir d2/d7 0 2024-04-25T01:40:03.641 INFO:tasks.workunit.client.0.smithi162.stdout:9/7: dread f0 [0,4194304] 0 2024-04-25T01:40:03.858 INFO:tasks.workunit.client.0.smithi162.stdout:1/24: dwrite f3 [0,4194304] 0 2024-04-25T01:40:03.875 INFO:tasks.workunit.client.0.smithi162.stdout:1/25: rmdir - no directory 2024-04-25T01:40:03.974 INFO:tasks.workunit.client.0.smithi162.stdout:7/12: creat f4 x:0 0 0 2024-04-25T01:40:04.056 INFO:tasks.workunit.client.0.smithi162.stdout:0/45: mknod d0/d1/c6 0 2024-04-25T01:40:04.163 INFO:tasks.workunit.client.0.smithi162.stdout:0/46: stat d0/d1/c5 0 2024-04-25T01:40:04.265 INFO:tasks.workunit.client.0.smithi162.stdout:5/19: symlink l5 0 2024-04-25T01:40:04.336 INFO:tasks.workunit.client.0.smithi162.stdout:0/47: sync 2024-04-25T01:40:04.366 INFO:tasks.workunit.client.0.smithi162.stdout:5/20: dread - f2 zero size 2024-04-25T01:40:04.387 INFO:tasks.workunit.client.0.smithi162.stdout:1/26: dwrite f7 [0,4194304] 0 2024-04-25T01:40:04.443 INFO:tasks.workunit.client.0.smithi162.stdout:0/48: sync 2024-04-25T01:40:04.518 INFO:tasks.workunit.client.0.smithi162.stdout:6/7: getdents . 0 2024-04-25T01:40:04.567 INFO:tasks.workunit.client.0.smithi162.stdout:4/16: creat f3 x:0 0 0 2024-04-25T01:40:04.581 INFO:tasks.workunit.client.0.smithi162.stdout:5/21: truncate f3 990736 0 2024-04-25T01:40:04.581 INFO:tasks.workunit.client.0.smithi162.stdout:6/8: stat c0 0 2024-04-25T01:40:04.581 INFO:tasks.workunit.client.0.smithi162.stdout:6/9: dread - no filename 2024-04-25T01:40:04.581 INFO:tasks.workunit.client.0.smithi162.stdout:6/10: dwrite - no filename 2024-04-25T01:40:04.581 INFO:tasks.workunit.client.0.smithi162.stdout:6/11: fsync - no filename 2024-04-25T01:40:04.581 INFO:tasks.workunit.client.0.smithi162.stdout:6/12: fsync - no filename 2024-04-25T01:40:04.631 INFO:tasks.workunit.client.0.smithi162.stdout:5/22: dread - f2 zero size 2024-04-25T01:40:04.696 INFO:tasks.workunit.client.0.smithi162.stdout:3/18: symlink d2/l8 0 2024-04-25T01:40:04.828 INFO:tasks.workunit.client.0.smithi162.stdout:0/49: dread d0/d1/f4 [0,4194304] 0 2024-04-25T01:40:04.877 INFO:tasks.workunit.client.0.smithi162.stdout:9/8: mkdir d4 0 2024-04-25T01:40:04.947 INFO:tasks.workunit.client.0.smithi162.stdout:7/13: creat f5 x:0 0 0 2024-04-25T01:40:05.082 INFO:tasks.workunit.client.0.smithi162.stdout:9/9: write f3 [832133,53256] 0 2024-04-25T01:40:05.181 INFO:tasks.workunit.client.0.smithi162.stdout:7/14: write f1 [2625105,12349] 0 2024-04-25T01:40:05.248 INFO:tasks.workunit.client.0.smithi162.stdout:2/22: mknod d0/d3/d5/c8 0 2024-04-25T01:40:05.248 INFO:tasks.workunit.client.0.smithi162.stdout:2/23: fdatasync - no filename 2024-04-25T01:40:05.248 INFO:tasks.workunit.client.0.smithi162.stdout:2/24: fsync - no filename 2024-04-25T01:40:05.289 INFO:tasks.workunit.client.0.smithi162.stdout:5/23: dwrite f2 [0,4194304] 0 2024-04-25T01:40:05.309 INFO:tasks.workunit.client.0.smithi162.stdout:1/27: symlink l8 0 2024-04-25T01:40:05.522 INFO:tasks.workunit.client.0.smithi162.stdout:6/13: mkdir d1 0 2024-04-25T01:40:05.539 INFO:tasks.workunit.client.0.smithi162.stdout:9/10: write f2 [97774,107528] 0 2024-04-25T01:40:05.605 INFO:tasks.workunit.client.0.smithi162.stdout:6/14: chown d1 0 1 2024-04-25T01:40:05.605 INFO:tasks.workunit.client.0.smithi162.stdout:6/15: truncate - no filename 2024-04-25T01:40:05.646 INFO:tasks.workunit.client.0.smithi162.stdout:0/50: dread d0/d1/f4 [0,4194304] 0 2024-04-25T01:40:05.648 INFO:tasks.workunit.client.0.smithi162.stdout:9/11: fdatasync f3 0 2024-04-25T01:40:05.708 INFO:tasks.workunit.client.0.smithi162.stdout:0/51: stat d0/d1/c5 0 2024-04-25T01:40:05.822 INFO:tasks.workunit.client.0.smithi162.stdout:8/12: getdents d0 0 2024-04-25T01:40:05.822 INFO:tasks.workunit.client.0.smithi162.stdout:8/13: write - no filename 2024-04-25T01:40:05.863 INFO:tasks.workunit.client.0.smithi162.stdout:3/19: readlink d2/l4 0 2024-04-25T01:40:05.863 INFO:tasks.workunit.client.0.smithi162.stdout:3/20: dwrite - no filename 2024-04-25T01:40:06.155 INFO:tasks.workunit.client.0.smithi162.stdout:2/25: creat d0/f9 x:0 0 0 2024-04-25T01:40:06.620 INFO:tasks.workunit.client.0.smithi162.stdout:5/24: symlink l6 0 2024-04-25T01:40:06.655 INFO:tasks.workunit.client.0.smithi162.stdout:0/52: creat d0/d1/f7 x:0 0 0 2024-04-25T01:40:06.667 INFO:tasks.workunit.client.0.smithi162.stdout:8/14: mkdir d0/d4 0 2024-04-25T01:40:06.667 INFO:tasks.workunit.client.0.smithi162.stdout:8/15: dread - no filename 2024-04-25T01:40:06.668 INFO:tasks.workunit.client.0.smithi162.stdout:8/16: read - no filename 2024-04-25T01:40:06.689 INFO:tasks.workunit.client.0.smithi162.stdout:7/15: link f1 f6 0 2024-04-25T01:40:06.694 INFO:tasks.workunit.client.0.smithi162.stdout:3/21: unlink d2/l8 0 2024-04-25T01:40:06.694 INFO:tasks.workunit.client.0.smithi162.stdout:3/22: write - no filename 2024-04-25T01:40:06.721 INFO:tasks.workunit.client.0.smithi162.stdout:2/26: creat d0/fa x:0 0 0 2024-04-25T01:40:06.754 INFO:tasks.workunit.client.0.smithi162.stdout:6/16: creat d1/f2 x:0 0 0 2024-04-25T01:40:06.776 INFO:tasks.workunit.client.0.smithi162.stdout:8/17: stat d0/c2 0 2024-04-25T01:40:06.798 INFO:tasks.workunit.client.0.smithi162.stdout:3/23: readlink d2/l4 0 2024-04-25T01:40:06.798 INFO:tasks.workunit.client.0.smithi162.stdout:3/24: dwrite - no filename 2024-04-25T01:40:06.798 INFO:tasks.workunit.client.0.smithi162.stdout:3/25: truncate - no filename 2024-04-25T01:40:06.799 INFO:tasks.workunit.client.0.smithi162.stdout:3/26: fsync - no filename 2024-04-25T01:40:06.845 INFO:tasks.workunit.client.0.smithi162.stdout:9/12: creat d4/f5 x:0 0 0 2024-04-25T01:40:06.854 INFO:tasks.workunit.client.0.smithi162.stdout:5/25: write f3 [1527553,5211] 0 2024-04-25T01:40:06.885 INFO:tasks.workunit.client.0.smithi162.stdout:4/17: getdents . 0 2024-04-25T01:40:06.939 INFO:tasks.workunit.client.0.smithi162.stdout:6/17: write d1/f2 [545663,10054] 0 2024-04-25T01:40:06.993 INFO:tasks.workunit.client.0.smithi162.stdout:2/27: chown d0/f9 22 1 2024-04-25T01:40:07.072 INFO:tasks.workunit.client.0.smithi162.stdout:1/28: getdents . 0 2024-04-25T01:40:07.090 INFO:tasks.workunit.client.0.smithi162.stdout:3/27: chown d2/c3 0 1 2024-04-25T01:40:07.095 INFO:tasks.workunit.client.0.smithi162.stdout:0/53: write d0/d1/f4 [4918102,30982] 0 2024-04-25T01:40:07.128 INFO:tasks.workunit.client.0.smithi162.stdout:4/18: creat f4 x:0 0 0 2024-04-25T01:40:07.193 INFO:tasks.workunit.client.0.smithi162.stdout:9/13: write f3 [53509,110500] 0 2024-04-25T01:40:07.356 INFO:tasks.workunit.client.0.smithi162.stdout:2/28: chown d0 15135 1 2024-04-25T01:40:07.629 INFO:tasks.workunit.client.0.smithi162.stdout:6/18: fsync d1/f2 0 2024-04-25T01:40:07.855 INFO:tasks.workunit.client.0.smithi162.stdout:8/18: getdents d0 0 2024-04-25T01:40:07.877 INFO:tasks.workunit.client.0.smithi162.stdout:3/28: mkdir d2/d9 0 2024-04-25T01:40:07.878 INFO:tasks.workunit.client.0.smithi162.stdout:3/29: truncate - no filename 2024-04-25T01:40:07.960 INFO:tasks.workunit.client.0.smithi162.stdout:1/29: rename f7 to f9 0 2024-04-25T01:40:08.126 INFO:tasks.workunit.client.0.smithi162.stdout:2/29: creat d0/fb x:0 0 0 2024-04-25T01:40:08.133 INFO:tasks.workunit.client.0.smithi162.stdout:3/30: chown d2 258 1 2024-04-25T01:40:08.151 INFO:tasks.workunit.client.0.smithi162.stdout:6/19: chown c0 60251 1 2024-04-25T01:40:08.158 INFO:tasks.workunit.client.0.smithi162.stdout:7/16: dwrite f5 [0,4194304] 0 2024-04-25T01:40:08.195 INFO:tasks.workunit.client.0.smithi162.stdout:0/54: rename d0/d1/c6 to d0/c8 0 2024-04-25T01:40:08.314 INFO:tasks.workunit.client.0.smithi162.stdout:5/26: dwrite f3 [0,4194304] 0 2024-04-25T01:40:08.336 INFO:tasks.workunit.client.0.smithi162.stdout:1/30: read f3 [436322,31013] 0 2024-04-25T01:40:08.642 INFO:tasks.workunit.client.0.smithi162.stdout:0/55: fdatasync d0/d1/f7 0 2024-04-25T01:40:08.681 INFO:tasks.workunit.client.0.smithi162.stdout:9/14: dwrite f0 [0,4194304] 0 2024-04-25T01:40:08.823 INFO:tasks.workunit.client.0.smithi162.stdout:0/56: dread - d0/d1/f7 zero size 2024-04-25T01:40:09.102 INFO:tasks.workunit.client.0.smithi162.stdout:3/31: mknod d2/ca 0 2024-04-25T01:40:09.164 INFO:tasks.workunit.client.0.smithi162.stdout:2/30: symlink d0/d3/lc 0 2024-04-25T01:40:09.227 INFO:tasks.workunit.client.0.smithi162.stdout:4/19: getdents . 0 2024-04-25T01:40:09.298 INFO:tasks.workunit.client.0.smithi162.stdout:1/31: fsync f3 0 2024-04-25T01:40:09.317 INFO:tasks.workunit.client.0.smithi162.stdout:7/17: write f2 [25308,22799] 0 2024-04-25T01:40:09.335 INFO:tasks.workunit.client.0.smithi162.stdout:8/19: rename d0/d4 to d0/d5 0 2024-04-25T01:40:09.335 INFO:tasks.workunit.client.0.smithi162.stdout:8/20: readlink - no filename 2024-04-25T01:40:09.364 INFO:tasks.workunit.client.0.smithi162.stdout:6/20: dwrite d1/f2 [0,4194304] 0 2024-04-25T01:40:09.530 INFO:tasks.workunit.client.0.smithi162.stdout:0/57: mknod d0/d1/c9 0 2024-04-25T01:40:09.531 INFO:tasks.workunit.client.0.smithi162.stdout:3/32: stat d2/c3 0 2024-04-25T01:40:09.601 INFO:tasks.workunit.client.0.smithi162.stdout:2/31: dread - d0/fa zero size 2024-04-25T01:40:09.602 INFO:tasks.workunit.client.0.smithi162.stdout:5/27: chown l4 7 1 2024-04-25T01:40:09.611 INFO:tasks.workunit.client.0.smithi162.stdout:1/32: sync 2024-04-25T01:40:09.697 INFO:tasks.workunit.client.0.smithi162.stdout:4/20: dread - f3 zero size 2024-04-25T01:40:09.758 INFO:tasks.workunit.client.0.smithi162.stdout:7/18: creat f7 x:0 0 0 2024-04-25T01:40:09.770 INFO:tasks.workunit.client.0.smithi162.stdout:9/15: dwrite f0 [4194304,4194304] 0 2024-04-25T01:40:09.787 INFO:tasks.workunit.client.0.smithi162.stdout:8/21: symlink d0/l6 0 2024-04-25T01:40:09.904 INFO:tasks.workunit.client.0.smithi162.stdout:3/33: mknod d2/cb 0 2024-04-25T01:40:09.904 INFO:tasks.workunit.client.0.smithi162.stdout:3/34: read - no filename 2024-04-25T01:40:09.904 INFO:tasks.workunit.client.0.smithi162.stdout:3/35: dread - no filename 2024-04-25T01:40:09.946 INFO:tasks.workunit.client.0.smithi162.stdout:1/33: creat fa x:0 0 0 2024-04-25T01:40:10.054 INFO:tasks.workunit.client.0.smithi162.stdout:1/34: stat c1 0 2024-04-25T01:40:10.084 INFO:tasks.workunit.client.0.smithi162.stdout:2/32: write d0/fb [599774,77755] 0 2024-04-25T01:40:10.086 INFO:tasks.workunit.client.0.smithi162.stdout:9/16: write f0 [2603782,20121] 0 2024-04-25T01:40:10.247 INFO:tasks.workunit.client.0.smithi162.stdout:7/19: mknod c8 0 2024-04-25T01:40:10.272 INFO:tasks.workunit.client.0.smithi162.stdout:3/36: symlink d2/lc 0 2024-04-25T01:40:10.324 INFO:tasks.workunit.client.0.smithi162.stdout:2/33: readlink d0/d3/lc 0 2024-04-25T01:40:10.362 INFO:tasks.workunit.client.0.smithi162.stdout:3/37: sync 2024-04-25T01:40:10.375 INFO:tasks.workunit.client.0.smithi162.stdout:5/28: dread f3 [0,4194304] 0 2024-04-25T01:40:10.448 INFO:tasks.workunit.client.0.smithi162.stdout:4/21: dwrite f4 [0,4194304] 0 2024-04-25T01:40:10.449 INFO:tasks.workunit.client.0.smithi162.stdout:8/22: symlink d0/d5/l7 0 2024-04-25T01:40:10.469 INFO:tasks.workunit.client.0.smithi162.stdout:5/29: fsync f2 0 2024-04-25T01:40:10.528 INFO:tasks.workunit.client.0.smithi162.stdout:8/23: sync 2024-04-25T01:40:10.528 INFO:tasks.workunit.client.0.smithi162.stdout:8/24: dwrite - no filename 2024-04-25T01:40:10.528 INFO:tasks.workunit.client.0.smithi162.stdout:8/25: dwrite - no filename 2024-04-25T01:40:10.688 INFO:tasks.workunit.client.0.smithi162.stdout:1/35: write f9 [1330583,76031] 0 2024-04-25T01:40:10.772 INFO:tasks.workunit.client.0.smithi162.stdout:6/21: link c0 d1/c3 0 2024-04-25T01:40:10.800 INFO:tasks.workunit.client.0.smithi162.stdout:2/34: creat d0/d3/fd x:0 0 0 2024-04-25T01:40:10.824 INFO:tasks.workunit.client.0.smithi162.stdout:8/26: readlink d0/l6 0 2024-04-25T01:40:10.824 INFO:tasks.workunit.client.0.smithi162.stdout:8/27: dread - no filename 2024-04-25T01:40:10.824 INFO:tasks.workunit.client.0.smithi162.stdout:8/28: write - no filename 2024-04-25T01:40:10.824 INFO:tasks.workunit.client.0.smithi162.stdout:8/29: write - no filename 2024-04-25T01:40:10.824 INFO:tasks.workunit.client.0.smithi162.stdout:8/30: dwrite - no filename 2024-04-25T01:40:10.883 INFO:tasks.workunit.client.0.smithi162.stdout:1/36: read f3 [2093755,36726] 0 2024-04-25T01:40:11.011 INFO:tasks.workunit.client.0.smithi162.stdout:0/58: getdents d0/d1 0 2024-04-25T01:40:11.061 INFO:tasks.workunit.client.0.smithi162.stdout:3/38: creat d2/d9/fd x:0 0 0 2024-04-25T01:40:11.207 INFO:tasks.workunit.client.0.smithi162.stdout:9/17: dwrite f3 [0,4194304] 0 2024-04-25T01:40:11.354 INFO:tasks.workunit.client.0.smithi162.stdout:6/22: unlink d1/c3 0 2024-04-25T01:40:11.362 INFO:tasks.workunit.client.0.smithi162.stdout:1/37: mknod cb 0 2024-04-25T01:40:11.381 INFO:tasks.workunit.client.0.smithi162.stdout:5/30: truncate f2 3948996 0 2024-04-25T01:40:11.419 INFO:tasks.workunit.client.0.smithi162.stdout:8/31: symlink d0/l8 0 2024-04-25T01:40:11.454 INFO:tasks.workunit.client.0.smithi162.stdout:9/18: dread - d4/f5 zero size 2024-04-25T01:40:11.537 INFO:tasks.workunit.client.0.smithi162.stdout:3/39: mknod d2/d9/ce 0 2024-04-25T01:40:11.715 INFO:tasks.workunit.client.0.smithi162.stdout:2/35: truncate d0/d3/fd 594712 0 2024-04-25T01:40:11.716 INFO:tasks.workunit.client.0.smithi162.stdout:1/38: creat fc x:0 0 0 2024-04-25T01:40:11.766 INFO:tasks.workunit.client.0.smithi162.stdout:7/20: dwrite f6 [0,4194304] 0 2024-04-25T01:40:11.959 INFO:tasks.workunit.client.0.smithi162.stdout:0/59: rename d0/d1/c5 to d0/d1/ca 0 2024-04-25T01:40:12.071 INFO:tasks.workunit.client.0.smithi162.stdout:1/39: chown fa 83 1 2024-04-25T01:40:12.111 INFO:tasks.workunit.client.0.smithi162.stdout:8/32: mknod d0/c9 0 2024-04-25T01:40:12.135 INFO:tasks.workunit.client.0.smithi162.stdout:7/21: dread - f7 zero size 2024-04-25T01:40:12.160 INFO:tasks.workunit.client.0.smithi162.stdout:9/19: creat d4/f6 x:0 0 0 2024-04-25T01:40:12.223 INFO:tasks.workunit.client.0.smithi162.stdout:2/36: write d0/fb [1150294,55577] 0 2024-04-25T01:40:12.246 INFO:tasks.workunit.client.0.smithi162.stdout:3/40: rename d2/l4 to d2/lf 0 2024-04-25T01:40:12.286 INFO:tasks.workunit.client.0.smithi162.stdout:4/22: dwrite f0 [0,4194304] 0 2024-04-25T01:40:12.378 INFO:tasks.workunit.client.0.smithi162.stdout:3/41: sync 2024-04-25T01:40:12.439 INFO:tasks.workunit.client.0.smithi162.stdout:0/60: creat d0/d1/fb x:0 0 0 2024-04-25T01:40:12.557 INFO:tasks.workunit.client.0.smithi162.stdout:9/20: chown f3 252 1 2024-04-25T01:40:12.600 INFO:tasks.workunit.client.0.smithi162.stdout:8/33: chown d0/c3 23 1 2024-04-25T01:40:12.726 INFO:tasks.workunit.client.0.smithi162.stdout:7/22: unlink f7 0 2024-04-25T01:40:12.834 INFO:tasks.workunit.client.0.smithi162.stdout:6/23: dwrite d1/f2 [0,4194304] 0 2024-04-25T01:40:12.856 INFO:tasks.workunit.client.0.smithi162.stdout:4/23: rename f3 to f5 0 2024-04-25T01:40:13.024 INFO:tasks.workunit.client.0.smithi162.stdout:5/31: dwrite f3 [0,4194304] 0 2024-04-25T01:40:13.113 INFO:tasks.workunit.client.0.smithi162.stdout:3/42: truncate d2/d9/fd 496612 0 2024-04-25T01:40:13.182 INFO:tasks.workunit.client.0.smithi162.stdout:4/24: dread - f5 zero size 2024-04-25T01:40:13.196 INFO:tasks.workunit.client.0.smithi162.stdout:1/40: getdents . 0 2024-04-25T01:40:13.220 INFO:tasks.workunit.client.0.smithi162.stdout:0/61: chown d0/d1/ca 468217 1 2024-04-25T01:40:13.250 INFO:tasks.workunit.client.0.smithi162.stdout:2/37: rename d0/fa to d0/d3/fe 0 2024-04-25T01:40:13.312 INFO:tasks.workunit.client.0.smithi162.stdout:1/41: truncate fa 318132 0 2024-04-25T01:40:13.329 INFO:tasks.workunit.client.0.smithi162.stdout:4/25: write f4 [1580146,44497] 0 2024-04-25T01:40:13.385 INFO:tasks.workunit.client.0.smithi162.stdout:1/42: read f9 [420639,17214] 0 2024-04-25T01:40:13.387 INFO:tasks.workunit.client.0.smithi162.stdout:2/38: chown d0/d3/l6 1512 1 2024-04-25T01:40:13.527 INFO:tasks.workunit.client.0.smithi162.stdout:5/32: mknod c7 0 2024-04-25T01:40:13.833 INFO:tasks.workunit.client.0.smithi162.stdout:0/62: creat d0/d1/fc x:0 0 0 2024-04-25T01:40:13.897 INFO:tasks.workunit.client.0.smithi162.stdout:6/24: rmdir d1 39 2024-04-25T01:40:14.077 INFO:tasks.workunit.client.0.smithi162.stdout:2/39: dwrite d0/fb [0,4194304] 0 2024-04-25T01:40:14.225 INFO:tasks.workunit.client.0.smithi162.stdout:4/26: symlink l6 0 2024-04-25T01:40:14.232 INFO:tasks.workunit.client.0.smithi162.stdout:0/63: dread - d0/d1/f7 zero size 2024-04-25T01:40:14.257 INFO:tasks.workunit.client.0.smithi162.stdout:1/43: symlink ld 0 2024-04-25T01:40:14.303 INFO:tasks.workunit.client.0.smithi162.stdout:7/23: dwrite f3 [0,4194304] 0 2024-04-25T01:40:14.466 INFO:tasks.workunit.client.0.smithi162.stdout:9/21: link d4/f5 d4/f7 0 2024-04-25T01:40:14.612 INFO:tasks.workunit.client.0.smithi162.stdout:9/22: truncate d4/f5 804781 0 2024-04-25T01:40:14.617 INFO:tasks.workunit.client.0.smithi162.stdout:4/27: dread f4 [0,4194304] 0 2024-04-25T01:40:14.647 INFO:tasks.workunit.client.0.smithi162.stdout:9/23: fdatasync f3 0 2024-04-25T01:40:14.655 INFO:tasks.workunit.client.0.smithi162.stdout:4/28: stat f5 0 2024-04-25T01:40:15.045 INFO:tasks.workunit.client.0.smithi162.stdout:1/44: dread f9 [0,4194304] 0 2024-04-25T01:40:15.065 INFO:tasks.workunit.client.0.smithi162.stdout:1/45: chown c2 143 1 2024-04-25T01:40:15.204 INFO:tasks.workunit.client.0.smithi162.stdout:2/40: unlink d0/fb 0 2024-04-25T01:40:15.218 INFO:tasks.workunit.client.0.smithi162.stdout:1/46: dread f3 [0,4194304] 0 2024-04-25T01:40:15.259 INFO:tasks.workunit.client.0.smithi162.stdout:1/47: dread - fc zero size 2024-04-25T01:40:15.298 INFO:tasks.workunit.client.0.smithi162.stdout:1/48: read f3 [3062020,114332] 0 2024-04-25T01:40:15.344 INFO:tasks.workunit.client.0.smithi162.stdout:7/24: creat f9 x:0 0 0 2024-04-25T01:40:15.556 INFO:tasks.workunit.client.0.smithi162.stdout:8/34: getdents d0/d5 0 2024-04-25T01:40:15.602 INFO:tasks.workunit.client.0.smithi162.stdout:6/25: rmdir d1 39 2024-04-25T01:40:15.785 INFO:tasks.workunit.client.0.smithi162.stdout:1/49: creat fe x:0 0 0 2024-04-25T01:40:15.800 INFO:tasks.workunit.client.0.smithi162.stdout:1/50: chown cb 18 1 2024-04-25T01:40:16.035 INFO:tasks.workunit.client.0.smithi162.stdout:5/33: write f2 [2512480,37896] 0 2024-04-25T01:40:16.084 INFO:tasks.workunit.client.0.smithi162.stdout:5/34: write f2 [2338916,25127] 0 2024-04-25T01:40:16.326 INFO:tasks.workunit.client.0.smithi162.stdout:3/43: getdents d2/d9 0 2024-04-25T01:40:16.364 INFO:tasks.workunit.client.0.smithi162.stdout:2/41: link d0/d3/fd d0/ff 0 2024-04-25T01:40:16.365 INFO:tasks.workunit.client.0.smithi162.stdout:1/51: mknod cf 0 2024-04-25T01:40:16.429 INFO:tasks.workunit.client.0.smithi162.stdout:3/44: write d2/d9/fd [476710,10894] 0 2024-04-25T01:40:16.529 INFO:tasks.workunit.client.0.smithi162.stdout:1/52: sync 2024-04-25T01:40:16.653 INFO:tasks.workunit.client.0.smithi162.stdout:6/26: dwrite d1/f2 [0,4194304] 0 2024-04-25T01:40:16.797 INFO:tasks.workunit.client.0.smithi162.stdout:5/35: symlink l8 0 2024-04-25T01:40:16.841 INFO:tasks.workunit.client.0.smithi162.stdout:4/29: truncate f0 1342347 0 2024-04-25T01:40:16.844 INFO:tasks.workunit.client.0.smithi162.stdout:5/36: write f2 [1539589,42968] 0 2024-04-25T01:40:16.865 INFO:tasks.workunit.client.0.smithi162.stdout:8/35: getdents d0/d5 0 2024-04-25T01:40:16.896 INFO:tasks.workunit.client.0.smithi162.stdout:3/45: mkdir d2/d9/d10 0 2024-04-25T01:40:16.920 INFO:tasks.workunit.client.0.smithi162.stdout:5/37: chown l8 3529 1 2024-04-25T01:40:16.933 INFO:tasks.workunit.client.0.smithi162.stdout:8/36: chown d0/c3 0 1 2024-04-25T01:40:17.014 INFO:tasks.workunit.client.0.smithi162.stdout:0/64: getdents d0/d1 0 2024-04-25T01:40:17.038 INFO:tasks.workunit.client.0.smithi162.stdout:9/24: getdents d4 0 2024-04-25T01:40:17.127 INFO:tasks.workunit.client.0.smithi162.stdout:0/65: dread - d0/d1/f7 zero size 2024-04-25T01:40:17.324 INFO:tasks.workunit.client.0.smithi162.stdout:7/25: truncate f6 108946 0 2024-04-25T01:40:17.427 INFO:tasks.workunit.client.0.smithi162.stdout:1/53: write f4 [787680,53104] 0 2024-04-25T01:40:17.501 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:40:17.504 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:40:17.737 INFO:tasks.workunit.client.0.smithi162.stdout:2/42: dwrite d0/f9 [0,4194304] 0 2024-04-25T01:40:17.833 INFO:tasks.workunit.client.0.smithi162.stdout:5/38: mknod c9 0 2024-04-25T01:40:17.850 INFO:tasks.workunit.client.0.smithi162.stdout:8/37: rmdir d0/d5 39 2024-04-25T01:40:17.850 INFO:tasks.workunit.client.0.smithi162.stdout:8/38: dwrite - no filename 2024-04-25T01:40:17.936 INFO:tasks.workunit.client.0.smithi162.stdout:9/25: mkdir d4/d8 0 2024-04-25T01:40:17.963 INFO:tasks.workunit.client.0.smithi162.stdout:0/66: rename d0/d1/fb to d0/fd 0 2024-04-25T01:40:18.030 INFO:tasks.workunit.client.0.smithi162.stdout:6/27: truncate d1/f2 610579 0 2024-04-25T01:40:18.113 INFO:tasks.workunit.client.0.smithi162.stdout:1/54: dwrite f4 [0,4194304] 0 2024-04-25T01:40:18.562 INFO:tasks.workunit.client.0.smithi162.stdout:1/55: write f4 [164974,12430] 0 2024-04-25T01:40:18.626 INFO:tasks.workunit.client.0.smithi162.stdout:3/46: link d2/d9/fd d2/d9/d10/f11 0 2024-04-25T01:40:18.949 INFO:tasks.workunit.client.0.smithi162.stdout:4/30: dwrite f5 [0,4194304] 0 2024-04-25T01:40:19.066 INFO:tasks.workunit.client.0.smithi162.stdout:5/39: dread f2 [0,4194304] 0 2024-04-25T01:40:19.177 INFO:tasks.workunit.client.0.smithi162.stdout:7/26: dwrite f5 [0,4194304] 0 2024-04-25T01:40:19.335 INFO:tasks.workunit.client.0.smithi162.stdout:6/28: creat d1/f4 x:0 0 0 2024-04-25T01:40:19.364 INFO:tasks.workunit.client.0.smithi162.stdout:1/56: mknod c10 0 2024-04-25T01:40:19.448 INFO:tasks.workunit.client.0.smithi162.stdout:0/67: dwrite d0/d1/fc [0,4194304] 0 2024-04-25T01:40:19.699 INFO:tasks.workunit.client.0.smithi162.stdout:7/27: dread f3 [0,4194304] 0 2024-04-25T01:40:19.719 INFO:tasks.workunit.client.0.smithi162.stdout:7/28: chown f2 402 1 2024-04-25T01:40:19.762 INFO:tasks.workunit.client.0.smithi162.stdout:9/26: mkdir d4/d9 0 2024-04-25T01:40:19.882 INFO:tasks.workunit.client.0.smithi162.stdout:8/39: mknod d0/ca 0 2024-04-25T01:40:19.882 INFO:tasks.workunit.client.0.smithi162.stdout:8/40: write - no filename 2024-04-25T01:40:20.048 INFO:tasks.workunit.client.0.smithi162.stdout:5/40: mknod ca 0 2024-04-25T01:40:20.329 INFO:tasks.workunit.client.0.smithi162.stdout:1/57: mknod c11 0 2024-04-25T01:40:20.377 INFO:tasks.workunit.client.0.smithi162.stdout:6/29: chown c0 979 1 2024-04-25T01:40:20.408 INFO:tasks.workunit.client.0.smithi162.stdout:6/30: write d1/f4 [178697,81425] 0 2024-04-25T01:40:20.676 INFO:tasks.workunit.client.0.smithi162.stdout:3/47: symlink d2/d7/l12 0 2024-04-25T01:40:20.833 INFO:tasks.workunit.client.0.smithi162.stdout:2/43: dwrite d0/ff [0,4194304] 0 2024-04-25T01:40:20.967 INFO:tasks.workunit.client.0.smithi162.stdout:3/48: chown d2/d9/ce 3643 1 2024-04-25T01:40:21.028 INFO:tasks.workunit.client.0.smithi162.stdout:8/41: rename d0/d5 to d0/d5/db 22 2024-04-25T01:40:21.066 INFO:tasks.workunit.client.0.smithi162.stdout:8/42: stat d0/ca 0 2024-04-25T01:40:21.138 INFO:tasks.workunit.client.0.smithi162.stdout:8/43: chown d0/l6 541425849 1 2024-04-25T01:40:21.264 INFO:tasks.workunit.client.0.smithi162.stdout:5/41: dread f3 [0,4194304] 0 2024-04-25T01:40:21.347 INFO:tasks.workunit.client.0.smithi162.stdout:1/58: mknod c12 0 2024-04-25T01:40:21.647 INFO:tasks.workunit.client.0.smithi162.stdout:9/27: creat d4/d9/fa x:0 0 0 2024-04-25T01:40:21.659 INFO:tasks.workunit.client.0.smithi162.stdout:9/28: chown d4 499245845 1 2024-04-25T01:40:22.079 INFO:tasks.workunit.client.0.smithi162.stdout:3/49: creat d2/f13 x:0 0 0 2024-04-25T01:40:22.110 INFO:tasks.workunit.client.0.smithi162.stdout:4/31: dwrite f4 [0,4194304] 0 2024-04-25T01:40:22.256 INFO:tasks.workunit.client.0.smithi162.stdout:2/44: rename d0/d3/d5/c8 to d0/d3/c10 0 2024-04-25T01:40:22.363 INFO:tasks.workunit.client.0.smithi162.stdout:5/42: symlink lb 0 2024-04-25T01:40:22.403 INFO:tasks.workunit.client.0.smithi162.stdout:5/43: stat l6 0 2024-04-25T01:40:22.437 INFO:tasks.workunit.client.0.smithi162.stdout:3/50: dread d2/d9/fd [0,4194304] 0 2024-04-25T01:40:22.441 INFO:tasks.workunit.client.0.smithi162.stdout:1/59: mknod c13 0 2024-04-25T01:40:22.558 INFO:tasks.workunit.client.0.smithi162.stdout:6/31: link d1/f4 d1/f5 0 2024-04-25T01:40:22.681 INFO:tasks.workunit.client.0.smithi162.stdout:9/29: mknod d4/d9/cb 0 2024-04-25T01:40:22.800 INFO:tasks.workunit.client.0.smithi162.stdout:4/32: creat f7 x:0 0 0 2024-04-25T01:40:22.953 INFO:tasks.workunit.client.0.smithi162.stdout:0/68: dwrite d0/d1/f4 [0,4194304] 0 2024-04-25T01:40:23.264 INFO:tasks.workunit.client.0.smithi162.stdout:5/44: fdatasync f3 0 2024-04-25T01:40:23.298 INFO:tasks.workunit.client.0.smithi162.stdout:3/51: dwrite d2/f13 [0,4194304] 0 2024-04-25T01:40:23.503 INFO:tasks.workunit.client.0.smithi162.stdout:7/29: getdents . 0 2024-04-25T01:40:23.668 INFO:tasks.workunit.client.0.smithi162.stdout:3/52: chown d2/cb 1 1 2024-04-25T01:40:23.672 INFO:tasks.workunit.client.0.smithi162.stdout:9/30: dread - d4/f6 zero size 2024-04-25T01:40:23.822 INFO:tasks.workunit.client.0.smithi162.stdout:2/45: dwrite d0/d3/fd [4194304,4194304] 0 2024-04-25T01:40:23.950 INFO:tasks.workunit.client.0.smithi162.stdout:2/46: chown d0/ff 268118535 1 2024-04-25T01:40:23.965 INFO:tasks.workunit.client.0.smithi162.stdout:2/47: readlink d0/d3/lc 0 2024-04-25T01:40:24.035 INFO:tasks.workunit.client.0.smithi162.stdout:6/32: fsync d1/f4 0 2024-04-25T01:40:24.074 INFO:tasks.workunit.client.0.smithi162.stdout:4/33: chown f0 3276556 1 2024-04-25T01:40:24.727 INFO:tasks.workunit.client.0.smithi162.stdout:0/69: dwrite d0/fd [0,4194304] 0 2024-04-25T01:40:24.743 INFO:tasks.workunit.client.0.smithi162.stdout:7/30: creat fa x:0 0 0 2024-04-25T01:40:24.760 INFO:tasks.workunit.client.0.smithi162.stdout:1/60: write f9 [5384,9080] 0 2024-04-25T01:40:25.011 INFO:tasks.workunit.client.0.smithi162.stdout:2/48: symlink d0/l11 0 2024-04-25T01:40:25.333 INFO:tasks.workunit.client.0.smithi162.stdout:6/33: write d1/f4 [730520,115846] 0 2024-04-25T01:40:25.540 INFO:tasks.workunit.client.0.smithi162.stdout:4/34: rename l6 to l8 0 2024-04-25T01:40:25.558 INFO:tasks.workunit.client.0.smithi162.stdout:8/44: link d0/d5/l7 d0/lc 0 2024-04-25T01:40:25.798 INFO:tasks.workunit.client.0.smithi162.stdout:1/61: unlink cf 0 2024-04-25T01:40:25.914 INFO:tasks.workunit.client.0.smithi162.stdout:0/70: symlink d0/le 0 2024-04-25T01:40:26.112 INFO:tasks.workunit.client.0.smithi162.stdout:7/31: truncate f3 645959 0 2024-04-25T01:40:26.260 INFO:tasks.workunit.client.0.smithi162.stdout:3/53: write d2/d9/fd [57483,23695] 0 2024-04-25T01:40:26.549 INFO:tasks.workunit.client.0.smithi162.stdout:9/31: dwrite f2 [0,4194304] 0 2024-04-25T01:40:26.690 INFO:tasks.workunit.client.0.smithi162.stdout:5/45: link l6 lc 0 2024-04-25T01:40:26.861 INFO:tasks.workunit.client.0.smithi162.stdout:4/35: chown l8 460 1 2024-04-25T01:40:26.875 INFO:tasks.workunit.client.0.smithi162.stdout:4/36: chown f5 1485 1 2024-04-25T01:40:26.931 INFO:tasks.workunit.client.0.smithi162.stdout:8/45: creat d0/d5/fd x:0 0 0 2024-04-25T01:40:26.959 INFO:tasks.workunit.client.0.smithi162.stdout:1/62: truncate f4 750923 0 2024-04-25T01:40:27.685 INFO:tasks.workunit.client.0.smithi162.stdout:6/34: rename d1/f5 to d1/f6 0 2024-04-25T01:40:27.829 INFO:tasks.workunit.client.0.smithi162.stdout:5/46: creat fd x:0 0 0 2024-04-25T01:40:28.182 INFO:tasks.workunit.client.0.smithi162.stdout:8/46: mkdir d0/d5/de 0 2024-04-25T01:40:28.211 INFO:tasks.workunit.client.0.smithi162.stdout:1/63: dread - fe zero size 2024-04-25T01:40:28.438 INFO:tasks.workunit.client.0.smithi162.stdout:8/47: sync 2024-04-25T01:40:28.468 INFO:tasks.workunit.client.0.smithi162.stdout:0/71: dwrite d0/d1/f7 [0,4194304] 0 2024-04-25T01:40:28.616 INFO:tasks.workunit.client.0.smithi162.stdout:3/54: creat d2/d9/d10/f14 x:0 0 0 2024-04-25T01:40:28.620 INFO:tasks.workunit.client.0.smithi162.stdout:2/49: link d0/d3/lc d0/d3/l12 0 2024-04-25T01:40:28.637 INFO:tasks.workunit.client.0.smithi162.stdout:6/35: creat d1/f7 x:0 0 0 2024-04-25T01:40:28.644 INFO:tasks.workunit.client.0.smithi162.stdout:8/48: dread - d0/d5/fd zero size 2024-04-25T01:40:28.679 INFO:tasks.workunit.client.0.smithi162.stdout:5/47: symlink le 0 2024-04-25T01:40:28.744 INFO:tasks.workunit.client.0.smithi162.stdout:2/50: dread - d0/d3/fe zero size 2024-04-25T01:40:28.748 INFO:tasks.workunit.client.0.smithi162.stdout:3/55: write d2/f13 [846153,33383] 0 2024-04-25T01:40:28.768 INFO:tasks.workunit.client.0.smithi162.stdout:5/48: write fd [683823,115297] 0 2024-04-25T01:40:28.978 INFO:tasks.workunit.client.0.smithi162.stdout:1/64: creat f14 x:0 0 0 2024-04-25T01:40:29.261 INFO:tasks.workunit.client.0.smithi162.stdout:2/51: dread d0/d3/fd [4194304,4194304] 0 2024-04-25T01:40:29.351 INFO:tasks.workunit.client.0.smithi162.stdout:8/49: dwrite d0/d5/fd [0,4194304] 0 2024-04-25T01:40:29.825 INFO:tasks.workunit.client.0.smithi162.stdout:4/37: dwrite f0 [0,4194304] 0 2024-04-25T01:40:29.940 INFO:tasks.workunit.client.0.smithi162.stdout:2/52: dread d0/ff [0,4194304] 0 2024-04-25T01:40:29.976 INFO:tasks.workunit.client.0.smithi162.stdout:5/49: rename f2 to ff 0 2024-04-25T01:40:30.059 INFO:tasks.workunit.client.0.smithi162.stdout:5/50: write fd [1119488,77687] 0 2024-04-25T01:40:30.437 INFO:tasks.workunit.client.0.smithi162.stdout:9/32: dwrite d4/f5 [0,4194304] 0 2024-04-25T01:40:30.573 INFO:tasks.workunit.client.0.smithi162.stdout:7/32: link f1 fb 0 2024-04-25T01:40:30.732 INFO:tasks.workunit.client.0.smithi162.stdout:6/36: rename d1/f6 to d1/f8 0 2024-04-25T01:40:31.227 INFO:tasks.workunit.client.0.smithi162.stdout:4/38: mknod c9 0 2024-04-25T01:40:31.481 INFO:tasks.workunit.client.0.smithi162.stdout:0/72: mkdir d0/df 0 2024-04-25T01:40:31.542 INFO:tasks.workunit.client.0.smithi162.stdout:1/65: dwrite fc [0,4194304] 0 2024-04-25T01:40:31.750 INFO:tasks.workunit.client.0.smithi162.stdout:4/39: dread f0 [0,4194304] 0 2024-04-25T01:40:31.868 INFO:tasks.workunit.client.0.smithi162.stdout:5/51: dread ff [0,4194304] 0 2024-04-25T01:40:31.962 INFO:tasks.workunit.client.0.smithi162.stdout:9/33: fsync d4/f7 0 2024-04-25T01:40:32.017 INFO:tasks.workunit.client.0.smithi162.stdout:7/33: read - fa zero size 2024-04-25T01:40:32.045 INFO:tasks.workunit.client.0.smithi162.stdout:7/34: read fb [75357,122175] 0 2024-04-25T01:40:32.090 INFO:tasks.workunit.client.0.smithi162.stdout:6/37: chown d1/f4 258119 1 2024-04-25T01:40:32.311 INFO:tasks.workunit.client.0.smithi162.stdout:8/50: mknod d0/cf 0 2024-04-25T01:40:32.625 INFO:tasks.workunit.client.0.smithi162.stdout:1/66: mkdir d15 0 2024-04-25T01:40:32.745 INFO:tasks.workunit.client.0.smithi162.stdout:2/53: dwrite d0/f9 [0,4194304] 0 2024-04-25T01:40:33.222 INFO:tasks.workunit.client.0.smithi162.stdout:7/35: mkdir dc 0 2024-04-25T01:40:33.398 INFO:tasks.workunit.client.0.smithi162.stdout:6/38: rename d1/f7 to d1/f9 0 2024-04-25T01:40:33.410 INFO:tasks.workunit.client.0.smithi162.stdout:6/39: chown c0 541 1 2024-04-25T01:40:33.576 INFO:tasks.workunit.client.0.smithi162.stdout:3/56: link d2/l6 d2/d9/d10/l15 0 2024-04-25T01:40:33.591 INFO:tasks.workunit.client.0.smithi162.stdout:0/73: write d0/d1/fc [5122654,84303] 0 2024-04-25T01:40:33.705 INFO:tasks.workunit.client.0.smithi162.stdout:8/51: unlink d0/l8 0 2024-04-25T01:40:33.986 INFO:tasks.workunit.client.0.smithi162.stdout:5/52: dwrite ff [4194304,4194304] 0 2024-04-25T01:40:34.310 INFO:tasks.workunit.client.0.smithi162.stdout:1/67: rename ld to d15/l16 0 2024-04-25T01:40:34.327 INFO:tasks.workunit.client.0.smithi162.stdout:4/40: unlink f0 0 2024-04-25T01:40:34.350 INFO:tasks.workunit.client.0.smithi162.stdout:2/54: symlink d0/d3/d5/l13 0 2024-04-25T01:40:34.380 INFO:tasks.workunit.client.0.smithi162.stdout:9/34: creat d4/d8/fc x:0 0 0 2024-04-25T01:40:34.467 INFO:tasks.workunit.client.0.smithi162.stdout:5/53: dwrite fd [0,4194304] 0 2024-04-25T01:40:34.677 INFO:tasks.workunit.client.0.smithi162.stdout:0/74: dread d0/fd [0,4194304] 0 2024-04-25T01:40:35.512 INFO:tasks.workunit.client.0.smithi162.stdout:1/68: dread - f14 zero size 2024-04-25T01:40:35.830 INFO:tasks.workunit.client.0.smithi162.stdout:8/52: symlink d0/l10 0 2024-04-25T01:40:35.902 INFO:tasks.workunit.client.0.smithi162.stdout:2/55: write d0/ff [2605766,89747] 0 2024-04-25T01:40:35.982 INFO:tasks.workunit.client.0.smithi162.stdout:6/40: dwrite d1/f8 [0,4194304] 0 2024-04-25T01:40:36.168 INFO:tasks.workunit.client.0.smithi162.stdout:3/57: dwrite d2/d9/d10/f11 [0,4194304] 0 2024-04-25T01:40:36.200 INFO:tasks.workunit.client.0.smithi162.stdout:0/75: rename d0/d1/c9 to d0/d1/c10 0 2024-04-25T01:40:36.351 INFO:tasks.workunit.client.0.smithi162.stdout:7/36: rmdir dc 0 2024-04-25T01:40:36.369 INFO:tasks.workunit.client.0.smithi162.stdout:4/41: dread f5 [0,4194304] 0 2024-04-25T01:40:36.398 INFO:tasks.workunit.client.0.smithi162.stdout:7/37: dread - fa zero size 2024-04-25T01:40:36.578 INFO:tasks.workunit.client.0.smithi162.stdout:1/69: rename c13 to d15/c17 0 2024-04-25T01:40:36.773 INFO:tasks.workunit.client.0.smithi162.stdout:8/53: fsync d0/d5/fd 0 2024-04-25T01:40:36.812 INFO:tasks.workunit.client.0.smithi162.stdout:8/54: fdatasync d0/d5/fd 0 2024-04-25T01:40:36.939 INFO:tasks.workunit.client.0.smithi162.stdout:2/56: rmdir d0/d3/d5 39 2024-04-25T01:40:37.063 INFO:tasks.workunit.client.0.smithi162.stdout:6/41: mknod d1/ca 0 2024-04-25T01:40:37.235 INFO:tasks.workunit.client.0.smithi162.stdout:4/42: mknod ca 0 2024-04-25T01:40:37.382 INFO:tasks.workunit.client.0.smithi162.stdout:1/70: symlink d15/l18 0 2024-04-25T01:40:37.450 INFO:tasks.workunit.client.0.smithi162.stdout:3/58: rename d2/d7/l12 to d2/d9/l16 0 2024-04-25T01:40:37.542 INFO:tasks.workunit.client.0.smithi162.stdout:9/35: rename d4/f6 to d4/fd 0 2024-04-25T01:40:37.752 INFO:tasks.workunit.client.0.smithi162.stdout:5/54: truncate ff 3397477 0 2024-04-25T01:40:37.883 INFO:tasks.workunit.client.0.smithi162.stdout:6/42: symlink d1/lb 0 2024-04-25T01:40:37.964 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:51:27.415 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:40:37.998 INFO:tasks.workunit.client.0.smithi162.stdout:0/76: unlink d0/d1/c10 0 2024-04-25T01:40:38.016 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:51:27.468 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:40:38.097 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:51:27.548 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:40:38.117 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:51:27.485 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:40:38.120 INFO:tasks.workunit.client.0.smithi162.stdout:4/43: creat fb x:0 0 0 2024-04-25T01:40:38.122 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:51:27.490 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:40:38.126 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:51:27.494 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:40:38.127 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:51:27.495 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:40:38.139 INFO:tasks.workunit.client.0.smithi162.stdout:4/44: chown fb 24 1 2024-04-25T01:40:38.200 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:51:27.568 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:40:38.229 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:51:27.595 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:40:38.557 INFO:tasks.workunit.client.0.smithi162.stdout:2/57: write d0/d3/fe [777904,94014] 0 2024-04-25T01:40:38.585 INFO:tasks.workunit.client.0.smithi162.stdout:2/58: fdatasync d0/d3/fd 0 2024-04-25T01:40:38.795 INFO:tasks.workunit.client.0.smithi162.stdout:9/36: truncate f0 5018386 0 2024-04-25T01:40:38.826 INFO:tasks.workunit.client.0.smithi162.stdout:5/55: mknod c10 0 2024-04-25T01:40:38.921 INFO:tasks.workunit.client.0.smithi162.stdout:9/37: chown d4/d8/fc 1102034 1 2024-04-25T01:40:38.991 INFO:tasks.workunit.client.0.smithi162.stdout:6/43: creat d1/fc x:0 0 0 2024-04-25T01:40:39.006 INFO:tasks.workunit.client.0.smithi162.stdout:3/59: dread d2/f13 [0,4194304] 0 2024-04-25T01:40:39.022 INFO:tasks.workunit.client.0.smithi162.stdout:0/77: mknod d0/d1/c11 0 2024-04-25T01:40:39.059 INFO:tasks.workunit.client.0.smithi162.stdout:4/45: creat fc x:0 0 0 2024-04-25T01:40:39.090 INFO:tasks.workunit.client.0.smithi162.stdout:7/38: write f3 [1400854,7057] 0 2024-04-25T01:40:39.113 INFO:tasks.workunit.client.0.smithi162.stdout:1/71: write f3 [709033,105054] 0 2024-04-25T01:40:39.154 INFO:tasks.workunit.client.0.smithi162.stdout:6/44: readlink d1/lb 0 2024-04-25T01:40:39.219 INFO:tasks.workunit.client.0.smithi162.stdout:1/72: write f3 [3796514,80617] 0 2024-04-25T01:40:39.336 INFO:tasks.workunit.client.0.smithi162.stdout:2/59: readlink d0/d3/lc 0 2024-04-25T01:40:39.618 INFO:tasks.workunit.client.0.smithi162.stdout:8/55: creat d0/f11 x:0 0 0 2024-04-25T01:40:39.726 INFO:tasks.workunit.client.0.smithi162.stdout:2/60: dwrite d0/ff [8388608,4194304] 0 2024-04-25T01:40:39.829 INFO:tasks.workunit.client.0.smithi162.stdout:2/61: readlink d0/d3/l12 0 2024-04-25T01:40:39.951 INFO:tasks.workunit.client.0.smithi162.stdout:4/46: mkdir dd 0 2024-04-25T01:40:39.966 INFO:tasks.workunit.client.0.smithi162.stdout:7/39: rename fb to fd 0 2024-04-25T01:40:39.978 INFO:tasks.workunit.client.0.smithi162.stdout:7/40: readlink l0 0 2024-04-25T01:40:39.979 INFO:tasks.workunit.client.0.smithi162.stdout:4/47: readlink l8 0 2024-04-25T01:40:40.005 INFO:tasks.workunit.client.0.smithi162.stdout:7/41: chown f3 2636 1 2024-04-25T01:40:40.045 INFO:tasks.workunit.client.0.smithi162.stdout:0/78: creat d0/d1/f12 x:0 0 0 2024-04-25T01:40:40.204 INFO:tasks.workunit.client.0.smithi162.stdout:3/60: mkdir d2/d9/d17 0 2024-04-25T01:40:40.225 INFO:tasks.workunit.client.0.smithi162.stdout:6/45: creat d1/fd x:0 0 0 2024-04-25T01:40:40.608 INFO:tasks.workunit.client.0.smithi162.stdout:5/56: link fd f11 0 2024-04-25T01:40:40.852 INFO:tasks.workunit.client.0.smithi162.stdout:9/38: dwrite f2 [0,4194304] 0 2024-04-25T01:40:41.034 INFO:tasks.workunit.client.0.smithi162.stdout:4/48: truncate f7 520303 0 2024-04-25T01:40:41.049 INFO:tasks.workunit.client.0.smithi162.stdout:7/42: mknod ce 0 2024-04-25T01:40:41.205 INFO:tasks.workunit.client.0.smithi162.stdout:0/79: fsync d0/d1/fc 0 2024-04-25T01:40:41.263 INFO:tasks.workunit.client.0.smithi162.stdout:0/80: dread - d0/d1/f12 zero size 2024-04-25T01:40:41.323 INFO:tasks.workunit.client.0.smithi162.stdout:3/61: truncate d2/d9/d10/f14 420309 0 2024-04-25T01:40:41.652 INFO:tasks.workunit.client.0.smithi162.stdout:6/46: dwrite d1/f9 [0,4194304] 0 2024-04-25T01:40:41.804 INFO:tasks.workunit.client.0.smithi162.stdout:8/56: mkdir d0/d12 0 2024-04-25T01:40:41.867 INFO:tasks.workunit.client.0.smithi162.stdout:9/39: rename d4/d8/fc to d4/d9/fe 0 2024-04-25T01:40:41.961 INFO:tasks.workunit.client.0.smithi162.stdout:0/81: rename d0 to d0/df/d13 22 2024-04-25T01:40:42.044 INFO:tasks.workunit.client.0.smithi162.stdout:8/57: sync 2024-04-25T01:40:42.180 INFO:tasks.workunit.client.0.smithi162.stdout:2/62: symlink d0/l14 0 2024-04-25T01:40:42.220 INFO:tasks.workunit.client.0.smithi162.stdout:5/57: dread ff [0,4194304] 0 2024-04-25T01:40:42.236 INFO:tasks.workunit.client.0.smithi162.stdout:1/73: dwrite fe [0,4194304] 0 2024-04-25T01:40:42.445 INFO:tasks.workunit.client.0.smithi162.stdout:8/58: truncate d0/f11 554003 0 2024-04-25T01:40:42.497 INFO:tasks.workunit.client.0.smithi162.stdout:1/74: write fe [3040374,90798] 0 2024-04-25T01:40:42.640 INFO:tasks.workunit.client.0.smithi162.stdout:6/47: creat d1/fe x:0 0 0 2024-04-25T01:40:42.806 INFO:tasks.workunit.client.0.smithi162.stdout:5/58: dread fd [0,4194304] 0 2024-04-25T01:40:42.875 INFO:tasks.workunit.client.0.smithi162.stdout:4/49: symlink dd/le 0 2024-04-25T01:40:43.060 INFO:tasks.workunit.client.0.smithi162.stdout:2/63: dwrite d0/d3/fd [0,4194304] 0 2024-04-25T01:40:43.567 INFO:tasks.workunit.client.0.smithi162.stdout:7/43: dwrite f9 [0,4194304] 0 2024-04-25T01:40:43.778 INFO:tasks.workunit.client.0.smithi162.stdout:1/75: rename fc to d15/f19 0 2024-04-25T01:40:43.850 INFO:tasks.workunit.client.0.smithi162.stdout:3/62: dwrite d2/f13 [0,4194304] 0 2024-04-25T01:40:43.854 INFO:tasks.workunit.client.0.smithi162.stdout:8/59: write d0/d5/fd [1645125,119489] 0 2024-04-25T01:40:43.994 INFO:tasks.workunit.client.0.smithi162.stdout:0/82: write d0/d1/f4 [3835719,26538] 0 2024-04-25T01:40:44.045 INFO:tasks.workunit.client.0.smithi162.stdout:8/60: fsync d0/d5/fd 0 2024-04-25T01:40:44.073 INFO:tasks.workunit.client.0.smithi162.stdout:0/83: read d0/d1/f4 [2581318,36360] 0 2024-04-25T01:40:44.101 INFO:tasks.workunit.client.0.smithi162.stdout:0/84: readlink d0/le 0 2024-04-25T01:40:44.130 INFO:tasks.workunit.client.0.smithi162.stdout:5/59: mkdir d12 0 2024-04-25T01:40:44.154 INFO:tasks.workunit.client.0.smithi162.stdout:0/85: read - d0/d1/f12 zero size 2024-04-25T01:40:44.528 INFO:tasks.workunit.client.0.smithi162.stdout:4/50: rmdir dd 39 2024-04-25T01:40:44.625 INFO:tasks.workunit.client.0.smithi162.stdout:9/40: write f0 [3119171,80908] 0 2024-04-25T01:40:45.012 INFO:tasks.workunit.client.0.smithi162.stdout:1/76: read f9 [2726683,21716] 0 2024-04-25T01:40:45.054 INFO:tasks.workunit.client.0.smithi162.stdout:1/77: write fe [1415186,34927] 0 2024-04-25T01:40:45.624 INFO:tasks.workunit.client.0.smithi162.stdout:6/48: rename d1/f9 to d1/ff 0 2024-04-25T01:40:45.628 INFO:tasks.workunit.client.0.smithi162.stdout:3/63: readlink d2/d9/l16 0 2024-04-25T01:40:45.691 INFO:tasks.workunit.client.0.smithi162.stdout:3/64: chown d2/d9/d10/f11 27881350 1 2024-04-25T01:40:45.728 INFO:tasks.workunit.client.0.smithi162.stdout:3/65: write d2/f13 [1721302,72813] 0 2024-04-25T01:40:46.223 INFO:tasks.workunit.client.0.smithi162.stdout:2/64: mknod d0/d3/c15 0 2024-04-25T01:40:46.304 INFO:tasks.workunit.client.0.smithi162.stdout:1/78: creat d15/f1a x:0 0 0 2024-04-25T01:40:46.365 INFO:tasks.workunit.client.0.smithi162.stdout:7/44: write fd [1051776,110523] 0 2024-04-25T01:40:46.447 INFO:tasks.workunit.client.0.smithi162.stdout:4/51: dread f7 [0,4194304] 0 2024-04-25T01:40:46.498 INFO:tasks.workunit.client.0.smithi162.stdout:1/79: write fe [57332,109736] 0 2024-04-25T01:40:46.534 INFO:tasks.workunit.client.0.smithi162.stdout:7/45: sync 2024-04-25T01:40:46.633 INFO:tasks.workunit.client.0.smithi162.stdout:0/86: creat d0/df/f14 x:0 0 0 2024-04-25T01:40:46.690 INFO:tasks.workunit.client.0.smithi162.stdout:6/49: truncate d1/fc 236668 0 2024-04-25T01:40:46.804 INFO:tasks.workunit.client.0.smithi162.stdout:5/60: dwrite ff [0,4194304] 0 2024-04-25T01:40:46.937 INFO:tasks.workunit.client.0.smithi162.stdout:8/61: link d0/c9 d0/d5/de/c13 0 2024-04-25T01:40:46.962 INFO:tasks.workunit.client.0.smithi162.stdout:7/46: mkdir df 0 2024-04-25T01:40:47.000 INFO:tasks.workunit.client.0.smithi162.stdout:9/41: link f2 d4/ff 0 2024-04-25T01:40:47.003 INFO:tasks.workunit.client.0.smithi162.stdout:0/87: dread - d0/d1/f12 zero size 2024-04-25T01:40:47.063 INFO:tasks.workunit.client.0.smithi162.stdout:1/80: creat d15/f1b x:0 0 0 2024-04-25T01:40:47.137 INFO:tasks.workunit.client.0.smithi162.stdout:1/81: dread - d15/f1a zero size 2024-04-25T01:40:47.157 INFO:tasks.workunit.client.0.smithi162.stdout:4/52: mkdir dd/df 0 2024-04-25T01:40:47.215 INFO:tasks.workunit.client.0.smithi162.stdout:0/88: truncate d0/df/f14 807615 0 2024-04-25T01:40:47.246 INFO:tasks.workunit.client.0.smithi162.stdout:2/65: creat d0/d3/f16 x:0 0 0 2024-04-25T01:40:47.433 INFO:tasks.workunit.client.0.smithi162.stdout:9/42: unlink d4/d9/fe 0 2024-04-25T01:40:47.677 INFO:tasks.workunit.client.0.smithi162.stdout:5/61: getdents d12 0 2024-04-25T01:40:47.678 INFO:tasks.workunit.client.0.smithi162.stdout:7/47: creat df/f10 x:0 0 0 2024-04-25T01:40:47.707 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:40:47.711 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:40:47.798 INFO:tasks.workunit.client.0.smithi162.stdout:8/62: chown d0/c9 641 1 2024-04-25T01:40:47.839 INFO:tasks.workunit.client.0.smithi162.stdout:5/62: dread f3 [0,4194304] 0 2024-04-25T01:40:48.078 INFO:tasks.workunit.client.0.smithi162.stdout:2/66: rmdir d0/d3 39 2024-04-25T01:40:48.084 INFO:tasks.workunit.client.0.smithi162.stdout:0/89: symlink d0/d1/l15 0 2024-04-25T01:40:48.181 INFO:tasks.workunit.client.0.smithi162.stdout:1/82: truncate f14 474340 0 2024-04-25T01:40:48.201 INFO:tasks.workunit.client.0.smithi162.stdout:9/43: rmdir d4/d9 39 2024-04-25T01:40:48.228 INFO:tasks.workunit.client.0.smithi162.stdout:7/48: fsync fa 0 2024-04-25T01:40:48.496 INFO:tasks.workunit.client.0.smithi162.stdout:3/66: dwrite d2/d9/d10/f14 [0,4194304] 0 2024-04-25T01:40:48.642 INFO:tasks.workunit.client.0.smithi162.stdout:4/53: creat dd/df/f10 x:0 0 0 2024-04-25T01:40:48.731 INFO:tasks.workunit.client.0.smithi162.stdout:2/67: readlink d0/d3/l6 0 2024-04-25T01:40:48.738 INFO:tasks.workunit.client.0.smithi162.stdout:6/50: getdents d1 0 2024-04-25T01:40:48.941 INFO:tasks.workunit.client.0.smithi162.stdout:8/63: symlink d0/d12/l14 0 2024-04-25T01:40:49.058 INFO:tasks.workunit.client.0.smithi162.stdout:1/83: creat d15/f1c x:0 0 0 2024-04-25T01:40:49.340 INFO:tasks.workunit.client.0.smithi162.stdout:0/90: write d0/fd [1873745,54275] 0 2024-04-25T01:40:49.785 INFO:tasks.workunit.client.0.smithi162.stdout:9/44: rename d4/ff to d4/d8/f10 0 2024-04-25T01:40:50.012 INFO:tasks.workunit.client.0.smithi162.stdout:7/49: write f4 [441433,114422] 0 2024-04-25T01:40:50.069 INFO:tasks.workunit.client.0.smithi162.stdout:7/50: truncate df/f10 416101 0 2024-04-25T01:40:50.092 INFO:tasks.workunit.client.0.smithi162.stdout:4/54: fsync fb 0 2024-04-25T01:40:50.218 INFO:tasks.workunit.client.0.smithi162.stdout:3/67: creat d2/d9/f18 x:0 0 0 2024-04-25T01:40:50.261 INFO:tasks.workunit.client.0.smithi162.stdout:6/51: creat d1/f10 x:0 0 0 2024-04-25T01:40:50.997 INFO:tasks.workunit.client.0.smithi162.stdout:5/63: rmdir d12 0 2024-04-25T01:40:50.998 INFO:tasks.workunit.client.0.smithi162.stdout:5/64: rmdir - no directory 2024-04-25T01:40:51.034 INFO:tasks.workunit.client.0.smithi162.stdout:7/51: truncate f9 3997166 0 2024-04-25T01:40:51.056 INFO:tasks.workunit.client.0.smithi162.stdout:4/55: mknod dd/c11 0 2024-04-25T01:40:51.075 INFO:tasks.workunit.client.0.smithi162.stdout:3/68: unlink d2/f13 0 2024-04-25T01:40:51.092 INFO:tasks.workunit.client.0.smithi162.stdout:6/52: unlink d1/ff 0 2024-04-25T01:40:51.111 INFO:tasks.workunit.client.0.smithi162.stdout:2/68: rename d0/d3/lc to d0/d3/d5/l17 0 2024-04-25T01:40:51.182 INFO:tasks.workunit.client.0.smithi162.stdout:8/64: creat d0/d5/de/f15 x:0 0 0 2024-04-25T01:40:51.327 INFO:tasks.workunit.client.0.smithi162.stdout:9/45: mkdir d4/d9/d11 0 2024-04-25T01:40:51.633 INFO:tasks.workunit.client.0.smithi162.stdout:3/69: rename d2/d7 to d2/d9/d19 0 2024-04-25T01:40:51.655 INFO:tasks.workunit.client.0.smithi162.stdout:8/65: dwrite d0/d5/de/f15 [0,4194304] 0 2024-04-25T01:40:51.813 INFO:tasks.workunit.client.0.smithi162.stdout:2/69: truncate d0/d3/fe 1415842 0 2024-04-25T01:40:51.906 INFO:tasks.workunit.client.0.smithi162.stdout:3/70: truncate d2/d9/d10/f14 4915749 0 2024-04-25T01:40:51.956 INFO:tasks.workunit.client.0.smithi162.stdout:3/71: write d2/d9/f18 [691094,125437] 0 2024-04-25T01:40:52.217 INFO:tasks.workunit.client.0.smithi162.stdout:9/46: unlink d4/f5 0 2024-04-25T01:40:52.572 INFO:tasks.workunit.client.0.smithi162.stdout:1/84: getdents d15 0 2024-04-25T01:40:52.629 INFO:tasks.workunit.client.0.smithi162.stdout:0/91: truncate d0/df/f14 35566 0 2024-04-25T01:40:53.040 INFO:tasks.workunit.client.0.smithi162.stdout:3/72: rename d2/d9/ce to d2/c1a 0 2024-04-25T01:40:53.459 INFO:tasks.workunit.client.0.smithi162.stdout:7/52: write f9 [1284312,115873] 0 2024-04-25T01:40:53.652 INFO:tasks.workunit.client.0.smithi162.stdout:7/53: sync 2024-04-25T01:40:53.653 INFO:tasks.workunit.client.0.smithi162.stdout:3/73: dwrite d2/d9/f18 [0,4194304] 0 2024-04-25T01:40:53.786 INFO:tasks.workunit.client.0.smithi162.stdout:4/56: dwrite f7 [0,4194304] 0 2024-04-25T01:40:53.849 INFO:tasks.workunit.client.0.smithi162.stdout:0/92: creat d0/f16 x:0 0 0 2024-04-25T01:40:53.927 INFO:tasks.workunit.client.0.smithi162.stdout:0/93: sync 2024-04-25T01:40:53.973 INFO:tasks.workunit.client.0.smithi162.stdout:5/65: link lc l13 0 2024-04-25T01:40:54.028 INFO:tasks.workunit.client.0.smithi162.stdout:9/47: creat d4/d9/d11/f12 x:0 0 0 2024-04-25T01:40:54.085 INFO:tasks.workunit.client.0.smithi162.stdout:7/54: chown f1 109 1 2024-04-25T01:40:54.135 INFO:tasks.workunit.client.0.smithi162.stdout:0/94: chown d0/d1/fc 3 1 2024-04-25T01:40:54.732 INFO:tasks.workunit.client.0.smithi162.stdout:2/70: dwrite d0/d3/fd [8388608,4194304] 0 2024-04-25T01:40:54.950 INFO:tasks.workunit.client.0.smithi162.stdout:6/53: getdents d1 0 2024-04-25T01:40:55.002 INFO:tasks.workunit.client.0.smithi162.stdout:5/66: rename lb to l14 0 2024-04-25T01:40:55.123 INFO:tasks.workunit.client.0.smithi162.stdout:5/67: dread f3 [0,4194304] 0 2024-04-25T01:40:55.667 INFO:tasks.workunit.client.0.smithi162.stdout:0/95: symlink d0/d1/l17 0 2024-04-25T01:40:55.863 INFO:tasks.workunit.client.0.smithi162.stdout:9/48: rename d4/d9/d11 to d4/d8/d13 0 2024-04-25T01:40:56.229 INFO:tasks.workunit.client.0.smithi162.stdout:8/66: getdents d0 0 2024-04-25T01:40:56.242 INFO:tasks.workunit.client.0.smithi162.stdout:8/67: readlink d0/lc 0 2024-04-25T01:40:56.318 INFO:tasks.workunit.client.0.smithi162.stdout:7/55: rmdir df 39 2024-04-25T01:40:56.341 INFO:tasks.workunit.client.0.smithi162.stdout:2/71: creat d0/d3/d5/f18 x:0 0 0 2024-04-25T01:40:56.511 INFO:tasks.workunit.client.0.smithi162.stdout:5/68: mkdir d15 0 2024-04-25T01:40:56.624 INFO:tasks.workunit.client.0.smithi162.stdout:4/57: link dd/df/f10 dd/df/f12 0 2024-04-25T01:40:56.685 INFO:tasks.workunit.client.0.smithi162.stdout:1/85: dwrite f4 [0,4194304] 0 2024-04-25T01:40:57.129 INFO:tasks.workunit.client.0.smithi162.stdout:3/74: write d2/d9/d10/f11 [3456377,79514] 0 2024-04-25T01:40:57.209 INFO:tasks.workunit.client.0.smithi162.stdout:8/68: creat d0/f16 x:0 0 0 2024-04-25T01:40:57.532 INFO:tasks.workunit.client.0.smithi162.stdout:2/72: rmdir d0 39 2024-04-25T01:40:57.950 INFO:tasks.workunit.client.0.smithi162.stdout:4/58: fsync fb 0 2024-04-25T01:40:58.054 INFO:tasks.workunit.client.0.smithi162.stdout:1/86: unlink d15/f19 0 2024-04-25T01:40:58.445 INFO:tasks.workunit.client.0.smithi162.stdout:7/56: mknod df/c11 0 2024-04-25T01:40:58.599 INFO:tasks.workunit.client.0.smithi162.stdout:9/49: dread d4/d8/f10 [0,4194304] 0 2024-04-25T01:40:58.777 INFO:tasks.workunit.client.0.smithi162.stdout:0/96: write d0/d1/f12 [846448,65545] 0 2024-04-25T01:40:58.880 INFO:tasks.workunit.client.0.smithi162.stdout:6/54: dwrite d1/fc [0,4194304] 0 2024-04-25T01:40:58.899 INFO:tasks.workunit.client.0.smithi162.stdout:4/59: rename c9 to dd/c13 0 2024-04-25T01:40:59.123 INFO:tasks.workunit.client.0.smithi162.stdout:7/57: creat df/f12 x:0 0 0 2024-04-25T01:40:59.440 INFO:tasks.workunit.client.0.smithi162.stdout:0/97: symlink d0/df/l18 0 2024-04-25T01:40:59.741 INFO:tasks.workunit.client.0.smithi162.stdout:3/75: unlink d2/cb 0 2024-04-25T01:40:59.885 INFO:tasks.workunit.client.0.smithi162.stdout:6/55: mknod d1/c11 0 2024-04-25T01:41:00.086 INFO:tasks.workunit.client.0.smithi162.stdout:4/60: creat dd/df/f14 x:0 0 0 2024-04-25T01:41:00.235 INFO:tasks.workunit.client.0.smithi162.stdout:7/58: creat df/f13 x:0 0 0 2024-04-25T01:41:00.353 INFO:tasks.workunit.client.0.smithi162.stdout:5/69: dwrite f11 [0,4194304] 0 2024-04-25T01:41:00.593 INFO:tasks.workunit.client.0.smithi162.stdout:6/56: truncate d1/f4 902384 0 2024-04-25T01:41:00.637 INFO:tasks.workunit.client.0.smithi162.stdout:0/98: dread d0/d1/f7 [0,4194304] 0 2024-04-25T01:41:00.982 INFO:tasks.workunit.client.0.smithi162.stdout:4/61: truncate fb 452205 0 2024-04-25T01:41:01.111 INFO:tasks.workunit.client.0.smithi162.stdout:7/59: creat df/f14 x:0 0 0 2024-04-25T01:41:01.116 INFO:tasks.workunit.client.0.smithi162.stdout:1/87: dwrite f3 [0,4194304] 0 2024-04-25T01:41:01.279 INFO:tasks.workunit.client.0.smithi162.stdout:1/88: chown c11 3445463 1 2024-04-25T01:41:01.290 INFO:tasks.workunit.client.0.smithi162.stdout:1/89: readlink d15/l16 0 2024-04-25T01:41:01.526 INFO:tasks.workunit.client.0.smithi162.stdout:3/76: symlink d2/d9/d17/l1b 0 2024-04-25T01:41:01.528 INFO:tasks.workunit.client.0.smithi162.stdout:8/69: fdatasync d0/d5/de/f15 0 2024-04-25T01:41:01.614 INFO:tasks.workunit.client.0.smithi162.stdout:6/57: mknod d1/c12 0 2024-04-25T01:41:01.786 INFO:tasks.workunit.client.0.smithi162.stdout:4/62: creat dd/f15 x:0 0 0 2024-04-25T01:41:01.960 INFO:tasks.workunit.client.0.smithi162.stdout:7/60: fsync f9 0 2024-04-25T01:41:02.116 INFO:tasks.workunit.client.0.smithi162.stdout:1/90: creat d15/f1d x:0 0 0 2024-04-25T01:41:02.309 INFO:tasks.workunit.client.0.smithi162.stdout:3/77: symlink d2/d9/l1c 0 2024-04-25T01:41:02.428 INFO:tasks.workunit.client.0.smithi162.stdout:6/58: mkdir d1/d13 0 2024-04-25T01:41:02.449 INFO:tasks.workunit.client.0.smithi162.stdout:6/59: chown d1/fd 169 1 2024-04-25T01:41:02.461 INFO:tasks.workunit.client.0.smithi162.stdout:6/60: stat d1/lb 0 2024-04-25T01:41:02.941 INFO:tasks.workunit.client.0.smithi162.stdout:7/61: rename df/f14 to df/f15 0 2024-04-25T01:41:03.346 INFO:tasks.workunit.client.0.smithi162.stdout:1/91: chown f14 5410419 1 2024-04-25T01:41:03.537 INFO:tasks.workunit.client.0.smithi162.stdout:9/50: rmdir d4/d9 39 2024-04-25T01:41:03.556 INFO:tasks.workunit.client.0.smithi162.stdout:5/70: write ff [2458303,51959] 0 2024-04-25T01:41:03.605 INFO:tasks.workunit.client.0.smithi162.stdout:5/71: write ff [2267746,125191] 0 2024-04-25T01:41:03.690 INFO:tasks.workunit.client.0.smithi162.stdout:2/73: creat d0/d3/f19 x:0 0 0 2024-04-25T01:41:03.836 INFO:tasks.workunit.client.0.smithi162.stdout:7/62: rmdir df 39 2024-04-25T01:41:04.026 INFO:tasks.workunit.client.0.smithi162.stdout:7/63: sync 2024-04-25T01:41:04.396 INFO:tasks.workunit.client.0.smithi162.stdout:8/70: link d0/d5/de/f15 d0/d12/f17 0 2024-04-25T01:41:04.814 INFO:tasks.workunit.client.0.smithi162.stdout:4/63: write f7 [3274330,90881] 0 2024-04-25T01:41:05.163 INFO:tasks.workunit.client.0.smithi162.stdout:6/61: mknod d1/d13/c14 0 2024-04-25T01:41:05.184 INFO:tasks.workunit.client.0.smithi162.stdout:0/99: getdents d0/df 0 2024-04-25T01:41:05.197 INFO:tasks.workunit.client.0.smithi162.stdout:6/62: chown d1/d13 106928655 1 2024-04-25T01:41:05.500 INFO:tasks.workunit.client.0.smithi162.stdout:0/100: sync 2024-04-25T01:41:05.769 INFO:tasks.workunit.client.0.smithi162.stdout:3/78: dwrite d2/d9/d10/f14 [4194304,4194304] 0 2024-04-25T01:41:06.189 INFO:tasks.workunit.client.0.smithi162.stdout:5/72: mknod d15/c16 0 2024-04-25T01:41:06.197 INFO:tasks.workunit.client.0.smithi162.stdout:8/71: fsync d0/d5/de/f15 0 2024-04-25T01:41:06.368 INFO:tasks.workunit.client.0.smithi162.stdout:4/64: creat dd/f16 x:0 0 0 2024-04-25T01:41:06.839 INFO:tasks.workunit.client.0.smithi162.stdout:0/101: mknod d0/d1/c19 0 2024-04-25T01:41:06.883 INFO:tasks.workunit.client.0.smithi162.stdout:0/102: dread d0/df/f14 [0,4194304] 0 2024-04-25T01:41:06.913 INFO:tasks.workunit.client.0.smithi162.stdout:1/92: link cb d15/c1e 0 2024-04-25T01:41:07.005 INFO:tasks.workunit.client.0.smithi162.stdout:7/64: write f4 [894319,77477] 0 2024-04-25T01:41:07.044 INFO:tasks.workunit.client.0.smithi162.stdout:9/51: rmdir d4/d9 39 2024-04-25T01:41:07.299 INFO:tasks.workunit.client.0.smithi162.stdout:3/79: dread d2/d9/f18 [0,4194304] 0 2024-04-25T01:41:07.529 INFO:tasks.workunit.client.0.smithi162.stdout:5/73: read fd [2469675,115435] 0 2024-04-25T01:41:07.659 INFO:tasks.workunit.client.0.smithi162.stdout:8/72: dread d0/f11 [0,4194304] 0 2024-04-25T01:41:07.862 INFO:tasks.workunit.client.0.smithi162.stdout:4/65: symlink dd/l17 0 2024-04-25T01:41:07.883 INFO:tasks.workunit.client.0.smithi162.stdout:2/74: creat d0/d3/f1a x:0 0 0 2024-04-25T01:41:08.115 INFO:tasks.workunit.client.0.smithi162.stdout:0/103: truncate d0/df/f14 1032925 0 2024-04-25T01:41:08.166 INFO:tasks.workunit.client.0.smithi162.stdout:7/65: dread - df/f15 zero size 2024-04-25T01:41:08.217 INFO:tasks.workunit.client.0.smithi162.stdout:7/66: dread - df/f15 zero size 2024-04-25T01:41:08.557 INFO:tasks.workunit.client.0.smithi162.stdout:3/80: stat d2/c1a 0 2024-04-25T01:41:08.837 INFO:tasks.workunit.client.0.smithi162.stdout:5/74: write fd [2484634,47130] 0 2024-04-25T01:41:09.045 INFO:tasks.workunit.client.0.smithi162.stdout:2/75: dread d0/d3/fe [0,4194304] 0 2024-04-25T01:41:09.063 INFO:tasks.workunit.client.0.smithi162.stdout:4/66: truncate f4 1389639 0 2024-04-25T01:41:09.167 INFO:tasks.workunit.client.0.smithi162.stdout:2/76: dread d0/d3/fe [0,4194304] 0 2024-04-25T01:41:09.253 INFO:tasks.workunit.client.0.smithi162.stdout:7/67: mknod df/c16 0 2024-04-25T01:41:09.490 INFO:tasks.workunit.client.0.smithi162.stdout:6/63: fsync d1/f8 0 2024-04-25T01:41:09.521 INFO:tasks.workunit.client.0.smithi162.stdout:6/64: chown d1/f8 283 1 2024-04-25T01:41:09.537 INFO:tasks.workunit.client.0.smithi162.stdout:6/65: chown d1/f10 427 1 2024-04-25T01:41:09.691 INFO:tasks.workunit.client.0.smithi162.stdout:4/67: mknod dd/c18 0 2024-04-25T01:41:09.906 INFO:tasks.workunit.client.0.smithi162.stdout:7/68: write df/f15 [661558,8881] 0 2024-04-25T01:41:10.528 INFO:tasks.workunit.client.0.smithi162.stdout:8/73: creat d0/f18 x:0 0 0 2024-04-25T01:41:10.551 INFO:tasks.workunit.client.0.smithi162.stdout:1/93: dwrite fa [0,4194304] 0 2024-04-25T01:41:10.654 INFO:tasks.workunit.client.0.smithi162.stdout:8/74: write d0/f18 [112197,51277] 0 2024-04-25T01:41:10.898 INFO:tasks.workunit.client.0.smithi162.stdout:4/68: creat dd/f19 x:0 0 0 2024-04-25T01:41:10.970 INFO:tasks.workunit.client.0.smithi162.stdout:0/104: write d0/d1/f7 [3681200,56261] 0 2024-04-25T01:41:11.000 INFO:tasks.workunit.client.0.smithi162.stdout:3/81: write d2/d9/d10/f11 [2815729,98407] 0 2024-04-25T01:41:11.091 INFO:tasks.workunit.client.0.smithi162.stdout:1/94: mkdir d15/d1f 0 2024-04-25T01:41:11.125 INFO:tasks.workunit.client.0.smithi162.stdout:8/75: dwrite d0/f18 [0,4194304] 0 2024-04-25T01:41:11.322 INFO:tasks.workunit.client.0.smithi162.stdout:5/75: truncate f11 1476602 0 2024-04-25T01:41:11.425 INFO:tasks.workunit.client.0.smithi162.stdout:2/77: mkdir d0/d3/d1b 0 2024-04-25T01:41:11.467 INFO:tasks.workunit.client.0.smithi162.stdout:1/95: stat c10 0 2024-04-25T01:41:11.469 INFO:tasks.workunit.client.0.smithi162.stdout:0/105: fdatasync d0/fd 0 2024-04-25T01:41:12.114 INFO:tasks.workunit.client.0.smithi162.stdout:9/52: dwrite d4/fd [0,4194304] 0 2024-04-25T01:41:12.177 INFO:tasks.workunit.client.0.smithi162.stdout:4/69: dread - dd/df/f14 zero size 2024-04-25T01:41:12.319 INFO:tasks.workunit.client.0.smithi162.stdout:1/96: mknod d15/c20 0 2024-04-25T01:41:12.397 INFO:tasks.workunit.client.0.smithi162.stdout:0/106: creat d0/f1a x:0 0 0 2024-04-25T01:41:12.430 INFO:tasks.workunit.client.0.smithi162.stdout:6/66: dwrite d1/f2 [0,4194304] 0 2024-04-25T01:41:12.617 INFO:tasks.workunit.client.0.smithi162.stdout:7/69: dwrite fa [0,4194304] 0 2024-04-25T01:41:12.690 INFO:tasks.workunit.client.0.smithi162.stdout:0/107: readlink d0/le 0 2024-04-25T01:41:12.690 INFO:tasks.workunit.client.0.smithi162.stdout:2/78: mkdir d0/d3/d1b/d1c 0 2024-04-25T01:41:12.809 INFO:tasks.workunit.client.0.smithi162.stdout:3/82: dread d2/d9/f18 [0,4194304] 0 2024-04-25T01:41:12.881 INFO:tasks.workunit.client.0.smithi162.stdout:4/70: mkdir dd/d1a 0 2024-04-25T01:41:12.942 INFO:tasks.workunit.client.0.smithi162.stdout:7/70: fsync f6 0 2024-04-25T01:41:12.984 INFO:tasks.workunit.client.0.smithi162.stdout:2/79: stat d0/l14 0 2024-04-25T01:41:13.064 INFO:tasks.workunit.client.0.smithi162.stdout:8/76: truncate d0/d5/fd 3054767 0 2024-04-25T01:41:13.149 INFO:tasks.workunit.client.0.smithi162.stdout:3/83: sync 2024-04-25T01:41:13.193 INFO:tasks.workunit.client.0.smithi162.stdout:8/77: sync 2024-04-25T01:41:13.219 INFO:tasks.workunit.client.0.smithi162.stdout:9/53: dread - d4/d8/d13/f12 zero size 2024-04-25T01:41:13.321 INFO:tasks.workunit.client.0.smithi162.stdout:6/67: write d1/fc [3497912,5029] 0 2024-04-25T01:41:13.456 INFO:tasks.workunit.client.0.smithi162.stdout:0/108: creat d0/df/f1b x:0 0 0 2024-04-25T01:41:13.648 INFO:tasks.workunit.client.0.smithi162.stdout:9/54: unlink f0 0 2024-04-25T01:41:13.651 INFO:tasks.workunit.client.0.smithi162.stdout:5/76: dwrite f3 [0,4194304] 0 2024-04-25T01:41:13.743 INFO:tasks.workunit.client.0.smithi162.stdout:9/55: sync 2024-04-25T01:41:13.759 INFO:tasks.workunit.client.0.smithi162.stdout:4/71: mknod dd/d1a/c1b 0 2024-04-25T01:41:13.825 INFO:tasks.workunit.client.0.smithi162.stdout:5/77: fdatasync f3 0 2024-04-25T01:41:13.881 INFO:tasks.workunit.client.0.smithi162.stdout:1/97: dwrite f14 [0,4194304] 0 2024-04-25T01:41:14.016 INFO:tasks.workunit.client.0.smithi162.stdout:7/71: dread f5 [0,4194304] 0 2024-04-25T01:41:14.112 INFO:tasks.workunit.client.0.smithi162.stdout:2/80: truncate d0/d3/f19 245541 0 2024-04-25T01:41:14.152 INFO:tasks.workunit.client.0.smithi162.stdout:6/68: write d1/fd [335305,88308] 0 2024-04-25T01:41:14.261 INFO:tasks.workunit.client.0.smithi162.stdout:0/109: truncate d0/d1/fc 3824741 0 2024-04-25T01:41:14.276 INFO:tasks.workunit.client.0.smithi162.stdout:4/72: write f5 [808960,19953] 0 2024-04-25T01:41:14.398 INFO:tasks.workunit.client.0.smithi162.stdout:9/56: truncate f3 4403745 0 2024-04-25T01:41:14.481 INFO:tasks.workunit.client.0.smithi162.stdout:8/78: write d0/d5/fd [1834208,56865] 0 2024-04-25T01:41:14.532 INFO:tasks.workunit.client.0.smithi162.stdout:6/69: dread d1/fd [0,4194304] 0 2024-04-25T01:41:14.574 INFO:tasks.workunit.client.0.smithi162.stdout:4/73: write dd/f19 [469713,30205] 0 2024-04-25T01:41:14.577 INFO:tasks.workunit.client.0.smithi162.stdout:0/110: rename d0/d1 to d0/d1/d1c 22 2024-04-25T01:41:14.663 INFO:tasks.workunit.client.0.smithi162.stdout:1/98: creat d15/f21 x:0 0 0 2024-04-25T01:41:14.684 INFO:tasks.workunit.client.0.smithi162.stdout:3/84: dwrite d2/d9/d10/f14 [0,4194304] 0 2024-04-25T01:41:14.692 INFO:tasks.workunit.client.0.smithi162.stdout:4/74: sync 2024-04-25T01:41:14.771 INFO:tasks.workunit.client.0.smithi162.stdout:2/81: mkdir d0/d3/d1b/d1d 0 2024-04-25T01:41:14.781 INFO:tasks.workunit.client.0.smithi162.stdout:7/72: dread - df/f12 zero size 2024-04-25T01:41:15.082 INFO:tasks.workunit.client.0.smithi162.stdout:3/85: dread d2/d9/d10/f14 [0,4194304] 0 2024-04-25T01:41:15.341 INFO:tasks.workunit.client.0.smithi162.stdout:3/86: write d2/d9/d10/f14 [1259780,29287] 0 2024-04-25T01:41:15.343 INFO:tasks.workunit.client.0.smithi162.stdout:8/79: creat d0/d5/de/f19 x:0 0 0 2024-04-25T01:41:15.414 INFO:tasks.workunit.client.0.smithi162.stdout:1/99: creat d15/f22 x:0 0 0 2024-04-25T01:41:15.458 INFO:tasks.workunit.client.0.smithi162.stdout:5/78: dwrite fd [0,4194304] 0 2024-04-25T01:41:15.483 INFO:tasks.workunit.client.0.smithi162.stdout:4/75: mknod dd/d1a/c1c 0 2024-04-25T01:41:15.663 INFO:tasks.workunit.client.0.smithi162.stdout:4/76: chown dd/d1a 24662333 1 2024-04-25T01:41:16.114 INFO:tasks.workunit.client.0.smithi162.stdout:0/111: write d0/fd [4574990,62210] 0 2024-04-25T01:41:16.341 INFO:tasks.workunit.client.0.smithi162.stdout:7/73: write f9 [1665544,120280] 0 2024-04-25T01:41:16.384 INFO:tasks.workunit.client.0.smithi162.stdout:7/74: fdatasync f9 0 2024-04-25T01:41:16.529 INFO:tasks.workunit.client.0.smithi162.stdout:5/79: rename ff to d15/f17 0 2024-04-25T01:41:16.556 INFO:tasks.workunit.client.0.smithi162.stdout:5/80: write f3 [1919071,4594] 0 2024-04-25T01:41:16.697 INFO:tasks.workunit.client.0.smithi162.stdout:2/82: write d0/d3/d5/f18 [268872,92950] 0 2024-04-25T01:41:16.764 INFO:tasks.workunit.client.0.smithi162.stdout:5/81: dread f3 [0,4194304] 0 2024-04-25T01:41:16.846 INFO:tasks.workunit.client.0.smithi162.stdout:3/87: truncate d2/d9/f18 674730 0 2024-04-25T01:41:17.005 INFO:tasks.workunit.client.0.smithi162.stdout:9/57: creat d4/f14 x:0 0 0 2024-04-25T01:41:17.168 INFO:tasks.workunit.client.0.smithi162.stdout:9/58: sync 2024-04-25T01:41:17.178 INFO:tasks.workunit.client.0.smithi162.stdout:0/112: creat d0/df/f1d x:0 0 0 2024-04-25T01:41:17.338 INFO:tasks.workunit.client.0.smithi162.stdout:1/100: rmdir d15 39 2024-04-25T01:41:17.829 INFO:tasks.workunit.client.0.smithi162.stdout:2/83: fsync d0/d3/fe 0 2024-04-25T01:41:17.838 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:41:17.842 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:41:17.862 INFO:tasks.workunit.client.0.smithi162.stdout:2/84: chown d0/d3/f1a 7156 1 2024-04-25T01:41:17.880 INFO:tasks.workunit.client.0.smithi162.stdout:2/85: chown d0/d3/l6 39692 1 2024-04-25T01:41:17.981 INFO:tasks.workunit.client.0.smithi162.stdout:5/82: symlink d15/l18 0 2024-04-25T01:41:18.109 INFO:tasks.workunit.client.0.smithi162.stdout:3/88: mknod d2/c1d 0 2024-04-25T01:41:18.137 INFO:tasks.workunit.client.0.smithi162.stdout:6/70: getdents d1/d13 0 2024-04-25T01:41:18.249 INFO:tasks.workunit.client.0.smithi162.stdout:6/71: fsync d1/fe 0 2024-04-25T01:41:18.366 INFO:tasks.workunit.client.0.smithi162.stdout:4/77: dwrite dd/df/f14 [0,4194304] 0 2024-04-25T01:41:18.470 INFO:tasks.workunit.client.0.smithi162.stdout:8/80: rename d0/d5 to d0/d1a 0 2024-04-25T01:41:18.566 INFO:tasks.workunit.client.0.smithi162.stdout:1/101: truncate fe 3946643 0 2024-04-25T01:41:18.609 INFO:tasks.workunit.client.0.smithi162.stdout:7/75: write df/f13 [579304,97634] 0 2024-04-25T01:41:18.720 INFO:tasks.workunit.client.0.smithi162.stdout:1/102: sync 2024-04-25T01:41:18.904 INFO:tasks.workunit.client.0.smithi162.stdout:1/103: sync 2024-04-25T01:41:19.395 INFO:tasks.workunit.client.0.smithi162.stdout:9/59: mkdir d4/d9/d15 0 2024-04-25T01:41:19.592 INFO:tasks.workunit.client.0.smithi162.stdout:0/113: unlink d0/d1/fc 0 2024-04-25T01:41:19.617 INFO:tasks.workunit.client.0.smithi162.stdout:0/114: chown d0/f16 7310326 1 2024-04-25T01:41:20.243 INFO:tasks.workunit.client.0.smithi162.stdout:7/76: creat df/f17 x:0 0 0 2024-04-25T01:41:20.524 INFO:tasks.workunit.client.0.smithi162.stdout:5/83: truncate f3 4758707 0 2024-04-25T01:41:20.549 INFO:tasks.workunit.client.0.smithi162.stdout:2/86: mkdir d0/d3/d1b/d1c/d1e 0 2024-04-25T01:41:20.636 INFO:tasks.workunit.client.0.smithi162.stdout:2/87: sync 2024-04-25T01:41:20.810 INFO:tasks.workunit.client.0.smithi162.stdout:9/60: creat d4/d8/d13/f16 x:0 0 0 2024-04-25T01:41:21.117 INFO:tasks.workunit.client.0.smithi162.stdout:8/81: mkdir d0/d12/d1b 0 2024-04-25T01:41:21.149 INFO:tasks.workunit.client.0.smithi162.stdout:6/72: write d1/f4 [1752938,6188] 0 2024-04-25T01:41:21.211 INFO:tasks.workunit.client.0.smithi162.stdout:0/115: fdatasync d0/d1/f4 0 2024-04-25T01:41:21.371 INFO:tasks.workunit.client.0.smithi162.stdout:6/73: chown d1/lb 2176226 1 2024-04-25T01:41:21.456 INFO:tasks.workunit.client.0.smithi162.stdout:3/89: dwrite d2/d9/d10/f11 [0,4194304] 0 2024-04-25T01:41:21.670 INFO:tasks.workunit.client.0.smithi162.stdout:5/84: mkdir d15/d19 0 2024-04-25T01:41:21.706 INFO:tasks.workunit.client.0.smithi162.stdout:5/85: rename d15 to d15/d19/d1a 22 2024-04-25T01:41:22.180 INFO:tasks.workunit.client.0.smithi162.stdout:2/88: truncate d0/d3/fd 5203510 0 2024-04-25T01:41:22.397 INFO:tasks.workunit.client.0.smithi162.stdout:9/61: dread d4/f7 [0,4194304] 0 2024-04-25T01:41:22.592 INFO:tasks.workunit.client.0.smithi162.stdout:8/82: creat d0/d1a/de/f1c x:0 0 0 2024-04-25T01:41:22.849 INFO:tasks.workunit.client.0.smithi162.stdout:6/74: creat d1/d13/f15 x:0 0 0 2024-04-25T01:41:22.961 INFO:tasks.workunit.client.0.smithi162.stdout:0/116: dread d0/d1/f12 [0,4194304] 0 2024-04-25T01:41:22.969 INFO:tasks.workunit.client.0.smithi162.stdout:7/77: link df/f13 df/f18 0 2024-04-25T01:41:23.075 INFO:tasks.workunit.client.0.smithi162.stdout:1/104: mkdir d15/d1f/d23 0 2024-04-25T01:41:23.727 INFO:tasks.workunit.client.0.smithi162.stdout:9/62: truncate d4/d8/d13/f12 965988 0 2024-04-25T01:41:24.205 INFO:tasks.workunit.client.0.smithi162.stdout:2/89: rmdir d0/d3/d1b 39 2024-04-25T01:41:24.287 INFO:tasks.workunit.client.0.smithi162.stdout:4/78: getdents dd/d1a 0 2024-04-25T01:41:24.414 INFO:tasks.workunit.client.0.smithi162.stdout:6/75: fsync d1/fd 0 2024-04-25T01:41:24.550 INFO:tasks.workunit.client.0.smithi162.stdout:7/78: symlink df/l19 0 2024-04-25T01:41:24.595 INFO:tasks.workunit.client.0.smithi162.stdout:0/117: dread - d0/f1a zero size 2024-04-25T01:41:24.840 INFO:tasks.workunit.client.0.smithi162.stdout:5/86: read f3 [2628989,82151] 0 2024-04-25T01:41:25.169 INFO:tasks.workunit.client.0.smithi162.stdout:9/63: creat d4/d8/d13/f17 x:0 0 0 2024-04-25T01:41:25.403 INFO:tasks.workunit.client.0.smithi162.stdout:2/90: read - d0/d3/f16 zero size 2024-04-25T01:41:25.639 INFO:tasks.workunit.client.0.smithi162.stdout:4/79: read - dd/f15 zero size 2024-04-25T01:41:25.830 INFO:tasks.workunit.client.0.smithi162.stdout:6/76: rmdir d1/d13 39 2024-04-25T01:41:25.839 INFO:tasks.workunit.client.0.smithi162.stdout:8/83: write d0/d12/f17 [1067833,69994] 0 2024-04-25T01:41:25.908 INFO:tasks.workunit.client.0.smithi162.stdout:6/77: write d1/f4 [1339233,20999] 0 2024-04-25T01:41:25.941 INFO:tasks.workunit.client.0.smithi162.stdout:7/79: mknod df/c1a 0 2024-04-25T01:41:26.086 INFO:tasks.workunit.client.0.smithi162.stdout:3/90: link d2/c1a d2/d9/d19/c1e 0 2024-04-25T01:41:26.162 INFO:tasks.workunit.client.0.smithi162.stdout:5/87: fdatasync f11 0 2024-04-25T01:41:26.251 INFO:tasks.workunit.client.0.smithi162.stdout:0/118: dread d0/d1/f7 [0,4194304] 0 2024-04-25T01:41:26.265 INFO:tasks.workunit.client.0.smithi162.stdout:9/64: creat d4/d8/f18 x:0 0 0 2024-04-25T01:41:26.343 INFO:tasks.workunit.client.0.smithi162.stdout:5/88: sync 2024-04-25T01:41:26.389 INFO:tasks.workunit.client.0.smithi162.stdout:3/91: write d2/d9/fd [2881374,116845] 0 2024-04-25T01:41:26.622 INFO:tasks.workunit.client.0.smithi162.stdout:4/80: dread - fc zero size 2024-04-25T01:41:26.641 INFO:tasks.workunit.client.0.smithi162.stdout:6/78: dwrite d1/f8 [0,4194304] 0 2024-04-25T01:41:26.788 INFO:tasks.workunit.client.0.smithi162.stdout:0/119: dread d0/d1/f12 [0,4194304] 0 2024-04-25T01:41:26.836 INFO:tasks.workunit.client.0.smithi162.stdout:4/81: readlink l8 0 2024-04-25T01:41:26.979 INFO:tasks.workunit.client.0.smithi162.stdout:1/105: dwrite fa [0,4194304] 0 2024-04-25T01:41:27.088 INFO:tasks.workunit.client.0.smithi162.stdout:0/120: chown d0/f16 26 1 2024-04-25T01:41:27.254 INFO:tasks.workunit.client.0.smithi162.stdout:0/121: dread d0/d1/f7 [0,4194304] 0 2024-04-25T01:41:27.379 INFO:tasks.workunit.client.0.smithi162.stdout:2/91: mknod d0/c1f 0 2024-04-25T01:41:27.865 INFO:tasks.workunit.client.0.smithi162.stdout:3/92: dread d2/d9/f18 [0,4194304] 0 2024-04-25T01:41:28.025 INFO:tasks.workunit.client.0.smithi162.stdout:8/84: mknod d0/c1d 0 2024-04-25T01:41:28.090 INFO:tasks.workunit.client.0.smithi162.stdout:5/89: dwrite f11 [4194304,4194304] 0 2024-04-25T01:41:28.239 INFO:tasks.workunit.client.0.smithi162.stdout:6/79: dread - d1/f10 zero size 2024-04-25T01:41:28.319 INFO:tasks.workunit.client.0.smithi162.stdout:5/90: chown d15/d19 56 1 2024-04-25T01:41:28.429 INFO:tasks.workunit.client.0.smithi162.stdout:5/91: write fd [5426270,100916] 0 2024-04-25T01:41:28.508 INFO:tasks.workunit.client.0.smithi162.stdout:3/93: dwrite d2/d9/d10/f11 [0,4194304] 0 2024-04-25T01:41:28.699 INFO:tasks.workunit.client.0.smithi162.stdout:5/92: dread fd [0,4194304] 0 2024-04-25T01:41:28.733 INFO:tasks.workunit.client.0.smithi162.stdout:5/93: write f11 [1713062,61728] 0 2024-04-25T01:41:28.943 INFO:tasks.workunit.client.0.smithi162.stdout:9/65: getdents d4/d9/d15 0 2024-04-25T01:41:29.012 INFO:tasks.workunit.client.0.smithi162.stdout:7/80: write f9 [3539742,6362] 0 2024-04-25T01:41:29.180 INFO:tasks.workunit.client.0.smithi162.stdout:4/82: write f7 [787831,38562] 0 2024-04-25T01:41:29.313 INFO:tasks.workunit.client.0.smithi162.stdout:4/83: read f7 [4100347,4309] 0 2024-04-25T01:41:29.322 INFO:tasks.workunit.client.0.smithi162.stdout:5/94: read d15/f17 [911016,111610] 0 2024-04-25T01:41:29.576 INFO:tasks.workunit.client.0.smithi162.stdout:1/106: dwrite f9 [0,4194304] 0 2024-04-25T01:41:29.727 INFO:tasks.workunit.client.0.smithi162.stdout:0/122: link d0/d1/f7 d0/d1/f1e 0 2024-04-25T01:41:29.739 INFO:tasks.workunit.client.0.smithi162.stdout:5/95: dread d15/f17 [0,4194304] 0 2024-04-25T01:41:29.772 INFO:tasks.workunit.client.0.smithi162.stdout:2/92: truncate d0/d3/fd 1992727 0 2024-04-25T01:41:29.805 INFO:tasks.workunit.client.0.smithi162.stdout:2/93: chown d0/d3 2 1 2024-04-25T01:41:29.830 INFO:tasks.workunit.client.0.smithi162.stdout:4/84: mknod dd/df/c1d 0 2024-04-25T01:41:29.858 INFO:tasks.workunit.client.0.smithi162.stdout:6/80: truncate d1/d13/f15 72178 0 2024-04-25T01:41:29.977 INFO:tasks.workunit.client.0.smithi162.stdout:4/85: sync 2024-04-25T01:41:29.996 INFO:tasks.workunit.client.0.smithi162.stdout:1/107: unlink fa 0 2024-04-25T01:41:30.043 INFO:tasks.workunit.client.0.smithi162.stdout:8/85: write d0/f16 [320158,36638] 0 2024-04-25T01:41:30.182 INFO:tasks.workunit.client.0.smithi162.stdout:4/86: dread - dd/f15 zero size 2024-04-25T01:41:30.284 INFO:tasks.workunit.client.0.smithi162.stdout:0/123: truncate d0/f1a 720942 0 2024-04-25T01:41:30.284 INFO:tasks.workunit.client.0.smithi162.stdout:9/66: mknod d4/c19 0 2024-04-25T01:41:30.460 INFO:tasks.workunit.client.0.smithi162.stdout:7/81: dwrite f5 [4194304,4194304] 0 2024-04-25T01:41:30.464 INFO:tasks.workunit.client.0.smithi162.stdout:9/67: chown d4/d9/cb 0 1 2024-04-25T01:41:30.662 INFO:tasks.workunit.client.0.smithi162.stdout:8/86: rmdir d0/d1a/de 39 2024-04-25T01:41:30.680 INFO:tasks.workunit.client.0.smithi162.stdout:1/108: rename d15/l18 to d15/d1f/l24 0 2024-04-25T01:41:30.695 INFO:tasks.workunit.client.0.smithi162.stdout:3/94: getdents d2/d9/d17 0 2024-04-25T01:41:30.731 INFO:tasks.workunit.client.0.smithi162.stdout:5/96: creat d15/d19/f1b x:0 0 0 2024-04-25T01:41:30.842 INFO:tasks.workunit.client.0.smithi162.stdout:3/95: chown d2/l6 4434 1 2024-04-25T01:41:30.894 INFO:tasks.workunit.client.0.smithi162.stdout:4/87: symlink dd/l1e 0 2024-04-25T01:41:31.004 INFO:tasks.workunit.client.0.smithi162.stdout:5/97: dread f11 [0,4194304] 0 2024-04-25T01:41:31.036 INFO:tasks.workunit.client.0.smithi162.stdout:5/98: chown d15/c16 152 1 2024-04-25T01:41:31.357 INFO:tasks.workunit.client.0.smithi162.stdout:7/82: dread f1 [0,4194304] 0 2024-04-25T01:41:31.359 INFO:tasks.workunit.client.0.smithi162.stdout:8/87: readlink d0/l10 0 2024-04-25T01:41:31.427 INFO:tasks.workunit.client.0.smithi162.stdout:8/88: write d0/f16 [216852,110717] 0 2024-04-25T01:41:31.496 INFO:tasks.workunit.client.0.smithi162.stdout:8/89: write d0/d12/f17 [3533455,22943] 0 2024-04-25T01:41:31.657 INFO:tasks.workunit.client.0.smithi162.stdout:1/109: truncate d15/f21 214361 0 2024-04-25T01:41:31.992 INFO:tasks.workunit.client.0.smithi162.stdout:3/96: mknod d2/d9/d19/c1f 0 2024-04-25T01:41:32.050 INFO:tasks.workunit.client.0.smithi162.stdout:3/97: write d2/d9/d10/f11 [3052177,117726] 0 2024-04-25T01:41:32.170 INFO:tasks.workunit.client.0.smithi162.stdout:0/124: write d0/f16 [970023,73241] 0 2024-04-25T01:41:32.203 INFO:tasks.workunit.client.0.smithi162.stdout:0/125: readlink d0/d1/l17 0 2024-04-25T01:41:32.293 INFO:tasks.workunit.client.0.smithi162.stdout:6/81: rename d1/fd to d1/f16 0 2024-04-25T01:41:32.311 INFO:tasks.workunit.client.0.smithi162.stdout:2/94: mkdir d0/d3/d1b/d1d/d20 0 2024-04-25T01:41:32.427 INFO:tasks.workunit.client.0.smithi162.stdout:2/95: sync 2024-04-25T01:41:32.441 INFO:tasks.workunit.client.0.smithi162.stdout:2/96: readlink d0/d3/l6 0 2024-04-25T01:41:32.482 INFO:tasks.workunit.client.0.smithi162.stdout:7/83: truncate df/f15 87820 0 2024-04-25T01:41:32.585 INFO:tasks.workunit.client.0.smithi162.stdout:7/84: sync 2024-04-25T01:41:32.845 INFO:tasks.workunit.client.0.smithi162.stdout:9/68: unlink c1 0 2024-04-25T01:41:32.916 INFO:tasks.workunit.client.0.smithi162.stdout:1/110: fdatasync f14 0 2024-04-25T01:41:33.223 INFO:tasks.workunit.client.0.smithi162.stdout:4/88: dwrite fc [0,4194304] 0 2024-04-25T01:41:33.382 INFO:tasks.workunit.client.0.smithi162.stdout:7/85: truncate df/f17 452785 0 2024-04-25T01:41:33.418 INFO:tasks.workunit.client.0.smithi162.stdout:2/97: dread - d0/d3/f1a zero size 2024-04-25T01:41:33.510 INFO:tasks.workunit.client.0.smithi162.stdout:4/89: fdatasync dd/f15 0 2024-04-25T01:41:33.549 INFO:tasks.workunit.client.0.smithi162.stdout:5/99: write d15/f17 [3134125,44163] 0 2024-04-25T01:41:33.656 INFO:tasks.workunit.client.0.smithi162.stdout:1/111: creat d15/d1f/d23/f25 x:0 0 0 2024-04-25T01:41:33.674 INFO:tasks.workunit.client.0.smithi162.stdout:9/69: dread d4/d8/f10 [0,4194304] 0 2024-04-25T01:41:33.877 INFO:tasks.workunit.client.0.smithi162.stdout:7/86: creat df/f1b x:0 0 0 2024-04-25T01:41:34.182 INFO:tasks.workunit.client.0.smithi162.stdout:2/98: unlink d0/d3/fe 0 2024-04-25T01:41:34.508 INFO:tasks.workunit.client.0.smithi162.stdout:5/100: symlink d15/l1c 0 2024-04-25T01:41:34.525 INFO:tasks.workunit.client.0.smithi162.stdout:5/101: chown l4 6921 1 2024-04-25T01:41:34.571 INFO:tasks.workunit.client.0.smithi162.stdout:5/102: write d15/d19/f1b [935427,127713] 0 2024-04-25T01:41:34.642 INFO:tasks.workunit.client.0.smithi162.stdout:5/103: write d15/d19/f1b [2090412,84176] 0 2024-04-25T01:41:34.734 INFO:tasks.workunit.client.0.smithi162.stdout:1/112: read d15/f21 [152233,16023] 0 2024-04-25T01:41:34.870 INFO:tasks.workunit.client.0.smithi162.stdout:3/98: write d2/d9/f18 [114101,19067] 0 2024-04-25T01:41:35.093 INFO:tasks.workunit.client.0.smithi162.stdout:5/104: dread d15/d19/f1b [0,4194304] 0 2024-04-25T01:41:35.641 INFO:tasks.workunit.client.0.smithi162.stdout:0/126: dwrite d0/d1/f12 [0,4194304] 0 2024-04-25T01:41:35.769 INFO:tasks.workunit.client.0.smithi162.stdout:0/127: sync 2024-04-25T01:41:35.873 INFO:tasks.workunit.client.0.smithi162.stdout:6/82: dwrite d1/f8 [4194304,4194304] 0 2024-04-25T01:41:36.041 INFO:tasks.workunit.client.0.smithi162.stdout:8/90: link d0/cf d0/d1a/de/c1e 0 2024-04-25T01:41:36.164 INFO:tasks.workunit.client.0.smithi162.stdout:0/128: rename d0/d1 to d0/d1/d1f 22 2024-04-25T01:41:36.166 INFO:tasks.workunit.client.0.smithi162.stdout:3/99: mknod d2/d9/d19/c20 0 2024-04-25T01:41:36.315 INFO:tasks.workunit.client.0.smithi162.stdout:5/105: symlink d15/l1d 0 2024-04-25T01:41:36.360 INFO:tasks.workunit.client.0.smithi162.stdout:9/70: write d4/f14 [187493,63686] 0 2024-04-25T01:41:36.487 INFO:tasks.workunit.client.0.smithi162.stdout:4/90: dwrite dd/f15 [0,4194304] 0 2024-04-25T01:41:36.748 INFO:tasks.workunit.client.0.smithi162.stdout:4/91: readlink dd/le 0 2024-04-25T01:41:36.891 INFO:tasks.workunit.client.0.smithi162.stdout:1/113: write d15/f22 [779203,107423] 0 2024-04-25T01:41:36.997 INFO:tasks.workunit.client.0.smithi162.stdout:5/106: dread d15/f17 [0,4194304] 0 2024-04-25T01:41:37.204 INFO:tasks.workunit.client.0.smithi162.stdout:7/87: dwrite fd [0,4194304] 0 2024-04-25T01:41:37.417 INFO:tasks.workunit.client.0.smithi162.stdout:6/83: creat d1/d13/f17 x:0 0 0 2024-04-25T01:41:37.439 INFO:tasks.workunit.client.0.smithi162.stdout:7/88: dread - df/f12 zero size 2024-04-25T01:41:37.509 INFO:tasks.workunit.client.0.smithi162.stdout:2/99: dwrite d0/f9 [0,4194304] 0 2024-04-25T01:41:37.616 INFO:tasks.workunit.client.0.smithi162.stdout:0/129: mkdir d0/df/d20 0 2024-04-25T01:41:37.757 INFO:tasks.workunit.client.0.smithi162.stdout:9/71: read - d4/d8/f18 zero size 2024-04-25T01:41:37.921 INFO:tasks.workunit.client.0.smithi162.stdout:4/92: symlink dd/l1f 0 2024-04-25T01:41:38.279 INFO:tasks.workunit.client.0.smithi162.stdout:5/107: mkdir d15/d1e 0 2024-04-25T01:41:38.412 INFO:tasks.workunit.client.0.smithi162.stdout:1/114: symlink d15/d1f/d23/l26 0 2024-04-25T01:41:38.568 INFO:tasks.workunit.client.0.smithi162.stdout:7/89: rename f3 to df/f1c 0 2024-04-25T01:41:38.879 INFO:tasks.workunit.client.0.smithi162.stdout:2/100: creat d0/d3/d1b/f21 x:0 0 0 2024-04-25T01:41:38.997 INFO:tasks.workunit.client.0.smithi162.stdout:8/91: dwrite d0/f18 [0,4194304] 0 2024-04-25T01:41:39.338 INFO:tasks.workunit.client.0.smithi162.stdout:3/100: dwrite d2/d9/d10/f14 [4194304,4194304] 0 2024-04-25T01:41:39.450 INFO:tasks.workunit.client.0.smithi162.stdout:5/108: mknod d15/d19/c1f 0 2024-04-25T01:41:39.478 INFO:tasks.workunit.client.0.smithi162.stdout:6/84: symlink d1/l18 0 2024-04-25T01:41:39.571 INFO:tasks.workunit.client.0.smithi162.stdout:1/115: creat d15/d1f/f27 x:0 0 0 2024-04-25T01:41:39.646 INFO:tasks.workunit.client.0.smithi162.stdout:5/109: dread f3 [0,4194304] 0 2024-04-25T01:41:39.740 INFO:tasks.workunit.client.0.smithi162.stdout:7/90: mknod df/c1d 0 2024-04-25T01:41:39.753 INFO:tasks.workunit.client.0.smithi162.stdout:0/130: rename d0/le to d0/df/l21 0 2024-04-25T01:41:40.340 INFO:tasks.workunit.client.0.smithi162.stdout:2/101: creat d0/d3/d1b/f22 x:0 0 0 2024-04-25T01:41:40.643 INFO:tasks.workunit.client.0.smithi162.stdout:4/93: dwrite dd/f19 [0,4194304] 0 2024-04-25T01:41:40.727 INFO:tasks.workunit.client.0.smithi162.stdout:3/101: rmdir d2/d9/d10 39 2024-04-25T01:41:40.791 INFO:tasks.workunit.client.0.smithi162.stdout:9/72: link d4/d9/fa d4/d8/f1a 0 2024-04-25T01:41:40.792 INFO:tasks.workunit.client.0.smithi162.stdout:6/85: dread - d1/fe zero size 2024-04-25T01:41:40.823 INFO:tasks.workunit.client.0.smithi162.stdout:6/86: readlink d1/lb 0 2024-04-25T01:41:40.995 INFO:tasks.workunit.client.0.smithi162.stdout:8/92: creat d0/d12/d1b/f1f x:0 0 0 2024-04-25T01:41:41.820 INFO:tasks.workunit.client.0.smithi162.stdout:4/94: creat dd/d1a/f20 x:0 0 0 2024-04-25T01:41:41.940 INFO:tasks.workunit.client.0.smithi162.stdout:9/73: truncate d4/f7 646028 0 2024-04-25T01:41:42.056 INFO:tasks.workunit.client.0.smithi162.stdout:6/87: rename d1/ca to d1/d13/c19 0 2024-04-25T01:41:42.084 INFO:tasks.workunit.client.0.smithi162.stdout:2/102: getdents d0/d3/d1b/d1d/d20 0 2024-04-25T01:41:42.090 INFO:tasks.workunit.client.0.smithi162.stdout:6/88: chown d1/lb 1 1 2024-04-25T01:41:42.133 INFO:tasks.workunit.client.0.smithi162.stdout:2/103: dread - d0/d3/d1b/f21 zero size 2024-04-25T01:41:42.299 INFO:tasks.workunit.client.0.smithi162.stdout:8/93: mknod d0/d12/c20 0 2024-04-25T01:41:42.421 INFO:tasks.workunit.client.0.smithi162.stdout:0/131: truncate d0/d1/f12 3252219 0 2024-04-25T01:41:42.696 INFO:tasks.workunit.client.0.smithi162.stdout:6/89: truncate d1/f8 5051174 0 2024-04-25T01:41:42.845 INFO:tasks.workunit.client.0.smithi162.stdout:6/90: dread - d1/d13/f17 zero size 2024-04-25T01:41:42.886 INFO:tasks.workunit.client.0.smithi162.stdout:2/104: dread d0/d3/d5/f18 [0,4194304] 0 2024-04-25T01:41:42.910 INFO:tasks.workunit.client.0.smithi162.stdout:3/102: dwrite d2/d9/d10/f11 [0,4194304] 0 2024-04-25T01:41:43.259 INFO:tasks.workunit.client.0.smithi162.stdout:1/116: getdents d15 0 2024-04-25T01:41:43.327 INFO:tasks.workunit.client.0.smithi162.stdout:5/110: getdents d15/d19 0 2024-04-25T01:41:43.408 INFO:tasks.workunit.client.0.smithi162.stdout:8/94: chown d0/c3 2992140 1 2024-04-25T01:41:43.422 INFO:tasks.workunit.client.0.smithi162.stdout:8/95: chown d0/d1a 1061496 1 2024-04-25T01:41:43.619 INFO:tasks.workunit.client.0.smithi162.stdout:9/74: unlink d4/d8/d13/f12 0 2024-04-25T01:41:43.623 INFO:tasks.workunit.client.0.smithi162.stdout:7/91: getdents df 0 2024-04-25T01:41:43.641 INFO:tasks.workunit.client.0.smithi162.stdout:4/95: truncate fb 236358 0 2024-04-25T01:41:43.712 INFO:tasks.workunit.client.0.smithi162.stdout:6/91: fdatasync d1/fe 0 2024-04-25T01:41:44.045 INFO:tasks.workunit.client.0.smithi162.stdout:1/117: mknod d15/d1f/c28 0 2024-04-25T01:41:44.128 INFO:tasks.workunit.client.0.smithi162.stdout:5/111: creat d15/d19/f20 x:0 0 0 2024-04-25T01:41:44.194 INFO:tasks.workunit.client.0.smithi162.stdout:8/96: mknod d0/d1a/de/c21 0 2024-04-25T01:41:44.346 INFO:tasks.workunit.client.0.smithi162.stdout:7/92: creat df/f1e x:0 0 0 2024-04-25T01:41:44.603 INFO:tasks.workunit.client.0.smithi162.stdout:4/96: creat dd/d1a/f21 x:0 0 0 2024-04-25T01:41:44.833 INFO:tasks.workunit.client.0.smithi162.stdout:0/132: dwrite d0/d1/f4 [0,4194304] 0 2024-04-25T01:41:44.980 INFO:tasks.workunit.client.0.smithi162.stdout:3/103: symlink d2/d9/l21 0 2024-04-25T01:41:45.070 INFO:tasks.workunit.client.0.smithi162.stdout:6/92: symlink d1/d13/l1a 0 2024-04-25T01:41:45.429 INFO:tasks.workunit.client.0.smithi162.stdout:5/112: truncate f11 5476870 0 2024-04-25T01:41:45.513 INFO:tasks.workunit.client.0.smithi162.stdout:8/97: rename d0/d12/l14 to d0/d12/l22 0 2024-04-25T01:41:46.016 INFO:tasks.workunit.client.0.smithi162.stdout:2/105: truncate d0/f9 1379760 0 2024-04-25T01:41:46.071 INFO:tasks.workunit.client.0.smithi162.stdout:2/106: truncate d0/d3/d1b/f22 565663 0 2024-04-25T01:41:46.241 INFO:tasks.workunit.client.0.smithi162.stdout:4/97: dread fc [0,4194304] 0 2024-04-25T01:41:46.258 INFO:tasks.workunit.client.0.smithi162.stdout:4/98: readlink dd/l1e 0 2024-04-25T01:41:46.382 INFO:tasks.workunit.client.0.smithi162.stdout:9/75: mkdir d4/d9/d15/d1b 0 2024-04-25T01:41:46.870 INFO:tasks.workunit.client.0.smithi162.stdout:1/118: rename l6 to d15/d1f/d23/l29 0 2024-04-25T01:41:46.985 INFO:tasks.workunit.client.0.smithi162.stdout:6/93: dread d1/fc [0,4194304] 0 2024-04-25T01:41:47.010 INFO:tasks.workunit.client.0.smithi162.stdout:0/133: mknod d0/c22 0 2024-04-25T01:41:47.245 INFO:tasks.workunit.client.0.smithi162.stdout:8/98: creat d0/d12/f23 x:0 0 0 2024-04-25T01:41:47.292 INFO:tasks.workunit.client.0.smithi162.stdout:0/134: sync 2024-04-25T01:41:47.731 INFO:tasks.workunit.client.0.smithi162.stdout:4/99: creat dd/d1a/f22 x:0 0 0 2024-04-25T01:41:47.937 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:41:47.940 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:41:48.107 INFO:tasks.workunit.client.0.smithi162.stdout:9/76: dread f3 [0,4194304] 0 2024-04-25T01:41:48.117 INFO:tasks.workunit.client.0.smithi162.stdout:6/94: chown d1/d13/f15 940101 1 2024-04-25T01:41:48.241 INFO:tasks.workunit.client.0.smithi162.stdout:8/99: dread d0/f11 [0,4194304] 0 2024-04-25T01:41:48.354 INFO:tasks.workunit.client.0.smithi162.stdout:0/135: rename d0/d1/f4 to d0/df/f23 0 2024-04-25T01:41:48.815 INFO:tasks.workunit.client.0.smithi162.stdout:2/107: symlink d0/d3/d1b/d1c/d1e/l23 0 2024-04-25T01:41:49.017 INFO:tasks.workunit.client.0.smithi162.stdout:4/100: mknod dd/df/c23 0 2024-04-25T01:41:49.021 INFO:tasks.workunit.client.0.smithi162.stdout:1/119: truncate fe 4094527 0 2024-04-25T01:41:49.061 INFO:tasks.workunit.client.0.smithi162.stdout:1/120: chown c12 216826 1 2024-04-25T01:41:49.743 INFO:tasks.workunit.client.0.smithi162.stdout:8/100: dwrite d0/d12/d1b/f1f [0,4194304] 0 2024-04-25T01:41:49.897 INFO:tasks.workunit.client.0.smithi162.stdout:7/93: getdents df 0 2024-04-25T01:41:49.915 INFO:tasks.workunit.client.0.smithi162.stdout:2/108: fdatasync d0/d3/f16 0 2024-04-25T01:41:49.985 INFO:tasks.workunit.client.0.smithi162.stdout:8/101: read - d0/d12/f23 zero size 2024-04-25T01:41:50.024 INFO:tasks.workunit.client.0.smithi162.stdout:8/102: read d0/f11 [413670,22708] 0 2024-04-25T01:41:50.053 INFO:tasks.workunit.client.0.smithi162.stdout:8/103: dread - d0/d12/f23 zero size 2024-04-25T01:41:50.207 INFO:tasks.workunit.client.0.smithi162.stdout:4/101: creat dd/df/f24 x:0 0 0 2024-04-25T01:41:50.232 INFO:tasks.workunit.client.0.smithi162.stdout:3/104: creat d2/f22 x:0 0 0 2024-04-25T01:41:50.260 INFO:tasks.workunit.client.0.smithi162.stdout:4/102: stat dd/c18 0 2024-04-25T01:41:50.502 INFO:tasks.workunit.client.0.smithi162.stdout:3/105: sync 2024-04-25T01:41:50.878 INFO:tasks.workunit.client.0.smithi162.stdout:7/94: mknod df/c1f 0 2024-04-25T01:41:50.902 INFO:tasks.workunit.client.0.smithi162.stdout:7/95: dread - df/f1b zero size 2024-04-25T01:41:50.926 INFO:tasks.workunit.client.0.smithi162.stdout:7/96: chown df/f18 15631605 1 2024-04-25T01:41:50.980 INFO:tasks.workunit.client.0.smithi162.stdout:2/109: unlink d0/d3/c15 0 2024-04-25T01:41:51.077 INFO:tasks.workunit.client.0.smithi162.stdout:8/104: fsync d0/f18 0 2024-04-25T01:41:51.312 INFO:tasks.workunit.client.0.smithi162.stdout:4/103: rmdir dd 39 2024-04-25T01:41:51.330 INFO:tasks.workunit.client.0.smithi162.stdout:6/95: link d1/l18 d1/d13/l1b 0 2024-04-25T01:41:51.373 INFO:tasks.workunit.client.0.smithi162.stdout:2/110: dwrite d0/d3/d1b/f22 [0,4194304] 0 2024-04-25T01:41:51.558 INFO:tasks.workunit.client.0.smithi162.stdout:9/77: write d4/d8/f18 [668654,24123] 0 2024-04-25T01:41:51.791 INFO:tasks.workunit.client.0.smithi162.stdout:0/136: write d0/fd [3160721,39603] 0 2024-04-25T01:41:52.314 INFO:tasks.workunit.client.0.smithi162.stdout:1/121: write d15/f1c [688003,17739] 0 2024-04-25T01:41:52.378 INFO:tasks.workunit.client.0.smithi162.stdout:2/111: chown d0/ff 0 1 2024-04-25T01:41:52.398 INFO:tasks.workunit.client.0.smithi162.stdout:3/106: fsync d2/f22 0 2024-04-25T01:41:52.512 INFO:tasks.workunit.client.0.smithi162.stdout:5/113: truncate fd 4610021 0 2024-04-25T01:41:52.518 INFO:tasks.workunit.client.0.smithi162.stdout:3/107: sync 2024-04-25T01:41:52.549 INFO:tasks.workunit.client.0.smithi162.stdout:5/114: readlink l5 0 2024-04-25T01:41:52.853 INFO:tasks.workunit.client.0.smithi162.stdout:3/108: dwrite d2/f22 [0,4194304] 0 2024-04-25T01:41:53.000 INFO:tasks.workunit.client.0.smithi162.stdout:7/97: link f1 df/f20 0 2024-04-25T01:41:53.088 INFO:tasks.workunit.client.0.smithi162.stdout:9/78: unlink f2 0 2024-04-25T01:41:53.164 INFO:tasks.workunit.client.0.smithi162.stdout:4/104: dread dd/f15 [0,4194304] 0 2024-04-25T01:41:53.483 INFO:tasks.workunit.client.0.smithi162.stdout:0/137: creat d0/df/d20/f24 x:0 0 0 2024-04-25T01:41:53.880 INFO:tasks.workunit.client.0.smithi162.stdout:9/79: creat d4/d9/d15/f1c x:0 0 0 2024-04-25T01:41:54.001 INFO:tasks.workunit.client.0.smithi162.stdout:8/105: write d0/d1a/de/f1c [7708,86294] 0 2024-04-25T01:41:54.120 INFO:tasks.workunit.client.0.smithi162.stdout:2/112: truncate d0/f9 1689014 0 2024-04-25T01:41:54.336 INFO:tasks.workunit.client.0.smithi162.stdout:6/96: dwrite d1/f2 [0,4194304] 0 2024-04-25T01:41:54.444 INFO:tasks.workunit.client.0.smithi162.stdout:6/97: chown d1/d13/l1a 3198762 1 2024-04-25T01:41:54.579 INFO:tasks.workunit.client.0.smithi162.stdout:0/138: mkdir d0/df/d20/d25 0 2024-04-25T01:41:54.773 INFO:tasks.workunit.client.0.smithi162.stdout:9/80: creat d4/d9/d15/f1d x:0 0 0 2024-04-25T01:41:55.121 INFO:tasks.workunit.client.0.smithi162.stdout:1/122: link c11 d15/d1f/c2a 0 2024-04-25T01:41:55.135 INFO:tasks.workunit.client.0.smithi162.stdout:9/81: dwrite d4/d9/d15/f1d [0,4194304] 0 2024-04-25T01:41:55.261 INFO:tasks.workunit.client.0.smithi162.stdout:3/109: write d2/d9/fd [4587375,79484] 0 2024-04-25T01:41:55.469 INFO:tasks.workunit.client.0.smithi162.stdout:6/98: chown d1/d13/c19 12156 1 2024-04-25T01:41:55.733 INFO:tasks.workunit.client.0.smithi162.stdout:7/98: dwrite df/f17 [0,4194304] 0 2024-04-25T01:41:55.885 INFO:tasks.workunit.client.0.smithi162.stdout:0/139: symlink d0/l26 0 2024-04-25T01:41:55.955 INFO:tasks.workunit.client.0.smithi162.stdout:4/105: write dd/df/f12 [792883,41279] 0 2024-04-25T01:41:56.691 INFO:tasks.workunit.client.0.smithi162.stdout:1/123: mknod d15/d1f/c2b 0 2024-04-25T01:41:56.711 INFO:tasks.workunit.client.0.smithi162.stdout:3/110: fdatasync d2/d9/d10/f14 0 2024-04-25T01:41:56.781 INFO:tasks.workunit.client.0.smithi162.stdout:8/106: write d0/f11 [1135817,103162] 0 2024-04-25T01:41:57.105 INFO:tasks.workunit.client.0.smithi162.stdout:2/113: dwrite d0/d3/d5/f18 [0,4194304] 0 2024-04-25T01:41:57.214 INFO:tasks.workunit.client.0.smithi162.stdout:2/114: readlink d0/l14 0 2024-04-25T01:41:57.361 INFO:tasks.workunit.client.0.smithi162.stdout:0/140: fsync d0/d1/f1e 0 2024-04-25T01:41:57.372 INFO:tasks.workunit.client.0.smithi162.stdout:4/106: stat fb 0 2024-04-25T01:41:57.406 INFO:tasks.workunit.client.0.smithi162.stdout:7/99: truncate df/f1b 452342 0 2024-04-25T01:41:57.551 INFO:tasks.workunit.client.0.smithi162.stdout:4/107: write dd/df/f12 [448248,94131] 0 2024-04-25T01:41:57.904 INFO:tasks.workunit.client.0.smithi162.stdout:2/115: creat d0/d3/d1b/d1c/d1e/f24 x:0 0 0 2024-04-25T01:41:58.306 INFO:tasks.workunit.client.0.smithi162.stdout:6/99: symlink d1/l1c 0 2024-04-25T01:41:58.408 INFO:tasks.workunit.client.0.smithi162.stdout:0/141: mknod d0/df/d20/c27 0 2024-04-25T01:41:58.611 INFO:tasks.workunit.client.0.smithi162.stdout:7/100: rename f9 to df/f21 0 2024-04-25T01:41:58.929 INFO:tasks.workunit.client.0.smithi162.stdout:4/108: fdatasync dd/d1a/f20 0 2024-04-25T01:41:58.995 INFO:tasks.workunit.client.0.smithi162.stdout:4/109: read dd/df/f12 [398196,91339] 0 2024-04-25T01:41:59.065 INFO:tasks.workunit.client.0.smithi162.stdout:4/110: truncate dd/df/f12 1012077 0 2024-04-25T01:41:59.437 INFO:tasks.workunit.client.0.smithi162.stdout:2/116: dwrite d0/d3/d1b/f22 [0,4194304] 0 2024-04-25T01:41:59.550 INFO:tasks.workunit.client.0.smithi162.stdout:2/117: stat d0/d3/fd 0 2024-04-25T01:41:59.584 INFO:tasks.workunit.client.0.smithi162.stdout:2/118: chown d0/d3/d1b/f21 3016 1 2024-04-25T01:41:59.955 INFO:tasks.workunit.client.0.smithi162.stdout:0/142: write d0/d1/f7 [4161989,3271] 0 2024-04-25T01:42:00.114 INFO:tasks.workunit.client.0.smithi162.stdout:5/115: truncate f11 59398 0 2024-04-25T01:42:00.250 INFO:tasks.workunit.client.0.smithi162.stdout:0/143: dwrite d0/d1/f7 [0,4194304] 0 2024-04-25T01:42:00.383 INFO:tasks.workunit.client.0.smithi162.stdout:2/119: fsync d0/d3/f1a 0 2024-04-25T01:42:00.428 INFO:tasks.workunit.client.0.smithi162.stdout:2/120: chown d0/l11 19355 1 2024-04-25T01:42:00.494 INFO:tasks.workunit.client.0.smithi162.stdout:3/111: link d2/d9/d19/c1e d2/d9/d10/c23 0 2024-04-25T01:42:00.816 INFO:tasks.workunit.client.0.smithi162.stdout:1/124: dwrite f3 [4194304,4194304] 0 2024-04-25T01:42:00.837 INFO:tasks.workunit.client.0.smithi162.stdout:8/107: creat d0/d12/f24 x:0 0 0 2024-04-25T01:42:01.259 INFO:tasks.workunit.client.0.smithi162.stdout:2/121: mknod d0/d3/d1b/d1d/c25 0 2024-04-25T01:42:01.380 INFO:tasks.workunit.client.0.smithi162.stdout:3/112: mknod d2/d9/d19/c24 0 2024-04-25T01:42:01.794 INFO:tasks.workunit.client.0.smithi162.stdout:8/108: truncate d0/f16 1380237 0 2024-04-25T01:42:01.890 INFO:tasks.workunit.client.0.smithi162.stdout:1/125: dread f9 [0,4194304] 0 2024-04-25T01:42:01.942 INFO:tasks.workunit.client.0.smithi162.stdout:2/122: symlink d0/d3/d1b/d1c/d1e/l26 0 2024-04-25T01:42:02.047 INFO:tasks.workunit.client.0.smithi162.stdout:3/113: creat d2/f25 x:0 0 0 2024-04-25T01:42:02.506 INFO:tasks.workunit.client.0.smithi162.stdout:2/123: truncate d0/f9 2599480 0 2024-04-25T01:42:02.628 INFO:tasks.workunit.client.0.smithi162.stdout:6/100: dwrite d1/fc [0,4194304] 0 2024-04-25T01:42:02.793 INFO:tasks.workunit.client.0.smithi162.stdout:6/101: chown d1/c11 29918699 1 2024-04-25T01:42:02.829 INFO:tasks.workunit.client.0.smithi162.stdout:4/111: write f5 [1151454,38945] 0 2024-04-25T01:42:02.847 INFO:tasks.workunit.client.0.smithi162.stdout:7/101: write f6 [930038,48880] 0 2024-04-25T01:42:03.041 INFO:tasks.workunit.client.0.smithi162.stdout:9/82: rmdir d4/d9 39 2024-04-25T01:42:03.330 INFO:tasks.workunit.client.0.smithi162.stdout:0/144: creat d0/df/f28 x:0 0 0 2024-04-25T01:42:03.506 INFO:tasks.workunit.client.0.smithi162.stdout:5/116: write f11 [727711,73836] 0 2024-04-25T01:42:03.558 INFO:tasks.workunit.client.0.smithi162.stdout:3/114: dwrite d2/d9/d10/f14 [0,4194304] 0 2024-04-25T01:42:03.694 INFO:tasks.workunit.client.0.smithi162.stdout:2/124: rename d0/d3/d1b/d1c/d1e to d0/d3/d1b/d1c/d27 0 2024-04-25T01:42:03.752 INFO:tasks.workunit.client.0.smithi162.stdout:1/126: getdents d15/d1f/d23 0 2024-04-25T01:42:03.880 INFO:tasks.workunit.client.0.smithi162.stdout:8/109: rmdir d0/d12 39 2024-04-25T01:42:03.903 INFO:tasks.workunit.client.0.smithi162.stdout:6/102: chown d1/f16 46 1 2024-04-25T01:42:03.978 INFO:tasks.workunit.client.0.smithi162.stdout:4/112: mknod dd/d1a/c25 0 2024-04-25T01:42:04.046 INFO:tasks.workunit.client.0.smithi162.stdout:7/102: creat df/f22 x:0 0 0 2024-04-25T01:42:04.286 INFO:tasks.workunit.client.0.smithi162.stdout:3/115: creat d2/f26 x:0 0 0 2024-04-25T01:42:04.307 INFO:tasks.workunit.client.0.smithi162.stdout:5/117: rename l8 to d15/d19/l21 0 2024-04-25T01:42:04.322 INFO:tasks.workunit.client.0.smithi162.stdout:2/125: symlink d0/d3/d1b/d1c/l28 0 2024-04-25T01:42:04.354 INFO:tasks.workunit.client.0.smithi162.stdout:1/127: symlink d15/d1f/d23/l2c 0 2024-04-25T01:42:04.409 INFO:tasks.workunit.client.0.smithi162.stdout:5/118: read fd [370273,107400] 0 2024-04-25T01:42:04.669 INFO:tasks.workunit.client.0.smithi162.stdout:0/145: mkdir d0/df/d20/d25/d29 0 2024-04-25T01:42:04.679 INFO:tasks.workunit.client.0.smithi162.stdout:6/103: dread d1/f8 [0,4194304] 0 2024-04-25T01:42:05.082 INFO:tasks.workunit.client.0.smithi162.stdout:1/128: creat d15/d1f/f2d x:0 0 0 2024-04-25T01:42:05.102 INFO:tasks.workunit.client.0.smithi162.stdout:1/129: chown c12 12909604 1 2024-04-25T01:42:05.274 INFO:tasks.workunit.client.0.smithi162.stdout:9/83: symlink d4/d9/d15/d1b/l1e 0 2024-04-25T01:42:05.554 INFO:tasks.workunit.client.0.smithi162.stdout:6/104: rmdir d1 39 2024-04-25T01:42:05.604 INFO:tasks.workunit.client.0.smithi162.stdout:7/103: write df/f17 [4338020,120383] 0 2024-04-25T01:42:05.700 INFO:tasks.workunit.client.0.smithi162.stdout:3/116: symlink d2/d9/l27 0 2024-04-25T01:42:05.900 INFO:tasks.workunit.client.0.smithi162.stdout:4/113: dwrite dd/d1a/f22 [0,4194304] 0 2024-04-25T01:42:06.029 INFO:tasks.workunit.client.0.smithi162.stdout:2/126: symlink d0/d3/d1b/d1d/d20/l29 0 2024-04-25T01:42:06.030 INFO:tasks.workunit.client.0.smithi162.stdout:4/114: stat fc 0 2024-04-25T01:42:06.085 INFO:tasks.workunit.client.0.smithi162.stdout:1/130: mknod d15/d1f/c2e 0 2024-04-25T01:42:06.134 INFO:tasks.workunit.client.0.smithi162.stdout:5/119: write d15/d19/f1b [564728,35871] 0 2024-04-25T01:42:06.349 INFO:tasks.workunit.client.0.smithi162.stdout:8/110: write d0/d12/f17 [56507,74623] 0 2024-04-25T01:42:06.388 INFO:tasks.workunit.client.0.smithi162.stdout:8/111: chown d0/f11 310089923 1 2024-04-25T01:42:06.470 INFO:tasks.workunit.client.0.smithi162.stdout:9/84: mknod d4/d9/c1f 0 2024-04-25T01:42:06.603 INFO:tasks.workunit.client.0.smithi162.stdout:7/104: creat df/f23 x:0 0 0 2024-04-25T01:42:06.630 INFO:tasks.workunit.client.0.smithi162.stdout:7/105: read f6 [4185428,27017] 0 2024-04-25T01:42:06.667 INFO:tasks.workunit.client.0.smithi162.stdout:7/106: stat df/f1e 0 2024-04-25T01:42:07.566 INFO:tasks.workunit.client.0.smithi162.stdout:4/115: creat dd/d1a/f26 x:0 0 0 2024-04-25T01:42:07.619 INFO:tasks.workunit.client.0.smithi162.stdout:4/116: chown dd/f16 6550 1 2024-04-25T01:42:07.908 INFO:tasks.workunit.client.0.smithi162.stdout:8/112: dread d0/f16 [0,4194304] 0 2024-04-25T01:42:07.937 INFO:tasks.workunit.client.0.smithi162.stdout:9/85: creat d4/d9/f20 x:0 0 0 2024-04-25T01:42:08.218 INFO:tasks.workunit.client.0.smithi162.stdout:0/146: link d0/d1/l17 d0/l2a 0 2024-04-25T01:42:08.285 INFO:tasks.workunit.client.0.smithi162.stdout:7/107: mknod df/c24 0 2024-04-25T01:42:08.499 INFO:tasks.workunit.client.0.smithi162.stdout:4/117: creat dd/df/f27 x:0 0 0 2024-04-25T01:42:08.609 INFO:tasks.workunit.client.0.smithi162.stdout:5/120: creat d15/d1e/f22 x:0 0 0 2024-04-25T01:42:08.736 INFO:tasks.workunit.client.0.smithi162.stdout:3/117: mknod d2/d9/c28 0 2024-04-25T01:42:09.098 INFO:tasks.workunit.client.0.smithi162.stdout:2/127: rename d0/d3/d5/l17 to d0/d3/d1b/l2a 0 2024-04-25T01:42:09.598 INFO:tasks.workunit.client.0.smithi162.stdout:7/108: mknod df/c25 0 2024-04-25T01:42:09.695 INFO:tasks.workunit.client.0.smithi162.stdout:1/131: creat d15/d1f/d23/f2f x:0 0 0 2024-04-25T01:42:09.881 INFO:tasks.workunit.client.0.smithi162.stdout:6/105: write d1/f10 [986951,98844] 0 2024-04-25T01:42:10.278 INFO:tasks.workunit.client.0.smithi162.stdout:2/128: rmdir d0 39 2024-04-25T01:42:10.376 INFO:tasks.workunit.client.0.smithi162.stdout:3/118: dwrite d2/f25 [0,4194304] 0 2024-04-25T01:42:10.520 INFO:tasks.workunit.client.0.smithi162.stdout:8/113: mkdir d0/d1a/d25 0 2024-04-25T01:42:10.858 INFO:tasks.workunit.client.0.smithi162.stdout:6/106: rmdir d1/d13 39 2024-04-25T01:42:10.871 INFO:tasks.workunit.client.0.smithi162.stdout:6/107: readlink d1/l1c 0 2024-04-25T01:42:11.121 INFO:tasks.workunit.client.0.smithi162.stdout:6/108: dread d1/f4 [0,4194304] 0 2024-04-25T01:42:11.451 INFO:tasks.workunit.client.0.smithi162.stdout:8/114: mknod d0/d1a/de/c26 0 2024-04-25T01:42:11.476 INFO:tasks.workunit.client.0.smithi162.stdout:8/115: chown d0/d12/f23 80 1 2024-04-25T01:42:11.591 INFO:tasks.workunit.client.0.smithi162.stdout:1/132: mkdir d15/d1f/d23/d30 0 2024-04-25T01:42:12.029 INFO:tasks.workunit.client.0.smithi162.stdout:5/121: write fd [729021,111232] 0 2024-04-25T01:42:12.200 INFO:tasks.workunit.client.0.smithi162.stdout:5/122: read f11 [630070,38722] 0 2024-04-25T01:42:12.325 INFO:tasks.workunit.client.0.smithi162.stdout:4/118: dwrite dd/df/f14 [0,4194304] 0 2024-04-25T01:42:12.353 INFO:tasks.workunit.client.0.smithi162.stdout:0/147: mknod d0/c2b 0 2024-04-25T01:42:12.528 INFO:tasks.workunit.client.0.smithi162.stdout:5/123: dread fd [0,4194304] 0 2024-04-25T01:42:12.897 INFO:tasks.workunit.client.0.smithi162.stdout:9/86: write d4/d8/f10 [784035,96928] 0 2024-04-25T01:42:13.029 INFO:tasks.workunit.client.0.smithi162.stdout:3/119: write d2/f22 [3593221,7363] 0 2024-04-25T01:42:13.403 INFO:tasks.workunit.client.0.smithi162.stdout:7/109: getdents df 0 2024-04-25T01:42:13.446 INFO:tasks.workunit.client.0.smithi162.stdout:0/148: read d0/df/f14 [116859,92306] 0 2024-04-25T01:42:13.677 INFO:tasks.workunit.client.0.smithi162.stdout:5/124: symlink d15/d19/l23 0 2024-04-25T01:42:13.848 INFO:tasks.workunit.client.0.smithi162.stdout:4/119: dwrite dd/d1a/f22 [0,4194304] 0 2024-04-25T01:42:13.992 INFO:tasks.workunit.client.0.smithi162.stdout:6/109: write d1/fe [673383,14906] 0 2024-04-25T01:42:14.059 INFO:tasks.workunit.client.0.smithi162.stdout:3/120: mkdir d2/d29 0 2024-04-25T01:42:14.071 INFO:tasks.workunit.client.0.smithi162.stdout:8/116: write d0/f11 [1193074,48750] 0 2024-04-25T01:42:14.200 INFO:tasks.workunit.client.0.smithi162.stdout:5/125: mkdir d15/d19/d24 0 2024-04-25T01:42:14.223 INFO:tasks.workunit.client.0.smithi162.stdout:3/121: sync 2024-04-25T01:42:14.408 INFO:tasks.workunit.client.0.smithi162.stdout:4/120: mknod dd/c28 0 2024-04-25T01:42:14.434 INFO:tasks.workunit.client.0.smithi162.stdout:1/133: dwrite f9 [0,4194304] 0 2024-04-25T01:42:14.573 INFO:tasks.workunit.client.0.smithi162.stdout:4/121: chown dd/c18 1370626 1 2024-04-25T01:42:15.079 INFO:tasks.workunit.client.0.smithi162.stdout:3/122: fsync d2/d9/f18 0 2024-04-25T01:42:15.266 INFO:tasks.workunit.client.0.smithi162.stdout:4/122: creat dd/f29 x:0 0 0 2024-04-25T01:42:15.297 INFO:tasks.workunit.client.0.smithi162.stdout:4/123: chown dd/df/f10 212380 1 2024-04-25T01:42:15.341 INFO:tasks.workunit.client.0.smithi162.stdout:1/134: truncate d15/f1b 882771 0 2024-04-25T01:42:15.407 INFO:tasks.workunit.client.0.smithi162.stdout:7/110: link f4 df/f26 0 2024-04-25T01:42:15.419 INFO:tasks.workunit.client.0.smithi162.stdout:7/111: stat df/c11 0 2024-04-25T01:42:15.436 INFO:tasks.workunit.client.0.smithi162.stdout:7/112: chown df/f10 20527621 1 2024-04-25T01:42:15.751 INFO:tasks.workunit.client.0.smithi162.stdout:5/126: truncate f11 1430553 0 2024-04-25T01:42:16.018 INFO:tasks.workunit.client.0.smithi162.stdout:4/124: mknod dd/c2a 0 2024-04-25T01:42:16.209 INFO:tasks.workunit.client.0.smithi162.stdout:7/113: read fa [1461474,37348] 0 2024-04-25T01:42:16.436 INFO:tasks.workunit.client.0.smithi162.stdout:0/149: dwrite d0/fd [0,4194304] 0 2024-04-25T01:42:16.574 INFO:tasks.workunit.client.0.smithi162.stdout:3/123: creat d2/d29/f2a x:0 0 0 2024-04-25T01:42:16.613 INFO:tasks.workunit.client.0.smithi162.stdout:2/129: link d0/d3/fd d0/d3/f2b 0 2024-04-25T01:42:16.680 INFO:tasks.workunit.client.0.smithi162.stdout:0/150: fsync d0/fd 0 2024-04-25T01:42:16.751 INFO:tasks.workunit.client.0.smithi162.stdout:7/114: dread df/f10 [0,4194304] 0 2024-04-25T01:42:16.818 INFO:tasks.workunit.client.0.smithi162.stdout:9/87: dwrite d4/d8/d13/f17 [0,4194304] 0 2024-04-25T01:42:16.929 INFO:tasks.workunit.client.0.smithi162.stdout:8/117: write d0/d12/f24 [780597,106667] 0 2024-04-25T01:42:17.071 INFO:tasks.workunit.client.0.smithi162.stdout:0/151: chown d0/d1/f1e 4462 1 2024-04-25T01:42:17.143 INFO:tasks.workunit.client.0.smithi162.stdout:3/124: dread d2/f22 [0,4194304] 0 2024-04-25T01:42:17.396 INFO:tasks.workunit.client.0.smithi162.stdout:1/135: truncate d15/d1f/d23/f2f 52032 0 2024-04-25T01:42:17.506 INFO:tasks.workunit.client.0.smithi162.stdout:7/115: rmdir df 39 2024-04-25T01:42:17.625 INFO:tasks.workunit.client.0.smithi162.stdout:6/110: rename d1/d13/l1b to d1/l1d 0 2024-04-25T01:42:17.647 INFO:tasks.workunit.client.0.smithi162.stdout:6/111: chown d1/f10 42140332 1 2024-04-25T01:42:17.984 INFO:tasks.workunit.client.0.smithi162.stdout:0/152: fdatasync d0/d1/f7 0 2024-04-25T01:42:17.993 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:42:17.996 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:42:18.012 INFO:tasks.workunit.client.0.smithi162.stdout:5/127: write f3 [4452595,86868] 0 2024-04-25T01:42:18.047 INFO:tasks.workunit.client.0.smithi162.stdout:5/128: fsync f3 0 2024-04-25T01:42:18.312 INFO:tasks.workunit.client.0.smithi162.stdout:2/130: mknod d0/d3/c2c 0 2024-04-25T01:42:18.472 INFO:tasks.workunit.client.0.smithi162.stdout:7/116: chown df/f1c 1842 1 2024-04-25T01:42:18.484 INFO:tasks.workunit.client.0.smithi162.stdout:7/117: chown df 5 1 2024-04-25T01:42:18.499 INFO:tasks.workunit.client.0.smithi162.stdout:7/118: chown l0 132 1 2024-04-25T01:42:18.673 INFO:tasks.workunit.client.0.smithi162.stdout:8/118: symlink d0/d1a/l27 0 2024-04-25T01:42:19.746 INFO:tasks.workunit.client.0.smithi162.stdout:7/119: rmdir df 39 2024-04-25T01:42:19.807 INFO:tasks.workunit.client.0.smithi162.stdout:1/136: write d15/f1d [501732,123482] 0 2024-04-25T01:42:19.991 INFO:tasks.workunit.client.0.smithi162.stdout:8/119: dread d0/d1a/de/f1c [0,4194304] 0 2024-04-25T01:42:20.026 INFO:tasks.workunit.client.0.smithi162.stdout:3/125: dwrite d2/f26 [0,4194304] 0 2024-04-25T01:42:20.028 INFO:tasks.workunit.client.0.smithi162.stdout:9/88: rename d4/fd to d4/f21 0 2024-04-25T01:42:20.207 INFO:tasks.workunit.client.0.smithi162.stdout:0/153: fdatasync d0/d1/f12 0 2024-04-25T01:42:20.307 INFO:tasks.workunit.client.0.smithi162.stdout:0/154: read d0/d1/f7 [1030827,10425] 0 2024-04-25T01:42:20.635 INFO:tasks.workunit.client.0.smithi162.stdout:5/129: creat d15/d19/d24/f25 x:0 0 0 2024-04-25T01:42:20.660 INFO:tasks.workunit.client.0.smithi162.stdout:5/130: chown f3 878875 1 2024-04-25T01:42:20.746 INFO:tasks.workunit.client.0.smithi162.stdout:6/112: creat d1/f1e x:0 0 0 2024-04-25T01:42:20.840 INFO:tasks.workunit.client.0.smithi162.stdout:7/120: write df/f1e [436413,30568] 0 2024-04-25T01:42:20.881 INFO:tasks.workunit.client.0.smithi162.stdout:1/137: symlink d15/d1f/l31 0 2024-04-25T01:42:21.060 INFO:tasks.workunit.client.0.smithi162.stdout:4/125: mknod dd/c2b 0 2024-04-25T01:42:21.424 INFO:tasks.workunit.client.0.smithi162.stdout:9/89: symlink d4/d9/l22 0 2024-04-25T01:42:21.436 INFO:tasks.workunit.client.0.smithi162.stdout:3/126: fsync d2/d9/d10/f14 0 2024-04-25T01:42:21.635 INFO:tasks.workunit.client.0.smithi162.stdout:0/155: dread - d0/df/f1d zero size 2024-04-25T01:42:21.781 INFO:tasks.workunit.client.0.smithi162.stdout:2/131: rename d0/d3/d1b/d1c to d0/d2d 0 2024-04-25T01:42:21.958 INFO:tasks.workunit.client.0.smithi162.stdout:5/131: symlink d15/d19/l26 0 2024-04-25T01:42:22.099 INFO:tasks.workunit.client.0.smithi162.stdout:6/113: rmdir d1 39 2024-04-25T01:42:22.177 INFO:tasks.workunit.client.0.smithi162.stdout:7/121: symlink df/l27 0 2024-04-25T01:42:22.304 INFO:tasks.workunit.client.0.smithi162.stdout:1/138: mkdir d15/d1f/d32 0 2024-04-25T01:42:23.192 INFO:tasks.workunit.client.0.smithi162.stdout:3/127: rmdir d2/d9/d10 39 2024-04-25T01:42:23.216 INFO:tasks.workunit.client.0.smithi162.stdout:0/156: symlink d0/df/d20/l2c 0 2024-04-25T01:42:23.455 INFO:tasks.workunit.client.0.smithi162.stdout:5/132: fsync d15/d19/f20 0 2024-04-25T01:42:23.540 INFO:tasks.workunit.client.0.smithi162.stdout:6/114: stat d1/d13/l1a 0 2024-04-25T01:42:23.673 INFO:tasks.workunit.client.0.smithi162.stdout:7/122: truncate df/f15 1102098 0 2024-04-25T01:42:23.766 INFO:tasks.workunit.client.0.smithi162.stdout:6/115: sync 2024-04-25T01:42:23.803 INFO:tasks.workunit.client.0.smithi162.stdout:6/116: write d1/f1e [588174,29521] 0 2024-04-25T01:42:23.862 INFO:tasks.workunit.client.0.smithi162.stdout:6/117: truncate d1/f1e 1104985 0 2024-04-25T01:42:24.297 INFO:tasks.workunit.client.0.smithi162.stdout:1/139: creat d15/d1f/f33 x:0 0 0 2024-04-25T01:42:24.304 INFO:tasks.workunit.client.0.smithi162.stdout:4/126: truncate f4 1529498 0 2024-04-25T01:42:24.434 INFO:tasks.workunit.client.0.smithi162.stdout:8/120: creat d0/d1a/f28 x:0 0 0 2024-04-25T01:42:24.483 INFO:tasks.workunit.client.0.smithi162.stdout:8/121: dread d0/d1a/de/f1c [0,4194304] 0 2024-04-25T01:42:24.561 INFO:tasks.workunit.client.0.smithi162.stdout:9/90: write d4/d8/d13/f16 [576146,115040] 0 2024-04-25T01:42:25.334 INFO:tasks.workunit.client.0.smithi162.stdout:7/123: fsync df/f1b 0 2024-04-25T01:42:25.470 INFO:tasks.workunit.client.0.smithi162.stdout:5/133: dwrite f3 [0,4194304] 0 2024-04-25T01:42:25.713 INFO:tasks.workunit.client.0.smithi162.stdout:9/91: stat d4/d8/f1a 0 2024-04-25T01:42:25.724 INFO:tasks.workunit.client.0.smithi162.stdout:7/124: dread f2 [0,4194304] 0 2024-04-25T01:42:25.759 INFO:tasks.workunit.client.0.smithi162.stdout:3/128: symlink d2/d9/d10/l2b 0 2024-04-25T01:42:25.988 INFO:tasks.workunit.client.0.smithi162.stdout:1/140: creat d15/f34 x:0 0 0 2024-04-25T01:42:26.354 INFO:tasks.workunit.client.0.smithi162.stdout:0/157: write d0/f16 [1235351,50871] 0 2024-04-25T01:42:26.489 INFO:tasks.workunit.client.0.smithi162.stdout:8/122: mkdir d0/d29 0 2024-04-25T01:42:26.496 INFO:tasks.workunit.client.0.smithi162.stdout:2/132: write d0/d3/fd [596970,47966] 0 2024-04-25T01:42:26.533 INFO:tasks.workunit.client.0.smithi162.stdout:5/134: creat d15/d1e/f27 x:0 0 0 2024-04-25T01:42:26.899 INFO:tasks.workunit.client.0.smithi162.stdout:9/92: creat d4/d9/d15/f23 x:0 0 0 2024-04-25T01:42:27.036 INFO:tasks.workunit.client.0.smithi162.stdout:3/129: mkdir d2/d9/d10/d2c 0 2024-04-25T01:42:27.408 INFO:tasks.workunit.client.0.smithi162.stdout:1/141: mkdir d15/d1f/d35 0 2024-04-25T01:42:27.553 INFO:tasks.workunit.client.0.smithi162.stdout:6/118: link d1/f16 d1/d13/f1f 0 2024-04-25T01:42:27.833 INFO:tasks.workunit.client.0.smithi162.stdout:7/125: write f1 [3021116,44149] 0 2024-04-25T01:42:28.030 INFO:tasks.workunit.client.0.smithi162.stdout:0/158: symlink d0/df/d20/d25/l2d 0 2024-04-25T01:42:28.042 INFO:tasks.workunit.client.0.smithi162.stdout:0/159: readlink d0/l3 0 2024-04-25T01:42:28.314 INFO:tasks.workunit.client.0.smithi162.stdout:5/135: dread f11 [0,4194304] 0 2024-04-25T01:42:28.459 INFO:tasks.workunit.client.0.smithi162.stdout:9/93: rename d4/d9/f20 to d4/d9/d15/f24 0 2024-04-25T01:42:28.809 INFO:tasks.workunit.client.0.smithi162.stdout:6/119: unlink d1/f4 0 2024-04-25T01:42:28.827 INFO:tasks.workunit.client.0.smithi162.stdout:6/120: stat d1/d13/f1f 0 2024-04-25T01:42:29.004 INFO:tasks.workunit.client.0.smithi162.stdout:4/127: getdents dd/d1a 0 2024-04-25T01:42:29.131 INFO:tasks.workunit.client.0.smithi162.stdout:4/128: sync 2024-04-25T01:42:29.147 INFO:tasks.workunit.client.0.smithi162.stdout:7/126: rmdir df 39 2024-04-25T01:42:29.215 INFO:tasks.workunit.client.0.smithi162.stdout:7/127: chown fd 62194644 1 2024-04-25T01:42:29.281 INFO:tasks.workunit.client.0.smithi162.stdout:7/128: sync 2024-04-25T01:42:29.298 INFO:tasks.workunit.client.0.smithi162.stdout:8/123: creat d0/d29/f2a x:0 0 0 2024-04-25T01:42:29.468 INFO:tasks.workunit.client.0.smithi162.stdout:5/136: mkdir d15/d1e/d28 0 2024-04-25T01:42:29.485 INFO:tasks.workunit.client.0.smithi162.stdout:0/160: dwrite d0/df/f23 [0,4194304] 0 2024-04-25T01:42:29.579 INFO:tasks.workunit.client.0.smithi162.stdout:9/94: rmdir d4/d9/d15 39 2024-04-25T01:42:29.722 INFO:tasks.workunit.client.0.smithi162.stdout:6/121: creat d1/d13/f20 x:0 0 0 2024-04-25T01:42:29.747 INFO:tasks.workunit.client.0.smithi162.stdout:4/129: truncate dd/df/f24 545240 0 2024-04-25T01:42:29.792 INFO:tasks.workunit.client.0.smithi162.stdout:1/142: write d15/d1f/f27 [8574,66516] 0 2024-04-25T01:42:29.818 INFO:tasks.workunit.client.0.smithi162.stdout:6/122: chown d1/d13/l1a 1098 1 2024-04-25T01:42:29.863 INFO:tasks.workunit.client.0.smithi162.stdout:1/143: chown c10 172126937 1 2024-04-25T01:42:30.235 INFO:tasks.workunit.client.0.smithi162.stdout:2/133: write d0/d3/f19 [1023942,83698] 0 2024-04-25T01:42:30.414 INFO:tasks.workunit.client.0.smithi162.stdout:3/130: creat d2/d9/f2d x:0 0 0 2024-04-25T01:42:30.560 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:53:20.008 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:42:30.574 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:53:20.022 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:42:30.610 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:53:19.975 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:42:30.613 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:53:19.978 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:42:30.623 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:53:19.988 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:42:30.629 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:53:19.993 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:42:30.681 INFO:tasks.workunit.client.0.smithi162.stdout:5/137: truncate d15/d1e/f22 569168 0 2024-04-25T01:42:30.682 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:53:20.129 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:42:30.682 INFO:tasks.workunit.client.0.smithi162.stdout:0/161: fsync d0/d1/f7 0 2024-04-25T01:42:30.757 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:53:20.121 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:42:30.837 INFO:tasks.workunit.client.0.smithi162.stdout:0/162: dread d0/df/f23 [4194304,4194304] 0 2024-04-25T01:42:30.869 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:53:20.232 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:42:30.890 INFO:tasks.workunit.client.0.smithi162.stdout:4/130: creat dd/f2c x:0 0 0 2024-04-25T01:42:30.891 INFO:tasks.workunit.client.0.smithi162.stdout:7/129: creat df/f28 x:0 0 0 2024-04-25T01:42:31.194 INFO:tasks.workunit.client.0.smithi162.stdout:8/124: dwrite d0/d12/f24 [0,4194304] 0 2024-04-25T01:42:31.544 INFO:tasks.workunit.client.0.smithi162.stdout:3/131: mkdir d2/d29/d2e 0 2024-04-25T01:42:31.557 INFO:tasks.workunit.client.0.smithi162.stdout:9/95: mkdir d4/d25 0 2024-04-25T01:42:31.920 INFO:tasks.workunit.client.0.smithi162.stdout:0/163: mkdir d0/df/d2e 0 2024-04-25T01:42:31.950 INFO:tasks.workunit.client.0.smithi162.stdout:4/131: symlink dd/d1a/l2d 0 2024-04-25T01:42:32.201 INFO:tasks.workunit.client.0.smithi162.stdout:5/138: dread d15/d19/f1b [0,4194304] 0 2024-04-25T01:42:32.341 INFO:tasks.workunit.client.0.smithi162.stdout:8/125: mkdir d0/d12/d2b 0 2024-04-25T01:42:32.376 INFO:tasks.workunit.client.0.smithi162.stdout:5/139: stat d15/d1e/d28 0 2024-04-25T01:42:32.382 INFO:tasks.workunit.client.0.smithi162.stdout:2/134: dwrite d0/d2d/d27/f24 [0,4194304] 0 2024-04-25T01:42:32.560 INFO:tasks.workunit.client.0.smithi162.stdout:8/126: read d0/f18 [2872117,106896] 0 2024-04-25T01:42:32.581 INFO:tasks.workunit.client.0.smithi162.stdout:5/140: dread - d15/d19/f20 zero size 2024-04-25T01:42:32.833 INFO:tasks.workunit.client.0.smithi162.stdout:3/132: creat d2/d9/d17/f2f x:0 0 0 2024-04-25T01:42:33.275 INFO:tasks.workunit.client.0.smithi162.stdout:1/144: dwrite d15/d1f/d23/f2f [0,4194304] 0 2024-04-25T01:42:33.493 INFO:tasks.workunit.client.0.smithi162.stdout:1/145: read f14 [4066789,99426] 0 2024-04-25T01:42:33.553 INFO:tasks.workunit.client.0.smithi162.stdout:4/132: mkdir dd/df/d2e 0 2024-04-25T01:42:33.653 INFO:tasks.workunit.client.0.smithi162.stdout:3/133: dwrite d2/d9/d17/f2f [0,4194304] 0 2024-04-25T01:42:33.761 INFO:tasks.workunit.client.0.smithi162.stdout:0/164: creat d0/df/d20/f2f x:0 0 0 2024-04-25T01:42:33.768 INFO:tasks.workunit.client.0.smithi162.stdout:1/146: chown d15/f34 81634 1 2024-04-25T01:42:33.805 INFO:tasks.workunit.client.0.smithi162.stdout:1/147: chown d15/c20 57 1 2024-04-25T01:42:34.014 INFO:tasks.workunit.client.0.smithi162.stdout:9/96: fsync d4/f21 0 2024-04-25T01:42:34.088 INFO:tasks.workunit.client.0.smithi162.stdout:8/127: dread d0/f11 [0,4194304] 0 2024-04-25T01:42:34.123 INFO:tasks.workunit.client.0.smithi162.stdout:2/135: rename d0/d3/d1b/d1d/d20/l29 to d0/d3/d5/l2e 0 2024-04-25T01:42:34.159 INFO:tasks.workunit.client.0.smithi162.stdout:8/128: chown d0/d1a/de/c13 22 1 2024-04-25T01:42:34.343 INFO:tasks.workunit.client.0.smithi162.stdout:7/130: truncate df/f20 2456294 0 2024-04-25T01:42:34.510 INFO:tasks.workunit.client.0.smithi162.stdout:6/123: rename d1/f16 to d1/f21 0 2024-04-25T01:42:34.768 INFO:tasks.workunit.client.0.smithi162.stdout:0/165: fsync d0/d1/f1e 0 2024-04-25T01:42:34.995 INFO:tasks.workunit.client.0.smithi162.stdout:9/97: read d4/f7 [537070,40416] 0 2024-04-25T01:42:35.219 INFO:tasks.workunit.client.0.smithi162.stdout:4/133: rename dd/f15 to dd/df/d2e/f2f 0 2024-04-25T01:42:35.323 INFO:tasks.workunit.client.0.smithi162.stdout:8/129: unlink d0/d1a/de/f19 0 2024-04-25T01:42:35.533 INFO:tasks.workunit.client.0.smithi162.stdout:7/131: fsync fa 0 2024-04-25T01:42:35.784 INFO:tasks.workunit.client.0.smithi162.stdout:6/124: chown d1/l18 7 1 2024-04-25T01:42:35.918 INFO:tasks.workunit.client.0.smithi162.stdout:7/132: dwrite df/f28 [0,4194304] 0 2024-04-25T01:42:36.506 INFO:tasks.workunit.client.0.smithi162.stdout:4/134: creat dd/df/f30 x:0 0 0 2024-04-25T01:42:36.543 INFO:tasks.workunit.client.0.smithi162.stdout:4/135: read dd/d1a/f22 [1059006,55767] 0 2024-04-25T01:42:36.736 INFO:tasks.workunit.client.0.smithi162.stdout:5/141: link f11 d15/d1e/f29 0 2024-04-25T01:42:36.780 INFO:tasks.workunit.client.0.smithi162.stdout:4/136: sync 2024-04-25T01:42:37.812 INFO:tasks.workunit.client.0.smithi162.stdout:2/136: dwrite d0/f9 [0,4194304] 0 2024-04-25T01:42:37.997 INFO:tasks.workunit.client.0.smithi162.stdout:8/130: write d0/d12/d1b/f1f [3072077,49370] 0 2024-04-25T01:42:38.004 INFO:tasks.workunit.client.0.smithi162.stdout:3/134: creat d2/d9/f30 x:0 0 0 2024-04-25T01:42:38.224 INFO:tasks.workunit.client.0.smithi162.stdout:0/166: symlink d0/df/d20/d25/d29/l30 0 2024-04-25T01:42:38.822 INFO:tasks.workunit.client.0.smithi162.stdout:1/148: rename d15/d1f/d23/l26 to d15/d1f/d35/l36 0 2024-04-25T01:42:39.099 INFO:tasks.workunit.client.0.smithi162.stdout:5/142: rmdir d15/d1e 39 2024-04-25T01:42:39.279 INFO:tasks.workunit.client.0.smithi162.stdout:4/137: mknod dd/df/d2e/c31 0 2024-04-25T01:42:39.566 INFO:tasks.workunit.client.0.smithi162.stdout:8/131: symlink d0/d29/l2c 0 2024-04-25T01:42:39.952 INFO:tasks.workunit.client.0.smithi162.stdout:0/167: rename d0/df/d20/f2f to d0/df/d20/f31 0 2024-04-25T01:42:40.127 INFO:tasks.workunit.client.0.smithi162.stdout:7/133: rename df/f26 to df/f29 0 2024-04-25T01:42:40.130 INFO:tasks.workunit.client.0.smithi162.stdout:0/168: sync 2024-04-25T01:42:40.327 INFO:tasks.workunit.client.0.smithi162.stdout:9/98: write d4/d9/d15/f1d [4345219,75588] 0 2024-04-25T01:42:40.765 INFO:tasks.workunit.client.0.smithi162.stdout:2/137: mknod d0/d3/c2f 0 2024-04-25T01:42:40.847 INFO:tasks.workunit.client.0.smithi162.stdout:2/138: sync 2024-04-25T01:42:41.118 INFO:tasks.workunit.client.0.smithi162.stdout:3/135: creat d2/d29/d2e/f31 x:0 0 0 2024-04-25T01:42:41.247 INFO:tasks.workunit.client.0.smithi162.stdout:7/134: rmdir df 39 2024-04-25T01:42:41.467 INFO:tasks.workunit.client.0.smithi162.stdout:0/169: symlink d0/d1/l32 0 2024-04-25T01:42:41.569 INFO:tasks.workunit.client.0.smithi162.stdout:1/149: creat d15/d1f/d32/f37 x:0 0 0 2024-04-25T01:42:41.629 INFO:tasks.workunit.client.0.smithi162.stdout:9/99: dread d4/f14 [0,4194304] 0 2024-04-25T01:42:41.712 INFO:tasks.workunit.client.0.smithi162.stdout:5/143: unlink l13 0 2024-04-25T01:42:41.975 INFO:tasks.workunit.client.0.smithi162.stdout:6/125: dwrite d1/fc [0,4194304] 0 2024-04-25T01:42:42.115 INFO:tasks.workunit.client.0.smithi162.stdout:1/150: dread f14 [0,4194304] 0 2024-04-25T01:42:42.184 INFO:tasks.workunit.client.0.smithi162.stdout:4/138: write dd/d1a/f20 [467733,102595] 0 2024-04-25T01:42:42.320 INFO:tasks.workunit.client.0.smithi162.stdout:0/170: fdatasync d0/df/f14 0 2024-04-25T01:42:42.869 INFO:tasks.workunit.client.0.smithi162.stdout:8/132: creat d0/f2d x:0 0 0 2024-04-25T01:42:43.444 INFO:tasks.workunit.client.0.smithi162.stdout:1/151: creat d15/d1f/d32/f38 x:0 0 0 2024-04-25T01:42:43.770 INFO:tasks.workunit.client.0.smithi162.stdout:3/136: dwrite d2/d9/fd [4194304,4194304] 0 2024-04-25T01:42:43.899 INFO:tasks.workunit.client.0.smithi162.stdout:7/135: rename df/f1e to df/f2a 0 2024-04-25T01:42:43.917 INFO:tasks.workunit.client.0.smithi162.stdout:2/139: mkdir d0/d3/d30 0 2024-04-25T01:42:43.941 INFO:tasks.workunit.client.0.smithi162.stdout:0/171: mknod d0/d1/c33 0 2024-04-25T01:42:44.029 INFO:tasks.workunit.client.0.smithi162.stdout:5/144: fsync fd 0 2024-04-25T01:42:44.074 INFO:tasks.workunit.client.0.smithi162.stdout:3/137: dread - d2/d29/d2e/f31 zero size 2024-04-25T01:42:44.167 INFO:tasks.workunit.client.0.smithi162.stdout:8/133: creat d0/d12/f2e x:0 0 0 2024-04-25T01:42:44.198 INFO:tasks.workunit.client.0.smithi162.stdout:7/136: dread df/f1c [0,4194304] 0 2024-04-25T01:42:44.656 INFO:tasks.workunit.client.0.smithi162.stdout:1/152: dread f9 [0,4194304] 0 2024-04-25T01:42:44.728 INFO:tasks.workunit.client.0.smithi162.stdout:1/153: chown c2 729 1 2024-04-25T01:42:44.737 INFO:tasks.workunit.client.0.smithi162.stdout:9/100: dwrite d4/d8/d13/f17 [0,4194304] 0 2024-04-25T01:42:44.969 INFO:tasks.workunit.client.0.smithi162.stdout:1/154: write d15/d1f/d32/f38 [620893,7710] 0 2024-04-25T01:42:45.122 INFO:tasks.workunit.client.0.smithi162.stdout:1/155: chown d15/f22 8 1 2024-04-25T01:42:45.166 INFO:tasks.workunit.client.0.smithi162.stdout:4/139: dwrite dd/f19 [0,4194304] 0 2024-04-25T01:42:45.319 INFO:tasks.workunit.client.0.smithi162.stdout:0/172: creat d0/df/d20/f34 x:0 0 0 2024-04-25T01:42:45.476 INFO:tasks.workunit.client.0.smithi162.stdout:3/138: fdatasync d2/d9/f30 0 2024-04-25T01:42:45.623 INFO:tasks.workunit.client.0.smithi162.stdout:6/126: write d1/fe [1261931,1200] 0 2024-04-25T01:42:45.821 INFO:tasks.workunit.client.0.smithi162.stdout:3/139: dwrite d2/d9/fd [0,4194304] 0 2024-04-25T01:42:45.972 INFO:tasks.workunit.client.0.smithi162.stdout:9/101: fdatasync f3 0 2024-04-25T01:42:46.083 INFO:tasks.workunit.client.0.smithi162.stdout:0/173: symlink d0/df/d20/l35 0 2024-04-25T01:42:46.201 INFO:tasks.workunit.client.0.smithi162.stdout:0/174: chown d0/df/d20/d25/d29 936099488 1 2024-04-25T01:42:46.208 INFO:tasks.workunit.client.0.smithi162.stdout:4/140: dread dd/df/f12 [0,4194304] 0 2024-04-25T01:42:46.243 INFO:tasks.workunit.client.0.smithi162.stdout:4/141: chown dd/l1f 3934 1 2024-04-25T01:42:46.314 INFO:tasks.workunit.client.0.smithi162.stdout:7/137: truncate df/f2a 210587 0 2024-04-25T01:42:46.476 INFO:tasks.workunit.client.0.smithi162.stdout:5/145: write f3 [1738644,319] 0 2024-04-25T01:42:46.634 INFO:tasks.workunit.client.0.smithi162.stdout:1/156: fdatasync d15/f1b 0 2024-04-25T01:42:46.705 INFO:tasks.workunit.client.0.smithi162.stdout:2/140: dwrite d0/d3/f19 [0,4194304] 0 2024-04-25T01:42:46.863 INFO:tasks.workunit.client.0.smithi162.stdout:3/140: rename d2/f22 to d2/d9/d10/d2c/f32 0 2024-04-25T01:42:46.863 INFO:tasks.workunit.client.0.smithi162.stdout:2/141: sync 2024-04-25T01:42:46.935 INFO:tasks.workunit.client.0.smithi162.stdout:0/175: readlink d0/l2a 0 2024-04-25T01:42:47.036 INFO:tasks.workunit.client.0.smithi162.stdout:4/142: mknod dd/df/d2e/c32 0 2024-04-25T01:42:47.204 INFO:tasks.workunit.client.0.smithi162.stdout:8/134: dwrite d0/f18 [0,4194304] 0 2024-04-25T01:42:47.281 INFO:tasks.workunit.client.0.smithi162.stdout:8/135: sync 2024-04-25T01:42:47.363 INFO:tasks.workunit.client.0.smithi162.stdout:7/138: rename df/c11 to df/c2b 0 2024-04-25T01:42:48.115 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:42:48.118 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:42:48.203 INFO:tasks.workunit.client.0.smithi162.stdout:6/127: dwrite d1/f8 [0,4194304] 0 2024-04-25T01:42:48.473 INFO:tasks.workunit.client.0.smithi162.stdout:9/102: truncate d4/d9/d15/f24 479126 0 2024-04-25T01:42:48.992 INFO:tasks.workunit.client.0.smithi162.stdout:5/146: creat d15/d1e/f2a x:0 0 0 2024-04-25T01:42:49.186 INFO:tasks.workunit.client.0.smithi162.stdout:4/143: creat dd/f33 x:0 0 0 2024-04-25T01:42:49.193 INFO:tasks.workunit.client.0.smithi162.stdout:7/139: mkdir df/d2c 0 2024-04-25T01:42:49.250 INFO:tasks.workunit.client.0.smithi162.stdout:5/147: chown d15/d1e/f29 1159493 1 2024-04-25T01:42:49.295 INFO:tasks.workunit.client.0.smithi162.stdout:8/136: dread d0/d1a/de/f15 [0,4194304] 0 2024-04-25T01:42:49.348 INFO:tasks.workunit.client.0.smithi162.stdout:8/137: stat d0/d1a/de/c26 0 2024-04-25T01:42:49.384 INFO:tasks.workunit.client.0.smithi162.stdout:8/138: dread d0/d1a/de/f1c [0,4194304] 0 2024-04-25T01:42:49.402 INFO:tasks.workunit.client.0.smithi162.stdout:1/157: fsync fe 0 2024-04-25T01:42:49.433 INFO:tasks.workunit.client.0.smithi162.stdout:1/158: stat c1 0 2024-04-25T01:42:49.826 INFO:tasks.workunit.client.0.smithi162.stdout:0/176: write d0/d1/f7 [5060425,46964] 0 2024-04-25T01:42:49.953 INFO:tasks.workunit.client.0.smithi162.stdout:3/141: dwrite d2/f26 [4194304,4194304] 0 2024-04-25T01:42:50.137 INFO:tasks.workunit.client.0.smithi162.stdout:7/140: creat df/f2d x:0 0 0 2024-04-25T01:42:50.158 INFO:tasks.workunit.client.0.smithi162.stdout:0/177: dread - d0/df/d20/f31 zero size 2024-04-25T01:42:50.217 INFO:tasks.workunit.client.0.smithi162.stdout:0/178: write d0/df/d20/f34 [506947,98704] 0 2024-04-25T01:42:50.309 INFO:tasks.workunit.client.0.smithi162.stdout:4/144: mkdir dd/d1a/d34 0 2024-04-25T01:42:50.337 INFO:tasks.workunit.client.0.smithi162.stdout:5/148: mkdir d15/d19/d24/d2b 0 2024-04-25T01:42:50.677 INFO:tasks.workunit.client.0.smithi162.stdout:6/128: symlink d1/d13/l22 0 2024-04-25T01:42:51.143 INFO:tasks.workunit.client.0.smithi162.stdout:7/141: chown df/c2b 5494964 1 2024-04-25T01:42:51.154 INFO:tasks.workunit.client.0.smithi162.stdout:7/142: readlink df/l19 0 2024-04-25T01:42:51.161 INFO:tasks.workunit.client.0.smithi162.stdout:7/143: readlink l0 0 2024-04-25T01:42:51.355 INFO:tasks.workunit.client.0.smithi162.stdout:0/179: fdatasync d0/df/d20/f24 0 2024-04-25T01:42:51.490 INFO:tasks.workunit.client.0.smithi162.stdout:3/142: dwrite d2/d29/d2e/f31 [0,4194304] 0 2024-04-25T01:42:51.675 INFO:tasks.workunit.client.0.smithi162.stdout:5/149: truncate d15/d1e/f29 2238889 0 2024-04-25T01:42:51.795 INFO:tasks.workunit.client.0.smithi162.stdout:6/129: unlink d1/fc 0 2024-04-25T01:42:51.839 INFO:tasks.workunit.client.0.smithi162.stdout:2/142: getdents d0/d3/d1b/d1d/d20 0 2024-04-25T01:42:52.640 INFO:tasks.workunit.client.0.smithi162.stdout:4/145: dwrite fb [0,4194304] 0 2024-04-25T01:42:52.978 INFO:tasks.workunit.client.0.smithi162.stdout:3/143: truncate d2/d9/f30 50840 0 2024-04-25T01:42:53.188 INFO:tasks.workunit.client.0.smithi162.stdout:6/130: dread - d1/d13/f17 zero size 2024-04-25T01:42:53.279 INFO:tasks.workunit.client.0.smithi162.stdout:9/103: rename d4/d9/d15/f24 to d4/f26 0 2024-04-25T01:42:53.348 INFO:tasks.workunit.client.0.smithi162.stdout:2/143: mknod d0/d2d/d27/c31 0 2024-04-25T01:42:53.587 INFO:tasks.workunit.client.0.smithi162.stdout:7/144: dwrite df/f10 [0,4194304] 0 2024-04-25T01:42:53.990 INFO:tasks.workunit.client.0.smithi162.stdout:0/180: dwrite d0/df/f14 [0,4194304] 0 2024-04-25T01:42:54.091 INFO:tasks.workunit.client.0.smithi162.stdout:4/146: truncate dd/df/f10 1351947 0 2024-04-25T01:42:54.127 INFO:tasks.workunit.client.0.smithi162.stdout:8/139: getdents d0/d12/d1b 0 2024-04-25T01:42:54.205 INFO:tasks.workunit.client.0.smithi162.stdout:3/144: fsync d2/f25 0 2024-04-25T01:42:54.281 INFO:tasks.workunit.client.0.smithi162.stdout:3/145: write d2/f26 [1710872,124718] 0 2024-04-25T01:42:54.461 INFO:tasks.workunit.client.0.smithi162.stdout:3/146: dread d2/f26 [4194304,4194304] 0 2024-04-25T01:42:54.524 INFO:tasks.workunit.client.0.smithi162.stdout:5/150: truncate d15/d1e/f22 27575 0 2024-04-25T01:42:54.634 INFO:tasks.workunit.client.0.smithi162.stdout:6/131: dread d1/f2 [0,4194304] 0 2024-04-25T01:42:54.769 INFO:tasks.workunit.client.0.smithi162.stdout:1/159: rename f9 to d15/f39 0 2024-04-25T01:42:54.808 INFO:tasks.workunit.client.0.smithi162.stdout:9/104: creat d4/d8/d13/f27 x:0 0 0 2024-04-25T01:42:55.645 INFO:tasks.workunit.client.0.smithi162.stdout:4/147: creat dd/df/d2e/f35 x:0 0 0 2024-04-25T01:42:55.838 INFO:tasks.workunit.client.0.smithi162.stdout:8/140: fdatasync d0/d12/f2e 0 2024-04-25T01:42:56.151 INFO:tasks.workunit.client.0.smithi162.stdout:3/147: mkdir d2/d29/d33 0 2024-04-25T01:42:56.482 INFO:tasks.workunit.client.0.smithi162.stdout:2/144: write d0/f9 [4912775,26025] 0 2024-04-25T01:42:56.627 INFO:tasks.workunit.client.0.smithi162.stdout:7/145: write f2 [1593440,12144] 0 2024-04-25T01:42:56.726 INFO:tasks.workunit.client.0.smithi162.stdout:9/105: creat d4/d9/d15/d1b/f28 x:0 0 0 2024-04-25T01:42:57.436 INFO:tasks.workunit.client.0.smithi162.stdout:4/148: dread dd/f19 [0,4194304] 0 2024-04-25T01:42:57.891 INFO:tasks.workunit.client.0.smithi162.stdout:6/132: write d1/fe [477993,122521] 0 2024-04-25T01:42:58.039 INFO:tasks.workunit.client.0.smithi162.stdout:5/151: creat d15/d19/d24/d2b/f2c x:0 0 0 2024-04-25T01:42:58.103 INFO:tasks.workunit.client.0.smithi162.stdout:1/160: write d15/f21 [928550,44807] 0 2024-04-25T01:42:58.502 INFO:tasks.workunit.client.0.smithi162.stdout:2/145: symlink d0/d3/d5/l32 0 2024-04-25T01:42:58.604 INFO:tasks.workunit.client.0.smithi162.stdout:0/181: rename d0/f1a to d0/df/d2e/f36 0 2024-04-25T01:42:58.962 INFO:tasks.workunit.client.0.smithi162.stdout:8/141: dwrite d0/d12/d1b/f1f [0,4194304] 0 2024-04-25T01:42:59.079 INFO:tasks.workunit.client.0.smithi162.stdout:8/142: chown d0/f2d 31376106 1 2024-04-25T01:42:59.097 INFO:tasks.workunit.client.0.smithi162.stdout:3/148: write d2/d9/d10/f11 [6875596,98617] 0 2024-04-25T01:42:59.352 INFO:tasks.workunit.client.0.smithi162.stdout:6/133: truncate d1/d13/f17 99867 0 2024-04-25T01:42:59.517 INFO:tasks.workunit.client.0.smithi162.stdout:5/152: creat d15/d19/d24/f2d x:0 0 0 2024-04-25T01:42:59.630 INFO:tasks.workunit.client.0.smithi162.stdout:1/161: symlink d15/d1f/d32/l3a 0 2024-04-25T01:42:59.655 INFO:tasks.workunit.client.0.smithi162.stdout:1/162: readlink d15/d1f/d32/l3a 0 2024-04-25T01:42:59.794 INFO:tasks.workunit.client.0.smithi162.stdout:2/146: mkdir d0/d3/d5/d33 0 2024-04-25T01:43:00.036 INFO:tasks.workunit.client.0.smithi162.stdout:9/106: rename d4/d9/d15/f1c to d4/d9/d15/d1b/f29 0 2024-04-25T01:43:00.236 INFO:tasks.workunit.client.0.smithi162.stdout:0/182: fdatasync d0/df/f23 0 2024-04-25T01:43:00.418 INFO:tasks.workunit.client.0.smithi162.stdout:9/107: dwrite d4/d8/d13/f27 [0,4194304] 0 2024-04-25T01:43:00.443 INFO:tasks.workunit.client.0.smithi162.stdout:8/143: rmdir d0/d29 39 2024-04-25T01:43:00.578 INFO:tasks.workunit.client.0.smithi162.stdout:3/149: symlink d2/d29/l34 0 2024-04-25T01:43:00.597 INFO:tasks.workunit.client.0.smithi162.stdout:8/144: stat d0/f2d 0 2024-04-25T01:43:00.598 INFO:tasks.workunit.client.0.smithi162.stdout:9/108: chown d4/d25 104 1 2024-04-25T01:43:00.933 INFO:tasks.workunit.client.0.smithi162.stdout:6/134: creat d1/d13/f23 x:0 0 0 2024-04-25T01:43:01.112 INFO:tasks.workunit.client.0.smithi162.stdout:1/163: truncate f4 3724228 0 2024-04-25T01:43:01.630 INFO:tasks.workunit.client.0.smithi162.stdout:0/183: dread - d0/df/d20/f31 zero size 2024-04-25T01:43:01.706 INFO:tasks.workunit.client.0.smithi162.stdout:4/149: link dd/c18 dd/df/c36 0 2024-04-25T01:43:01.848 INFO:tasks.workunit.client.0.smithi162.stdout:8/145: dread d0/f18 [0,4194304] 0 2024-04-25T01:43:02.010 INFO:tasks.workunit.client.0.smithi162.stdout:3/150: symlink d2/d9/d10/d2c/l35 0 2024-04-25T01:43:02.027 INFO:tasks.workunit.client.0.smithi162.stdout:9/109: rename d4/f7 to d4/d8/d13/f2a 0 2024-04-25T01:43:02.039 INFO:tasks.workunit.client.0.smithi162.stdout:0/184: sync 2024-04-25T01:43:02.517 INFO:tasks.workunit.client.0.smithi162.stdout:1/164: dread d15/f39 [0,4194304] 0 2024-04-25T01:43:02.722 INFO:tasks.workunit.client.0.smithi162.stdout:7/146: getdents df 0 2024-04-25T01:43:02.836 INFO:tasks.workunit.client.0.smithi162.stdout:2/147: dwrite d0/d2d/d27/f24 [0,4194304] 0 2024-04-25T01:43:02.949 INFO:tasks.workunit.client.0.smithi162.stdout:4/150: unlink dd/f19 0 2024-04-25T01:43:03.129 INFO:tasks.workunit.client.0.smithi162.stdout:3/151: dread d2/d9/f30 [0,4194304] 0 2024-04-25T01:43:03.471 INFO:tasks.workunit.client.0.smithi162.stdout:0/185: dread d0/d1/f1e [0,4194304] 0 2024-04-25T01:43:03.875 INFO:tasks.workunit.client.0.smithi162.stdout:5/153: dwrite d15/d1e/f22 [0,4194304] 0 2024-04-25T01:43:04.039 INFO:tasks.workunit.client.0.smithi162.stdout:1/165: unlink d15/f22 0 2024-04-25T01:43:04.075 INFO:tasks.workunit.client.0.smithi162.stdout:8/146: write d0/d1a/de/f1c [1080254,106] 0 2024-04-25T01:43:04.312 INFO:tasks.workunit.client.0.smithi162.stdout:2/148: dread d0/d3/fd [0,4194304] 0 2024-04-25T01:43:04.521 INFO:tasks.workunit.client.0.smithi162.stdout:3/152: creat d2/d9/d19/f36 x:0 0 0 2024-04-25T01:43:04.536 INFO:tasks.workunit.client.0.smithi162.stdout:2/149: dread d0/d2d/d27/f24 [0,4194304] 0 2024-04-25T01:43:04.662 INFO:tasks.workunit.client.0.smithi162.stdout:6/135: write d1/f1e [1334106,92530] 0 2024-04-25T01:43:05.469 INFO:tasks.workunit.client.0.smithi162.stdout:1/166: fdatasync d15/f1c 0 2024-04-25T01:43:05.543 INFO:tasks.workunit.client.0.smithi162.stdout:7/147: write df/f1b [879391,15730] 0 2024-04-25T01:43:05.628 INFO:tasks.workunit.client.0.smithi162.stdout:0/186: unlink d0/f16 0 2024-04-25T01:43:05.788 INFO:tasks.workunit.client.0.smithi162.stdout:7/148: chown l0 11993 1 2024-04-25T01:43:05.850 INFO:tasks.workunit.client.0.smithi162.stdout:5/154: dread d15/f17 [0,4194304] 0 2024-04-25T01:43:06.122 INFO:tasks.workunit.client.0.smithi162.stdout:4/151: dwrite dd/f2c [0,4194304] 0 2024-04-25T01:43:06.257 INFO:tasks.workunit.client.0.smithi162.stdout:2/150: mknod d0/d3/d1b/d1d/d20/c34 0 2024-04-25T01:43:06.260 INFO:tasks.workunit.client.0.smithi162.stdout:4/152: readlink l2 0 2024-04-25T01:43:06.349 INFO:tasks.workunit.client.0.smithi162.stdout:9/110: rename d4/d9/l22 to d4/d9/l2b 0 2024-04-25T01:43:06.758 INFO:tasks.workunit.client.0.smithi162.stdout:7/149: mkdir df/d2e 0 2024-04-25T01:43:07.141 INFO:tasks.workunit.client.0.smithi162.stdout:1/167: truncate d15/d1f/f33 809636 0 2024-04-25T01:43:07.302 INFO:tasks.workunit.client.0.smithi162.stdout:5/155: read d15/d1e/f29 [255730,69017] 0 2024-04-25T01:43:07.347 INFO:tasks.workunit.client.0.smithi162.stdout:0/187: rename d0/df/d2e to d0/df/d20/d37 0 2024-04-25T01:43:07.372 INFO:tasks.workunit.client.0.smithi162.stdout:7/150: dwrite df/f1b [0,4194304] 0 2024-04-25T01:43:07.390 INFO:tasks.workunit.client.0.smithi162.stdout:1/168: chown f14 51806 1 2024-04-25T01:43:07.534 INFO:tasks.workunit.client.0.smithi162.stdout:8/147: dwrite d0/d12/f2e [0,4194304] 0 2024-04-25T01:43:07.560 INFO:tasks.workunit.client.0.smithi162.stdout:5/156: stat d15/f17 0 2024-04-25T01:43:07.695 INFO:tasks.workunit.client.0.smithi162.stdout:4/153: rmdir dd 39 2024-04-25T01:43:07.811 INFO:tasks.workunit.client.0.smithi162.stdout:9/111: symlink d4/d8/d13/l2c 0 2024-04-25T01:43:07.978 INFO:tasks.workunit.client.0.smithi162.stdout:3/153: dwrite d2/d29/d2e/f31 [0,4194304] 0 2024-04-25T01:43:08.655 INFO:tasks.workunit.client.0.smithi162.stdout:1/169: read f4 [3123020,85590] 0 2024-04-25T01:43:08.963 INFO:tasks.workunit.client.0.smithi162.stdout:2/151: unlink d0/d3/d5/l2e 0 2024-04-25T01:43:08.985 INFO:tasks.workunit.client.0.smithi162.stdout:2/152: readlink d0/d3/l6 0 2024-04-25T01:43:09.153 INFO:tasks.workunit.client.0.smithi162.stdout:5/157: symlink d15/d19/l2e 0 2024-04-25T01:43:09.265 INFO:tasks.workunit.client.0.smithi162.stdout:0/188: mknod d0/df/d20/d25/c38 0 2024-04-25T01:43:09.378 INFO:tasks.workunit.client.0.smithi162.stdout:5/158: sync 2024-04-25T01:43:09.837 INFO:tasks.workunit.client.0.smithi162.stdout:7/151: dwrite df/f21 [0,4194304] 0 2024-04-25T01:43:10.087 INFO:tasks.workunit.client.0.smithi162.stdout:7/152: chown df/c1f 2918 1 2024-04-25T01:43:10.174 INFO:tasks.workunit.client.0.smithi162.stdout:6/136: link d1/f2 d1/f24 0 2024-04-25T01:43:10.188 INFO:tasks.workunit.client.0.smithi162.stdout:8/148: mknod d0/c2f 0 2024-04-25T01:43:10.236 INFO:tasks.workunit.client.0.smithi162.stdout:0/189: truncate d0/df/f14 2360697 0 2024-04-25T01:43:10.328 INFO:tasks.workunit.client.0.smithi162.stdout:4/154: dwrite f7 [4194304,4194304] 0 2024-04-25T01:43:10.620 INFO:tasks.workunit.client.0.smithi162.stdout:7/153: unlink df/f18 0 2024-04-25T01:43:10.680 INFO:tasks.workunit.client.0.smithi162.stdout:4/155: readlink l2 0 2024-04-25T01:43:10.925 INFO:tasks.workunit.client.0.smithi162.stdout:1/170: dwrite d15/f1d [0,4194304] 0 2024-04-25T01:43:11.134 INFO:tasks.workunit.client.0.smithi162.stdout:5/159: dread f3 [0,4194304] 0 2024-04-25T01:43:11.150 INFO:tasks.workunit.client.0.smithi162.stdout:3/154: link d2/d9/c28 d2/d9/d10/d2c/c37 0 2024-04-25T01:43:11.151 INFO:tasks.workunit.client.0.smithi162.stdout:9/112: creat d4/d8/f2d x:0 0 0 2024-04-25T01:43:11.199 INFO:tasks.workunit.client.0.smithi162.stdout:6/137: dread d1/f24 [0,4194304] 0 2024-04-25T01:43:11.200 INFO:tasks.workunit.client.0.smithi162.stdout:2/153: creat d0/d3/f35 x:0 0 0 2024-04-25T01:43:11.493 INFO:tasks.workunit.client.0.smithi162.stdout:4/156: fsync fc 0 2024-04-25T01:43:11.495 INFO:tasks.workunit.client.0.smithi162.stdout:7/154: creat df/f2f x:0 0 0 2024-04-25T01:43:11.533 INFO:tasks.workunit.client.0.smithi162.stdout:0/190: truncate d0/d1/f1e 1288634 0 2024-04-25T01:43:11.591 INFO:tasks.workunit.client.0.smithi162.stdout:9/113: chown d4/d8/d13/f16 176611 1 2024-04-25T01:43:11.750 INFO:tasks.workunit.client.0.smithi162.stdout:5/160: dread - d15/d19/d24/f2d zero size 2024-04-25T01:43:11.830 INFO:tasks.workunit.client.0.smithi162.stdout:9/114: read - d4/d8/f2d zero size 2024-04-25T01:43:11.856 INFO:tasks.workunit.client.0.smithi162.stdout:8/149: dwrite d0/f11 [0,4194304] 0 2024-04-25T01:43:11.972 INFO:tasks.workunit.client.0.smithi162.stdout:5/161: chown d15/l1c 9 1 2024-04-25T01:43:12.006 INFO:tasks.workunit.client.0.smithi162.stdout:1/171: symlink d15/d1f/d23/d30/l3b 0 2024-04-25T01:43:12.020 INFO:tasks.workunit.client.0.smithi162.stdout:9/115: sync 2024-04-25T01:43:12.086 INFO:tasks.workunit.client.0.smithi162.stdout:3/155: dread d2/d9/fd [0,4194304] 0 2024-04-25T01:43:12.106 INFO:tasks.workunit.client.0.smithi162.stdout:0/191: dread - d0/df/f28 zero size 2024-04-25T01:43:12.257 INFO:tasks.workunit.client.0.smithi162.stdout:8/150: rmdir d0/d1a 39 2024-04-25T01:43:12.272 INFO:tasks.workunit.client.0.smithi162.stdout:7/155: symlink df/d2c/l30 0 2024-04-25T01:43:12.408 INFO:tasks.workunit.client.0.smithi162.stdout:8/151: dread d0/f18 [0,4194304] 0 2024-04-25T01:43:12.454 INFO:tasks.workunit.client.0.smithi162.stdout:3/156: unlink d2/l6 0 2024-04-25T01:43:12.460 INFO:tasks.workunit.client.0.smithi162.stdout:1/172: dread - d15/d1f/d32/f37 zero size 2024-04-25T01:43:12.480 INFO:tasks.workunit.client.0.smithi162.stdout:9/116: creat d4/d9/d15/d1b/f2e x:0 0 0 2024-04-25T01:43:12.539 INFO:tasks.workunit.client.0.smithi162.stdout:9/117: chown d4/d8/f2d 12 1 2024-04-25T01:43:12.793 INFO:tasks.workunit.client.0.smithi162.stdout:7/156: symlink df/d2c/l31 0 2024-04-25T01:43:12.982 INFO:tasks.workunit.client.0.smithi162.stdout:4/157: write dd/df/d2e/f35 [473560,26318] 0 2024-04-25T01:43:13.042 INFO:tasks.workunit.client.0.smithi162.stdout:8/152: chown d0/c2 3695 1 2024-04-25T01:43:13.477 INFO:tasks.workunit.client.0.smithi162.stdout:3/157: dread - d2/d9/f2d zero size 2024-04-25T01:43:13.587 INFO:tasks.workunit.client.0.smithi162.stdout:0/192: write d0/df/f28 [947534,54931] 0 2024-04-25T01:43:13.637 INFO:tasks.workunit.client.0.smithi162.stdout:1/173: rmdir d15/d1f/d32 39 2024-04-25T01:43:14.101 INFO:tasks.workunit.client.0.smithi162.stdout:2/154: getdents d0/d2d 0 2024-04-25T01:43:14.388 INFO:tasks.workunit.client.0.smithi162.stdout:6/138: link d1/d13/f17 d1/f25 0 2024-04-25T01:43:14.425 INFO:tasks.workunit.client.0.smithi162.stdout:6/139: chown d1/d13/l22 10219 1 2024-04-25T01:43:14.540 INFO:tasks.workunit.client.0.smithi162.stdout:5/162: creat d15/f2f x:0 0 0 2024-04-25T01:43:14.548 INFO:tasks.workunit.client.0.smithi162.stdout:4/158: creat dd/d1a/f37 x:0 0 0 2024-04-25T01:43:14.834 INFO:tasks.workunit.client.0.smithi162.stdout:9/118: rmdir d4/d8 39 2024-04-25T01:43:15.021 INFO:tasks.workunit.client.0.smithi162.stdout:0/193: rename d0/df/f1d to d0/df/f39 0 2024-04-25T01:43:15.176 INFO:tasks.workunit.client.0.smithi162.stdout:1/174: dread f3 [4194304,4194304] 0 2024-04-25T01:43:15.235 INFO:tasks.workunit.client.0.smithi162.stdout:2/155: mkdir d0/d3/d5/d36 0 2024-04-25T01:43:15.292 INFO:tasks.workunit.client.0.smithi162.stdout:7/157: fsync df/f29 0 2024-04-25T01:43:15.634 INFO:tasks.workunit.client.0.smithi162.stdout:8/153: mknod d0/d12/d2b/c30 0 2024-04-25T01:43:15.709 INFO:tasks.workunit.client.0.smithi162.stdout:5/163: fsync d15/f2f 0 2024-04-25T01:43:15.850 INFO:tasks.workunit.client.0.smithi162.stdout:5/164: dread d15/f17 [0,4194304] 0 2024-04-25T01:43:16.129 INFO:tasks.workunit.client.0.smithi162.stdout:2/156: unlink d0/d3/f2b 0 2024-04-25T01:43:16.135 INFO:tasks.workunit.client.0.smithi162.stdout:3/158: write d2/d9/f18 [1203293,85211] 0 2024-04-25T01:43:16.138 INFO:tasks.workunit.client.0.smithi162.stdout:1/175: creat d15/d1f/d23/d30/f3c x:0 0 0 2024-04-25T01:43:16.157 INFO:tasks.workunit.client.0.smithi162.stdout:0/194: read d0/df/f14 [2031676,58474] 0 2024-04-25T01:43:16.262 INFO:tasks.workunit.client.0.smithi162.stdout:1/176: stat d15/d1f/d23/f2f 0 2024-04-25T01:43:16.914 INFO:tasks.workunit.client.0.smithi162.stdout:5/165: fsync d15/d19/f1b 0 2024-04-25T01:43:16.918 INFO:tasks.workunit.client.0.smithi162.stdout:3/159: creat d2/d9/d17/f38 x:0 0 0 2024-04-25T01:43:16.934 INFO:tasks.workunit.client.0.smithi162.stdout:0/195: fsync d0/df/d20/f24 0 2024-04-25T01:43:17.094 INFO:tasks.workunit.client.0.smithi162.stdout:9/119: truncate d4/d8/d13/f27 319116 0 2024-04-25T01:43:17.119 INFO:tasks.workunit.client.0.smithi162.stdout:6/140: link c0 d1/d13/c26 0 2024-04-25T01:43:17.133 INFO:tasks.workunit.client.0.smithi162.stdout:4/159: link dd/l1f dd/d1a/d34/l38 0 2024-04-25T01:43:17.171 INFO:tasks.workunit.client.0.smithi162.stdout:1/177: chown d15/d1f/d32/f38 459569 1 2024-04-25T01:43:17.709 INFO:tasks.workunit.client.0.smithi162.stdout:7/158: link df/f22 df/f32 0 2024-04-25T01:43:17.795 INFO:tasks.workunit.client.0.smithi162.stdout:3/160: fsync d2/f26 0 2024-04-25T01:43:18.241 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:43:18.244 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:43:18.245 INFO:tasks.workunit.client.0.smithi162.stdout:8/154: rename d0/d29 to d0/d1a/de/d31 0 2024-04-25T01:43:18.498 INFO:tasks.workunit.client.0.smithi162.stdout:6/141: read d1/fe [1232090,80827] 0 2024-04-25T01:43:18.616 INFO:tasks.workunit.client.0.smithi162.stdout:9/120: mkdir d4/d9/d15/d1b/d2f 0 2024-04-25T01:43:19.040 INFO:tasks.workunit.client.0.smithi162.stdout:1/178: truncate f14 5006851 0 2024-04-25T01:43:19.472 INFO:tasks.workunit.client.0.smithi162.stdout:0/196: write d0/df/d20/f31 [457793,87056] 0 2024-04-25T01:43:19.770 INFO:tasks.workunit.client.0.smithi162.stdout:3/161: dread - d2/d9/d19/f36 zero size 2024-04-25T01:43:19.824 INFO:tasks.workunit.client.0.smithi162.stdout:3/162: dread - d2/d9/d19/f36 zero size 2024-04-25T01:43:19.906 INFO:tasks.workunit.client.0.smithi162.stdout:2/157: link d0/d2d/d27/f24 d0/d3/d5/d36/f37 0 2024-04-25T01:43:20.527 INFO:tasks.workunit.client.0.smithi162.stdout:4/160: creat dd/d1a/d34/f39 x:0 0 0 2024-04-25T01:43:20.870 INFO:tasks.workunit.client.0.smithi162.stdout:7/159: write f5 [4058051,87505] 0 2024-04-25T01:43:21.298 INFO:tasks.workunit.client.0.smithi162.stdout:2/158: creat d0/d3/d1b/d1d/f38 x:0 0 0 2024-04-25T01:43:21.796 INFO:tasks.workunit.client.0.smithi162.stdout:1/179: fsync d15/d1f/f33 0 2024-04-25T01:43:22.044 INFO:tasks.workunit.client.0.smithi162.stdout:5/166: link d15/d19/l26 d15/l30 0 2024-04-25T01:43:22.062 INFO:tasks.workunit.client.0.smithi162.stdout:9/121: write d4/d8/f1a [977294,97747] 0 2024-04-25T01:43:22.212 INFO:tasks.workunit.client.0.smithi162.stdout:8/155: dwrite d0/d12/f2e [0,4194304] 0 2024-04-25T01:43:22.409 INFO:tasks.workunit.client.0.smithi162.stdout:6/142: creat d1/f27 x:0 0 0 2024-04-25T01:43:22.438 INFO:tasks.workunit.client.0.smithi162.stdout:7/160: dread df/f1b [0,4194304] 0 2024-04-25T01:43:22.459 INFO:tasks.workunit.client.0.smithi162.stdout:4/161: rename f4 to dd/f3a 0 2024-04-25T01:43:22.492 INFO:tasks.workunit.client.0.smithi162.stdout:4/162: readlink dd/d1a/l2d 0 2024-04-25T01:43:22.803 INFO:tasks.workunit.client.0.smithi162.stdout:0/197: dwrite d0/df/d20/f24 [0,4194304] 0 2024-04-25T01:43:22.949 INFO:tasks.workunit.client.0.smithi162.stdout:1/180: fdatasync d15/d1f/f33 0 2024-04-25T01:43:23.046 INFO:tasks.workunit.client.0.smithi162.stdout:3/163: creat d2/d9/f39 x:0 0 0 2024-04-25T01:43:23.117 INFO:tasks.workunit.client.0.smithi162.stdout:8/156: readlink d0/d12/l22 0 2024-04-25T01:43:23.261 INFO:tasks.workunit.client.0.smithi162.stdout:9/122: dread d4/d8/d13/f16 [0,4194304] 0 2024-04-25T01:43:23.311 INFO:tasks.workunit.client.0.smithi162.stdout:3/164: dread d2/d9/fd [0,4194304] 0 2024-04-25T01:43:23.419 INFO:tasks.workunit.client.0.smithi162.stdout:7/161: rename df/f2f to df/f33 0 2024-04-25T01:43:23.537 INFO:tasks.workunit.client.0.smithi162.stdout:6/143: dread d1/f8 [0,4194304] 0 2024-04-25T01:43:23.777 INFO:tasks.workunit.client.0.smithi162.stdout:4/163: rmdir dd/df 39 2024-04-25T01:43:23.793 INFO:tasks.workunit.client.0.smithi162.stdout:2/159: write d0/d3/d5/d36/f37 [2908071,55219] 0 2024-04-25T01:43:23.860 INFO:tasks.workunit.client.0.smithi162.stdout:2/160: chown d0/d3/c2f 404296 1 2024-04-25T01:43:23.883 INFO:tasks.workunit.client.0.smithi162.stdout:2/161: readlink d0/d2d/d27/l23 0 2024-04-25T01:43:25.189 INFO:tasks.workunit.client.0.smithi162.stdout:6/144: mkdir d1/d13/d28 0 2024-04-25T01:43:25.530 INFO:tasks.workunit.client.0.smithi162.stdout:5/167: rmdir d15/d1e/d28 0 2024-04-25T01:43:25.695 INFO:tasks.workunit.client.0.smithi162.stdout:9/123: mkdir d4/d9/d15/d1b/d2f/d30 0 2024-04-25T01:43:25.824 INFO:tasks.workunit.client.0.smithi162.stdout:1/181: dwrite f4 [0,4194304] 0 2024-04-25T01:43:26.081 INFO:tasks.workunit.client.0.smithi162.stdout:0/198: rename d0/df/f28 to d0/df/d20/f3a 0 2024-04-25T01:43:26.157 INFO:tasks.workunit.client.0.smithi162.stdout:8/157: dwrite d0/f18 [0,4194304] 0 2024-04-25T01:43:26.294 INFO:tasks.workunit.client.0.smithi162.stdout:5/168: mkdir d15/d19/d31 0 2024-04-25T01:43:26.361 INFO:tasks.workunit.client.0.smithi162.stdout:2/162: symlink d0/l39 0 2024-04-25T01:43:26.373 INFO:tasks.workunit.client.0.smithi162.stdout:2/163: readlink d0/l11 0 2024-04-25T01:43:26.806 INFO:tasks.workunit.client.0.smithi162.stdout:7/162: write df/f33 [179395,103844] 0 2024-04-25T01:43:27.081 INFO:tasks.workunit.client.0.smithi162.stdout:6/145: creat d1/d13/d28/f29 x:0 0 0 2024-04-25T01:43:27.196 INFO:tasks.workunit.client.0.smithi162.stdout:8/158: fdatasync d0/d1a/de/f15 0 2024-04-25T01:43:27.200 INFO:tasks.workunit.client.0.smithi162.stdout:9/124: symlink d4/d8/l31 0 2024-04-25T01:43:27.240 INFO:tasks.workunit.client.0.smithi162.stdout:4/164: link dd/f2c dd/df/d2e/f3b 0 2024-04-25T01:43:27.429 INFO:tasks.workunit.client.0.smithi162.stdout:6/146: sync 2024-04-25T01:43:27.640 INFO:tasks.workunit.client.0.smithi162.stdout:3/165: rename d2/d9/d10/f14 to d2/d29/d2e/f3a 0 2024-04-25T01:43:28.041 INFO:tasks.workunit.client.0.smithi162.stdout:7/163: dwrite df/f21 [4194304,4194304] 0 2024-04-25T01:43:28.183 INFO:tasks.workunit.client.0.smithi162.stdout:4/165: symlink dd/d1a/d34/l3c 0 2024-04-25T01:43:28.248 INFO:tasks.workunit.client.0.smithi162.stdout:5/169: rmdir d15/d19/d31 0 2024-04-25T01:43:28.264 INFO:tasks.workunit.client.0.smithi162.stdout:0/199: write d0/df/f39 [503732,24064] 0 2024-04-25T01:43:28.270 INFO:tasks.workunit.client.0.smithi162.stdout:2/164: rename d0/d3/d5/d33 to d0/d3/d1b/d1d/d3a 0 2024-04-25T01:43:28.294 INFO:tasks.workunit.client.0.smithi162.stdout:9/125: dread d4/d8/d13/f17 [0,4194304] 0 2024-04-25T01:43:28.297 INFO:tasks.workunit.client.0.smithi162.stdout:3/166: rmdir d2/d29 39 2024-04-25T01:43:28.446 INFO:tasks.workunit.client.0.smithi162.stdout:3/167: chown d2/d9/f39 146 1 2024-04-25T01:43:28.466 INFO:tasks.workunit.client.0.smithi162.stdout:7/164: rmdir df/d2c 39 2024-04-25T01:43:28.517 INFO:tasks.workunit.client.0.smithi162.stdout:1/182: getdents d15/d1f 0 2024-04-25T01:43:28.608 INFO:tasks.workunit.client.0.smithi162.stdout:2/165: truncate d0/d3/d5/d36/f37 5228964 0 2024-04-25T01:43:28.662 INFO:tasks.workunit.client.0.smithi162.stdout:2/166: write d0/d2d/d27/f24 [5106997,30226] 0 2024-04-25T01:43:28.808 INFO:tasks.workunit.client.0.smithi162.stdout:8/159: creat d0/d1a/f32 x:0 0 0 2024-04-25T01:43:29.323 INFO:tasks.workunit.client.0.smithi162.stdout:9/126: dread d4/d8/f18 [0,4194304] 0 2024-04-25T01:43:29.470 INFO:tasks.workunit.client.0.smithi162.stdout:5/170: symlink d15/d19/d24/d2b/l32 0 2024-04-25T01:43:29.584 INFO:tasks.workunit.client.0.smithi162.stdout:4/166: rename dd/df/f27 to dd/df/d2e/f3d 0 2024-04-25T01:43:29.777 INFO:tasks.workunit.client.0.smithi162.stdout:3/168: rmdir d2/d9/d19 39 2024-04-25T01:43:29.799 INFO:tasks.workunit.client.0.smithi162.stdout:3/169: stat d2/d9/d17/f38 0 2024-04-25T01:43:29.940 INFO:tasks.workunit.client.0.smithi162.stdout:1/183: symlink d15/d1f/d35/l3d 0 2024-04-25T01:43:29.956 INFO:tasks.workunit.client.0.smithi162.stdout:1/184: chown d15/f39 777 1 2024-04-25T01:43:30.216 INFO:tasks.workunit.client.0.smithi162.stdout:2/167: dread d0/d3/f19 [0,4194304] 0 2024-04-25T01:43:30.556 INFO:tasks.workunit.client.0.smithi162.stdout:9/127: dread d4/d8/d13/f27 [0,4194304] 0 2024-04-25T01:43:30.584 INFO:tasks.workunit.client.0.smithi162.stdout:9/128: readlink d4/d8/d13/l2c 0 2024-04-25T01:43:30.695 INFO:tasks.workunit.client.0.smithi162.stdout:5/171: creat d15/d19/f33 x:0 0 0 2024-04-25T01:43:30.915 INFO:tasks.workunit.client.0.smithi162.stdout:6/147: getdents d1/d13/d28 0 2024-04-25T01:43:31.291 INFO:tasks.workunit.client.0.smithi162.stdout:7/165: symlink df/d2e/l34 0 2024-04-25T01:43:31.380 INFO:tasks.workunit.client.0.smithi162.stdout:1/185: creat d15/d1f/d32/f3e x:0 0 0 2024-04-25T01:43:31.420 INFO:tasks.workunit.client.0.smithi162.stdout:7/166: dread df/f29 [0,4194304] 0 2024-04-25T01:43:31.440 INFO:tasks.workunit.client.0.smithi162.stdout:1/186: stat d15/f1a 0 2024-04-25T01:43:31.588 INFO:tasks.workunit.client.0.smithi162.stdout:2/168: chown d0/d3/fd 12333 1 2024-04-25T01:43:31.754 INFO:tasks.workunit.client.0.smithi162.stdout:9/129: fsync d4/d8/d13/f17 0 2024-04-25T01:43:31.762 INFO:tasks.workunit.client.0.smithi162.stdout:5/172: creat d15/d19/f34 x:0 0 0 2024-04-25T01:43:31.837 INFO:tasks.workunit.client.0.smithi162.stdout:5/173: write d15/d19/f33 [205017,25195] 0 2024-04-25T01:43:31.845 INFO:tasks.workunit.client.0.smithi162.stdout:2/169: sync 2024-04-25T01:43:32.027 INFO:tasks.workunit.client.0.smithi162.stdout:0/200: link d0/d1/l15 d0/df/d20/d25/d29/l3b 0 2024-04-25T01:43:32.250 INFO:tasks.workunit.client.0.smithi162.stdout:8/160: dwrite d0/d1a/fd [0,4194304] 0 2024-04-25T01:43:32.492 INFO:tasks.workunit.client.0.smithi162.stdout:9/130: dread - d4/d8/f2d zero size 2024-04-25T01:43:32.573 INFO:tasks.workunit.client.0.smithi162.stdout:5/174: dread - d15/d1e/f27 zero size 2024-04-25T01:43:32.694 INFO:tasks.workunit.client.0.smithi162.stdout:2/170: creat d0/d3/d1b/d1d/d3a/f3b x:0 0 0 2024-04-25T01:43:33.423 INFO:tasks.workunit.client.0.smithi162.stdout:0/201: creat d0/d1/f3c x:0 0 0 2024-04-25T01:43:33.515 INFO:tasks.workunit.client.0.smithi162.stdout:8/161: rmdir d0/d12 39 2024-04-25T01:43:33.535 INFO:tasks.workunit.client.0.smithi162.stdout:0/202: stat d0/d1/c33 0 2024-04-25T01:43:33.544 INFO:tasks.workunit.client.0.smithi162.stdout:7/167: write f5 [7738187,122591] 0 2024-04-25T01:43:33.692 INFO:tasks.workunit.client.0.smithi162.stdout:1/187: write fe [4452391,91049] 0 2024-04-25T01:43:33.846 INFO:tasks.workunit.client.0.smithi162.stdout:9/131: read d4/d8/f1a [459091,13711] 0 2024-04-25T01:43:33.881 INFO:tasks.workunit.client.0.smithi162.stdout:5/175: creat d15/d19/f35 x:0 0 0 2024-04-25T01:43:33.973 INFO:tasks.workunit.client.0.smithi162.stdout:4/167: dwrite dd/df/f24 [0,4194304] 0 2024-04-25T01:43:34.155 INFO:tasks.workunit.client.0.smithi162.stdout:6/148: creat d1/f2a x:0 0 0 2024-04-25T01:43:34.266 INFO:tasks.workunit.client.0.smithi162.stdout:3/170: getdents d2/d9/d10 0 2024-04-25T01:43:34.299 INFO:tasks.workunit.client.0.smithi162.stdout:3/171: rename d2 to d2/d9/d10/d3b 22 2024-04-25T01:43:34.352 INFO:tasks.workunit.client.0.smithi162.stdout:7/168: symlink df/d2e/l35 0 2024-04-25T01:43:34.662 INFO:tasks.workunit.client.0.smithi162.stdout:8/162: mkdir d0/d1a/de/d31/d33 0 2024-04-25T01:43:34.867 INFO:tasks.workunit.client.0.smithi162.stdout:1/188: creat d15/f3f x:0 0 0 2024-04-25T01:43:35.283 INFO:tasks.workunit.client.0.smithi162.stdout:2/171: dwrite d0/d3/fd [0,4194304] 0 2024-04-25T01:43:35.444 INFO:tasks.workunit.client.0.smithi162.stdout:0/203: truncate d0/df/d20/f34 862834 0 2024-04-25T01:43:35.600 INFO:tasks.workunit.client.0.smithi162.stdout:5/176: mknod d15/d19/d24/c36 0 2024-04-25T01:43:35.908 INFO:tasks.workunit.client.0.smithi162.stdout:8/163: creat d0/d1a/de/d31/f34 x:0 0 0 2024-04-25T01:43:35.945 INFO:tasks.workunit.client.0.smithi162.stdout:8/164: chown d0/d1a/de/c21 65 1 2024-04-25T01:43:35.992 INFO:tasks.workunit.client.0.smithi162.stdout:8/165: write d0/d1a/fd [5199532,27190] 0 2024-04-25T01:43:36.140 INFO:tasks.workunit.client.0.smithi162.stdout:1/189: mknod d15/d1f/d35/c40 0 2024-04-25T01:43:36.584 INFO:tasks.workunit.client.0.smithi162.stdout:0/204: creat d0/d1/f3d x:0 0 0 2024-04-25T01:43:36.629 INFO:tasks.workunit.client.0.smithi162.stdout:2/172: truncate d0/d3/d1b/f21 16313 0 2024-04-25T01:43:36.742 INFO:tasks.workunit.client.0.smithi162.stdout:4/168: write f5 [1706330,128369] 0 2024-04-25T01:43:36.965 INFO:tasks.workunit.client.0.smithi162.stdout:3/172: creat d2/d29/f3c x:0 0 0 2024-04-25T01:43:37.061 INFO:tasks.workunit.client.0.smithi162.stdout:7/169: fdatasync df/f22 0 2024-04-25T01:43:37.505 INFO:tasks.workunit.client.0.smithi162.stdout:0/205: symlink d0/df/d20/l3e 0 2024-04-25T01:43:37.674 INFO:tasks.workunit.client.0.smithi162.stdout:2/173: truncate d0/d3/f35 641933 0 2024-04-25T01:43:37.768 INFO:tasks.workunit.client.0.smithi162.stdout:4/169: symlink dd/d1a/l3e 0 2024-04-25T01:43:37.970 INFO:tasks.workunit.client.0.smithi162.stdout:3/173: dread - d2/d9/d19/f36 zero size 2024-04-25T01:43:38.411 INFO:tasks.workunit.client.0.smithi162.stdout:6/149: write d1/d13/f1f [1094532,80221] 0 2024-04-25T01:43:38.421 INFO:tasks.workunit.client.0.smithi162.stdout:9/132: dwrite d4/d8/d13/f2a [0,4194304] 0 2024-04-25T01:43:38.817 INFO:tasks.workunit.client.0.smithi162.stdout:5/177: dwrite d15/d1e/f27 [0,4194304] 0 2024-04-25T01:43:38.989 INFO:tasks.workunit.client.0.smithi162.stdout:1/190: write d15/f39 [3651016,118700] 0 2024-04-25T01:43:39.002 INFO:tasks.workunit.client.0.smithi162.stdout:8/166: write d0/f2d [890172,41030] 0 2024-04-25T01:43:39.476 INFO:tasks.workunit.client.0.smithi162.stdout:7/170: creat df/d2c/f36 x:0 0 0 2024-04-25T01:43:39.762 INFO:tasks.workunit.client.0.smithi162.stdout:4/170: mknod dd/df/c3f 0 2024-04-25T01:43:39.907 INFO:tasks.workunit.client.0.smithi162.stdout:6/150: rename d1/d13/c19 to d1/d13/c2b 0 2024-04-25T01:43:39.918 INFO:tasks.workunit.client.0.smithi162.stdout:6/151: chown d1 11 1 2024-04-25T01:43:40.006 INFO:tasks.workunit.client.0.smithi162.stdout:9/133: symlink d4/d9/d15/d1b/d2f/l32 0 2024-04-25T01:43:40.203 INFO:tasks.workunit.client.0.smithi162.stdout:2/174: mknod d0/d3/d30/c3c 0 2024-04-25T01:43:40.433 INFO:tasks.workunit.client.0.smithi162.stdout:0/206: unlink d0/df/d20/f34 0 2024-04-25T01:43:41.821 INFO:tasks.workunit.client.0.smithi162.stdout:6/152: symlink d1/d13/l2c 0 2024-04-25T01:43:41.990 INFO:tasks.workunit.client.0.smithi162.stdout:2/175: symlink d0/d3/d1b/d1d/d20/l3d 0 2024-04-25T01:43:42.485 INFO:tasks.workunit.client.0.smithi162.stdout:1/191: rename c0 to d15/c41 0 2024-04-25T01:43:42.559 INFO:tasks.workunit.client.0.smithi162.stdout:3/174: rmdir d2/d29/d33 0 2024-04-25T01:43:42.582 INFO:tasks.workunit.client.0.smithi162.stdout:8/167: write d0/d1a/f28 [876516,112504] 0 2024-04-25T01:43:43.031 INFO:tasks.workunit.client.0.smithi162.stdout:9/134: mknod d4/d8/c33 0 2024-04-25T01:43:43.186 INFO:tasks.workunit.client.0.smithi162.stdout:4/171: mknod dd/c40 0 2024-04-25T01:43:43.206 INFO:tasks.workunit.client.0.smithi162.stdout:5/178: creat d15/f37 x:0 0 0 2024-04-25T01:43:43.272 INFO:tasks.workunit.client.0.smithi162.stdout:5/179: chown d15/d19/d24/f25 43 1 2024-04-25T01:43:43.283 INFO:tasks.workunit.client.0.smithi162.stdout:5/180: stat d15/l18 0 2024-04-25T01:43:43.623 INFO:tasks.workunit.client.0.smithi162.stdout:2/176: rename d0/l11 to d0/d3/d30/l3e 0 2024-04-25T01:43:43.737 INFO:tasks.workunit.client.0.smithi162.stdout:1/192: truncate d15/d1f/d32/f38 991465 0 2024-04-25T01:43:43.989 INFO:tasks.workunit.client.0.smithi162.stdout:3/175: fdatasync d2/d9/d19/f36 0 2024-04-25T01:43:44.020 INFO:tasks.workunit.client.0.smithi162.stdout:3/176: readlink d2/d9/l16 0 2024-04-25T01:43:44.086 INFO:tasks.workunit.client.0.smithi162.stdout:0/207: write d0/df/d20/f31 [105133,63358] 0 2024-04-25T01:43:44.300 INFO:tasks.workunit.client.0.smithi162.stdout:8/168: write d0/d1a/de/d31/f34 [134034,82833] 0 2024-04-25T01:43:44.519 INFO:tasks.workunit.client.0.smithi162.stdout:0/208: dwrite d0/df/d20/f31 [0,4194304] 0 2024-04-25T01:43:44.670 INFO:tasks.workunit.client.0.smithi162.stdout:0/209: chown d0/d1/c11 216 1 2024-04-25T01:43:44.774 INFO:tasks.workunit.client.0.smithi162.stdout:5/181: mknod d15/d19/d24/d2b/c38 0 2024-04-25T01:43:44.892 INFO:tasks.workunit.client.0.smithi162.stdout:5/182: chown d15/d19/d24 4 1 2024-04-25T01:43:44.987 INFO:tasks.workunit.client.0.smithi162.stdout:2/177: mknod d0/d3/d1b/d1d/c3f 0 2024-04-25T01:43:45.092 INFO:tasks.workunit.client.0.smithi162.stdout:4/172: dread dd/df/f14 [0,4194304] 0 2024-04-25T01:43:45.897 INFO:tasks.workunit.client.0.smithi162.stdout:7/171: creat df/f37 x:0 0 0 2024-04-25T01:43:46.446 INFO:tasks.workunit.client.0.smithi162.stdout:0/210: symlink d0/df/d20/d25/d29/l3f 0 2024-04-25T01:43:46.583 INFO:tasks.workunit.client.0.smithi162.stdout:0/211: stat d0/df/d20/d25/d29 0 2024-04-25T01:43:46.771 INFO:tasks.workunit.client.0.smithi162.stdout:9/135: dwrite d4/d8/d13/f17 [0,4194304] 0 2024-04-25T01:43:47.151 INFO:tasks.workunit.client.0.smithi162.stdout:4/173: dread f5 [0,4194304] 0 2024-04-25T01:43:47.169 INFO:tasks.workunit.client.0.smithi162.stdout:4/174: readlink dd/l17 0 2024-04-25T01:43:47.197 INFO:tasks.workunit.client.0.smithi162.stdout:8/169: symlink d0/d12/d2b/l35 0 2024-04-25T01:43:47.283 INFO:tasks.workunit.client.0.smithi162.stdout:7/172: unlink df/f29 0 2024-04-25T01:43:47.428 INFO:tasks.workunit.client.0.smithi162.stdout:6/153: link d1/d13/c26 d1/d13/d28/c2d 0 2024-04-25T01:43:47.544 INFO:tasks.workunit.client.0.smithi162.stdout:3/177: dwrite d2/d9/d17/f38 [0,4194304] 0 2024-04-25T01:43:47.779 INFO:tasks.workunit.client.0.smithi162.stdout:9/136: fdatasync f3 0 2024-04-25T01:43:47.830 INFO:tasks.workunit.client.0.smithi162.stdout:0/212: truncate d0/df/f39 83140 0 2024-04-25T01:43:47.928 INFO:tasks.workunit.client.0.smithi162.stdout:4/175: creat dd/d1a/d34/f41 x:0 0 0 2024-04-25T01:43:48.049 INFO:tasks.workunit.client.0.smithi162.stdout:8/170: chown d0/ca 14607 1 2024-04-25T01:43:48.151 INFO:tasks.workunit.client.0.smithi162.stdout:7/173: fsync df/f10 0 2024-04-25T01:43:48.188 INFO:tasks.workunit.client.0.smithi162.stdout:7/174: dread - df/f12 zero size 2024-04-25T01:43:48.334 INFO:tasks.workunit.client.0.smithi162.stdout:1/193: getdents d15/d1f/d35 0 2024-04-25T01:43:48.344 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:43:48.347 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:43:48.522 INFO:tasks.workunit.client.0.smithi162.stdout:3/178: creat d2/d9/d17/f3d x:0 0 0 2024-04-25T01:43:48.523 INFO:tasks.workunit.client.0.smithi162.stdout:6/154: creat d1/d13/d28/f2e x:0 0 0 2024-04-25T01:43:48.843 INFO:tasks.workunit.client.0.smithi162.stdout:0/213: creat d0/df/d20/f40 x:0 0 0 2024-04-25T01:43:48.866 INFO:tasks.workunit.client.0.smithi162.stdout:0/214: stat d0/df/f1b 0 2024-04-25T01:43:49.174 INFO:tasks.workunit.client.0.smithi162.stdout:5/183: write fd [497145,104978] 0 2024-04-25T01:43:49.563 INFO:tasks.workunit.client.0.smithi162.stdout:2/178: rename d0/d3/fd to d0/d3/d1b/d1d/d3a/f40 0 2024-04-25T01:43:49.900 INFO:tasks.workunit.client.0.smithi162.stdout:4/176: write fc [4952173,20812] 0 2024-04-25T01:43:50.332 INFO:tasks.workunit.client.0.smithi162.stdout:6/155: rmdir d1 39 2024-04-25T01:43:50.716 INFO:tasks.workunit.client.0.smithi162.stdout:8/171: creat d0/d1a/d25/f36 x:0 0 0 2024-04-25T01:43:50.829 INFO:tasks.workunit.client.0.smithi162.stdout:5/184: mknod d15/d19/d24/d2b/c39 0 2024-04-25T01:43:50.894 INFO:tasks.workunit.client.0.smithi162.stdout:7/175: mknod df/c38 0 2024-04-25T01:43:50.912 INFO:tasks.workunit.client.0.smithi162.stdout:7/176: chown df/l27 26 1 2024-04-25T01:43:51.386 INFO:tasks.workunit.client.0.smithi162.stdout:4/177: unlink dd/d1a/l2d 0 2024-04-25T01:43:51.610 INFO:tasks.workunit.client.0.smithi162.stdout:9/137: link d4/d8/f1a d4/d25/f34 0 2024-04-25T01:43:51.758 INFO:tasks.workunit.client.0.smithi162.stdout:4/178: sync 2024-04-25T01:43:51.817 INFO:tasks.workunit.client.0.smithi162.stdout:9/138: sync 2024-04-25T01:43:51.878 INFO:tasks.workunit.client.0.smithi162.stdout:8/172: mkdir d0/d12/d1b/d37 0 2024-04-25T01:43:51.886 INFO:tasks.workunit.client.0.smithi162.stdout:1/194: dwrite d15/d1f/f2d [0,4194304] 0 2024-04-25T01:43:51.895 INFO:tasks.workunit.client.0.smithi162.stdout:7/177: mknod df/d2c/c39 0 2024-04-25T01:43:51.927 INFO:tasks.workunit.client.0.smithi162.stdout:3/179: rename d2/d9/d19/c1e to d2/d9/d10/c3e 0 2024-04-25T01:43:52.065 INFO:tasks.workunit.client.0.smithi162.stdout:9/139: chown d4/d25 850 1 2024-04-25T01:43:52.183 INFO:tasks.workunit.client.0.smithi162.stdout:7/178: dread - df/f2d zero size 2024-04-25T01:43:52.417 INFO:tasks.workunit.client.0.smithi162.stdout:2/179: link d0/d3/d1b/d1d/f38 d0/d3/d30/f41 0 2024-04-25T01:43:52.642 INFO:tasks.workunit.client.0.smithi162.stdout:8/173: creat d0/d1a/de/f38 x:0 0 0 2024-04-25T01:43:52.708 INFO:tasks.workunit.client.0.smithi162.stdout:0/215: dwrite d0/d1/f3d [0,4194304] 0 2024-04-25T01:43:52.834 INFO:tasks.workunit.client.0.smithi162.stdout:3/180: mkdir d2/d9/d19/d3f 0 2024-04-25T01:43:52.842 INFO:tasks.workunit.client.0.smithi162.stdout:8/174: chown d0/d12/d1b 1638612663 1 2024-04-25T01:43:52.875 INFO:tasks.workunit.client.0.smithi162.stdout:9/140: creat d4/d9/d15/f35 x:0 0 0 2024-04-25T01:43:53.130 INFO:tasks.workunit.client.0.smithi162.stdout:3/181: dread d2/d9/fd [4194304,4194304] 0 2024-04-25T01:43:53.512 INFO:tasks.workunit.client.0.smithi162.stdout:5/185: rename d15/f37 to d15/f3a 0 2024-04-25T01:43:54.261 INFO:tasks.workunit.client.0.smithi162.stdout:8/175: dread d0/d1a/de/f15 [0,4194304] 0 2024-04-25T01:43:54.370 INFO:tasks.workunit.client.0.smithi162.stdout:9/141: truncate d4/d8/f2d 333658 0 2024-04-25T01:43:54.519 INFO:tasks.workunit.client.0.smithi162.stdout:6/156: link d1/d13/f20 d1/d13/d28/f2f 0 2024-04-25T01:43:54.681 INFO:tasks.workunit.client.0.smithi162.stdout:5/186: dread - d15/d19/f34 zero size 2024-04-25T01:43:54.994 INFO:tasks.workunit.client.0.smithi162.stdout:4/179: dwrite dd/f2c [0,4194304] 0 2024-04-25T01:43:55.403 INFO:tasks.workunit.client.0.smithi162.stdout:1/195: rename d15/d1f/d23/f2f to d15/d1f/d23/f42 0 2024-04-25T01:43:55.445 INFO:tasks.workunit.client.0.smithi162.stdout:2/180: dwrite d0/d3/f1a [0,4194304] 0 2024-04-25T01:43:55.613 INFO:tasks.workunit.client.0.smithi162.stdout:0/216: write d0/df/f14 [842300,14445] 0 2024-04-25T01:43:55.670 INFO:tasks.workunit.client.0.smithi162.stdout:9/142: rmdir d4/d9/d15/d1b 39 2024-04-25T01:43:56.401 INFO:tasks.workunit.client.0.smithi162.stdout:7/179: getdents df 0 2024-04-25T01:43:56.427 INFO:tasks.workunit.client.0.smithi162.stdout:1/196: read d15/f1d [961567,102891] 0 2024-04-25T01:43:56.834 INFO:tasks.workunit.client.0.smithi162.stdout:2/181: mkdir d0/d3/d1b/d1d/d20/d42 0 2024-04-25T01:43:57.174 INFO:tasks.workunit.client.0.smithi162.stdout:6/157: write d1/f2 [5208594,80280] 0 2024-04-25T01:43:57.359 INFO:tasks.workunit.client.0.smithi162.stdout:4/180: write dd/df/f14 [4242735,50700] 0 2024-04-25T01:43:57.524 INFO:tasks.workunit.client.0.smithi162.stdout:7/180: stat f1 0 2024-04-25T01:43:57.537 INFO:tasks.workunit.client.0.smithi162.stdout:1/197: stat d15/d1f/d32/f38 0 2024-04-25T01:43:57.594 INFO:tasks.workunit.client.0.smithi162.stdout:8/176: rmdir d0/d12/d1b/d37 0 2024-04-25T01:43:57.659 INFO:tasks.workunit.client.0.smithi162.stdout:5/187: dwrite d15/d19/d24/f2d [0,4194304] 0 2024-04-25T01:43:57.902 INFO:tasks.workunit.client.0.smithi162.stdout:3/182: unlink d2/d9/f18 0 2024-04-25T01:43:57.934 INFO:tasks.workunit.client.0.smithi162.stdout:0/217: fdatasync d0/df/d20/d37/f36 0 2024-04-25T01:43:58.262 INFO:tasks.workunit.client.0.smithi162.stdout:9/143: write d4/f21 [4207014,71562] 0 2024-04-25T01:43:58.478 INFO:tasks.workunit.client.0.smithi162.stdout:7/181: symlink df/d2e/l3a 0 2024-04-25T01:43:58.497 INFO:tasks.workunit.client.0.smithi162.stdout:7/182: dread - df/f2d zero size 2024-04-25T01:43:58.860 INFO:tasks.workunit.client.0.smithi162.stdout:5/188: mkdir d15/d19/d24/d2b/d3b 0 2024-04-25T01:43:59.154 INFO:tasks.workunit.client.0.smithi162.stdout:0/218: read d0/d1/f3d [697979,125501] 0 2024-04-25T01:43:59.453 INFO:tasks.workunit.client.0.smithi162.stdout:6/158: dwrite d1/f25 [0,4194304] 0 2024-04-25T01:43:59.895 INFO:tasks.workunit.client.0.smithi162.stdout:4/181: dwrite dd/df/f30 [0,4194304] 0 2024-04-25T01:44:00.024 INFO:tasks.workunit.client.0.smithi162.stdout:1/198: getdents d15/d1f/d35 0 2024-04-25T01:44:00.203 INFO:tasks.workunit.client.0.smithi162.stdout:7/183: creat df/d2c/f3b x:0 0 0 2024-04-25T01:44:00.334 INFO:tasks.workunit.client.0.smithi162.stdout:2/182: dwrite d0/d3/d30/f41 [0,4194304] 0 2024-04-25T01:44:00.334 INFO:tasks.workunit.client.0.smithi162.stdout:7/184: readlink df/d2e/l35 0 2024-04-25T01:44:00.441 INFO:tasks.workunit.client.0.smithi162.stdout:5/189: fsync d15/d1e/f22 0 2024-04-25T01:44:00.664 INFO:tasks.workunit.client.0.smithi162.stdout:3/183: readlink d2/d9/d10/d2c/l35 0 2024-04-25T01:44:01.029 INFO:tasks.workunit.client.0.smithi162.stdout:6/159: mkdir d1/d13/d28/d30 0 2024-04-25T01:44:01.092 INFO:tasks.workunit.client.0.smithi162.stdout:9/144: creat d4/d9/d15/d1b/d2f/f36 x:0 0 0 2024-04-25T01:44:01.124 INFO:tasks.workunit.client.0.smithi162.stdout:9/145: chown d4/d8/d13/l2c 20 1 2024-04-25T01:44:01.157 INFO:tasks.workunit.client.0.smithi162.stdout:9/146: dread - d4/d9/d15/d1b/d2f/f36 zero size 2024-04-25T01:44:01.283 INFO:tasks.workunit.client.0.smithi162.stdout:4/182: mknod dd/d1a/d34/c42 0 2024-04-25T01:44:01.418 INFO:tasks.workunit.client.0.smithi162.stdout:4/183: dread f5 [0,4194304] 0 2024-04-25T01:44:01.997 INFO:tasks.workunit.client.0.smithi162.stdout:8/177: link d0/d12/f2e d0/d1a/de/d31/f39 0 2024-04-25T01:44:02.146 INFO:tasks.workunit.client.0.smithi162.stdout:8/178: dread d0/d1a/de/f15 [0,4194304] 0 2024-04-25T01:44:02.185 INFO:tasks.workunit.client.0.smithi162.stdout:8/179: chown d0/d1a/de/d31/l2c 4864558 1 2024-04-25T01:44:02.248 INFO:tasks.workunit.client.0.smithi162.stdout:3/184: truncate d2/f26 2890359 0 2024-04-25T01:44:02.357 INFO:tasks.workunit.client.0.smithi162.stdout:8/180: sync 2024-04-25T01:44:02.465 INFO:tasks.workunit.client.0.smithi162.stdout:0/219: write d0/d1/f3d [4008633,18822] 0 2024-04-25T01:44:02.755 INFO:tasks.workunit.client.0.smithi162.stdout:4/184: dread - dd/d1a/d34/f41 zero size 2024-04-25T01:44:03.147 INFO:tasks.workunit.client.0.smithi162.stdout:2/183: write d0/d3/d1b/d1d/f38 [4877883,88851] 0 2024-04-25T01:44:03.334 INFO:tasks.workunit.client.0.smithi162.stdout:6/160: symlink d1/l31 0 2024-04-25T01:44:03.343 INFO:tasks.workunit.client.0.smithi162.stdout:1/199: write d15/d1f/f27 [187715,2950] 0 2024-04-25T01:44:03.423 INFO:tasks.workunit.client.0.smithi162.stdout:4/185: symlink dd/d1a/d34/l43 0 2024-04-25T01:44:03.719 INFO:tasks.workunit.client.0.smithi162.stdout:7/185: dwrite df/f2d [0,4194304] 0 2024-04-25T01:44:03.845 INFO:tasks.workunit.client.0.smithi162.stdout:3/185: mkdir d2/d9/d10/d40 0 2024-04-25T01:44:04.142 INFO:tasks.workunit.client.0.smithi162.stdout:6/161: stat d1/l1c 0 2024-04-25T01:44:04.279 INFO:tasks.workunit.client.0.smithi162.stdout:5/190: dwrite f11 [0,4194304] 0 2024-04-25T01:44:04.527 INFO:tasks.workunit.client.0.smithi162.stdout:8/181: write d0/d12/f24 [1968369,26497] 0 2024-04-25T01:44:04.616 INFO:tasks.workunit.client.0.smithi162.stdout:2/184: creat d0/d3/d1b/d1d/d20/d42/f43 x:0 0 0 2024-04-25T01:44:04.706 INFO:tasks.workunit.client.0.smithi162.stdout:9/147: dwrite f3 [0,4194304] 0 2024-04-25T01:44:04.729 INFO:tasks.workunit.client.0.smithi162.stdout:7/186: rename df/f10 to df/d2c/f3c 0 2024-04-25T01:44:05.122 INFO:tasks.workunit.client.0.smithi162.stdout:0/220: dwrite d0/df/f23 [0,4194304] 0 2024-04-25T01:44:05.128 INFO:tasks.workunit.client.0.smithi162.stdout:6/162: write d1/f2 [5549573,34479] 0 2024-04-25T01:44:05.257 INFO:tasks.workunit.client.0.smithi162.stdout:4/186: fdatasync dd/df/f10 0 2024-04-25T01:44:05.302 INFO:tasks.workunit.client.0.smithi162.stdout:8/182: rmdir d0/d12/d2b 39 2024-04-25T01:44:05.450 INFO:tasks.workunit.client.0.smithi162.stdout:6/163: dread d1/f2 [0,4194304] 0 2024-04-25T01:44:05.936 INFO:tasks.workunit.client.0.smithi162.stdout:9/148: truncate d4/d8/f10 3899945 0 2024-04-25T01:44:06.000 INFO:tasks.workunit.client.0.smithi162.stdout:5/191: mkdir d15/d19/d24/d2b/d3b/d3c 0 2024-04-25T01:44:06.019 INFO:tasks.workunit.client.0.smithi162.stdout:5/192: read f3 [3324332,127866] 0 2024-04-25T01:44:06.259 INFO:tasks.workunit.client.0.smithi162.stdout:0/221: read d0/d1/f1e [741301,8606] 0 2024-04-25T01:44:06.504 INFO:tasks.workunit.client.0.smithi162.stdout:1/200: write f14 [1129614,124984] 0 2024-04-25T01:44:06.573 INFO:tasks.workunit.client.0.smithi162.stdout:8/183: chown d0/d1a/de/c1e 878022 1 2024-04-25T01:44:06.931 INFO:tasks.workunit.client.0.smithi162.stdout:3/186: link d2/d29/l34 d2/d29/l41 0 2024-04-25T01:44:06.957 INFO:tasks.workunit.client.0.smithi162.stdout:3/187: stat d2/d9/d19/f36 0 2024-04-25T01:44:07.002 INFO:tasks.workunit.client.0.smithi162.stdout:3/188: chown d2/d9/l16 48712437 1 2024-04-25T01:44:07.287 INFO:tasks.workunit.client.0.smithi162.stdout:5/193: dread - d15/d19/f35 zero size 2024-04-25T01:44:07.760 INFO:tasks.workunit.client.0.smithi162.stdout:1/201: unlink d15/f39 0 2024-04-25T01:44:07.923 INFO:tasks.workunit.client.0.smithi162.stdout:1/202: sync 2024-04-25T01:44:07.954 INFO:tasks.workunit.client.0.smithi162.stdout:2/185: write d0/d3/f35 [1105771,116093] 0 2024-04-25T01:44:08.030 INFO:tasks.workunit.client.0.smithi162.stdout:6/164: mknod d1/c32 0 2024-04-25T01:44:08.093 INFO:tasks.workunit.client.0.smithi162.stdout:6/165: readlink d1/d13/l1a 0 2024-04-25T01:44:08.494 INFO:tasks.workunit.client.0.smithi162.stdout:3/189: dread d2/f26 [0,4194304] 0 2024-04-25T01:44:08.639 INFO:tasks.workunit.client.0.smithi162.stdout:4/187: rename dd/df/c3f to dd/c44 0 2024-04-25T01:44:09.193 INFO:tasks.workunit.client.0.smithi162.stdout:9/149: creat d4/d8/f37 x:0 0 0 2024-04-25T01:44:09.295 INFO:tasks.workunit.client.0.smithi162.stdout:8/184: dwrite d0/f18 [4194304,4194304] 0 2024-04-25T01:44:09.436 INFO:tasks.workunit.client.0.smithi162.stdout:3/190: mknod d2/d9/d19/c42 0 2024-04-25T01:44:09.575 INFO:tasks.workunit.client.0.smithi162.stdout:3/191: stat d2/d9/l21 0 2024-04-25T01:44:09.730 INFO:tasks.workunit.client.0.smithi162.stdout:3/192: dread - d2/d9/d19/f36 zero size 2024-04-25T01:44:09.779 INFO:tasks.workunit.client.0.smithi162.stdout:0/222: dwrite d0/df/f39 [0,4194304] 0 2024-04-25T01:44:09.924 INFO:tasks.workunit.client.0.smithi162.stdout:5/194: rename d15/d1e/f29 to d15/d19/d24/d2b/f3d 0 2024-04-25T01:44:09.947 INFO:tasks.workunit.client.0.smithi162.stdout:7/187: write df/f21 [1756813,44782] 0 2024-04-25T01:44:09.974 INFO:tasks.workunit.client.0.smithi162.stdout:4/188: readlink dd/d1a/d34/l38 0 2024-04-25T01:44:10.006 INFO:tasks.workunit.client.0.smithi162.stdout:1/203: getdents d15/d1f/d35 0 2024-04-25T01:44:10.237 INFO:tasks.workunit.client.0.smithi162.stdout:6/166: write d1/f1e [2088756,128319] 0 2024-04-25T01:44:10.605 INFO:tasks.workunit.client.0.smithi162.stdout:9/150: mkdir d4/d8/d13/d38 0 2024-04-25T01:44:11.354 INFO:tasks.workunit.client.0.smithi162.stdout:2/186: write d0/d3/d1b/f21 [91992,33515] 0 2024-04-25T01:44:11.720 INFO:tasks.workunit.client.0.smithi162.stdout:3/193: mknod d2/d9/d10/d2c/c43 0 2024-04-25T01:44:11.877 INFO:tasks.workunit.client.0.smithi162.stdout:6/167: chown d1/d13/d28/f2f 4669510 1 2024-04-25T01:44:12.246 INFO:tasks.workunit.client.0.smithi162.stdout:3/194: readlink d2/d29/l41 0 2024-04-25T01:44:12.751 INFO:tasks.workunit.client.0.smithi162.stdout:3/195: rmdir d2/d9/d17 39 2024-04-25T01:44:12.769 INFO:tasks.workunit.client.0.smithi162.stdout:3/196: stat d2/d9/f39 0 2024-04-25T01:44:12.973 INFO:tasks.workunit.client.0.smithi162.stdout:7/188: write f6 [1841833,12556] 0 2024-04-25T01:44:13.115 INFO:tasks.workunit.client.0.smithi162.stdout:8/185: write d0/d1a/de/d31/f39 [2041484,22241] 0 2024-04-25T01:44:13.228 INFO:tasks.workunit.client.0.smithi162.stdout:6/168: write d1/d13/f15 [634282,10712] 0 2024-04-25T01:44:13.432 INFO:tasks.workunit.client.0.smithi162.stdout:3/197: mknod d2/d9/d19/d3f/c44 0 2024-04-25T01:44:14.001 INFO:tasks.workunit.client.0.smithi162.stdout:8/186: mkdir d0/d12/d3a 0 2024-04-25T01:44:14.866 INFO:tasks.workunit.client.0.smithi162.stdout:6/169: creat d1/d13/d28/d30/f33 x:0 0 0 2024-04-25T01:44:15.021 INFO:tasks.workunit.client.0.smithi162.stdout:0/223: dwrite d0/df/f1b [0,4194304] 0 2024-04-25T01:44:15.238 INFO:tasks.workunit.client.0.smithi162.stdout:2/187: dwrite d0/d3/d1b/d1d/d3a/f3b [0,4194304] 0 2024-04-25T01:44:15.244 INFO:tasks.workunit.client.0.smithi162.stdout:5/195: dwrite d15/d1e/f22 [0,4194304] 0 2024-04-25T01:44:15.275 INFO:tasks.workunit.client.0.smithi162.stdout:9/151: dwrite d4/d9/d15/d1b/f28 [0,4194304] 0 2024-04-25T01:44:15.361 INFO:tasks.workunit.client.0.smithi162.stdout:4/189: dwrite dd/d1a/d34/f39 [0,4194304] 0 2024-04-25T01:44:15.397 INFO:tasks.workunit.client.0.smithi162.stdout:1/204: dwrite d15/f1c [0,4194304] 0 2024-04-25T01:44:15.639 INFO:tasks.workunit.client.0.smithi162.stdout:8/187: mknod d0/d1a/c3b 0 2024-04-25T01:44:15.776 INFO:tasks.workunit.client.0.smithi162.stdout:6/170: fsync d1/d13/f20 0 2024-04-25T01:44:15.861 INFO:tasks.workunit.client.0.smithi162.stdout:3/198: getdents d2/d9/d10 0 2024-04-25T01:44:16.022 INFO:tasks.workunit.client.0.smithi162.stdout:0/224: chown d0/df/d20/f3a 1501 1 2024-04-25T01:44:16.079 INFO:tasks.workunit.client.0.smithi162.stdout:7/189: dwrite df/f1c [0,4194304] 0 2024-04-25T01:44:16.081 INFO:tasks.workunit.client.0.smithi162.stdout:4/190: symlink dd/d1a/l45 0 2024-04-25T01:44:16.101 INFO:tasks.workunit.client.0.smithi162.stdout:5/196: mknod d15/c3e 0 2024-04-25T01:44:16.320 INFO:tasks.workunit.client.0.smithi162.stdout:1/205: fdatasync d15/d1f/d32/f38 0 2024-04-25T01:44:16.484 INFO:tasks.workunit.client.0.smithi162.stdout:6/171: fdatasync d1/d13/d28/f29 0 2024-04-25T01:44:16.495 INFO:tasks.workunit.client.0.smithi162.stdout:9/152: dread - d4/d9/d15/d1b/f29 zero size 2024-04-25T01:44:16.508 INFO:tasks.workunit.client.0.smithi162.stdout:5/197: chown f3 697585 1 2024-04-25T01:44:16.701 INFO:tasks.workunit.client.0.smithi162.stdout:8/188: creat d0/d12/f3c x:0 0 0 2024-04-25T01:44:16.728 INFO:tasks.workunit.client.0.smithi162.stdout:0/225: write d0/d1/f7 [230878,13505] 0 2024-04-25T01:44:16.801 INFO:tasks.workunit.client.0.smithi162.stdout:2/188: dwrite d0/d3/f16 [0,4194304] 0 2024-04-25T01:44:17.088 INFO:tasks.workunit.client.0.smithi162.stdout:1/206: symlink d15/d1f/d32/l43 0 2024-04-25T01:44:17.347 INFO:tasks.workunit.client.0.smithi162.stdout:0/226: dwrite d0/df/f1b [0,4194304] 0 2024-04-25T01:44:17.453 INFO:tasks.workunit.client.0.smithi162.stdout:6/172: truncate d1/f2a 899579 0 2024-04-25T01:44:17.474 INFO:tasks.workunit.client.0.smithi162.stdout:2/189: symlink d0/d3/d1b/d1d/d20/l44 0 2024-04-25T01:44:17.492 INFO:tasks.workunit.client.0.smithi162.stdout:5/198: write d15/d1e/f2a [248582,26676] 0 2024-04-25T01:44:17.559 INFO:tasks.workunit.client.0.smithi162.stdout:6/173: chown d1/f8 14 1 2024-04-25T01:44:17.621 INFO:tasks.workunit.client.0.smithi162.stdout:3/199: getdents d2/d9/d10 0 2024-04-25T01:44:17.772 INFO:tasks.workunit.client.0.smithi162.stdout:1/207: write d15/f21 [747688,80506] 0 2024-04-25T01:44:18.069 INFO:tasks.workunit.client.0.smithi162.stdout:0/227: creat d0/df/f41 x:0 0 0 2024-04-25T01:44:18.072 INFO:tasks.workunit.client.0.smithi162.stdout:2/190: mknod d0/d2d/c45 0 2024-04-25T01:44:18.122 INFO:tasks.workunit.client.0.smithi162.stdout:6/174: creat d1/d13/f34 x:0 0 0 2024-04-25T01:44:18.202 INFO:tasks.workunit.client.0.smithi162.stdout:9/153: rename d4/f14 to d4/f39 0 2024-04-25T01:44:18.228 INFO:tasks.workunit.client.0.smithi162.stdout:4/191: getdents dd/d1a/d34 0 2024-04-25T01:44:18.362 INFO:tasks.workunit.client.0.smithi162.stdout:8/189: creat d0/d1a/f3d x:0 0 0 2024-04-25T01:44:18.380 INFO:tasks.workunit.client.0.smithi162.stdout:3/200: dread - d2/d29/f2a zero size 2024-04-25T01:44:18.388 INFO:tasks.workunit.client.0.smithi162.stdout:9/154: sync 2024-04-25T01:44:18.463 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:44:18.466 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:44:18.484 INFO:tasks.workunit.client.0.smithi162.stdout:1/208: write f4 [3585493,97915] 0 2024-04-25T01:44:18.552 INFO:tasks.workunit.client.0.smithi162.stdout:0/228: dread d0/df/f1b [0,4194304] 0 2024-04-25T01:44:18.642 INFO:tasks.workunit.client.0.smithi162.stdout:5/199: mkdir d15/d19/d24/d2b/d3b/d3c/d3f 0 2024-04-25T01:44:18.662 INFO:tasks.workunit.client.0.smithi162.stdout:7/190: getdents df/d2e 0 2024-04-25T01:44:18.698 INFO:tasks.workunit.client.0.smithi162.stdout:2/191: mknod d0/d3/d1b/d1d/c46 0 2024-04-25T01:44:18.836 INFO:tasks.workunit.client.0.smithi162.stdout:6/175: dwrite d1/d13/f34 [0,4194304] 0 2024-04-25T01:44:18.891 INFO:tasks.workunit.client.0.smithi162.stdout:7/191: sync 2024-04-25T01:44:18.993 INFO:tasks.workunit.client.0.smithi162.stdout:3/201: fdatasync d2/d9/d10/f11 0 2024-04-25T01:44:19.022 INFO:tasks.workunit.client.0.smithi162.stdout:8/190: creat d0/d1a/de/d31/f3e x:0 0 0 2024-04-25T01:44:19.078 INFO:tasks.workunit.client.0.smithi162.stdout:0/229: unlink d0/df/f23 0 2024-04-25T01:44:19.112 INFO:tasks.workunit.client.0.smithi162.stdout:3/202: sync 2024-04-25T01:44:19.206 INFO:tasks.workunit.client.0.smithi162.stdout:4/192: symlink dd/l46 0 2024-04-25T01:44:19.530 INFO:tasks.workunit.client.0.smithi162.stdout:9/155: fsync d4/d8/f10 0 2024-04-25T01:44:19.784 INFO:tasks.workunit.client.0.smithi162.stdout:7/192: symlink df/d2e/l3d 0 2024-04-25T01:44:19.803 INFO:tasks.workunit.client.0.smithi162.stdout:7/193: readlink df/d2e/l34 0 2024-04-25T01:44:19.852 INFO:tasks.workunit.client.0.smithi162.stdout:1/209: write fe [1647644,29793] 0 2024-04-25T01:44:20.419 INFO:tasks.workunit.client.0.smithi162.stdout:5/200: write d15/f2f [688443,114451] 0 2024-04-25T01:44:20.465 INFO:tasks.workunit.client.0.smithi162.stdout:5/201: read f11 [2885848,64366] 0 2024-04-25T01:44:20.721 INFO:tasks.workunit.client.0.smithi162.stdout:8/191: truncate d0/d1a/de/f15 1476467 0 2024-04-25T01:44:20.759 INFO:tasks.workunit.client.0.smithi162.stdout:2/192: dwrite d0/d3/f19 [4194304,4194304] 0 2024-04-25T01:44:20.767 INFO:tasks.workunit.client.0.smithi162.stdout:4/193: rmdir dd/df 39 2024-04-25T01:44:20.943 INFO:tasks.workunit.client.0.smithi162.stdout:4/194: chown dd/d1a/d34/c42 4469 1 2024-04-25T01:44:21.192 INFO:tasks.workunit.client.0.smithi162.stdout:9/156: creat d4/d9/d15/d1b/d2f/f3a x:0 0 0 2024-04-25T01:44:21.241 INFO:tasks.workunit.client.0.smithi162.stdout:9/157: readlink d4/d9/d15/d1b/l1e 0 2024-04-25T01:44:21.417 INFO:tasks.workunit.client.0.smithi162.stdout:1/210: unlink d15/d1f/d32/f38 0 2024-04-25T01:44:21.562 INFO:tasks.workunit.client.0.smithi162.stdout:1/211: readlink d15/d1f/d32/l43 0 2024-04-25T01:44:21.647 INFO:tasks.workunit.client.0.smithi162.stdout:0/230: write d0/df/d20/f24 [149352,46683] 0 2024-04-25T01:44:21.795 INFO:tasks.workunit.client.0.smithi162.stdout:6/176: dwrite d1/d13/d28/f2f [0,4194304] 0 2024-04-25T01:44:21.898 INFO:tasks.workunit.client.0.smithi162.stdout:5/202: fsync d15/d19/f33 0 2024-04-25T01:44:22.291 INFO:tasks.workunit.client.0.smithi162.stdout:2/193: unlink d0/d3/d1b/d1d/d20/l3d 0 2024-04-25T01:44:22.308 INFO:tasks.workunit.client.0.smithi162.stdout:4/195: creat dd/d1a/f47 x:0 0 0 2024-04-25T01:44:22.482 INFO:tasks.workunit.client.0.smithi162.stdout:7/194: dread - df/d2c/f36 zero size 2024-04-25T01:44:22.700 INFO:tasks.workunit.client.0.smithi162.stdout:4/196: dwrite dd/d1a/f47 [0,4194304] 0 2024-04-25T01:44:23.319 INFO:tasks.workunit.client.0.smithi162.stdout:0/231: dread - d0/d1/f3c zero size 2024-04-25T01:44:23.619 INFO:tasks.workunit.client.0.smithi162.stdout:8/192: symlink d0/d12/l3f 0 2024-04-25T01:44:23.846 INFO:tasks.workunit.client.0.smithi162.stdout:5/203: mkdir d15/d19/d24/d40 0 2024-04-25T01:44:23.859 INFO:tasks.workunit.client.0.smithi162.stdout:5/204: chown l4 586540 1 2024-04-25T01:44:23.896 INFO:tasks.workunit.client.0.smithi162.stdout:5/205: write d15/f2f [734526,88672] 0 2024-04-25T01:44:23.947 INFO:tasks.workunit.client.0.smithi162.stdout:6/177: rename d1/f2 to d1/d13/f35 0 2024-04-25T01:44:24.341 INFO:tasks.workunit.client.0.smithi162.stdout:7/195: dread f4 [0,4194304] 0 2024-04-25T01:44:24.373 INFO:tasks.workunit.client.0.smithi162.stdout:9/158: getdents d4/d9/d15/d1b/d2f/d30 0 2024-04-25T01:44:24.591 INFO:tasks.workunit.client.0.smithi162.stdout:4/197: creat dd/d1a/f48 x:0 0 0 2024-04-25T01:44:24.621 INFO:tasks.workunit.client.0.smithi162.stdout:4/198: fdatasync dd/d1a/f47 0 2024-04-25T01:44:24.933 INFO:tasks.workunit.client.0.smithi162.stdout:3/203: getdents d2/d29/d2e 0 2024-04-25T01:44:25.100 INFO:tasks.workunit.client.0.smithi162.stdout:0/232: symlink d0/df/d20/d25/l42 0 2024-04-25T01:44:25.119 INFO:tasks.workunit.client.0.smithi162.stdout:0/233: stat d0/d1/c33 0 2024-04-25T01:44:25.676 INFO:tasks.workunit.client.0.smithi162.stdout:1/212: link d15/d1f/f33 d15/d1f/d35/f44 0 2024-04-25T01:44:26.198 INFO:tasks.workunit.client.0.smithi162.stdout:6/178: dwrite d1/f24 [0,4194304] 0 2024-04-25T01:44:26.494 INFO:tasks.workunit.client.0.smithi162.stdout:9/159: dread d4/d25/f34 [0,4194304] 0 2024-04-25T01:44:26.964 INFO:tasks.workunit.client.0.smithi162.stdout:9/160: sync 2024-04-25T01:44:27.044 INFO:tasks.workunit.client.0.smithi162.stdout:0/234: chown d0/df/l21 721 1 2024-04-25T01:44:27.522 INFO:tasks.workunit.client.0.smithi162.stdout:2/194: creat d0/d3/f47 x:0 0 0 2024-04-25T01:44:28.052 INFO:tasks.workunit.client.0.smithi162.stdout:5/206: dwrite d15/d19/d24/f25 [0,4194304] 0 2024-04-25T01:44:28.242 INFO:tasks.workunit.client.0.smithi162.stdout:4/199: rmdir dd/df 39 2024-04-25T01:44:28.382 INFO:tasks.workunit.client.0.smithi162.stdout:9/161: read - d4/d9/d15/d1b/d2f/f3a zero size 2024-04-25T01:44:28.623 INFO:tasks.workunit.client.0.smithi162.stdout:3/204: write d2/d9/f2d [270016,51443] 0 2024-04-25T01:44:28.764 INFO:tasks.workunit.client.0.smithi162.stdout:2/195: rmdir d0/d3/d1b/d1d 39 2024-04-25T01:44:28.931 INFO:tasks.workunit.client.0.smithi162.stdout:1/213: write d15/d1f/d32/f3e [76202,109874] 0 2024-04-25T01:44:29.518 INFO:tasks.workunit.client.0.smithi162.stdout:6/179: rename d1/f8 to d1/f36 0 2024-04-25T01:44:29.528 INFO:tasks.workunit.client.0.smithi162.stdout:7/196: write df/f12 [550572,61469] 0 2024-04-25T01:44:29.607 INFO:tasks.workunit.client.0.smithi162.stdout:7/197: readlink df/d2c/l30 0 2024-04-25T01:44:29.640 INFO:tasks.workunit.client.0.smithi162.stdout:1/214: rename l8 to d15/d1f/l45 0 2024-04-25T01:44:29.789 INFO:tasks.workunit.client.0.smithi162.stdout:8/193: symlink d0/d1a/l40 0 2024-04-25T01:44:30.166 INFO:tasks.workunit.client.0.smithi162.stdout:0/235: write d0/df/f41 [33368,125327] 0 2024-04-25T01:44:30.300 INFO:tasks.workunit.client.0.smithi162.stdout:5/207: write d15/d19/d24/d2b/f2c [1047199,29907] 0 2024-04-25T01:44:30.396 INFO:tasks.workunit.client.0.smithi162.stdout:9/162: write d4/d8/d13/f2a [2406924,40088] 0 2024-04-25T01:44:30.474 INFO:tasks.workunit.client.0.smithi162.stdout:6/180: mkdir d1/d13/d28/d37 0 2024-04-25T01:44:30.558 INFO:tasks.workunit.client.0.smithi162.stdout:2/196: write d0/f9 [1857727,47216] 0 2024-04-25T01:44:31.041 INFO:tasks.workunit.client.0.smithi162.stdout:8/194: symlink d0/d12/d1b/l41 0 2024-04-25T01:44:31.073 INFO:tasks.workunit.client.0.smithi162.stdout:8/195: stat d0/d1a/de/d31 0 2024-04-25T01:44:31.284 INFO:tasks.workunit.client.0.smithi162.stdout:5/208: fdatasync d15/d19/f33 0 2024-04-25T01:44:31.563 INFO:tasks.workunit.client.0.smithi162.stdout:6/181: symlink d1/d13/d28/l38 0 2024-04-25T01:44:31.756 INFO:tasks.workunit.client.0.smithi162.stdout:3/205: write d2/d9/d10/d2c/f32 [1219032,22604] 0 2024-04-25T01:44:31.899 INFO:tasks.workunit.client.0.smithi162.stdout:3/206: sync 2024-04-25T01:44:31.938 INFO:tasks.workunit.client.0.smithi162.stdout:3/207: read d2/d29/d2e/f3a [6342296,16487] 0 2024-04-25T01:44:32.054 INFO:tasks.workunit.client.0.smithi162.stdout:1/215: rename d15/d1f/d23/l29 to d15/d1f/d35/l46 0 2024-04-25T01:44:32.266 INFO:tasks.workunit.client.0.smithi162.stdout:4/200: write dd/df/d2e/f2f [1848717,21638] 0 2024-04-25T01:44:32.664 INFO:tasks.workunit.client.0.smithi162.stdout:9/163: mkdir d4/d8/d13/d38/d3b 0 2024-04-25T01:44:32.931 INFO:tasks.workunit.client.0.smithi162.stdout:7/198: link f6 df/d2c/f3e 0 2024-04-25T01:44:33.030 INFO:tasks.workunit.client.0.smithi162.stdout:7/199: sync 2024-04-25T01:44:33.232 INFO:tasks.workunit.client.0.smithi162.stdout:3/208: truncate d2/d29/d2e/f3a 3900392 0 2024-04-25T01:44:33.254 INFO:tasks.workunit.client.0.smithi162.stdout:3/209: chown d2/d9/d10/d2c 3947 1 2024-04-25T01:44:33.473 INFO:tasks.workunit.client.0.smithi162.stdout:8/196: creat d0/d12/d3a/f42 x:0 0 0 2024-04-25T01:44:33.680 INFO:tasks.workunit.client.0.smithi162.stdout:0/236: link d0/df/d20/d37/f36 d0/df/f43 0 2024-04-25T01:44:33.833 INFO:tasks.workunit.client.0.smithi162.stdout:5/209: creat d15/d19/d24/d40/f41 x:0 0 0 2024-04-25T01:44:34.257 INFO:tasks.workunit.client.0.smithi162.stdout:7/200: chown df/f23 6 1 2024-04-25T01:44:34.398 INFO:tasks.workunit.client.0.smithi162.stdout:3/210: mknod d2/d9/d10/c45 0 2024-04-25T01:44:34.495 INFO:tasks.workunit.client.0.smithi162.stdout:3/211: dread d2/f26 [0,4194304] 0 2024-04-25T01:44:34.533 INFO:tasks.workunit.client.0.smithi162.stdout:3/212: dread d2/d9/f30 [0,4194304] 0 2024-04-25T01:44:34.554 INFO:tasks.workunit.client.0.smithi162.stdout:3/213: chown d2/f25 16190 1 2024-04-25T01:44:34.597 INFO:tasks.workunit.client.0.smithi162.stdout:0/237: rename d0/df/d20/l2c to d0/df/d20/d37/l44 0 2024-04-25T01:44:34.609 INFO:tasks.workunit.client.0.smithi162.stdout:8/197: dread - d0/d12/f3c zero size 2024-04-25T01:44:34.610 INFO:tasks.workunit.client.0.smithi162.stdout:5/210: rmdir d15/d19/d24 39 2024-04-25T01:44:34.722 INFO:tasks.workunit.client.0.smithi162.stdout:9/164: mknod d4/d9/d15/d1b/d2f/d30/c3c 0 2024-04-25T01:44:34.747 INFO:tasks.workunit.client.0.smithi162.stdout:0/238: sync 2024-04-25T01:44:34.773 INFO:tasks.workunit.client.0.smithi162.stdout:0/239: chown d0/df/d20/f3a 11485712 1 2024-04-25T01:44:34.816 INFO:tasks.workunit.client.0.smithi162.stdout:0/240: dread d0/df/f41 [0,4194304] 0 2024-04-25T01:44:34.835 INFO:tasks.workunit.client.0.smithi162.stdout:7/201: creat df/d2c/f3f x:0 0 0 2024-04-25T01:44:34.898 INFO:tasks.workunit.client.0.smithi162.stdout:0/241: chown d0/df/d20/d25/l42 348170 1 2024-04-25T01:44:34.925 INFO:tasks.workunit.client.0.smithi162.stdout:3/214: dread - d2/d9/f39 zero size 2024-04-25T01:44:34.939 INFO:tasks.workunit.client.0.smithi162.stdout:0/242: fdatasync d0/df/f41 0 2024-04-25T01:44:35.039 INFO:tasks.workunit.client.0.smithi162.stdout:5/211: truncate f11 2766372 0 2024-04-25T01:44:35.120 INFO:tasks.workunit.client.0.smithi162.stdout:2/197: write d0/d3/d1b/d1d/d3a/f3b [1525188,76372] 0 2024-04-25T01:44:35.297 INFO:tasks.workunit.client.0.smithi162.stdout:3/215: dwrite d2/d9/d10/d2c/f32 [0,4194304] 0 2024-04-25T01:44:35.429 INFO:tasks.workunit.client.0.smithi162.stdout:8/198: creat d0/d12/d1b/f43 x:0 0 0 2024-04-25T01:44:35.462 INFO:tasks.workunit.client.0.smithi162.stdout:1/216: write fe [4831973,112480] 0 2024-04-25T01:44:35.586 INFO:tasks.workunit.client.0.smithi162.stdout:9/165: dread d4/f26 [0,4194304] 0 2024-04-25T01:44:35.858 INFO:tasks.workunit.client.0.smithi162.stdout:7/202: creat df/d2e/f40 x:0 0 0 2024-04-25T01:44:35.885 INFO:tasks.workunit.client.0.smithi162.stdout:0/243: fdatasync d0/fd 0 2024-04-25T01:44:36.026 INFO:tasks.workunit.client.0.smithi162.stdout:6/182: write d1/f2a [1574885,2921] 0 2024-04-25T01:44:36.236 INFO:tasks.workunit.client.0.smithi162.stdout:4/201: dwrite dd/d1a/d34/f39 [4194304,4194304] 0 2024-04-25T01:44:36.396 INFO:tasks.workunit.client.0.smithi162.stdout:8/199: rmdir d0/d1a/de/d31 39 2024-04-25T01:44:36.539 INFO:tasks.workunit.client.0.smithi162.stdout:9/166: rename d4/d9/d15/f1d to d4/d9/d15/d1b/d2f/d30/f3d 0 2024-04-25T01:44:36.576 INFO:tasks.workunit.client.0.smithi162.stdout:4/202: dread dd/d1a/d34/f39 [4194304,4194304] 0 2024-04-25T01:44:37.137 INFO:tasks.workunit.client.0.smithi162.stdout:7/203: chown fd 24 1 2024-04-25T01:44:37.167 INFO:tasks.workunit.client.0.smithi162.stdout:7/204: truncate df/f23 904248 0 2024-04-25T01:44:37.816 INFO:tasks.workunit.client.0.smithi162.stdout:1/217: fdatasync d15/d1f/d23/f25 0 2024-04-25T01:44:37.898 INFO:tasks.workunit.client.0.smithi162.stdout:3/216: dread d2/d9/d17/f38 [0,4194304] 0 2024-04-25T01:44:37.982 INFO:tasks.workunit.client.0.smithi162.stdout:8/200: fsync d0/d12/f24 0 2024-04-25T01:44:38.110 INFO:tasks.workunit.client.0.smithi162.stdout:4/203: creat dd/df/f49 x:0 0 0 2024-04-25T01:44:38.197 INFO:tasks.workunit.client.0.smithi162.stdout:8/201: sync 2024-04-25T01:44:38.476 INFO:tasks.workunit.client.0.smithi162.stdout:9/167: symlink d4/d9/d15/d1b/d2f/d30/l3e 0 2024-04-25T01:44:38.519 INFO:tasks.workunit.client.0.smithi162.stdout:0/244: unlink d0/d1/l15 0 2024-04-25T01:44:38.814 INFO:tasks.workunit.client.0.smithi162.stdout:2/198: write d0/d3/f16 [3098198,93544] 0 2024-04-25T01:44:39.076 INFO:tasks.workunit.client.0.smithi162.stdout:2/199: dwrite d0/d3/f16 [0,4194304] 0 2024-04-25T01:44:39.252 INFO:tasks.workunit.client.0.smithi162.stdout:1/218: dread d15/f1b [0,4194304] 0 2024-04-25T01:44:39.277 INFO:tasks.workunit.client.0.smithi162.stdout:2/200: truncate d0/d3/f16 4879423 0 2024-04-25T01:44:39.613 INFO:tasks.workunit.client.0.smithi162.stdout:8/202: read d0/f2d [339561,72823] 0 2024-04-25T01:44:39.648 INFO:tasks.workunit.client.0.smithi162.stdout:2/201: sync 2024-04-25T01:44:39.750 INFO:tasks.workunit.client.0.smithi162.stdout:4/204: dread dd/d1a/d34/f39 [4194304,4194304] 0 2024-04-25T01:44:39.787 INFO:tasks.workunit.client.0.smithi162.stdout:7/205: mknod df/c41 0 2024-04-25T01:44:39.796 INFO:tasks.workunit.client.0.smithi162.stdout:9/168: dread - d4/d8/f37 zero size 2024-04-25T01:44:39.915 INFO:tasks.workunit.client.0.smithi162.stdout:7/206: chown df/c41 11022 1 2024-04-25T01:44:39.920 INFO:tasks.workunit.client.0.smithi162.stdout:4/205: chown dd/df/d2e/c31 108034 1 2024-04-25T01:44:40.273 INFO:tasks.workunit.client.0.smithi162.stdout:2/202: mknod d0/d3/d1b/d1d/c48 0 2024-04-25T01:44:40.351 INFO:tasks.workunit.client.0.smithi162.stdout:6/183: write d1/d13/f35 [1637990,48323] 0 2024-04-25T01:44:40.356 INFO:tasks.workunit.client.0.smithi162.stdout:2/203: sync 2024-04-25T01:44:40.466 INFO:tasks.workunit.client.0.smithi162.stdout:8/203: truncate d0/d12/f2e 3810495 0 2024-04-25T01:44:40.536 INFO:tasks.workunit.client.0.smithi162.stdout:9/169: fsync d4/d9/d15/f23 0 2024-04-25T01:44:40.682 INFO:tasks.workunit.client.0.smithi162.stdout:4/206: truncate fb 1848956 0 2024-04-25T01:44:41.285 INFO:tasks.workunit.client.0.smithi162.stdout:9/170: dread - d4/d9/d15/d1b/f2e zero size 2024-04-25T01:44:41.665 INFO:tasks.workunit.client.0.smithi162.stdout:4/207: mknod dd/df/d2e/c4a 0 2024-04-25T01:44:41.918 INFO:tasks.workunit.client.0.smithi162.stdout:5/212: unlink d15/d19/f33 0 2024-04-25T01:44:42.834 INFO:tasks.workunit.client.0.smithi162.stdout:1/219: getdents d15/d1f/d35 0 2024-04-25T01:44:42.982 INFO:tasks.workunit.client.0.smithi162.stdout:4/208: mkdir dd/df/d2e/d4b 0 2024-04-25T01:44:43.481 INFO:tasks.workunit.client.0.smithi162.stdout:6/184: creat d1/f39 x:0 0 0 2024-04-25T01:44:44.148 INFO:tasks.workunit.client.0.smithi162.stdout:1/220: mknod d15/d1f/d35/c47 0 2024-04-25T01:44:44.223 INFO:tasks.workunit.client.0.smithi162.stdout:6/185: mkdir d1/d13/d28/d30/d3a 0 2024-04-25T01:44:44.427 INFO:tasks.workunit.client.0.smithi162.stdout:9/171: creat d4/d9/d15/f3f x:0 0 0 2024-04-25T01:44:44.636 INFO:tasks.workunit.client.0.smithi162.stdout:6/186: dwrite d1/f39 [0,4194304] 0 2024-04-25T01:44:44.818 INFO:tasks.workunit.client.0.smithi162.stdout:3/217: write d2/d29/d2e/f3a [501357,126380] 0 2024-04-25T01:44:45.002 INFO:tasks.workunit.client.0.smithi162.stdout:4/209: mknod dd/df/d2e/d4b/c4c 0 2024-04-25T01:44:45.176 INFO:tasks.workunit.client.0.smithi162.stdout:7/207: dwrite df/f15 [0,4194304] 0 2024-04-25T01:44:45.434 INFO:tasks.workunit.client.0.smithi162.stdout:9/172: fsync d4/d8/f10 0 2024-04-25T01:44:45.486 INFO:tasks.workunit.client.0.smithi162.stdout:8/204: dwrite d0/d12/f17 [0,4194304] 0 2024-04-25T01:44:45.507 INFO:tasks.workunit.client.0.smithi162.stdout:0/245: rename d0/df/f41 to d0/df/d20/f45 0 2024-04-25T01:44:45.644 INFO:tasks.workunit.client.0.smithi162.stdout:5/213: write d15/d19/f35 [30023,87555] 0 2024-04-25T01:44:46.262 INFO:tasks.workunit.client.0.smithi162.stdout:3/218: dread d2/d9/d10/d2c/f32 [0,4194304] 0 2024-04-25T01:44:46.335 INFO:tasks.workunit.client.0.smithi162.stdout:4/210: mknod dd/df/d2e/d4b/c4d 0 2024-04-25T01:44:46.649 INFO:tasks.workunit.client.0.smithi162.stdout:0/246: creat d0/d1/f46 x:0 0 0 2024-04-25T01:44:46.950 INFO:tasks.workunit.client.0.smithi162.stdout:8/205: unlink d0/c1d 0 2024-04-25T01:44:47.394 INFO:tasks.workunit.client.0.smithi162.stdout:7/208: mknod df/d2c/c42 0 2024-04-25T01:44:47.408 INFO:tasks.workunit.client.0.smithi162.stdout:1/221: write d15/d1f/d32/f37 [49003,106010] 0 2024-04-25T01:44:47.687 INFO:tasks.workunit.client.0.smithi162.stdout:2/204: rename d0/d2d to d0/d49 0 2024-04-25T01:44:47.714 INFO:tasks.workunit.client.0.smithi162.stdout:3/219: creat d2/d29/f46 x:0 0 0 2024-04-25T01:44:47.776 INFO:tasks.workunit.client.0.smithi162.stdout:4/211: read - dd/f29 zero size 2024-04-25T01:44:47.931 INFO:tasks.workunit.client.0.smithi162.stdout:0/247: fdatasync d0/df/d20/f45 0 2024-04-25T01:44:48.122 INFO:tasks.workunit.client.0.smithi162.stdout:5/214: creat d15/d19/d24/d2b/f42 x:0 0 0 2024-04-25T01:44:48.395 INFO:tasks.workunit.client.0.smithi162.stdout:1/222: truncate f3 8563635 0 2024-04-25T01:44:48.504 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:44:48.507 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:44:48.672 INFO:tasks.workunit.client.0.smithi162.stdout:4/212: mkdir dd/d1a/d4e 0 2024-04-25T01:44:48.739 INFO:tasks.workunit.client.0.smithi162.stdout:9/173: creat d4/d8/f40 x:0 0 0 2024-04-25T01:44:48.875 INFO:tasks.workunit.client.0.smithi162.stdout:9/174: fdatasync d4/d9/d15/f3f 0 2024-04-25T01:44:49.039 INFO:tasks.workunit.client.0.smithi162.stdout:6/187: dwrite d1/d13/f17 [0,4194304] 0 2024-04-25T01:44:49.283 INFO:tasks.workunit.client.0.smithi162.stdout:1/223: unlink d15/d1f/d23/l2c 0 2024-04-25T01:44:49.496 INFO:tasks.workunit.client.0.smithi162.stdout:4/213: symlink dd/df/d2e/l4f 0 2024-04-25T01:44:49.741 INFO:tasks.workunit.client.0.smithi162.stdout:8/206: rename d0/d1a/de to d0/d44 0 2024-04-25T01:44:49.883 INFO:tasks.workunit.client.0.smithi162.stdout:9/175: unlink d4/d9/d15/d1b/d2f/f36 0 2024-04-25T01:44:50.215 INFO:tasks.workunit.client.0.smithi162.stdout:4/214: fsync dd/df/d2e/f35 0 2024-04-25T01:44:50.720 INFO:tasks.workunit.client.0.smithi162.stdout:9/176: symlink d4/d9/d15/d1b/d2f/d30/l41 0 2024-04-25T01:44:51.021 INFO:tasks.workunit.client.0.smithi162.stdout:9/177: dwrite d4/d8/f40 [0,4194304] 0 2024-04-25T01:44:51.579 INFO:tasks.workunit.client.0.smithi162.stdout:3/220: rename d2/c1a to d2/d9/d10/c47 0 2024-04-25T01:44:51.610 INFO:tasks.workunit.client.0.smithi162.stdout:3/221: stat d2/d9/d10/d2c/f32 0 2024-04-25T01:44:51.747 INFO:tasks.workunit.client.0.smithi162.stdout:8/207: symlink d0/d44/d31/l45 0 2024-04-25T01:44:51.767 INFO:tasks.workunit.client.0.smithi162.stdout:2/205: write d0/d3/f47 [419945,88331] 0 2024-04-25T01:44:51.807 INFO:tasks.workunit.client.0.smithi162.stdout:3/222: dread d2/d9/d10/d2c/f32 [0,4194304] 0 2024-04-25T01:44:51.885 INFO:tasks.workunit.client.0.smithi162.stdout:3/223: dread d2/d9/f30 [0,4194304] 0 2024-04-25T01:44:51.911 INFO:tasks.workunit.client.0.smithi162.stdout:9/178: fsync d4/d25/f34 0 2024-04-25T01:44:51.964 INFO:tasks.workunit.client.0.smithi162.stdout:3/224: chown d2/d9/d19 0 1 2024-04-25T01:44:51.981 INFO:tasks.workunit.client.0.smithi162.stdout:9/179: fdatasync d4/d9/d15/f3f 0 2024-04-25T01:44:52.115 INFO:tasks.workunit.client.0.smithi162.stdout:2/206: mknod d0/d3/d1b/d1d/d3a/c4a 0 2024-04-25T01:44:52.336 INFO:tasks.workunit.client.0.smithi162.stdout:1/224: rename d15/d1f/d23/f42 to d15/d1f/d23/f48 0 2024-04-25T01:44:52.352 INFO:tasks.workunit.client.0.smithi162.stdout:7/209: rmdir df/d2e 39 2024-04-25T01:44:52.356 INFO:tasks.workunit.client.0.smithi162.stdout:8/208: dread d0/d12/f2e [0,4194304] 0 2024-04-25T01:44:52.471 INFO:tasks.workunit.client.0.smithi162.stdout:7/210: chown fa 126967088 1 2024-04-25T01:44:52.569 INFO:tasks.workunit.client.0.smithi162.stdout:9/180: symlink d4/d8/d13/l42 0 2024-04-25T01:44:52.580 INFO:tasks.workunit.client.0.smithi162.stdout:5/215: write d15/d19/f34 [559030,80473] 0 2024-04-25T01:44:52.622 INFO:tasks.workunit.client.0.smithi162.stdout:7/211: readlink l0 0 2024-04-25T01:44:52.798 INFO:tasks.workunit.client.0.smithi162.stdout:0/248: dwrite d0/d1/f1e [0,4194304] 0 2024-04-25T01:44:52.805 INFO:tasks.workunit.client.0.smithi162.stdout:7/212: chown df/d2c/c39 830918 1 2024-04-25T01:44:53.197 INFO:tasks.workunit.client.0.smithi162.stdout:3/225: mkdir d2/d9/d48 0 2024-04-25T01:44:53.306 INFO:tasks.workunit.client.0.smithi162.stdout:6/188: dwrite d1/d13/d28/f29 [0,4194304] 0 2024-04-25T01:44:53.436 INFO:tasks.workunit.client.0.smithi162.stdout:1/225: rename d15/d1f/d32/l43 to d15/d1f/l49 0 2024-04-25T01:44:53.467 INFO:tasks.workunit.client.0.smithi162.stdout:1/226: chown c2 0 1 2024-04-25T01:44:53.478 INFO:tasks.workunit.client.0.smithi162.stdout:1/227: readlink d15/d1f/l31 0 2024-04-25T01:44:53.518 INFO:tasks.workunit.client.0.smithi162.stdout:2/207: symlink d0/l4b 0 2024-04-25T01:44:54.403 INFO:tasks.workunit.client.0.smithi162.stdout:9/181: rename d4/d8/c33 to d4/d8/d13/d38/d3b/c43 0 2024-04-25T01:44:54.436 INFO:tasks.workunit.client.0.smithi162.stdout:9/182: chown d4/d9/d15/d1b/f29 19 1 2024-04-25T01:44:54.517 INFO:tasks.workunit.client.0.smithi162.stdout:1/228: mkdir d15/d1f/d23/d30/d4a 0 2024-04-25T01:44:54.643 INFO:tasks.workunit.client.0.smithi162.stdout:5/216: fsync d15/f3a 0 2024-04-25T01:44:54.683 INFO:tasks.workunit.client.0.smithi162.stdout:2/208: chown d0/d3/l12 1050 1 2024-04-25T01:44:54.740 INFO:tasks.workunit.client.0.smithi162.stdout:5/217: write d15/d19/f34 [602881,45847] 0 2024-04-25T01:44:54.964 INFO:tasks.workunit.client.0.smithi162.stdout:4/215: write fb [2848185,15392] 0 2024-04-25T01:44:55.247 INFO:tasks.workunit.client.0.smithi162.stdout:9/183: rename d4/d8/f1a to d4/d9/d15/d1b/d2f/d30/f44 0 2024-04-25T01:44:55.372 INFO:tasks.workunit.client.0.smithi162.stdout:1/229: fsync d15/d1f/d35/f44 0 2024-04-25T01:44:55.719 INFO:tasks.workunit.client.0.smithi162.stdout:7/213: creat df/f43 x:0 0 0 2024-04-25T01:44:56.197 INFO:tasks.workunit.client.0.smithi162.stdout:0/249: mknod d0/df/d20/d25/d29/c47 0 2024-04-25T01:44:56.225 INFO:tasks.workunit.client.0.smithi162.stdout:2/209: truncate d0/d3/f19 5096459 0 2024-04-25T01:44:56.377 INFO:tasks.workunit.client.0.smithi162.stdout:0/250: chown d0/df/d20/l35 126004 1 2024-04-25T01:44:56.523 INFO:tasks.workunit.client.0.smithi162.stdout:4/216: dread - dd/f16 zero size 2024-04-25T01:44:56.572 INFO:tasks.workunit.client.0.smithi162.stdout:8/209: dwrite d0/d44/d31/f34 [0,4194304] 0 2024-04-25T01:44:56.655 INFO:tasks.workunit.client.0.smithi162.stdout:4/217: chown dd/d1a/f47 6794 1 2024-04-25T01:44:56.706 INFO:tasks.workunit.client.0.smithi162.stdout:0/251: sync 2024-04-25T01:44:56.783 INFO:tasks.workunit.client.0.smithi162.stdout:1/230: rename c2 to d15/d1f/d23/d30/d4a/c4b 0 2024-04-25T01:44:57.076 INFO:tasks.workunit.client.0.smithi162.stdout:7/214: dread df/f20 [0,4194304] 0 2024-04-25T01:44:57.264 INFO:tasks.workunit.client.0.smithi162.stdout:3/226: link d2/d29/d2e/f3a d2/d9/f49 0 2024-04-25T01:44:57.294 INFO:tasks.workunit.client.0.smithi162.stdout:3/227: stat d2/d9/d10/d40 0 2024-04-25T01:44:57.551 INFO:tasks.workunit.client.0.smithi162.stdout:6/189: write d1/d13/f35 [2704804,38822] 0 2024-04-25T01:44:57.813 INFO:tasks.workunit.client.0.smithi162.stdout:0/252: read d0/df/f43 [545439,62772] 0 2024-04-25T01:44:58.431 INFO:tasks.workunit.client.0.smithi162.stdout:3/228: truncate d2/d9/d19/f36 915119 0 2024-04-25T01:44:58.537 INFO:tasks.workunit.client.0.smithi162.stdout:9/184: link f3 d4/d25/f45 0 2024-04-25T01:44:58.577 INFO:tasks.workunit.client.0.smithi162.stdout:9/185: stat d4/d9/d15/d1b 0 2024-04-25T01:44:58.595 INFO:tasks.workunit.client.0.smithi162.stdout:6/190: truncate d1/d13/f15 288219 0 2024-04-25T01:44:59.422 INFO:tasks.workunit.client.0.smithi162.stdout:5/218: dwrite d15/f17 [0,4194304] 0 2024-04-25T01:44:59.545 INFO:tasks.workunit.client.0.smithi162.stdout:6/191: chown d1/d13/c26 518223 1 2024-04-25T01:44:59.649 INFO:tasks.workunit.client.0.smithi162.stdout:0/253: chown d0/df/d20/d25/d29/l3b 129267 1 2024-04-25T01:44:59.720 INFO:tasks.workunit.client.0.smithi162.stdout:9/186: dwrite d4/d9/d15/f3f [0,4194304] 0 2024-04-25T01:44:59.866 INFO:tasks.workunit.client.0.smithi162.stdout:8/210: getdents d0/d1a/d25 0 2024-04-25T01:44:59.908 INFO:tasks.workunit.client.0.smithi162.stdout:1/231: getdents d15/d1f/d23/d30 0 2024-04-25T01:44:59.995 INFO:tasks.workunit.client.0.smithi162.stdout:5/219: dread d15/f17 [0,4194304] 0 2024-04-25T01:45:00.017 INFO:tasks.workunit.client.0.smithi162.stdout:1/232: chown d15/f1d 2 1 2024-04-25T01:45:00.030 INFO:tasks.workunit.client.0.smithi162.stdout:5/220: fsync d15/f17 0 2024-04-25T01:45:00.047 INFO:tasks.workunit.client.0.smithi162.stdout:8/211: chown d0/d12/d1b/l41 3254 1 2024-04-25T01:45:00.113 INFO:tasks.workunit.client.0.smithi162.stdout:2/210: write d0/d3/d5/f18 [672229,37185] 0 2024-04-25T01:45:00.131 INFO:tasks.workunit.client.0.smithi162.stdout:1/233: chown d15/d1f/l31 134 1 2024-04-25T01:45:00.346 INFO:tasks.workunit.client.0.smithi162.stdout:2/211: sync 2024-04-25T01:45:00.556 INFO:tasks.workunit.client.0.smithi162.stdout:8/212: symlink d0/d1a/d25/l46 0 2024-04-25T01:45:00.667 INFO:tasks.workunit.client.0.smithi162.stdout:4/218: dwrite dd/d1a/f47 [0,4194304] 0 2024-04-25T01:45:00.870 INFO:tasks.workunit.client.0.smithi162.stdout:6/192: dwrite d1/d13/d28/f29 [0,4194304] 0 2024-04-25T01:45:01.201 INFO:tasks.workunit.client.0.smithi162.stdout:7/215: dwrite df/f1b [0,4194304] 0 2024-04-25T01:45:01.364 INFO:tasks.workunit.client.0.smithi162.stdout:9/187: fsync d4/d25/f45 0 2024-04-25T01:45:01.497 INFO:tasks.workunit.client.0.smithi162.stdout:3/229: dwrite d2/d9/f2d [0,4194304] 0 2024-04-25T01:45:01.615 INFO:tasks.workunit.client.0.smithi162.stdout:5/221: creat d15/d19/d24/d2b/d3b/d3c/d3f/f43 x:0 0 0 2024-04-25T01:45:01.634 INFO:tasks.workunit.client.0.smithi162.stdout:0/254: symlink d0/l48 0 2024-04-25T01:45:01.672 INFO:tasks.workunit.client.0.smithi162.stdout:4/219: creat dd/d1a/d34/f50 x:0 0 0 2024-04-25T01:45:01.738 INFO:tasks.workunit.client.0.smithi162.stdout:0/255: dread - d0/d1/f3c zero size 2024-04-25T01:45:01.768 INFO:tasks.workunit.client.0.smithi162.stdout:2/212: rmdir d0/d49 39 2024-04-25T01:45:01.855 INFO:tasks.workunit.client.0.smithi162.stdout:0/256: chown d0/df/d20/d25/d29/l3b 5000 1 2024-04-25T01:45:02.504 INFO:tasks.workunit.client.0.smithi162.stdout:4/220: creat dd/d1a/d34/f51 x:0 0 0 2024-04-25T01:45:02.524 INFO:tasks.workunit.client.0.smithi162.stdout:4/221: readlink dd/l1e 0 2024-04-25T01:45:02.635 INFO:tasks.workunit.client.0.smithi162.stdout:3/230: rename d2/d9/l1c to d2/d9/d10/d40/l4a 0 2024-04-25T01:45:02.760 INFO:tasks.workunit.client.0.smithi162.stdout:5/222: mknod d15/d19/d24/d2b/d3b/d3c/c44 0 2024-04-25T01:45:02.944 INFO:tasks.workunit.client.0.smithi162.stdout:0/257: creat d0/df/d20/d25/f49 x:0 0 0 2024-04-25T01:45:03.215 INFO:tasks.workunit.client.0.smithi162.stdout:7/216: fsync df/f17 0 2024-04-25T01:45:03.253 INFO:tasks.workunit.client.0.smithi162.stdout:1/234: write d15/d1f/f27 [590528,39273] 0 2024-04-25T01:45:03.701 INFO:tasks.workunit.client.0.smithi162.stdout:3/231: mkdir d2/d9/d17/d4b 0 2024-04-25T01:45:03.991 INFO:tasks.workunit.client.0.smithi162.stdout:8/213: dwrite d0/d44/f15 [0,4194304] 0 2024-04-25T01:45:04.108 INFO:tasks.workunit.client.0.smithi162.stdout:6/193: rmdir d1/d13/d28/d37 0 2024-04-25T01:45:04.275 INFO:tasks.workunit.client.0.smithi162.stdout:1/235: mkdir d15/d1f/d35/d4c 0 2024-04-25T01:45:04.565 INFO:tasks.workunit.client.0.smithi162.stdout:4/222: fdatasync dd/f3a 0 2024-04-25T01:45:04.720 INFO:tasks.workunit.client.0.smithi162.stdout:3/232: mkdir d2/d9/d10/d4c 0 2024-04-25T01:45:04.728 INFO:tasks.workunit.client.0.smithi162.stdout:9/188: write d4/d8/f37 [166200,69593] 0 2024-04-25T01:45:04.798 INFO:tasks.workunit.client.0.smithi162.stdout:3/233: chown d2/d9/f30 2118243553 1 2024-04-25T01:45:04.844 INFO:tasks.workunit.client.0.smithi162.stdout:3/234: chown d2/lc 408177 1 2024-04-25T01:45:05.030 INFO:tasks.workunit.client.0.smithi162.stdout:6/194: dread d1/f1e [0,4194304] 0 2024-04-25T01:45:05.377 INFO:tasks.workunit.client.0.smithi162.stdout:9/189: symlink d4/d8/d13/d38/d3b/l46 0 2024-04-25T01:45:05.487 INFO:tasks.workunit.client.0.smithi162.stdout:3/235: symlink d2/d9/d10/d2c/l4d 0 2024-04-25T01:45:05.562 INFO:tasks.workunit.client.0.smithi162.stdout:2/213: write d0/d3/d1b/d1d/f38 [3509508,109714] 0 2024-04-25T01:45:05.694 INFO:tasks.workunit.client.0.smithi162.stdout:3/236: dread d2/d9/f2d [0,4194304] 0 2024-04-25T01:45:05.731 INFO:tasks.workunit.client.0.smithi162.stdout:6/195: symlink d1/d13/d28/d30/l3b 0 2024-04-25T01:45:05.767 INFO:tasks.workunit.client.0.smithi162.stdout:6/196: readlink d1/d13/d28/d30/l3b 0 2024-04-25T01:45:06.047 INFO:tasks.workunit.client.0.smithi162.stdout:6/197: sync 2024-04-25T01:45:06.469 INFO:tasks.workunit.client.0.smithi162.stdout:7/217: rename df/c24 to df/c44 0 2024-04-25T01:45:06.556 INFO:tasks.workunit.client.0.smithi162.stdout:0/258: write d0/d1/f3d [508865,108359] 0 2024-04-25T01:45:06.575 INFO:tasks.workunit.client.0.smithi162.stdout:5/223: write f3 [1260282,120697] 0 2024-04-25T01:45:06.628 INFO:tasks.workunit.client.0.smithi162.stdout:6/198: fsync d1/d13/f23 0 2024-04-25T01:45:06.709 INFO:tasks.workunit.client.0.smithi162.stdout:7/218: dread f4 [0,4194304] 0 2024-04-25T01:45:06.788 INFO:tasks.workunit.client.0.smithi162.stdout:7/219: sync 2024-04-25T01:45:07.065 INFO:tasks.workunit.client.0.smithi162.stdout:1/236: rename d15/d1f/d35/l46 to d15/d1f/d23/l4d 0 2024-04-25T01:45:07.503 INFO:tasks.workunit.client.0.smithi162.stdout:8/214: write d0/d12/f3c [445762,38082] 0 2024-04-25T01:45:07.505 INFO:tasks.workunit.client.0.smithi162.stdout:5/224: dread f11 [0,4194304] 0 2024-04-25T01:45:07.685 INFO:tasks.workunit.client.0.smithi162.stdout:0/259: fdatasync d0/df/d20/f31 0 2024-04-25T01:45:07.715 INFO:tasks.workunit.client.0.smithi162.stdout:7/220: readlink df/l19 0 2024-04-25T01:45:07.796 INFO:tasks.workunit.client.0.smithi162.stdout:7/221: sync 2024-04-25T01:45:07.809 INFO:tasks.workunit.client.0.smithi162.stdout:7/222: chown f5 23 1 2024-04-25T01:45:07.823 INFO:tasks.workunit.client.0.smithi162.stdout:7/223: chown f6 9729 1 2024-04-25T01:45:07.896 INFO:tasks.workunit.client.0.smithi162.stdout:7/224: sync 2024-04-25T01:45:07.905 INFO:tasks.workunit.client.0.smithi162.stdout:4/223: rename dd/d1a/d34/f39 to dd/df/f52 0 2024-04-25T01:45:08.068 INFO:tasks.workunit.client.0.smithi162.stdout:1/237: rename d15/d1f/l31 to d15/d1f/l4e 0 2024-04-25T01:45:09.067 INFO:tasks.workunit.client.0.smithi162.stdout:0/260: fdatasync d0/d1/f3c 0 2024-04-25T01:45:09.337 INFO:tasks.workunit.client.0.smithi162.stdout:7/225: mknod df/d2c/c45 0 2024-04-25T01:45:09.735 INFO:tasks.workunit.client.0.smithi162.stdout:2/214: dwrite d0/d3/f1a [0,4194304] 0 2024-04-25T01:45:09.872 INFO:tasks.workunit.client.0.smithi162.stdout:8/215: creat d0/d44/d31/d33/f47 x:0 0 0 2024-04-25T01:45:09.913 INFO:tasks.workunit.client.0.smithi162.stdout:2/215: chown d0/d3/c2c 115643515 1 2024-04-25T01:45:10.024 INFO:tasks.workunit.client.0.smithi162.stdout:3/237: write d2/d9/f49 [657881,73848] 0 2024-04-25T01:45:10.092 INFO:tasks.workunit.client.0.smithi162.stdout:0/261: mknod d0/df/d20/d37/c4a 0 2024-04-25T01:45:10.123 INFO:tasks.workunit.client.0.smithi162.stdout:0/262: stat d0/df/d20/d25/c38 0 2024-04-25T01:45:11.331 INFO:tasks.workunit.client.0.smithi162.stdout:0/263: dread d0/d1/f1e [0,4194304] 0 2024-04-25T01:45:11.651 INFO:tasks.workunit.client.0.smithi162.stdout:9/190: rename d4/d8/d13/f17 to d4/d9/f47 0 2024-04-25T01:45:11.799 INFO:tasks.workunit.client.0.smithi162.stdout:5/225: write d15/d1e/f2a [1308742,37005] 0 2024-04-25T01:45:11.865 INFO:tasks.workunit.client.0.smithi162.stdout:6/199: dwrite d1/f36 [4194304,4194304] 0 2024-04-25T01:45:12.099 INFO:tasks.workunit.client.0.smithi162.stdout:0/264: mkdir d0/d1/d4b 0 2024-04-25T01:45:12.270 INFO:tasks.workunit.client.0.smithi162.stdout:5/226: dread d15/d19/f1b [0,4194304] 0 2024-04-25T01:45:12.366 INFO:tasks.workunit.client.0.smithi162.stdout:2/216: link d0/f9 d0/d3/d1b/d1d/d3a/f4c 0 2024-04-25T01:45:12.421 INFO:tasks.workunit.client.0.smithi162.stdout:1/238: write d15/d1f/d23/f25 [790341,110451] 0 2024-04-25T01:45:12.629 INFO:tasks.workunit.client.0.smithi162.stdout:0/265: creat d0/df/d20/d25/f4c x:0 0 0 2024-04-25T01:45:12.745 INFO:tasks.workunit.client.0.smithi162.stdout:5/227: symlink d15/d19/d24/l45 0 2024-04-25T01:45:12.848 INFO:tasks.workunit.client.0.smithi162.stdout:2/217: mknod d0/d3/d1b/d1d/d3a/c4d 0 2024-04-25T01:45:12.981 INFO:tasks.workunit.client.0.smithi162.stdout:5/228: sync 2024-04-25T01:45:12.999 INFO:tasks.workunit.client.0.smithi162.stdout:5/229: dread - d15/f3a zero size 2024-04-25T01:45:13.757 INFO:tasks.workunit.client.0.smithi162.stdout:4/224: creat dd/f53 x:0 0 0 2024-04-25T01:45:13.770 INFO:tasks.workunit.client.0.smithi162.stdout:5/230: creat d15/d19/d24/d2b/d3b/f46 x:0 0 0 2024-04-25T01:45:14.147 INFO:tasks.workunit.client.0.smithi162.stdout:8/216: dwrite d0/d44/d31/f2a [0,4194304] 0 2024-04-25T01:45:14.270 INFO:tasks.workunit.client.0.smithi162.stdout:4/225: read - dd/d1a/f37 zero size 2024-04-25T01:45:14.295 INFO:tasks.workunit.client.0.smithi162.stdout:0/266: link d0/df/d20/f24 d0/df/d20/d25/f4d 0 2024-04-25T01:45:14.425 INFO:tasks.workunit.client.0.smithi162.stdout:2/218: link d0/d3/d1b/d1d/d3a/f4c d0/d3/d5/d36/f4e 0 2024-04-25T01:45:14.954 INFO:tasks.workunit.client.0.smithi162.stdout:0/267: mkdir d0/d1/d4e 0 2024-04-25T01:45:15.144 INFO:tasks.workunit.client.0.smithi162.stdout:8/217: symlink d0/d1a/l48 0 2024-04-25T01:45:15.338 INFO:tasks.workunit.client.0.smithi162.stdout:2/219: fdatasync d0/d3/d1b/d1d/d3a/f40 0 2024-04-25T01:45:15.367 INFO:tasks.workunit.client.0.smithi162.stdout:7/226: dwrite df/f12 [0,4194304] 0 2024-04-25T01:45:15.534 INFO:tasks.workunit.client.0.smithi162.stdout:0/268: creat d0/d1/d4b/f4f x:0 0 0 2024-04-25T01:45:15.913 INFO:tasks.workunit.client.0.smithi162.stdout:4/226: unlink dd/d1a/f47 0 2024-04-25T01:45:15.921 INFO:tasks.workunit.client.0.smithi162.stdout:6/200: write d1/d13/d28/f2e [815159,65220] 0 2024-04-25T01:45:15.936 INFO:tasks.workunit.client.0.smithi162.stdout:9/191: write d4/d9/d15/d1b/d2f/f3a [832498,106375] 0 2024-04-25T01:45:16.200 INFO:tasks.workunit.client.0.smithi162.stdout:1/239: dwrite fe [0,4194304] 0 2024-04-25T01:45:16.433 INFO:tasks.workunit.client.0.smithi162.stdout:1/240: dread fe [0,4194304] 0 2024-04-25T01:45:16.936 INFO:tasks.workunit.client.0.smithi162.stdout:7/227: fsync df/f2a 0 2024-04-25T01:45:17.088 INFO:tasks.workunit.client.0.smithi162.stdout:5/231: dwrite d15/d19/d24/d40/f41 [0,4194304] 0 2024-04-25T01:45:17.319 INFO:tasks.workunit.client.0.smithi162.stdout:0/269: dread d0/df/d20/f24 [0,4194304] 0 2024-04-25T01:45:17.405 INFO:tasks.workunit.client.0.smithi162.stdout:9/192: symlink d4/d9/d15/d1b/l48 0 2024-04-25T01:45:17.409 INFO:tasks.workunit.client.0.smithi162.stdout:2/220: write d0/d3/f16 [811720,18958] 0 2024-04-25T01:45:17.718 INFO:tasks.workunit.client.0.smithi162.stdout:1/241: mkdir d15/d1f/d32/d4f 0 2024-04-25T01:45:18.329 INFO:tasks.workunit.client.0.smithi162.stdout:3/238: symlink d2/l4e 0 2024-04-25T01:45:18.463 INFO:tasks.workunit.client.0.smithi162.stdout:5/232: dread d15/d19/d24/f2d [0,4194304] 0 2024-04-25T01:45:18.496 INFO:tasks.workunit.client.0.smithi162.stdout:5/233: readlink d15/d19/l23 0 2024-04-25T01:45:18.592 INFO:tasks.workunit.client.0.smithi162.stdout:9/193: dread d4/d8/f2d [0,4194304] 0 2024-04-25T01:45:18.809 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:45:18.814 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:45:19.221 INFO:tasks.workunit.client.0.smithi162.stdout:0/270: mknod d0/df/d20/d25/d29/c50 0 2024-04-25T01:45:19.363 INFO:tasks.workunit.client.0.smithi162.stdout:3/239: creat d2/d29/d2e/f4f x:0 0 0 2024-04-25T01:45:19.442 INFO:tasks.workunit.client.0.smithi162.stdout:4/227: write dd/d1a/f21 [955500,126694] 0 2024-04-25T01:45:19.462 INFO:tasks.workunit.client.0.smithi162.stdout:1/242: dread d15/d1f/d23/f48 [0,4194304] 0 2024-04-25T01:45:19.483 INFO:tasks.workunit.client.0.smithi162.stdout:6/201: write d1/d13/f34 [2213398,10500] 0 2024-04-25T01:45:19.608 INFO:tasks.workunit.client.0.smithi162.stdout:1/243: chown d15/d1f/f33 113 1 2024-04-25T01:45:19.618 INFO:tasks.workunit.client.0.smithi162.stdout:4/228: chown dd/d1a/d34/f50 64932207 1 2024-04-25T01:45:19.749 INFO:tasks.workunit.client.0.smithi162.stdout:0/271: rmdir d0/df/d20/d25 39 2024-04-25T01:45:19.780 INFO:tasks.workunit.client.0.smithi162.stdout:2/221: creat d0/d3/d1b/f4f x:0 0 0 2024-04-25T01:45:19.874 INFO:tasks.workunit.client.0.smithi162.stdout:1/244: sync 2024-04-25T01:45:20.095 INFO:tasks.workunit.client.0.smithi162.stdout:6/202: rename d1/d13/f35 to d1/d13/d28/d30/d3a/f3c 0 2024-04-25T01:45:20.204 INFO:tasks.workunit.client.0.smithi162.stdout:4/229: creat dd/df/d2e/d4b/f54 x:0 0 0 2024-04-25T01:45:20.556 INFO:tasks.workunit.client.0.smithi162.stdout:7/228: dwrite df/f15 [4194304,4194304] 0 2024-04-25T01:45:20.801 INFO:tasks.workunit.client.0.smithi162.stdout:9/194: creat d4/d9/d15/f49 x:0 0 0 2024-04-25T01:45:21.156 INFO:tasks.workunit.client.0.smithi162.stdout:8/218: mknod d0/c49 0 2024-04-25T01:45:21.249 INFO:tasks.workunit.client.0.smithi162.stdout:4/230: dread fb [0,4194304] 0 2024-04-25T01:45:21.492 INFO:tasks.workunit.client.0.smithi162.stdout:0/272: rename d0/df/d20/d25/d29 to d0/df/d20/d25/d51 0 2024-04-25T01:45:21.867 INFO:tasks.workunit.client.0.smithi162.stdout:5/234: dwrite d15/d19/d24/d2b/f3d [0,4194304] 0 2024-04-25T01:45:21.894 INFO:tasks.workunit.client.0.smithi162.stdout:3/240: write d2/d9/d17/f38 [2104608,46061] 0 2024-04-25T01:45:22.173 INFO:tasks.workunit.client.0.smithi162.stdout:9/195: rename d4/d9/d15/d1b/d2f/l32 to d4/d9/d15/d1b/l4a 0 2024-04-25T01:45:22.210 INFO:tasks.workunit.client.0.smithi162.stdout:9/196: chown d4/d9/d15/d1b/f2e 26583094 1 2024-04-25T01:45:22.756 INFO:tasks.workunit.client.0.smithi162.stdout:0/273: write d0/d1/d4b/f4f [495295,35986] 0 2024-04-25T01:45:23.160 INFO:tasks.workunit.client.0.smithi162.stdout:1/245: dwrite d15/d1f/d35/f44 [0,4194304] 0 2024-04-25T01:45:23.404 INFO:tasks.workunit.client.0.smithi162.stdout:6/203: dwrite d1/d13/f17 [0,4194304] 0 2024-04-25T01:45:23.636 INFO:tasks.workunit.client.0.smithi162.stdout:4/231: mknod dd/d1a/d4e/c55 0 2024-04-25T01:45:23.936 INFO:tasks.workunit.client.0.smithi162.stdout:7/229: dwrite f6 [0,4194304] 0 2024-04-25T01:45:24.142 INFO:tasks.workunit.client.0.smithi162.stdout:2/222: link d0/d49/c45 d0/d3/d1b/d1d/d20/c50 0 2024-04-25T01:45:24.161 INFO:tasks.workunit.client.0.smithi162.stdout:2/223: chown d0/ff 2432112 1 2024-04-25T01:45:24.179 INFO:tasks.workunit.client.0.smithi162.stdout:2/224: stat d0/d3/f47 0 2024-04-25T01:45:24.331 INFO:tasks.workunit.client.0.smithi162.stdout:1/246: mknod d15/d1f/c50 0 2024-04-25T01:45:24.526 INFO:tasks.workunit.client.0.smithi162.stdout:9/197: mknod d4/d9/c4b 0 2024-04-25T01:45:24.739 INFO:tasks.workunit.client.0.smithi162.stdout:6/204: rename d1/f36 to d1/d13/d28/d30/d3a/f3d 0 2024-04-25T01:45:24.792 INFO:tasks.workunit.client.0.smithi162.stdout:8/219: dwrite d0/d12/f23 [0,4194304] 0 2024-04-25T01:45:24.804 INFO:tasks.workunit.client.0.smithi162.stdout:4/232: creat dd/d1a/d4e/f56 x:0 0 0 2024-04-25T01:45:25.674 INFO:tasks.workunit.client.0.smithi162.stdout:5/235: dwrite d15/f3a [0,4194304] 0 2024-04-25T01:45:25.682 INFO:tasks.workunit.client.0.smithi162.stdout:3/241: dwrite d2/f26 [0,4194304] 0 2024-04-25T01:45:25.956 INFO:tasks.workunit.client.0.smithi162.stdout:6/205: chown d1/f24 1485148 1 2024-04-25T01:45:26.471 INFO:tasks.workunit.client.0.smithi162.stdout:4/233: mkdir dd/d1a/d34/d57 0 2024-04-25T01:45:26.473 INFO:tasks.workunit.client.0.smithi162.stdout:8/220: creat d0/d44/d31/f4a x:0 0 0 2024-04-25T01:45:26.539 INFO:tasks.workunit.client.0.smithi162.stdout:8/221: chown d0/d1a/f3d 78 1 2024-04-25T01:45:26.554 INFO:tasks.workunit.client.0.smithi162.stdout:4/234: chown dd/df/d2e/d4b/c4d 31196332 1 2024-04-25T01:45:26.940 INFO:tasks.workunit.client.0.smithi162.stdout:0/274: link d0/df/d20/f3a d0/d1/d4b/f52 0 2024-04-25T01:45:27.058 INFO:tasks.workunit.client.0.smithi162.stdout:2/225: symlink d0/d3/d1b/l51 0 2024-04-25T01:45:27.066 INFO:tasks.workunit.client.0.smithi162.stdout:9/198: write d4/d8/f2d [345308,129787] 0 2024-04-25T01:45:27.908 INFO:tasks.workunit.client.0.smithi162.stdout:6/206: creat d1/d13/d28/d30/d3a/f3e x:0 0 0 2024-04-25T01:45:28.001 INFO:tasks.workunit.client.0.smithi162.stdout:4/235: fdatasync fc 0 2024-04-25T01:45:28.206 INFO:tasks.workunit.client.0.smithi162.stdout:8/222: dread - d0/d44/d31/d33/f47 zero size 2024-04-25T01:45:28.252 INFO:tasks.workunit.client.0.smithi162.stdout:1/247: creat d15/d1f/d23/f51 x:0 0 0 2024-04-25T01:45:28.321 INFO:tasks.workunit.client.0.smithi162.stdout:7/230: dwrite df/f37 [0,4194304] 0 2024-04-25T01:45:28.415 INFO:tasks.workunit.client.0.smithi162.stdout:0/275: rename d0/df/d20/f24 to d0/d1/f53 0 2024-04-25T01:45:28.830 INFO:tasks.workunit.client.0.smithi162.stdout:3/242: creat d2/d9/d17/d4b/f50 x:0 0 0 2024-04-25T01:45:29.522 INFO:tasks.workunit.client.0.smithi162.stdout:4/236: unlink dd/d1a/d34/c42 0 2024-04-25T01:45:29.553 INFO:tasks.workunit.client.0.smithi162.stdout:4/237: stat dd/d1a/d34/l43 0 2024-04-25T01:45:29.810 INFO:tasks.workunit.client.0.smithi162.stdout:9/199: rename d4/d8/f40 to d4/d8/d13/d38/f4c 0 2024-04-25T01:45:29.942 INFO:tasks.workunit.client.0.smithi162.stdout:5/236: link d15/c16 d15/d1e/c47 0 2024-04-25T01:45:30.141 INFO:tasks.workunit.client.0.smithi162.stdout:3/243: fdatasync d2/f25 0 2024-04-25T01:45:30.509 INFO:tasks.workunit.client.0.smithi162.stdout:6/207: truncate d1/d13/f15 306479 0 2024-04-25T01:45:30.619 INFO:tasks.workunit.client.0.smithi162.stdout:8/223: symlink d0/l4b 0 2024-04-25T01:45:30.760 INFO:tasks.workunit.client.0.smithi162.stdout:8/224: dread d0/f2d [0,4194304] 0 2024-04-25T01:45:30.952 INFO:tasks.workunit.client.0.smithi162.stdout:1/248: rename d15/d1f/c28 to d15/d1f/d32/c52 0 2024-04-25T01:45:31.042 INFO:tasks.workunit.client.0.smithi162.stdout:1/249: fdatasync d15/d1f/d23/f51 0 2024-04-25T01:45:31.085 INFO:tasks.workunit.client.0.smithi162.stdout:9/200: symlink d4/d8/d13/l4d 0 2024-04-25T01:45:31.208 INFO:tasks.workunit.client.0.smithi162.stdout:2/226: write d0/d3/d1b/f4f [549668,34222] 0 2024-04-25T01:45:31.757 INFO:tasks.workunit.client.0.smithi162.stdout:3/244: truncate d2/d9/d17/f2f 3347403 0 2024-04-25T01:45:32.002 INFO:tasks.workunit.client.0.smithi162.stdout:6/208: dread d1/d13/f34 [0,4194304] 0 2024-04-25T01:45:32.327 INFO:tasks.workunit.client.0.smithi162.stdout:0/276: rename d0/l2a to d0/d1/d4b/l54 0 2024-04-25T01:45:32.374 INFO:tasks.workunit.client.0.smithi162.stdout:0/277: stat d0/d1/f1e 0 2024-04-25T01:45:32.629 INFO:tasks.workunit.client.0.smithi162.stdout:1/250: creat d15/d1f/d23/d30/f53 x:0 0 0 2024-04-25T01:45:32.664 INFO:tasks.workunit.client.0.smithi162.stdout:1/251: chown d15/d1f/d32/f3e 44 1 2024-04-25T01:45:32.927 INFO:tasks.workunit.client.0.smithi162.stdout:2/227: dread d0/d3/f1a [0,4194304] 0 2024-04-25T01:45:33.127 INFO:tasks.workunit.client.0.smithi162.stdout:8/225: rename d0/d44/c1e to d0/d12/d1b/c4c 0 2024-04-25T01:45:33.159 INFO:tasks.workunit.client.0.smithi162.stdout:8/226: readlink d0/l10 0 2024-04-25T01:45:33.206 INFO:tasks.workunit.client.0.smithi162.stdout:0/278: mkdir d0/df/d20/d25/d55 0 2024-04-25T01:45:33.434 INFO:tasks.workunit.client.0.smithi162.stdout:9/201: fsync d4/d25/f34 0 2024-04-25T01:45:33.642 INFO:tasks.workunit.client.0.smithi162.stdout:4/238: write dd/df/d2e/f2f [2361854,54497] 0 2024-04-25T01:45:33.992 INFO:tasks.workunit.client.0.smithi162.stdout:4/239: dread dd/d1a/f22 [0,4194304] 0 2024-04-25T01:45:34.205 INFO:tasks.workunit.client.0.smithi162.stdout:3/245: rename d2/d9/d17/d4b to d2/d9/d10/d4c/d51 0 2024-04-25T01:45:34.533 INFO:tasks.workunit.client.0.smithi162.stdout:8/227: fsync d0/d44/d31/f2a 0 2024-04-25T01:45:34.565 INFO:tasks.workunit.client.0.smithi162.stdout:5/237: write d15/d19/d24/f25 [207796,120625] 0 2024-04-25T01:45:34.758 INFO:tasks.workunit.client.0.smithi162.stdout:6/209: creat d1/f3f x:0 0 0 2024-04-25T01:45:34.938 INFO:tasks.workunit.client.0.smithi162.stdout:5/238: sync 2024-04-25T01:45:35.188 INFO:tasks.workunit.client.0.smithi162.stdout:7/231: link df/c44 df/c46 0 2024-04-25T01:45:35.686 INFO:tasks.workunit.client.0.smithi162.stdout:0/279: rename d0/df/d20/d25/d51/c50 to d0/d1/d4b/c56 0 2024-04-25T01:45:36.005 INFO:tasks.workunit.client.0.smithi162.stdout:8/228: mknod d0/d44/d31/d33/c4d 0 2024-04-25T01:45:36.141 INFO:tasks.workunit.client.0.smithi162.stdout:6/210: mknod d1/d13/d28/d30/d3a/c40 0 2024-04-25T01:45:36.577 INFO:tasks.workunit.client.0.smithi162.stdout:9/202: dwrite d4/d9/d15/d1b/d2f/d30/f44 [0,4194304] 0 2024-04-25T01:45:36.809 INFO:tasks.workunit.client.0.smithi162.stdout:0/280: chown d0/df/d20/d25/d51/l30 3 1 2024-04-25T01:45:36.940 INFO:tasks.workunit.client.0.smithi162.stdout:1/252: getdents d15/d1f 0 2024-04-25T01:45:36.995 INFO:tasks.workunit.client.0.smithi162.stdout:2/228: dwrite d0/d3/d1b/d1d/d20/d42/f43 [0,4194304] 0 2024-04-25T01:45:37.096 INFO:tasks.workunit.client.0.smithi162.stdout:8/229: truncate d0/d1a/f28 1103683 0 2024-04-25T01:45:37.183 INFO:tasks.workunit.client.0.smithi162.stdout:0/281: read d0/df/d20/f31 [2964357,9751] 0 2024-04-25T01:45:37.312 INFO:tasks.workunit.client.0.smithi162.stdout:5/239: symlink d15/d19/l48 0 2024-04-25T01:45:37.969 INFO:tasks.workunit.client.0.smithi162.stdout:8/230: fsync d0/d1a/f32 0 2024-04-25T01:45:38.075 INFO:tasks.workunit.client.0.smithi162.stdout:2/229: truncate d0/ff 4128320 0 2024-04-25T01:45:38.323 INFO:tasks.workunit.client.0.smithi162.stdout:5/240: mknod d15/d19/d24/d2b/d3b/c49 0 2024-04-25T01:45:38.434 INFO:tasks.workunit.client.0.smithi162.stdout:9/203: mkdir d4/d9/d15/d4e 0 2024-04-25T01:45:38.480 INFO:tasks.workunit.client.0.smithi162.stdout:4/240: dwrite dd/f33 [0,4194304] 0 2024-04-25T01:45:38.973 INFO:tasks.workunit.client.0.smithi162.stdout:3/246: dwrite d2/d29/d2e/f31 [0,4194304] 0 2024-04-25T01:45:39.209 INFO:tasks.workunit.client.0.smithi162.stdout:2/230: mknod d0/d3/d1b/d1d/c52 0 2024-04-25T01:45:39.492 INFO:tasks.workunit.client.0.smithi162.stdout:5/241: read d15/d1e/f22 [3167352,48106] 0 2024-04-25T01:45:39.614 INFO:tasks.workunit.client.0.smithi162.stdout:4/241: mkdir dd/df/d58 0 2024-04-25T01:45:39.823 INFO:tasks.workunit.client.0.smithi162.stdout:7/232: dwrite df/d2c/f3f [0,4194304] 0 2024-04-25T01:45:39.952 INFO:tasks.workunit.client.0.smithi162.stdout:3/247: creat d2/d9/d17/f52 x:0 0 0 2024-04-25T01:45:40.006 INFO:tasks.workunit.client.0.smithi162.stdout:4/242: dread fb [0,4194304] 0 2024-04-25T01:45:40.410 INFO:tasks.workunit.client.0.smithi162.stdout:7/233: creat df/d2c/f47 x:0 0 0 2024-04-25T01:45:40.566 INFO:tasks.workunit.client.0.smithi162.stdout:3/248: creat d2/d9/d10/d4c/f53 x:0 0 0 2024-04-25T01:45:40.659 INFO:tasks.workunit.client.0.smithi162.stdout:4/243: fdatasync dd/d1a/f21 0 2024-04-25T01:45:41.100 INFO:tasks.workunit.client.0.smithi162.stdout:1/253: write d15/d1f/f2d [3175864,15964] 0 2024-04-25T01:45:41.143 INFO:tasks.workunit.client.0.smithi162.stdout:3/249: dread - d2/d29/f46 zero size 2024-04-25T01:45:41.225 INFO:tasks.workunit.client.0.smithi162.stdout:3/250: fdatasync d2/d9/d10/d4c/f53 0 2024-04-25T01:45:41.247 INFO:tasks.workunit.client.0.smithi162.stdout:3/251: readlink d2/d9/l16 0 2024-04-25T01:45:41.437 INFO:tasks.workunit.client.0.smithi162.stdout:4/244: truncate dd/df/f30 3874260 0 2024-04-25T01:45:41.467 INFO:tasks.workunit.client.0.smithi162.stdout:0/282: write d0/df/d20/f45 [392847,76376] 0 2024-04-25T01:45:41.663 INFO:tasks.workunit.client.0.smithi162.stdout:7/234: truncate df/f33 209916 0 2024-04-25T01:45:41.838 INFO:tasks.workunit.client.0.smithi162.stdout:8/231: dwrite d0/d1a/d25/f36 [0,4194304] 0 2024-04-25T01:45:41.973 INFO:tasks.workunit.client.0.smithi162.stdout:3/252: rename d2/d9/d10/d2c/f32 to d2/d9/d10/f54 0 2024-04-25T01:45:41.975 INFO:tasks.workunit.client.0.smithi162.stdout:4/245: mkdir dd/df/d2e/d59 0 2024-04-25T01:45:42.006 INFO:tasks.workunit.client.0.smithi162.stdout:8/232: stat d0/c3 0 2024-04-25T01:45:42.065 INFO:tasks.workunit.client.0.smithi162.stdout:3/253: dread - d2/d9/d10/d4c/f53 zero size 2024-04-25T01:45:42.562 INFO:tasks.workunit.client.0.smithi162.stdout:1/254: symlink d15/l54 0 2024-04-25T01:45:42.728 INFO:tasks.workunit.client.0.smithi162.stdout:4/246: dread - dd/d1a/f48 zero size 2024-04-25T01:45:42.788 INFO:tasks.workunit.client.0.smithi162.stdout:9/204: dwrite d4/d9/d15/f23 [0,4194304] 0 2024-04-25T01:45:42.935 INFO:tasks.workunit.client.0.smithi162.stdout:3/254: mknod d2/d29/d2e/c55 0 2024-04-25T01:45:43.287 INFO:tasks.workunit.client.0.smithi162.stdout:5/242: dwrite f11 [0,4194304] 0 2024-04-25T01:45:43.436 INFO:tasks.workunit.client.0.smithi162.stdout:5/243: stat d15/l18 0 2024-04-25T01:45:43.549 INFO:tasks.workunit.client.0.smithi162.stdout:9/205: fdatasync d4/d9/d15/d1b/f29 0 2024-04-25T01:45:43.594 INFO:tasks.workunit.client.0.smithi162.stdout:2/231: link d0/d3/d1b/d1d/c46 d0/d3/c53 0 2024-04-25T01:45:43.672 INFO:tasks.workunit.client.0.smithi162.stdout:4/247: truncate dd/d1a/d34/f41 59725 0 2024-04-25T01:45:43.764 INFO:tasks.workunit.client.0.smithi162.stdout:1/255: rename d15/d1f/d23/d30/d4a/c4b to d15/d1f/d35/c55 0 2024-04-25T01:45:43.822 INFO:tasks.workunit.client.0.smithi162.stdout:1/256: dread d15/f1b [0,4194304] 0 2024-04-25T01:45:44.081 INFO:tasks.workunit.client.0.smithi162.stdout:5/244: unlink d15/d19/l48 0 2024-04-25T01:45:44.371 INFO:tasks.workunit.client.0.smithi162.stdout:6/211: mknod d1/c41 0 2024-04-25T01:45:45.166 INFO:tasks.workunit.client.0.smithi162.stdout:3/255: creat d2/d9/f56 x:0 0 0 2024-04-25T01:45:45.499 INFO:tasks.workunit.client.0.smithi162.stdout:6/212: creat d1/d13/f42 x:0 0 0 2024-04-25T01:45:45.821 INFO:tasks.workunit.client.0.smithi162.stdout:0/283: dwrite d0/df/d20/d37/f36 [0,4194304] 0 2024-04-25T01:45:45.944 INFO:tasks.workunit.client.0.smithi162.stdout:3/256: fdatasync d2/d29/f2a 0 2024-04-25T01:45:45.972 INFO:tasks.workunit.client.0.smithi162.stdout:7/235: write df/f43 [1046203,101295] 0 2024-04-25T01:45:46.130 INFO:tasks.workunit.client.0.smithi162.stdout:6/213: mknod d1/d13/d28/d30/d3a/c43 0 2024-04-25T01:45:46.181 INFO:tasks.workunit.client.0.smithi162.stdout:9/206: getdents d4 0 2024-04-25T01:45:46.310 INFO:tasks.workunit.client.0.smithi162.stdout:8/233: dwrite d0/d44/d31/f2a [0,4194304] 0 2024-04-25T01:45:46.708 INFO:tasks.workunit.client.0.smithi162.stdout:0/284: creat d0/df/d20/d37/f57 x:0 0 0 2024-04-25T01:45:46.863 INFO:tasks.workunit.client.0.smithi162.stdout:9/207: chown d4/d9/l2b 1 1 2024-04-25T01:45:46.886 INFO:tasks.workunit.client.0.smithi162.stdout:6/214: dwrite d1/d13/f42 [0,4194304] 0 2024-04-25T01:45:47.381 INFO:tasks.workunit.client.0.smithi162.stdout:4/248: rename dd/d1a/d34/f41 to dd/df/d58/f5a 0 2024-04-25T01:45:47.497 INFO:tasks.workunit.client.0.smithi162.stdout:8/234: read d0/d1a/f28 [1075782,123322] 0 2024-04-25T01:45:47.781 INFO:tasks.workunit.client.0.smithi162.stdout:0/285: mkdir d0/df/d20/d37/d58 0 2024-04-25T01:45:47.800 INFO:tasks.workunit.client.0.smithi162.stdout:9/208: symlink d4/d9/d15/d1b/l4f 0 2024-04-25T01:45:48.182 INFO:tasks.workunit.client.0.smithi162.stdout:2/232: dwrite d0/d3/d5/d36/f37 [4194304,4194304] 0 2024-04-25T01:45:48.444 INFO:tasks.workunit.client.0.smithi162.stdout:4/249: symlink dd/d1a/l5b 0 2024-04-25T01:45:48.474 INFO:tasks.workunit.client.0.smithi162.stdout:1/257: dwrite d15/d1f/d23/f48 [0,4194304] 0 2024-04-25T01:45:48.701 INFO:tasks.workunit.client.0.smithi162.stdout:1/258: sync 2024-04-25T01:45:48.884 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:45:48.887 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:45:48.936 INFO:tasks.workunit.client.0.smithi162.stdout:5/245: dwrite d15/d19/d24/d2b/f2c [0,4194304] 0 2024-04-25T01:45:48.942 INFO:tasks.workunit.client.0.smithi162.stdout:9/209: fsync d4/d9/d15/d1b/f29 0 2024-04-25T01:45:49.090 INFO:tasks.workunit.client.0.smithi162.stdout:9/210: chown d4/f21 1498309222 1 2024-04-25T01:45:49.124 INFO:tasks.workunit.client.0.smithi162.stdout:2/233: creat d0/d3/d1b/d1d/d20/f54 x:0 0 0 2024-04-25T01:45:49.557 INFO:tasks.workunit.client.0.smithi162.stdout:7/236: write df/f1b [1349830,57647] 0 2024-04-25T01:45:49.646 INFO:tasks.workunit.client.0.smithi162.stdout:5/246: mknod d15/d19/d24/c4a 0 2024-04-25T01:45:50.181 INFO:tasks.workunit.client.0.smithi162.stdout:8/235: rename d0/d44/d31/f2a to d0/d12/f4e 0 2024-04-25T01:45:50.358 INFO:tasks.workunit.client.0.smithi162.stdout:3/257: write d2/d9/d10/f54 [4741718,127733] 0 2024-04-25T01:45:50.924 INFO:tasks.workunit.client.0.smithi162.stdout:8/236: fdatasync d0/d12/f23 0 2024-04-25T01:45:50.968 INFO:tasks.workunit.client.0.smithi162.stdout:6/215: write d1/d13/d28/f2f [3400021,71527] 0 2024-04-25T01:45:51.020 INFO:tasks.workunit.client.0.smithi162.stdout:7/237: creat df/d2e/f48 x:0 0 0 2024-04-25T01:45:51.291 INFO:tasks.workunit.client.0.smithi162.stdout:3/258: creat d2/d9/d10/d4c/f57 x:0 0 0 2024-04-25T01:45:51.573 INFO:tasks.workunit.client.0.smithi162.stdout:2/234: link d0/d3/d5/l32 d0/d49/d27/l55 0 2024-04-25T01:45:51.659 INFO:tasks.workunit.client.0.smithi162.stdout:2/235: truncate d0/d3/d1b/d1d/d20/f54 723202 0 2024-04-25T01:45:51.973 INFO:tasks.workunit.client.0.smithi162.stdout:8/237: fsync d0/d12/f2e 0 2024-04-25T01:45:51.976 INFO:tasks.workunit.client.0.smithi162.stdout:7/238: mkdir df/d2c/d49 0 2024-04-25T01:45:52.226 INFO:tasks.workunit.client.0.smithi162.stdout:6/216: creat d1/d13/d28/d30/d3a/f44 x:0 0 0 2024-04-25T01:45:52.617 INFO:tasks.workunit.client.0.smithi162.stdout:1/259: rename d15/d1f/d23/d30/f3c to d15/d1f/d23/f56 0 2024-04-25T01:45:52.636 INFO:tasks.workunit.client.0.smithi162.stdout:1/260: dread - d15/f1a zero size 2024-04-25T01:45:52.783 INFO:tasks.workunit.client.0.smithi162.stdout:1/261: dread d15/d1f/d23/f48 [0,4194304] 0 2024-04-25T01:45:52.815 INFO:tasks.workunit.client.0.smithi162.stdout:1/262: chown d15/f1a 18926 1 2024-04-25T01:45:53.120 INFO:tasks.workunit.client.0.smithi162.stdout:7/239: symlink df/d2c/l4a 0 2024-04-25T01:45:53.403 INFO:tasks.workunit.client.0.smithi162.stdout:4/250: dwrite dd/df/f10 [0,4194304] 0 2024-04-25T01:45:53.906 INFO:tasks.workunit.client.0.smithi162.stdout:9/211: dwrite d4/d8/d13/f27 [0,4194304] 0 2024-04-25T01:45:54.206 INFO:tasks.workunit.client.0.smithi162.stdout:7/240: dread df/f13 [0,4194304] 0 2024-04-25T01:45:54.401 INFO:tasks.workunit.client.0.smithi162.stdout:5/247: dwrite d15/d19/d24/f2d [0,4194304] 0 2024-04-25T01:45:54.730 INFO:tasks.workunit.client.0.smithi162.stdout:0/286: mkdir d0/d59 0 2024-04-25T01:45:54.757 INFO:tasks.workunit.client.0.smithi162.stdout:3/259: getdents d2/d9/d10/d2c 0 2024-04-25T01:45:54.829 INFO:tasks.workunit.client.0.smithi162.stdout:3/260: rename d2/d9/d19 to d2/d9/d19/d3f/d58 22 2024-04-25T01:45:55.128 INFO:tasks.workunit.client.0.smithi162.stdout:4/251: symlink dd/d1a/d34/d57/l5c 0 2024-04-25T01:45:55.302 INFO:tasks.workunit.client.0.smithi162.stdout:1/263: creat d15/d1f/d23/f57 x:0 0 0 2024-04-25T01:45:55.380 INFO:tasks.workunit.client.0.smithi162.stdout:5/248: creat d15/d19/d24/d40/f4b x:0 0 0 2024-04-25T01:45:55.944 INFO:tasks.workunit.client.0.smithi162.stdout:3/261: mknod d2/d9/d10/d40/c59 0 2024-04-25T01:45:56.313 INFO:tasks.workunit.client.0.smithi162.stdout:7/241: mknod df/d2c/d49/c4b 0 2024-04-25T01:45:56.459 INFO:tasks.workunit.client.0.smithi162.stdout:5/249: rmdir d15/d19/d24/d2b/d3b 39 2024-04-25T01:45:56.639 INFO:tasks.workunit.client.0.smithi162.stdout:3/262: truncate d2/d29/f2a 330445 0 2024-04-25T01:45:56.881 INFO:tasks.workunit.client.0.smithi162.stdout:7/242: mkdir df/d2e/d4c 0 2024-04-25T01:45:56.902 INFO:tasks.workunit.client.0.smithi162.stdout:8/238: write d0/d1a/f28 [976697,90426] 0 2024-04-25T01:45:57.372 INFO:tasks.workunit.client.0.smithi162.stdout:6/217: dwrite d1/d13/d28/f2e [0,4194304] 0 2024-04-25T01:45:57.380 INFO:tasks.workunit.client.0.smithi162.stdout:9/212: getdents d4/d8/d13/d38 0 2024-04-25T01:45:57.514 INFO:tasks.workunit.client.0.smithi162.stdout:4/252: link dd/df/d2e/c4a dd/d1a/d34/c5d 0 2024-04-25T01:45:57.567 INFO:tasks.workunit.client.0.smithi162.stdout:6/218: chown d1/l31 60216 1 2024-04-25T01:45:57.818 INFO:tasks.workunit.client.0.smithi162.stdout:5/250: rename c10 to d15/d19/d24/d2b/d3b/c4c 0 2024-04-25T01:45:57.957 INFO:tasks.workunit.client.0.smithi162.stdout:1/264: getdents d15/d1f/d23/d30/d4a 0 2024-04-25T01:45:58.247 INFO:tasks.workunit.client.0.smithi162.stdout:6/219: dread - d1/d13/d28/d30/f33 zero size 2024-04-25T01:45:58.651 INFO:tasks.workunit.client.0.smithi162.stdout:6/220: dread d1/d13/d28/d30/d3a/f3c [0,4194304] 0 2024-04-25T01:45:58.706 INFO:tasks.workunit.client.0.smithi162.stdout:5/251: mkdir d15/d19/d24/d4d 0 2024-04-25T01:45:58.816 INFO:tasks.workunit.client.0.smithi162.stdout:1/265: creat d15/d1f/d23/d30/d4a/f58 x:0 0 0 2024-04-25T01:45:58.970 INFO:tasks.workunit.client.0.smithi162.stdout:4/253: mknod dd/df/d2e/d59/c5e 0 2024-04-25T01:45:59.067 INFO:tasks.workunit.client.0.smithi162.stdout:4/254: dread dd/df/d2e/f35 [0,4194304] 0 2024-04-25T01:45:59.069 INFO:tasks.workunit.client.0.smithi162.stdout:1/266: sync 2024-04-25T01:45:59.463 INFO:tasks.workunit.client.0.smithi162.stdout:5/252: symlink d15/d19/d24/d40/l4e 0 2024-04-25T01:45:59.647 INFO:tasks.workunit.client.0.smithi162.stdout:8/239: getdents d0 0 2024-04-25T01:45:59.663 INFO:tasks.workunit.client.0.smithi162.stdout:0/287: write d0/df/d20/f45 [1011015,44129] 0 2024-04-25T01:45:59.790 INFO:tasks.workunit.client.0.smithi162.stdout:0/288: readlink d0/df/d20/d25/l42 0 2024-04-25T01:45:59.899 INFO:tasks.workunit.client.0.smithi162.stdout:1/267: dread d15/d1f/f33 [0,4194304] 0 2024-04-25T01:45:59.920 INFO:tasks.workunit.client.0.smithi162.stdout:4/255: mknod dd/df/d58/c5f 0 2024-04-25T01:46:00.607 INFO:tasks.workunit.client.0.smithi162.stdout:1/268: dread - d15/d1f/d23/f56 zero size 2024-04-25T01:46:00.723 INFO:tasks.workunit.client.0.smithi162.stdout:4/256: chown dd/df/d2e/f3d 1627283462 1 2024-04-25T01:46:01.166 INFO:tasks.workunit.client.0.smithi162.stdout:6/221: getdents d1/d13/d28/d30/d3a 0 2024-04-25T01:46:01.297 INFO:tasks.workunit.client.0.smithi162.stdout:1/269: symlink d15/d1f/l59 0 2024-04-25T01:46:01.366 INFO:tasks.workunit.client.0.smithi162.stdout:3/263: write d2/d9/f49 [2400353,111322] 0 2024-04-25T01:46:01.396 INFO:tasks.workunit.client.0.smithi162.stdout:3/264: stat d2/f26 0 2024-04-25T01:46:01.443 INFO:tasks.workunit.client.0.smithi162.stdout:3/265: write d2/d29/d2e/f3a [3523440,100403] 0 2024-04-25T01:46:01.471 INFO:tasks.workunit.client.0.smithi162.stdout:7/243: write df/f2a [356727,14262] 0 2024-04-25T01:46:01.547 INFO:tasks.workunit.client.0.smithi162.stdout:4/257: rename dd/d1a/c25 to dd/df/d2e/d4b/c60 0 2024-04-25T01:46:01.712 INFO:tasks.workunit.client.0.smithi162.stdout:8/240: link d0/d12/d1b/f43 d0/d44/d31/d33/f4f 0 2024-04-25T01:46:01.887 INFO:tasks.workunit.client.0.smithi162.stdout:1/270: creat d15/d1f/d23/d30/f5a x:0 0 0 2024-04-25T01:46:02.121 INFO:tasks.workunit.client.0.smithi162.stdout:9/213: dwrite d4/d8/f10 [0,4194304] 0 2024-04-25T01:46:02.248 INFO:tasks.workunit.client.0.smithi162.stdout:8/241: fdatasync d0/d44/f1c 0 2024-04-25T01:46:03.224 INFO:tasks.workunit.client.0.smithi162.stdout:2/236: creat d0/d3/d1b/f56 x:0 0 0 2024-04-25T01:46:03.228 INFO:tasks.workunit.client.0.smithi162.stdout:8/242: truncate d0/f18 5251406 0 2024-04-25T01:46:03.658 INFO:tasks.workunit.client.0.smithi162.stdout:8/243: creat d0/d12/d1b/f50 x:0 0 0 2024-04-25T01:46:03.775 INFO:tasks.workunit.client.0.smithi162.stdout:8/244: sync 2024-04-25T01:46:04.154 INFO:tasks.workunit.client.0.smithi162.stdout:3/266: getdents d2/d9/d10/d4c/d51 0 2024-04-25T01:46:04.234 INFO:tasks.workunit.client.0.smithi162.stdout:3/267: sync 2024-04-25T01:46:04.442 INFO:tasks.workunit.client.0.smithi162.stdout:5/253: dwrite d15/d19/f20 [0,4194304] 0 2024-04-25T01:46:04.609 INFO:tasks.workunit.client.0.smithi162.stdout:2/237: dread d0/d3/d1b/f22 [0,4194304] 0 2024-04-25T01:46:05.057 INFO:tasks.workunit.client.0.smithi162.stdout:7/244: write f1 [5182759,64815] 0 2024-04-25T01:46:05.208 INFO:tasks.workunit.client.0.smithi162.stdout:0/289: dwrite d0/df/d20/f3a [0,4194304] 0 2024-04-25T01:46:05.368 INFO:tasks.workunit.client.0.smithi162.stdout:2/238: chown d0/l4b 6 1 2024-04-25T01:46:05.396 INFO:tasks.workunit.client.0.smithi162.stdout:9/214: creat d4/f50 x:0 0 0 2024-04-25T01:46:05.493 INFO:tasks.workunit.client.0.smithi162.stdout:6/222: dwrite d1/d13/f1f [0,4194304] 0 2024-04-25T01:46:05.714 INFO:tasks.workunit.client.0.smithi162.stdout:0/290: readlink d0/l48 0 2024-04-25T01:46:05.929 INFO:tasks.workunit.client.0.smithi162.stdout:5/254: mknod d15/d19/d24/d2b/d3b/d3c/d3f/c4f 0 2024-04-25T01:46:06.044 INFO:tasks.workunit.client.0.smithi162.stdout:1/271: dwrite d15/f1a [0,4194304] 0 2024-04-25T01:46:06.185 INFO:tasks.workunit.client.0.smithi162.stdout:4/258: dwrite dd/df/f30 [0,4194304] 0 2024-04-25T01:46:06.268 INFO:tasks.workunit.client.0.smithi162.stdout:8/245: getdents d0 0 2024-04-25T01:46:06.284 INFO:tasks.workunit.client.0.smithi162.stdout:0/291: dread - d0/d1/f3c zero size 2024-04-25T01:46:06.345 INFO:tasks.workunit.client.0.smithi162.stdout:3/268: link d2/d9/d19/c20 d2/d9/d17/c5a 0 2024-04-25T01:46:06.353 INFO:tasks.workunit.client.0.smithi162.stdout:6/223: rmdir d1/d13/d28 39 2024-04-25T01:46:06.411 INFO:tasks.workunit.client.0.smithi162.stdout:7/245: rename fd to df/f4d 0 2024-04-25T01:46:06.467 INFO:tasks.workunit.client.0.smithi162.stdout:3/269: sync 2024-04-25T01:46:06.740 INFO:tasks.workunit.client.0.smithi162.stdout:1/272: truncate d15/f21 100385 0 2024-04-25T01:46:06.848 INFO:tasks.workunit.client.0.smithi162.stdout:8/246: read d0/d44/f15 [3233604,81772] 0 2024-04-25T01:46:07.073 INFO:tasks.workunit.client.0.smithi162.stdout:2/239: write d0/d3/d1b/d1d/d3a/f40 [1130466,28770] 0 2024-04-25T01:46:07.080 INFO:tasks.workunit.client.0.smithi162.stdout:5/255: write d15/d19/d24/f25 [2548011,125441] 0 2024-04-25T01:46:07.304 INFO:tasks.workunit.client.0.smithi162.stdout:0/292: write d0/df/f1b [3739605,93722] 0 2024-04-25T01:46:07.386 INFO:tasks.workunit.client.0.smithi162.stdout:6/224: mkdir d1/d13/d28/d45 0 2024-04-25T01:46:07.477 INFO:tasks.workunit.client.0.smithi162.stdout:4/259: dwrite dd/d1a/f48 [0,4194304] 0 2024-04-25T01:46:07.618 INFO:tasks.workunit.client.0.smithi162.stdout:7/246: rename df/c38 to df/d2e/c4e 0 2024-04-25T01:46:07.676 INFO:tasks.workunit.client.0.smithi162.stdout:6/225: write d1/f21 [1230177,52414] 0 2024-04-25T01:46:07.702 INFO:tasks.workunit.client.0.smithi162.stdout:8/247: creat d0/d44/d31/f51 x:0 0 0 2024-04-25T01:46:07.872 INFO:tasks.workunit.client.0.smithi162.stdout:9/215: creat d4/d8/f51 x:0 0 0 2024-04-25T01:46:08.101 INFO:tasks.workunit.client.0.smithi162.stdout:0/293: dread d0/df/f1b [0,4194304] 0 2024-04-25T01:46:08.147 INFO:tasks.workunit.client.0.smithi162.stdout:1/273: write d15/f3f [641463,126844] 0 2024-04-25T01:46:08.857 INFO:tasks.workunit.client.0.smithi162.stdout:7/247: write df/f4d [5094996,94481] 0 2024-04-25T01:46:09.043 INFO:tasks.workunit.client.0.smithi162.stdout:4/260: mknod dd/d1a/d34/c61 0 2024-04-25T01:46:09.278 INFO:tasks.workunit.client.0.smithi162.stdout:7/248: dwrite df/d2c/f3e [4194304,4194304] 0 2024-04-25T01:46:09.392 INFO:tasks.workunit.client.0.smithi162.stdout:7/249: stat df/d2c/c39 0 2024-04-25T01:46:09.410 INFO:tasks.workunit.client.0.smithi162.stdout:7/250: fdatasync f6 0 2024-04-25T01:46:09.630 INFO:tasks.workunit.client.0.smithi162.stdout:6/226: mkdir d1/d46 0 2024-04-25T01:46:09.634 INFO:tasks.workunit.client.0.smithi162.stdout:0/294: dread - d0/df/d20/f40 zero size 2024-04-25T01:46:09.639 INFO:tasks.workunit.client.0.smithi162.stdout:1/274: dread - d15/d1f/d23/d30/d4a/f58 zero size 2024-04-25T01:46:09.734 INFO:tasks.workunit.client.0.smithi162.stdout:9/216: readlink d4/d9/d15/d1b/d2f/d30/l41 0 2024-04-25T01:46:09.872 INFO:tasks.workunit.client.0.smithi162.stdout:8/248: mknod d0/d12/d2b/c52 0 2024-04-25T01:46:09.992 INFO:tasks.workunit.client.0.smithi162.stdout:4/261: symlink dd/df/d2e/d4b/l62 0 2024-04-25T01:46:10.010 INFO:tasks.workunit.client.0.smithi162.stdout:3/270: write d2/d9/d17/f2f [1761206,81095] 0 2024-04-25T01:46:10.275 INFO:tasks.workunit.client.0.smithi162.stdout:5/256: creat d15/f50 x:0 0 0 2024-04-25T01:46:10.757 INFO:tasks.workunit.client.0.smithi162.stdout:1/275: mknod d15/d1f/d35/c5b 0 2024-04-25T01:46:10.757 INFO:tasks.workunit.client.0.smithi162.stdout:7/251: dread df/d2c/f3c [0,4194304] 0 2024-04-25T01:46:10.757 INFO:tasks.workunit.client.0.smithi162.stdout:5/257: dread d15/d19/f1b [0,4194304] 0 2024-04-25T01:46:10.757 INFO:tasks.workunit.client.0.smithi162.stdout:1/276: sync 2024-04-25T01:46:10.757 INFO:tasks.workunit.client.0.smithi162.stdout:9/217: fsync d4/d8/d13/d38/f4c 0 2024-04-25T01:46:10.844 INFO:tasks.workunit.client.0.smithi162.stdout:0/295: dread d0/df/d20/d37/f36 [0,4194304] 0 2024-04-25T01:46:11.044 INFO:tasks.workunit.client.0.smithi162.stdout:2/240: dwrite d0/d3/d1b/d1d/d20/d42/f43 [0,4194304] 0 2024-04-25T01:46:11.644 INFO:tasks.workunit.client.0.smithi162.stdout:9/218: unlink d4/d9/d15/d1b/d2f/d30/f44 0 2024-04-25T01:46:11.783 INFO:tasks.workunit.client.0.smithi162.stdout:3/271: unlink d2/d9/l27 0 2024-04-25T01:46:11.791 INFO:tasks.workunit.client.0.smithi162.stdout:5/258: truncate d15/d19/f35 575249 0 2024-04-25T01:46:11.821 INFO:tasks.workunit.client.0.smithi162.stdout:5/259: chown ca 3034617 1 2024-04-25T01:46:12.051 INFO:tasks.workunit.client.0.smithi162.stdout:7/252: creat df/d2e/d4c/f4f x:0 0 0 2024-04-25T01:46:12.087 INFO:tasks.workunit.client.0.smithi162.stdout:7/253: chown df/d2c/l31 29 1 2024-04-25T01:46:12.299 INFO:tasks.workunit.client.0.smithi162.stdout:3/272: creat d2/d9/d10/d40/f5b x:0 0 0 2024-04-25T01:46:12.503 INFO:tasks.workunit.client.0.smithi162.stdout:0/296: creat d0/df/d20/d25/d55/f5a x:0 0 0 2024-04-25T01:46:13.225 INFO:tasks.workunit.client.0.smithi162.stdout:6/227: dwrite d1/f25 [0,4194304] 0 2024-04-25T01:46:13.347 INFO:tasks.workunit.client.0.smithi162.stdout:3/273: dread - d2/d9/f56 zero size 2024-04-25T01:46:13.417 INFO:tasks.workunit.client.0.smithi162.stdout:0/297: creat d0/df/d20/d37/f5b x:0 0 0 2024-04-25T01:46:13.464 INFO:tasks.workunit.client.0.smithi162.stdout:6/228: stat d1/d13/f20 0 2024-04-25T01:46:13.767 INFO:tasks.workunit.client.0.smithi162.stdout:8/249: dwrite d0/d12/f2e [0,4194304] 0 2024-04-25T01:46:14.278 INFO:tasks.workunit.client.0.smithi162.stdout:9/219: rename d4/f50 to d4/f52 0 2024-04-25T01:46:14.332 INFO:tasks.workunit.client.0.smithi162.stdout:4/262: dwrite dd/f3a [0,4194304] 0 2024-04-25T01:46:14.392 INFO:tasks.workunit.client.0.smithi162.stdout:9/220: sync 2024-04-25T01:46:14.698 INFO:tasks.workunit.client.0.smithi162.stdout:3/274: dread d2/f25 [0,4194304] 0 2024-04-25T01:46:14.760 INFO:tasks.workunit.client.0.smithi162.stdout:0/298: creat d0/df/d20/d25/d55/f5c x:0 0 0 2024-04-25T01:46:14.772 INFO:tasks.workunit.client.0.smithi162.stdout:1/277: dwrite d15/f1b [0,4194304] 0 2024-04-25T01:46:14.780 INFO:tasks.workunit.client.0.smithi162.stdout:5/260: write f3 [1899664,39116] 0 2024-04-25T01:46:15.001 INFO:tasks.workunit.client.0.smithi162.stdout:2/241: write d0/d3/d5/d36/f4e [5057006,40076] 0 2024-04-25T01:46:15.107 INFO:tasks.workunit.client.0.smithi162.stdout:4/263: dread fc [4194304,4194304] 0 2024-04-25T01:46:15.236 INFO:tasks.workunit.client.0.smithi162.stdout:9/221: read d4/d9/d15/d1b/d2f/d30/f3d [2062678,36205] 0 2024-04-25T01:46:15.291 INFO:tasks.workunit.client.0.smithi162.stdout:2/242: chown d0/d3/d1b/d1d/d20/l44 271 1 2024-04-25T01:46:15.568 INFO:tasks.workunit.client.0.smithi162.stdout:6/229: write d1/d13/f42 [2591636,125499] 0 2024-04-25T01:46:16.144 INFO:tasks.workunit.client.0.smithi162.stdout:3/275: creat d2/d9/d10/d2c/f5c x:0 0 0 2024-04-25T01:46:16.159 INFO:tasks.workunit.client.0.smithi162.stdout:1/278: unlink d15/d1f/d35/l36 0 2024-04-25T01:46:16.189 INFO:tasks.workunit.client.0.smithi162.stdout:5/261: rmdir d15/d19/d24/d2b/d3b/d3c/d3f 39 2024-04-25T01:46:16.219 INFO:tasks.workunit.client.0.smithi162.stdout:9/222: fdatasync d4/d8/f2d 0 2024-04-25T01:46:16.221 INFO:tasks.workunit.client.0.smithi162.stdout:4/264: truncate dd/d1a/f20 1041189 0 2024-04-25T01:46:16.260 INFO:tasks.workunit.client.0.smithi162.stdout:2/243: mkdir d0/d3/d1b/d1d/d20/d42/d57 0 2024-04-25T01:46:16.733 INFO:tasks.workunit.client.0.smithi162.stdout:3/276: mkdir d2/d29/d5d 0 2024-04-25T01:46:16.755 INFO:tasks.workunit.client.0.smithi162.stdout:0/299: write d0/df/f14 [2328540,125965] 0 2024-04-25T01:46:17.001 INFO:tasks.workunit.client.0.smithi162.stdout:7/254: link ce df/c50 0 2024-04-25T01:46:17.262 INFO:tasks.workunit.client.0.smithi162.stdout:8/250: dwrite d0/d12/d1b/f43 [0,4194304] 0 2024-04-25T01:46:17.530 INFO:tasks.workunit.client.0.smithi162.stdout:2/244: write d0/d3/d1b/d1d/d20/d42/f43 [2730615,110672] 0 2024-04-25T01:46:17.557 INFO:tasks.workunit.client.0.smithi162.stdout:8/251: dread d0/d12/f4e [0,4194304] 0 2024-04-25T01:46:17.602 INFO:tasks.workunit.client.0.smithi162.stdout:6/230: creat d1/d46/f47 x:0 0 0 2024-04-25T01:46:17.640 INFO:tasks.workunit.client.0.smithi162.stdout:6/231: chown c0 833 1 2024-04-25T01:46:18.076 INFO:tasks.workunit.client.0.smithi162.stdout:3/277: creat d2/d29/d2e/f5e x:0 0 0 2024-04-25T01:46:18.544 INFO:tasks.workunit.client.0.smithi162.stdout:5/262: creat d15/d19/d24/d2b/d3b/d3c/d3f/f51 x:0 0 0 2024-04-25T01:46:18.560 INFO:tasks.workunit.client.0.smithi162.stdout:7/255: truncate df/f17 4576430 0 2024-04-25T01:46:18.578 INFO:tasks.workunit.client.0.smithi162.stdout:2/245: unlink d0/d3/d1b/l51 0 2024-04-25T01:46:18.989 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:46:18.992 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:46:19.053 INFO:tasks.workunit.client.0.smithi162.stdout:4/265: write dd/d1a/f26 [507971,94466] 0 2024-04-25T01:46:19.282 INFO:tasks.workunit.client.0.smithi162.stdout:7/256: truncate df/d2c/f3e 2715407 0 2024-04-25T01:46:19.346 INFO:tasks.workunit.client.0.smithi162.stdout:1/279: dwrite d15/d1f/d23/f56 [0,4194304] 0 2024-04-25T01:46:19.548 INFO:tasks.workunit.client.0.smithi162.stdout:0/300: write d0/df/d20/f40 [644139,20] 0 2024-04-25T01:46:19.750 INFO:tasks.workunit.client.0.smithi162.stdout:7/257: dread - df/d2c/f36 zero size 2024-04-25T01:46:19.811 INFO:tasks.workunit.client.0.smithi162.stdout:9/223: dwrite d4/d9/d15/d1b/d2f/d30/f3d [4194304,4194304] 0 2024-04-25T01:46:19.948 INFO:tasks.workunit.client.0.smithi162.stdout:2/246: dwrite d0/d3/d1b/d1d/d20/d42/f43 [0,4194304] 0 2024-04-25T01:46:19.987 INFO:tasks.workunit.client.0.smithi162.stdout:7/258: sync 2024-04-25T01:46:20.121 INFO:tasks.workunit.client.0.smithi162.stdout:7/259: readlink df/d2e/l3a 0 2024-04-25T01:46:20.304 INFO:tasks.workunit.client.0.smithi162.stdout:1/280: mkdir d15/d1f/d35/d5c 0 2024-04-25T01:46:20.499 INFO:tasks.workunit.client.0.smithi162.stdout:9/224: creat d4/d8/d13/f53 x:0 0 0 2024-04-25T01:46:20.703 INFO:tasks.workunit.client.0.smithi162.stdout:8/252: write d0/d44/d31/f3e [117480,64926] 0 2024-04-25T01:46:20.791 INFO:tasks.workunit.client.0.smithi162.stdout:7/260: symlink df/d2e/l51 0 2024-04-25T01:46:21.315 INFO:tasks.workunit.client.0.smithi162.stdout:5/263: write d15/f50 [707415,60200] 0 2024-04-25T01:46:21.473 INFO:tasks.workunit.client.0.smithi162.stdout:1/281: fdatasync d15/f3f 0 2024-04-25T01:46:21.882 INFO:tasks.workunit.client.0.smithi162.stdout:7/261: stat df/f28 0 2024-04-25T01:46:22.568 INFO:tasks.workunit.client.0.smithi162.stdout:1/282: write d15/f1b [3849111,74588] 0 2024-04-25T01:46:22.792 INFO:tasks.workunit.client.0.smithi162.stdout:7/262: truncate df/d2c/f3f 1638600 0 2024-04-25T01:46:22.932 INFO:tasks.workunit.client.0.smithi162.stdout:0/301: link d0/c8 d0/df/d20/d25/c5d 0 2024-04-25T01:46:22.954 INFO:tasks.workunit.client.0.smithi162.stdout:4/266: dwrite dd/f53 [0,4194304] 0 2024-04-25T01:46:23.087 INFO:tasks.workunit.client.0.smithi162.stdout:3/278: rename d2/d9/d10/f54 to d2/d9/f5f 0 2024-04-25T01:46:23.409 INFO:tasks.workunit.client.0.smithi162.stdout:2/247: write d0/d3/f16 [5194595,96389] 0 2024-04-25T01:46:23.886 INFO:tasks.workunit.client.0.smithi162.stdout:7/263: fdatasync df/d2e/f40 0 2024-04-25T01:46:24.000 INFO:tasks.workunit.client.0.smithi162.stdout:3/279: mknod d2/d9/d10/d4c/d51/c60 0 2024-04-25T01:46:24.013 INFO:tasks.workunit.client.0.smithi162.stdout:0/302: rename d0/df/d20/d25/l2d to d0/d1/l5e 0 2024-04-25T01:46:24.058 INFO:tasks.workunit.client.0.smithi162.stdout:3/280: chown d2/d9/f49 61896 1 2024-04-25T01:46:24.273 INFO:tasks.workunit.client.0.smithi162.stdout:2/248: unlink d0/d3/d5/d36/f4e 0 2024-04-25T01:46:24.374 INFO:tasks.workunit.client.0.smithi162.stdout:9/225: getdents d4/d9/d15/d1b/d2f/d30 0 2024-04-25T01:46:24.476 INFO:tasks.workunit.client.0.smithi162.stdout:1/283: mknod d15/d1f/d35/d4c/c5d 0 2024-04-25T01:46:24.533 INFO:tasks.workunit.client.0.smithi162.stdout:8/253: write d0/f11 [2197694,126190] 0 2024-04-25T01:46:24.900 INFO:tasks.workunit.client.0.smithi162.stdout:0/303: symlink d0/df/d20/d25/d55/l5f 0 2024-04-25T01:46:24.916 INFO:tasks.workunit.client.0.smithi162.stdout:3/281: mkdir d2/d9/d17/d61 0 2024-04-25T01:46:24.966 INFO:tasks.workunit.client.0.smithi162.stdout:3/282: chown d2/f26 5621063 1 2024-04-25T01:46:25.584 INFO:tasks.workunit.client.0.smithi162.stdout:1/284: readlink d15/d1f/d23/l4d 0 2024-04-25T01:46:25.686 INFO:tasks.workunit.client.0.smithi162.stdout:5/264: dwrite d15/d19/f34 [0,4194304] 0 2024-04-25T01:46:25.923 INFO:tasks.workunit.client.0.smithi162.stdout:8/254: truncate d0/d44/f38 679951 0 2024-04-25T01:46:25.937 INFO:tasks.workunit.client.0.smithi162.stdout:1/285: dread d15/f1b [0,4194304] 0 2024-04-25T01:46:25.995 INFO:tasks.workunit.client.0.smithi162.stdout:7/264: mkdir df/d52 0 2024-04-25T01:46:26.186 INFO:tasks.workunit.client.0.smithi162.stdout:0/304: creat d0/df/d20/d37/f60 x:0 0 0 2024-04-25T01:46:26.214 INFO:tasks.workunit.client.0.smithi162.stdout:0/305: chown d0/df 50 1 2024-04-25T01:46:26.250 INFO:tasks.workunit.client.0.smithi162.stdout:0/306: dread - d0/df/d20/d37/f60 zero size 2024-04-25T01:46:26.868 INFO:tasks.workunit.client.0.smithi162.stdout:6/232: link d1/d13/d28/d30/d3a/f44 d1/f48 0 2024-04-25T01:46:27.264 INFO:tasks.workunit.client.0.smithi162.stdout:4/267: dwrite dd/f16 [0,4194304] 0 2024-04-25T01:46:27.526 INFO:tasks.workunit.client.0.smithi162.stdout:0/307: fdatasync d0/d1/f12 0 2024-04-25T01:46:27.704 INFO:tasks.workunit.client.0.smithi162.stdout:5/265: dread d15/d1e/f27 [0,4194304] 0 2024-04-25T01:46:27.733 INFO:tasks.workunit.client.0.smithi162.stdout:9/226: link d4/d8/d13/f53 d4/d25/f54 0 2024-04-25T01:46:27.807 INFO:tasks.workunit.client.0.smithi162.stdout:9/227: truncate d4/d25/f54 239761 0 2024-04-25T01:46:28.228 INFO:tasks.workunit.client.0.smithi162.stdout:1/286: symlink d15/d1f/d32/d4f/l5e 0 2024-04-25T01:46:28.339 INFO:tasks.workunit.client.0.smithi162.stdout:3/283: creat d2/f62 x:0 0 0 2024-04-25T01:46:28.378 INFO:tasks.workunit.client.0.smithi162.stdout:2/249: write d0/d3/d1b/d1d/d20/f54 [937439,102557] 0 2024-04-25T01:46:28.786 INFO:tasks.workunit.client.0.smithi162.stdout:4/268: read dd/d1a/f26 [524694,73816] 0 2024-04-25T01:46:28.938 INFO:tasks.workunit.client.0.smithi162.stdout:0/308: creat d0/d1/d4b/f61 x:0 0 0 2024-04-25T01:46:28.990 INFO:tasks.workunit.client.0.smithi162.stdout:0/309: chown d0/df/d20/d25/f4c 4062521 1 2024-04-25T01:46:29.132 INFO:tasks.workunit.client.0.smithi162.stdout:9/228: fsync d4/d8/f10 0 2024-04-25T01:46:29.187 INFO:tasks.workunit.client.0.smithi162.stdout:9/229: dread d4/d25/f54 [0,4194304] 0 2024-04-25T01:46:29.318 INFO:tasks.workunit.client.0.smithi162.stdout:1/287: creat d15/d1f/f5f x:0 0 0 2024-04-25T01:46:29.829 INFO:tasks.workunit.client.0.smithi162.stdout:3/284: mkdir d2/d9/d10/d4c/d51/d63 0 2024-04-25T01:46:30.047 INFO:tasks.workunit.client.0.smithi162.stdout:4/269: symlink dd/d1a/d34/l63 0 2024-04-25T01:46:30.523 INFO:tasks.workunit.client.0.smithi162.stdout:9/230: write d4/d25/f54 [816171,62430] 0 2024-04-25T01:46:30.819 INFO:tasks.workunit.client.0.smithi162.stdout:8/255: dwrite d0/d1a/fd [4194304,4194304] 0 2024-04-25T01:46:30.955 INFO:tasks.workunit.client.0.smithi162.stdout:2/250: truncate d0/f9 502170 0 2024-04-25T01:46:31.053 INFO:tasks.workunit.client.0.smithi162.stdout:3/285: mknod d2/d29/c64 0 2024-04-25T01:46:31.085 INFO:tasks.workunit.client.0.smithi162.stdout:3/286: chown d2/f26 4945 1 2024-04-25T01:46:31.282 INFO:tasks.workunit.client.0.smithi162.stdout:5/266: creat d15/d19/d24/d2b/f52 x:0 0 0 2024-04-25T01:46:31.365 INFO:tasks.workunit.client.0.smithi162.stdout:0/310: symlink d0/df/d20/d37/d58/l62 0 2024-04-25T01:46:31.425 INFO:tasks.workunit.client.0.smithi162.stdout:6/233: link d1/lb d1/d46/l49 0 2024-04-25T01:46:31.652 INFO:tasks.workunit.client.0.smithi162.stdout:9/231: creat d4/d8/d13/f55 x:0 0 0 2024-04-25T01:46:31.764 INFO:tasks.workunit.client.0.smithi162.stdout:8/256: creat d0/d44/d31/d33/f53 x:0 0 0 2024-04-25T01:46:32.355 INFO:tasks.workunit.client.0.smithi162.stdout:5/267: dread d15/d19/d24/f2d [0,4194304] 0 2024-04-25T01:46:32.355 INFO:tasks.workunit.client.0.smithi162.stdout:6/234: creat d1/d13/d28/d30/f4a x:0 0 0 2024-04-25T01:46:32.421 INFO:tasks.workunit.client.0.smithi162.stdout:7/265: dwrite df/f32 [0,4194304] 0 2024-04-25T01:46:32.583 INFO:tasks.workunit.client.0.smithi162.stdout:6/235: chown d1/d13/d28/f2f 87043 1 2024-04-25T01:46:32.691 INFO:tasks.workunit.client.0.smithi162.stdout:7/266: sync 2024-04-25T01:46:32.738 INFO:tasks.workunit.client.0.smithi162.stdout:7/267: chown df/d2c/l30 52811 1 2024-04-25T01:46:33.175 INFO:tasks.workunit.client.0.smithi162.stdout:5/268: dread d15/d1e/f2a [0,4194304] 0 2024-04-25T01:46:33.338 INFO:tasks.workunit.client.0.smithi162.stdout:5/269: dread d15/d19/d24/f2d [0,4194304] 0 2024-04-25T01:46:33.478 INFO:tasks.workunit.client.0.smithi162.stdout:6/236: truncate d1/d13/d28/f29 3103359 0 2024-04-25T01:46:34.017 INFO:tasks.workunit.client.0.smithi162.stdout:4/270: getdents dd/df/d2e/d59 0 2024-04-25T01:46:34.036 INFO:tasks.workunit.client.0.smithi162.stdout:1/288: write d15/d1f/d32/f37 [568898,47465] 0 2024-04-25T01:46:34.174 INFO:tasks.workunit.client.0.smithi162.stdout:7/268: creat df/d2e/d4c/f53 x:0 0 0 2024-04-25T01:46:34.242 INFO:tasks.workunit.client.0.smithi162.stdout:2/251: getdents d0 0 2024-04-25T01:46:34.607 INFO:tasks.workunit.client.0.smithi162.stdout:6/237: fsync d1/d13/d28/f2e 0 2024-04-25T01:46:34.622 INFO:tasks.workunit.client.0.smithi162.stdout:8/257: link d0/d1a/f32 d0/d44/d31/d33/f54 0 2024-04-25T01:46:35.027 INFO:tasks.workunit.client.0.smithi162.stdout:1/289: creat d15/d1f/d23/d30/f60 x:0 0 0 2024-04-25T01:46:35.058 INFO:tasks.workunit.client.0.smithi162.stdout:4/271: truncate dd/df/d2e/f3d 998622 0 2024-04-25T01:46:35.075 INFO:tasks.workunit.client.0.smithi162.stdout:4/272: chown dd 16494 1 2024-04-25T01:46:35.099 INFO:tasks.workunit.client.0.smithi162.stdout:1/290: dread - d15/d1f/d23/d30/d4a/f58 zero size 2024-04-25T01:46:35.416 INFO:tasks.workunit.client.0.smithi162.stdout:7/269: creat df/d2e/d4c/f54 x:0 0 0 2024-04-25T01:46:35.579 INFO:tasks.workunit.client.0.smithi162.stdout:0/311: write d0/df/f14 [2245244,42002] 0 2024-04-25T01:46:35.887 INFO:tasks.workunit.client.0.smithi162.stdout:6/238: rename d1/d13/f34 to d1/d13/d28/d30/d3a/f4b 0 2024-04-25T01:46:36.105 INFO:tasks.workunit.client.0.smithi162.stdout:6/239: dread d1/d13/d28/f2e [0,4194304] 0 2024-04-25T01:46:36.185 INFO:tasks.workunit.client.0.smithi162.stdout:7/270: mknod df/d2e/c55 0 2024-04-25T01:46:36.214 INFO:tasks.workunit.client.0.smithi162.stdout:1/291: dread d15/f1b [0,4194304] 0 2024-04-25T01:46:36.495 INFO:tasks.workunit.client.0.smithi162.stdout:9/232: dwrite d4/d8/f18 [0,4194304] 0 2024-04-25T01:46:36.730 INFO:tasks.workunit.client.0.smithi162.stdout:4/273: link dd/f16 dd/df/f64 0 2024-04-25T01:46:36.974 INFO:tasks.workunit.client.0.smithi162.stdout:5/270: write d15/d19/d24/d40/f4b [341888,75436] 0 2024-04-25T01:46:37.430 INFO:tasks.workunit.client.0.smithi162.stdout:7/271: dread f1 [0,4194304] 0 2024-04-25T01:46:37.462 INFO:tasks.workunit.client.0.smithi162.stdout:6/240: symlink d1/d13/d28/d30/l4c 0 2024-04-25T01:46:37.481 INFO:tasks.workunit.client.0.smithi162.stdout:1/292: truncate d15/d1f/d23/f48 1853610 0 2024-04-25T01:46:37.777 INFO:tasks.workunit.client.0.smithi162.stdout:4/274: mknod dd/d1a/d34/c65 0 2024-04-25T01:46:38.064 INFO:tasks.workunit.client.0.smithi162.stdout:8/258: dwrite d0/d44/d31/d33/f4f [0,4194304] 0 2024-04-25T01:46:38.525 INFO:tasks.workunit.client.0.smithi162.stdout:6/241: symlink d1/d13/d28/d30/l4d 0 2024-04-25T01:46:38.831 INFO:tasks.workunit.client.0.smithi162.stdout:2/252: mknod d0/d3/d1b/d1d/d20/c58 0 2024-04-25T01:46:38.840 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:57:28.282 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:46:38.867 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:57:28.308 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:46:38.904 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:57:28.263 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:46:38.909 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:57:28.268 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:46:38.917 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:57:28.276 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:46:38.923 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:57:28.282 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:46:39.028 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:57:28.470 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:46:39.077 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:57:28.436 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:46:39.080 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:57:28.440 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:46:39.433 INFO:tasks.workunit.client.0.smithi162.stdout:4/275: creat dd/df/d58/f66 x:0 0 0 2024-04-25T01:46:39.467 INFO:tasks.workunit.client.0.smithi162.stdout:4/276: chown dd/df/f24 181910 1 2024-04-25T01:46:39.484 INFO:tasks.workunit.client.0.smithi162.stdout:8/259: symlink d0/d44/d31/d33/l55 0 2024-04-25T01:46:39.511 INFO:tasks.workunit.client.0.smithi162.stdout:0/312: rename d0/df/d20/d25/d51/c47 to d0/df/d20/d25/d51/c63 0 2024-04-25T01:46:39.527 INFO:tasks.workunit.client.0.smithi162.stdout:6/242: unlink c0 0 2024-04-25T01:46:39.544 INFO:tasks.workunit.client.0.smithi162.stdout:3/287: rename d2/f26 to d2/f65 0 2024-04-25T01:46:39.977 INFO:tasks.workunit.client.0.smithi162.stdout:4/277: creat dd/df/d2e/d59/f67 x:0 0 0 2024-04-25T01:46:40.033 INFO:tasks.workunit.client.0.smithi162.stdout:4/278: write dd/df/d2e/d59/f67 [890634,19016] 0 2024-04-25T01:46:40.041 INFO:tasks.workunit.client.0.smithi162.stdout:8/260: rmdir d0/d1a/d25 39 2024-04-25T01:46:40.531 INFO:tasks.workunit.client.0.smithi162.stdout:5/271: dwrite fd [4194304,4194304] 0 2024-04-25T01:46:40.714 INFO:tasks.workunit.client.0.smithi162.stdout:7/272: truncate df/f22 3633434 0 2024-04-25T01:46:41.056 INFO:tasks.workunit.client.0.smithi162.stdout:9/233: dwrite d4/f26 [0,4194304] 0 2024-04-25T01:46:41.294 INFO:tasks.workunit.client.0.smithi162.stdout:4/279: rmdir dd/d1a/d34 39 2024-04-25T01:46:41.648 INFO:tasks.workunit.client.0.smithi162.stdout:5/272: fsync d15/d1e/f27 0 2024-04-25T01:46:41.784 INFO:tasks.workunit.client.0.smithi162.stdout:0/313: write d0/df/d20/d25/f4c [667233,108798] 0 2024-04-25T01:46:41.963 INFO:tasks.workunit.client.0.smithi162.stdout:6/243: write d1/d13/f42 [3002511,40966] 0 2024-04-25T01:46:41.977 INFO:tasks.workunit.client.0.smithi162.stdout:8/261: dread d0/f18 [0,4194304] 0 2024-04-25T01:46:41.985 INFO:tasks.workunit.client.0.smithi162.stdout:0/314: stat d0 0 2024-04-25T01:46:42.071 INFO:tasks.workunit.client.0.smithi162.stdout:1/293: dwrite d15/d1f/d23/f48 [0,4194304] 0 2024-04-25T01:46:42.255 INFO:tasks.workunit.client.0.smithi162.stdout:2/253: getdents d0/d3 0 2024-04-25T01:46:42.394 INFO:tasks.workunit.client.0.smithi162.stdout:7/273: truncate df/d2c/f36 986371 0 2024-04-25T01:46:42.519 INFO:tasks.workunit.client.0.smithi162.stdout:3/288: creat d2/d9/f66 x:0 0 0 2024-04-25T01:46:42.621 INFO:tasks.workunit.client.0.smithi162.stdout:4/280: readlink dd/d1a/d34/l63 0 2024-04-25T01:46:42.773 INFO:tasks.workunit.client.0.smithi162.stdout:9/234: dread d4/d8/d13/f27 [0,4194304] 0 2024-04-25T01:46:43.189 INFO:tasks.workunit.client.0.smithi162.stdout:2/254: mknod d0/c59 0 2024-04-25T01:46:43.334 INFO:tasks.workunit.client.0.smithi162.stdout:1/294: creat d15/d1f/f61 x:0 0 0 2024-04-25T01:46:43.393 INFO:tasks.workunit.client.0.smithi162.stdout:1/295: write d15/d1f/d23/f48 [1336528,8418] 0 2024-04-25T01:46:43.739 INFO:tasks.workunit.client.0.smithi162.stdout:7/274: mkdir df/d2c/d56 0 2024-04-25T01:46:43.792 INFO:tasks.workunit.client.0.smithi162.stdout:7/275: chown df/d2e/l35 45120213 1 2024-04-25T01:46:44.438 INFO:tasks.workunit.client.0.smithi162.stdout:9/235: creat d4/d9/d15/d1b/d2f/d30/f56 x:0 0 0 2024-04-25T01:46:44.879 INFO:tasks.workunit.client.0.smithi162.stdout:8/262: creat d0/d1a/d25/f56 x:0 0 0 2024-04-25T01:46:45.172 INFO:tasks.workunit.client.0.smithi162.stdout:2/255: rename d0/d3/d30/f41 to d0/f5a 0 2024-04-25T01:46:45.202 INFO:tasks.workunit.client.0.smithi162.stdout:1/296: rmdir d15/d1f/d32/d4f 39 2024-04-25T01:46:45.229 INFO:tasks.workunit.client.0.smithi162.stdout:1/297: dread - d15/d1f/f61 zero size 2024-04-25T01:46:45.863 INFO:tasks.workunit.client.0.smithi162.stdout:3/289: dwrite d2/f62 [0,4194304] 0 2024-04-25T01:46:46.225 INFO:tasks.workunit.client.0.smithi162.stdout:4/281: dwrite dd/df/d2e/f3b [0,4194304] 0 2024-04-25T01:46:46.377 INFO:tasks.workunit.client.0.smithi162.stdout:8/263: fsync d0/d12/f17 0 2024-04-25T01:46:46.379 INFO:tasks.workunit.client.0.smithi162.stdout:5/273: creat d15/d19/d24/d2b/f53 x:0 0 0 2024-04-25T01:46:46.438 INFO:tasks.workunit.client.0.smithi162.stdout:8/264: read d0/f18 [2236290,122462] 0 2024-04-25T01:46:46.473 INFO:tasks.workunit.client.0.smithi162.stdout:5/274: chown d15/d19/f34 1341 1 2024-04-25T01:46:46.694 INFO:tasks.workunit.client.0.smithi162.stdout:7/276: mknod df/d2c/d56/c57 0 2024-04-25T01:46:47.174 INFO:tasks.workunit.client.0.smithi162.stdout:0/315: getdents d0/df 0 2024-04-25T01:46:47.195 INFO:tasks.workunit.client.0.smithi162.stdout:9/236: truncate d4/d9/fa 2898098 0 2024-04-25T01:46:47.323 INFO:tasks.workunit.client.0.smithi162.stdout:4/282: fsync fb 0 2024-04-25T01:46:47.474 INFO:tasks.workunit.client.0.smithi162.stdout:2/256: symlink d0/d3/d1b/l5b 0 2024-04-25T01:46:47.534 INFO:tasks.workunit.client.0.smithi162.stdout:6/244: dread d1/d13/d28/f2f [0,4194304] 0 2024-04-25T01:46:47.705 INFO:tasks.workunit.client.0.smithi162.stdout:8/265: rmdir d0/d12/d1b 39 2024-04-25T01:46:47.753 INFO:tasks.workunit.client.0.smithi162.stdout:3/290: dread d2/d9/f49 [0,4194304] 0 2024-04-25T01:46:47.808 INFO:tasks.workunit.client.0.smithi162.stdout:3/291: readlink d2/d9/d10/d2c/l35 0 2024-04-25T01:46:47.996 INFO:tasks.workunit.client.0.smithi162.stdout:0/316: fsync d0/d1/f3c 0 2024-04-25T01:46:48.035 INFO:tasks.workunit.client.0.smithi162.stdout:1/298: creat d15/d1f/d32/f62 x:0 0 0 2024-04-25T01:46:48.288 INFO:tasks.workunit.client.0.smithi162.stdout:1/299: sync 2024-04-25T01:46:48.298 INFO:tasks.workunit.client.0.smithi162.stdout:2/257: creat d0/f5c x:0 0 0 2024-04-25T01:46:48.330 INFO:tasks.workunit.client.0.smithi162.stdout:6/245: creat d1/d13/d28/d30/f4e x:0 0 0 2024-04-25T01:46:48.352 INFO:tasks.workunit.client.0.smithi162.stdout:8/266: rmdir d0/d12/d3a 39 2024-04-25T01:46:48.443 INFO:tasks.workunit.client.0.smithi162.stdout:2/258: stat d0/d3/d1b/d1d/d20/c58 0 2024-04-25T01:46:49.114 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:46:49.117 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:46:49.170 INFO:tasks.workunit.client.0.smithi162.stdout:0/317: mkdir d0/d1/d64 0 2024-04-25T01:46:49.350 INFO:tasks.workunit.client.0.smithi162.stdout:5/275: write d15/f3a [1849759,31768] 0 2024-04-25T01:46:49.362 INFO:tasks.workunit.client.0.smithi162.stdout:1/300: stat d15/f21 0 2024-04-25T01:46:49.397 INFO:tasks.workunit.client.0.smithi162.stdout:1/301: fsync d15/d1f/f61 0 2024-04-25T01:46:49.624 INFO:tasks.workunit.client.0.smithi162.stdout:8/267: truncate d0/d44/f15 3016683 0 2024-04-25T01:46:49.945 INFO:tasks.workunit.client.0.smithi162.stdout:7/277: dwrite df/f2a [0,4194304] 0 2024-04-25T01:46:50.073 INFO:tasks.workunit.client.0.smithi162.stdout:3/292: mknod d2/d9/d17/d61/c67 0 2024-04-25T01:46:50.124 INFO:tasks.workunit.client.0.smithi162.stdout:3/293: stat d2 0 2024-04-25T01:46:50.182 INFO:tasks.workunit.client.0.smithi162.stdout:0/318: symlink d0/d1/l65 0 2024-04-25T01:46:50.340 INFO:tasks.workunit.client.0.smithi162.stdout:4/283: dwrite dd/f29 [0,4194304] 0 2024-04-25T01:46:50.349 INFO:tasks.workunit.client.0.smithi162.stdout:0/319: sync 2024-04-25T01:46:51.294 INFO:tasks.workunit.client.0.smithi162.stdout:0/320: fsync d0/df/f14 0 2024-04-25T01:46:51.295 INFO:tasks.workunit.client.0.smithi162.stdout:1/302: creat d15/d1f/d32/d4f/f63 x:0 0 0 2024-04-25T01:46:51.373 INFO:tasks.workunit.client.0.smithi162.stdout:1/303: chown d15/d1f/d23/f25 1 1 2024-04-25T01:46:51.753 INFO:tasks.workunit.client.0.smithi162.stdout:6/246: dwrite d1/d13/d28/d30/d3a/f3e [0,4194304] 0 2024-04-25T01:46:51.994 INFO:tasks.workunit.client.0.smithi162.stdout:3/294: getdents d2/d9/d10/d4c/d51/d63 0 2024-04-25T01:46:52.228 INFO:tasks.workunit.client.0.smithi162.stdout:2/259: dwrite d0/d3/f1a [0,4194304] 0 2024-04-25T01:46:52.420 INFO:tasks.workunit.client.0.smithi162.stdout:0/321: creat d0/df/f66 x:0 0 0 2024-04-25T01:46:53.228 INFO:tasks.workunit.client.0.smithi162.stdout:5/276: link lc d15/d19/d24/d40/l54 0 2024-04-25T01:46:53.648 INFO:tasks.workunit.client.0.smithi162.stdout:6/247: fdatasync d1/f10 0 2024-04-25T01:46:54.017 INFO:tasks.workunit.client.0.smithi162.stdout:8/268: dwrite d0/d12/d1b/f1f [0,4194304] 0 2024-04-25T01:46:54.461 INFO:tasks.workunit.client.0.smithi162.stdout:7/278: unlink df/f17 0 2024-04-25T01:46:54.477 INFO:tasks.workunit.client.0.smithi162.stdout:9/237: rename d4/d8/d13/l4d to d4/l57 0 2024-04-25T01:46:54.558 INFO:tasks.workunit.client.0.smithi162.stdout:4/284: mknod dd/c68 0 2024-04-25T01:46:54.612 INFO:tasks.workunit.client.0.smithi162.stdout:2/260: write d0/d3/d5/f18 [3589863,42121] 0 2024-04-25T01:46:54.769 INFO:tasks.workunit.client.0.smithi162.stdout:4/285: chown dd/c2b 736200880 1 2024-04-25T01:46:54.942 INFO:tasks.workunit.client.0.smithi162.stdout:1/304: dwrite d15/f21 [0,4194304] 0 2024-04-25T01:46:54.964 INFO:tasks.workunit.client.0.smithi162.stdout:6/248: creat d1/d13/d28/d45/f4f x:0 0 0 2024-04-25T01:46:54.977 INFO:tasks.workunit.client.0.smithi162.stdout:8/269: mknod d0/d12/d1b/c57 0 2024-04-25T01:46:55.147 INFO:tasks.workunit.client.0.smithi162.stdout:3/295: getdents d2/d9/d10/d2c 0 2024-04-25T01:46:55.200 INFO:tasks.workunit.client.0.smithi162.stdout:0/322: rename d0/df/d20/f3a to d0/d1/d64/f67 0 2024-04-25T01:46:55.260 INFO:tasks.workunit.client.0.smithi162.stdout:7/279: chown df/f33 5460629 1 2024-04-25T01:46:55.571 INFO:tasks.workunit.client.0.smithi162.stdout:2/261: unlink d0/c1f 0 2024-04-25T01:46:55.621 INFO:tasks.workunit.client.0.smithi162.stdout:1/305: rmdir d15/d1f/d35 39 2024-04-25T01:46:55.766 INFO:tasks.workunit.client.0.smithi162.stdout:8/270: creat d0/d1a/d25/f58 x:0 0 0 2024-04-25T01:46:56.133 INFO:tasks.workunit.client.0.smithi162.stdout:0/323: truncate d0/fd 2527488 0 2024-04-25T01:46:56.145 INFO:tasks.workunit.client.0.smithi162.stdout:7/280: mkdir df/d2e/d4c/d58 0 2024-04-25T01:46:56.337 INFO:tasks.workunit.client.0.smithi162.stdout:5/277: rename d15/d19/l21 to d15/d19/d24/d2b/d3b/l55 0 2024-04-25T01:46:56.422 INFO:tasks.workunit.client.0.smithi162.stdout:2/262: fdatasync d0/d49/d27/f24 0 2024-04-25T01:46:56.613 INFO:tasks.workunit.client.0.smithi162.stdout:8/271: fsync d0/f18 0 2024-04-25T01:46:56.871 INFO:tasks.workunit.client.0.smithi162.stdout:1/306: dread d15/d1f/f2d [0,4194304] 0 2024-04-25T01:46:56.883 INFO:tasks.workunit.client.0.smithi162.stdout:3/296: creat d2/d29/d5d/f68 x:0 0 0 2024-04-25T01:46:57.130 INFO:tasks.workunit.client.0.smithi162.stdout:7/281: dread f2 [0,4194304] 0 2024-04-25T01:46:57.370 INFO:tasks.workunit.client.0.smithi162.stdout:5/278: dread d15/d19/f20 [0,4194304] 0 2024-04-25T01:46:57.565 INFO:tasks.workunit.client.0.smithi162.stdout:8/272: dread - d0/d44/d31/f4a zero size 2024-04-25T01:46:57.650 INFO:tasks.workunit.client.0.smithi162.stdout:3/297: mknod d2/d29/c69 0 2024-04-25T01:46:57.797 INFO:tasks.workunit.client.0.smithi162.stdout:9/238: dwrite d4/d9/d15/d1b/f2e [0,4194304] 0 2024-04-25T01:46:57.802 INFO:tasks.workunit.client.0.smithi162.stdout:0/324: creat d0/d59/f68 x:0 0 0 2024-04-25T01:46:58.229 INFO:tasks.workunit.client.0.smithi162.stdout:4/286: dwrite dd/df/d2e/d59/f67 [0,4194304] 0 2024-04-25T01:46:58.350 INFO:tasks.workunit.client.0.smithi162.stdout:7/282: symlink df/d2c/d56/l59 0 2024-04-25T01:46:58.578 INFO:tasks.workunit.client.0.smithi162.stdout:2/263: write d0/d49/d27/f24 [2461622,95037] 0 2024-04-25T01:46:58.997 INFO:tasks.workunit.client.0.smithi162.stdout:8/273: mknod d0/d1a/d25/c59 0 2024-04-25T01:46:59.027 INFO:tasks.workunit.client.0.smithi162.stdout:5/279: read - d15/d19/d24/d2b/d3b/d3c/d3f/f51 zero size 2024-04-25T01:46:59.057 INFO:tasks.workunit.client.0.smithi162.stdout:8/274: chown d0/c2 213130 1 2024-04-25T01:46:59.482 INFO:tasks.workunit.client.0.smithi162.stdout:3/298: symlink d2/d9/d10/d4c/l6a 0 2024-04-25T01:46:59.619 INFO:tasks.workunit.client.0.smithi162.stdout:4/287: chown dd/df/f52 3908767 1 2024-04-25T01:46:59.705 INFO:tasks.workunit.client.0.smithi162.stdout:2/264: symlink d0/d49/d27/l5d 0 2024-04-25T01:46:59.823 INFO:tasks.workunit.client.0.smithi162.stdout:5/280: chown d15/d19/l26 1835921836 1 2024-04-25T01:47:00.452 INFO:tasks.workunit.client.0.smithi162.stdout:4/288: mknod dd/df/d2e/c69 0 2024-04-25T01:47:00.468 INFO:tasks.workunit.client.0.smithi162.stdout:4/289: chown dd/c2a 231956 1 2024-04-25T01:47:00.646 INFO:tasks.workunit.client.0.smithi162.stdout:4/290: sync 2024-04-25T01:47:00.777 INFO:tasks.workunit.client.0.smithi162.stdout:1/307: getdents d15 0 2024-04-25T01:47:00.797 INFO:tasks.workunit.client.0.smithi162.stdout:2/265: rmdir d0/d3/d1b/d1d 39 2024-04-25T01:47:01.769 INFO:tasks.workunit.client.0.smithi162.stdout:1/308: fdatasync f14 0 2024-04-25T01:47:01.794 INFO:tasks.workunit.client.0.smithi162.stdout:0/325: write d0/df/d20/d37/f57 [257144,72723] 0 2024-04-25T01:47:01.842 INFO:tasks.workunit.client.0.smithi162.stdout:7/283: write df/d2c/f3e [3049676,6830] 0 2024-04-25T01:47:01.994 INFO:tasks.workunit.client.0.smithi162.stdout:4/291: symlink dd/d1a/l6a 0 2024-04-25T01:47:02.018 INFO:tasks.workunit.client.0.smithi162.stdout:4/292: chown dd/d1a/d4e/c55 16292 1 2024-04-25T01:47:02.042 INFO:tasks.workunit.client.0.smithi162.stdout:4/293: dread - dd/d1a/f37 zero size 2024-04-25T01:47:02.295 INFO:tasks.workunit.client.0.smithi162.stdout:2/266: mkdir d0/d3/d1b/d1d/d20/d5e 0 2024-04-25T01:47:02.523 INFO:tasks.workunit.client.0.smithi162.stdout:0/326: creat d0/df/d20/d25/d55/f69 x:0 0 0 2024-04-25T01:47:02.588 INFO:tasks.workunit.client.0.smithi162.stdout:7/284: truncate df/d2e/d4c/f4f 1013729 0 2024-04-25T01:47:02.810 INFO:tasks.workunit.client.0.smithi162.stdout:3/299: dwrite d2/d9/f49 [0,4194304] 0 2024-04-25T01:47:02.929 INFO:tasks.workunit.client.0.smithi162.stdout:9/239: mknod d4/d9/c58 0 2024-04-25T01:47:03.206 INFO:tasks.workunit.client.0.smithi162.stdout:0/327: dread d0/d1/d4b/f52 [0,4194304] 0 2024-04-25T01:47:03.447 INFO:tasks.workunit.client.0.smithi162.stdout:1/309: creat d15/d1f/d23/f64 x:0 0 0 2024-04-25T01:47:03.520 INFO:tasks.workunit.client.0.smithi162.stdout:4/294: unlink dd/f29 0 2024-04-25T01:47:03.558 INFO:tasks.workunit.client.0.smithi162.stdout:9/240: stat d4/f39 0 2024-04-25T01:47:03.690 INFO:tasks.workunit.client.0.smithi162.stdout:7/285: mknod df/d2e/d4c/d58/c5a 0 2024-04-25T01:47:03.727 INFO:tasks.workunit.client.0.smithi162.stdout:4/295: stat dd/le 0 2024-04-25T01:47:04.024 INFO:tasks.workunit.client.0.smithi162.stdout:9/241: stat d4/d9/d15/d1b/d2f/d30/c3c 0 2024-04-25T01:47:04.033 INFO:tasks.workunit.client.0.smithi162.stdout:8/275: dwrite d0/d44/d31/d33/f54 [0,4194304] 0 2024-04-25T01:47:04.076 INFO:tasks.workunit.client.0.smithi162.stdout:5/281: dwrite fd [4194304,4194304] 0 2024-04-25T01:47:04.339 INFO:tasks.workunit.client.0.smithi162.stdout:0/328: mkdir d0/d1/d6a 0 2024-04-25T01:47:04.360 INFO:tasks.workunit.client.0.smithi162.stdout:2/267: creat d0/d3/d1b/f5f x:0 0 0 2024-04-25T01:47:04.471 INFO:tasks.workunit.client.0.smithi162.stdout:0/329: readlink d0/df/d20/d25/d51/l30 0 2024-04-25T01:47:04.677 INFO:tasks.workunit.client.0.smithi162.stdout:7/286: read df/f21 [1896781,83126] 0 2024-04-25T01:47:04.699 INFO:tasks.workunit.client.0.smithi162.stdout:7/287: chown df/f15 436797 1 2024-04-25T01:47:04.723 INFO:tasks.workunit.client.0.smithi162.stdout:7/288: fdatasync df/f20 0 2024-04-25T01:47:04.814 INFO:tasks.workunit.client.0.smithi162.stdout:1/310: creat d15/d1f/d23/d30/d4a/f65 x:0 0 0 2024-04-25T01:47:05.581 INFO:tasks.workunit.client.0.smithi162.stdout:2/268: mknod d0/d3/d1b/d1d/d20/c60 0 2024-04-25T01:47:05.649 INFO:tasks.workunit.client.0.smithi162.stdout:9/242: dread d4/d9/f47 [0,4194304] 0 2024-04-25T01:47:05.684 INFO:tasks.workunit.client.0.smithi162.stdout:9/243: readlink d4/d9/d15/d1b/l4f 0 2024-04-25T01:47:05.928 INFO:tasks.workunit.client.0.smithi162.stdout:0/330: unlink d0/df/d20/d25/d51/l30 0 2024-04-25T01:47:06.129 INFO:tasks.workunit.client.0.smithi162.stdout:7/289: dread df/d2c/f36 [0,4194304] 0 2024-04-25T01:47:06.270 INFO:tasks.workunit.client.0.smithi162.stdout:3/300: dwrite d2/d9/f2d [0,4194304] 0 2024-04-25T01:47:06.375 INFO:tasks.workunit.client.0.smithi162.stdout:6/249: rename d1/d13/d28/f2e to d1/d13/f50 0 2024-04-25T01:47:06.668 INFO:tasks.workunit.client.0.smithi162.stdout:2/269: fdatasync d0/d3/f35 0 2024-04-25T01:47:07.044 INFO:tasks.workunit.client.0.smithi162.stdout:1/311: symlink d15/d1f/l66 0 2024-04-25T01:47:07.140 INFO:tasks.workunit.client.0.smithi162.stdout:1/312: dread d15/d1f/f27 [0,4194304] 0 2024-04-25T01:47:07.300 INFO:tasks.workunit.client.0.smithi162.stdout:7/290: creat df/d2c/f5b x:0 0 0 2024-04-25T01:47:07.323 INFO:tasks.workunit.client.0.smithi162.stdout:5/282: link d15/d19/d24/d2b/f2c d15/d19/d24/f56 0 2024-04-25T01:47:07.513 INFO:tasks.workunit.client.0.smithi162.stdout:3/301: unlink d2/d29/c69 0 2024-04-25T01:47:07.823 INFO:tasks.workunit.client.0.smithi162.stdout:9/244: mkdir d4/d9/d15/d4e/d59 0 2024-04-25T01:47:07.918 INFO:tasks.workunit.client.0.smithi162.stdout:4/296: write dd/d1a/d4e/f56 [183857,45484] 0 2024-04-25T01:47:07.997 INFO:tasks.workunit.client.0.smithi162.stdout:2/270: dread d0/d3/d1b/d1d/d3a/f3b [0,4194304] 0 2024-04-25T01:47:08.543 INFO:tasks.workunit.client.0.smithi162.stdout:3/302: truncate d2/d9/d17/f2f 1783179 0 2024-04-25T01:47:09.142 INFO:tasks.workunit.client.0.smithi162.stdout:6/250: creat d1/f51 x:0 0 0 2024-04-25T01:47:09.193 INFO:tasks.workunit.client.0.smithi162.stdout:8/276: write d0/d12/d3a/f42 [93989,116547] 0 2024-04-25T01:47:09.250 INFO:tasks.workunit.client.0.smithi162.stdout:8/277: fsync d0/d44/d31/d33/f54 0 2024-04-25T01:47:09.741 INFO:tasks.workunit.client.0.smithi162.stdout:2/271: fdatasync d0/f9 0 2024-04-25T01:47:10.261 INFO:tasks.workunit.client.0.smithi162.stdout:8/278: creat d0/d12/d3a/f5a x:0 0 0 2024-04-25T01:47:10.975 INFO:tasks.workunit.client.0.smithi162.stdout:0/331: rmdir d0 39 2024-04-25T01:47:11.055 INFO:tasks.workunit.client.0.smithi162.stdout:9/245: link d4/d9/d15/d1b/l48 d4/d8/d13/l5a 0 2024-04-25T01:47:11.150 INFO:tasks.workunit.client.0.smithi162.stdout:6/251: mknod d1/d13/d28/d45/c52 0 2024-04-25T01:47:11.437 INFO:tasks.workunit.client.0.smithi162.stdout:8/279: read d0/f11 [2119067,102678] 0 2024-04-25T01:47:11.534 INFO:tasks.workunit.client.0.smithi162.stdout:1/313: link d15/d1f/d35/c5b d15/d1f/d35/c67 0 2024-04-25T01:47:11.638 INFO:tasks.workunit.client.0.smithi162.stdout:8/280: chown d0/f16 83 1 2024-04-25T01:47:11.748 INFO:tasks.workunit.client.0.smithi162.stdout:3/303: rename d2/d9/d10/l2b to d2/d9/l6b 0 2024-04-25T01:47:11.764 INFO:tasks.workunit.client.0.smithi162.stdout:7/291: dwrite df/f2a [0,4194304] 0 2024-04-25T01:47:11.920 INFO:tasks.workunit.client.0.smithi162.stdout:4/297: link f7 dd/d1a/f6b 0 2024-04-25T01:47:11.993 INFO:tasks.workunit.client.0.smithi162.stdout:9/246: dread - d4/d8/d13/f55 zero size 2024-04-25T01:47:12.050 INFO:tasks.workunit.client.0.smithi162.stdout:6/252: mkdir d1/d13/d28/d53 0 2024-04-25T01:47:12.088 INFO:tasks.workunit.client.0.smithi162.stdout:7/292: readlink df/d2e/l34 0 2024-04-25T01:47:12.237 INFO:tasks.workunit.client.0.smithi162.stdout:5/283: dwrite d15/d1e/f27 [4194304,4194304] 0 2024-04-25T01:47:12.368 INFO:tasks.workunit.client.0.smithi162.stdout:7/293: readlink df/d2c/l30 0 2024-04-25T01:47:12.533 INFO:tasks.workunit.client.0.smithi162.stdout:8/281: mknod d0/d12/d1b/c5b 0 2024-04-25T01:47:12.825 INFO:tasks.workunit.client.0.smithi162.stdout:9/247: rmdir d4/d8/d13/d38 39 2024-04-25T01:47:13.079 INFO:tasks.workunit.client.0.smithi162.stdout:6/253: symlink d1/d13/d28/l54 0 2024-04-25T01:47:13.163 INFO:tasks.workunit.client.0.smithi162.stdout:1/314: truncate f3 9138423 0 2024-04-25T01:47:13.163 INFO:tasks.workunit.client.0.smithi162.stdout:1/315: chown d15/d1f/f27 340 1 2024-04-25T01:47:13.231 INFO:tasks.workunit.client.0.smithi162.stdout:0/332: fdatasync d0/fd 0 2024-04-25T01:47:13.258 INFO:tasks.workunit.client.0.smithi162.stdout:7/294: truncate fa 2813275 0 2024-04-25T01:47:13.298 INFO:tasks.workunit.client.0.smithi162.stdout:0/333: readlink d0/df/d20/l35 0 2024-04-25T01:47:13.332 INFO:tasks.workunit.client.0.smithi162.stdout:5/284: dread - d15/d19/d24/d2b/f42 zero size 2024-04-25T01:47:13.563 INFO:tasks.workunit.client.0.smithi162.stdout:8/282: read d0/d12/f2e [3807309,3620] 0 2024-04-25T01:47:14.063 INFO:tasks.workunit.client.0.smithi162.stdout:6/254: rmdir d1/d13 39 2024-04-25T01:47:14.087 INFO:tasks.workunit.client.0.smithi162.stdout:1/316: truncate d15/d1f/d35/f44 1115778 0 2024-04-25T01:47:14.942 INFO:tasks.workunit.client.0.smithi162.stdout:8/283: creat d0/d44/d31/f5c x:0 0 0 2024-04-25T01:47:15.292 INFO:tasks.workunit.client.0.smithi162.stdout:6/255: symlink d1/d46/l55 0 2024-04-25T01:47:16.071 INFO:tasks.workunit.client.0.smithi162.stdout:9/248: creat d4/d8/d13/f5b x:0 0 0 2024-04-25T01:47:16.089 INFO:tasks.workunit.client.0.smithi162.stdout:3/304: write d2/d9/d10/f11 [114564,84882] 0 2024-04-25T01:47:16.225 INFO:tasks.workunit.client.0.smithi162.stdout:4/298: getdents dd/df/d2e/d59 0 2024-04-25T01:47:16.387 INFO:tasks.workunit.client.0.smithi162.stdout:0/334: link d0/d1/l65 d0/d59/l6b 0 2024-04-25T01:47:16.658 INFO:tasks.workunit.client.0.smithi162.stdout:6/256: read d1/d13/f42 [3819361,45301] 0 2024-04-25T01:47:16.784 INFO:tasks.workunit.client.0.smithi162.stdout:4/299: creat dd/df/f6c x:0 0 0 2024-04-25T01:47:16.862 INFO:tasks.workunit.client.0.smithi162.stdout:8/284: creat d0/d12/f5d x:0 0 0 2024-04-25T01:47:17.007 INFO:tasks.workunit.client.0.smithi162.stdout:2/272: rename d0/d49 to d0/d3/d1b/d1d/d20/d5e/d61 0 2024-04-25T01:47:17.062 INFO:tasks.workunit.client.0.smithi162.stdout:2/273: readlink d0/d3/d1b/l2a 0 2024-04-25T01:47:17.122 INFO:tasks.workunit.client.0.smithi162.stdout:0/335: creat d0/df/d20/d37/f6c x:0 0 0 2024-04-25T01:47:17.425 INFO:tasks.workunit.client.0.smithi162.stdout:6/257: read - d1/d13/d28/d45/f4f zero size 2024-04-25T01:47:17.637 INFO:tasks.workunit.client.0.smithi162.stdout:8/285: fsync d0/d44/d31/d33/f53 0 2024-04-25T01:47:17.691 INFO:tasks.workunit.client.0.smithi162.stdout:1/317: rename d15/d1f/l49 to d15/l68 0 2024-04-25T01:47:17.770 INFO:tasks.workunit.client.0.smithi162.stdout:2/274: mkdir d0/d3/d1b/d1d/d20/d5e/d61/d62 0 2024-04-25T01:47:17.819 INFO:tasks.workunit.client.0.smithi162.stdout:0/336: fsync d0/df/d20/f40 0 2024-04-25T01:47:17.840 INFO:tasks.workunit.client.0.smithi162.stdout:8/286: chown d0/d12/f4e 124238 1 2024-04-25T01:47:17.943 INFO:tasks.workunit.client.0.smithi162.stdout:9/249: creat d4/d9/d15/f5c x:0 0 0 2024-04-25T01:47:18.022 INFO:tasks.workunit.client.0.smithi162.stdout:1/318: chown d15/d1f/d32/d4f/l5e 3841 1 2024-04-25T01:47:18.033 INFO:tasks.workunit.client.0.smithi162.stdout:7/295: dwrite df/d2e/d4c/f53 [0,4194304] 0 2024-04-25T01:47:18.161 INFO:tasks.workunit.client.0.smithi162.stdout:6/258: fsync d1/d13/d28/d45/f4f 0 2024-04-25T01:47:18.164 INFO:tasks.workunit.client.0.smithi162.stdout:2/275: read d0/d3/f47 [495037,14433] 0 2024-04-25T01:47:18.192 INFO:tasks.workunit.client.0.smithi162.stdout:5/285: write d15/d19/d24/f2d [4523154,86242] 0 2024-04-25T01:47:18.314 INFO:tasks.workunit.client.0.smithi162.stdout:1/319: chown d15/d1f/d23/d30/l3b 0 1 2024-04-25T01:47:18.362 INFO:tasks.workunit.client.0.smithi162.stdout:1/320: stat d15/d1f/d35/l3d 0 2024-04-25T01:47:18.718 INFO:tasks.workunit.client.0.smithi162.stdout:0/337: chown d0/d1/d4b/l54 395724462 1 2024-04-25T01:47:18.734 INFO:tasks.workunit.client.0.smithi162.stdout:0/338: chown d0/l48 0 1 2024-04-25T01:47:18.992 INFO:tasks.workunit.client.0.smithi162.stdout:6/259: creat d1/d46/f56 x:0 0 0 2024-04-25T01:47:19.013 INFO:tasks.workunit.client.0.smithi162.stdout:6/260: chown d1/f27 10 1 2024-04-25T01:47:19.119 INFO:tasks.workunit.client.0.smithi162.stdout:5/286: fdatasync d15/d1e/f22 0 2024-04-25T01:47:19.178 INFO:tasks.workunit.client.0.smithi162.stdout:7/296: symlink df/d2e/d4c/l5c 0 2024-04-25T01:47:19.180 INFO:tasks.workunit.client.0.smithi162.stdout:5/287: rename d15/d19 to d15/d19/d24/d4d/d57 22 2024-04-25T01:47:19.230 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:47:19.231 INFO:tasks.workunit.client.0.smithi162.stdout:7/297: chown df/d2e/l3d 21 1 2024-04-25T01:47:19.233 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:47:19.659 INFO:tasks.workunit.client.0.smithi162.stdout:8/287: symlink d0/d1a/l5e 0 2024-04-25T01:47:19.783 INFO:tasks.workunit.client.0.smithi162.stdout:2/276: dread d0/d3/d1b/d1d/d20/d5e/d61/d27/f24 [0,4194304] 0 2024-04-25T01:47:19.798 INFO:tasks.workunit.client.0.smithi162.stdout:0/339: mknod d0/d59/c6d 0 2024-04-25T01:47:19.868 INFO:tasks.workunit.client.0.smithi162.stdout:6/261: mkdir d1/d13/d28/d30/d3a/d57 0 2024-04-25T01:47:20.113 INFO:tasks.workunit.client.0.smithi162.stdout:3/305: dwrite d2/d29/f3c [0,4194304] 0 2024-04-25T01:47:20.304 INFO:tasks.workunit.client.0.smithi162.stdout:0/340: mknod d0/d1/c6e 0 2024-04-25T01:47:20.420 INFO:tasks.workunit.client.0.smithi162.stdout:7/298: dread df/f2a [0,4194304] 0 2024-04-25T01:47:20.516 INFO:tasks.workunit.client.0.smithi162.stdout:8/288: mknod d0/d1a/d25/c5f 0 2024-04-25T01:47:20.810 INFO:tasks.workunit.client.0.smithi162.stdout:2/277: mkdir d0/d3/d1b/d1d/d3a/d63 0 2024-04-25T01:47:21.150 INFO:tasks.workunit.client.0.smithi162.stdout:3/306: mknod d2/d29/d5d/c6c 0 2024-04-25T01:47:21.160 INFO:tasks.workunit.client.0.smithi162.stdout:0/341: unlink d0/d1/d4b/f52 0 2024-04-25T01:47:21.281 INFO:tasks.workunit.client.0.smithi162.stdout:4/300: write dd/df/d58/f5a [740155,42018] 0 2024-04-25T01:47:21.321 INFO:tasks.workunit.client.0.smithi162.stdout:4/301: chown dd/df/d58/f66 124 1 2024-04-25T01:47:21.370 INFO:tasks.workunit.client.0.smithi162.stdout:7/299: mkdir df/d2c/d49/d5d 0 2024-04-25T01:47:21.432 INFO:tasks.workunit.client.0.smithi162.stdout:8/289: read d0/d1a/f28 [502961,89678] 0 2024-04-25T01:47:21.685 INFO:tasks.workunit.client.0.smithi162.stdout:2/278: unlink d0/d3/f19 0 2024-04-25T01:47:21.760 INFO:tasks.workunit.client.0.smithi162.stdout:0/342: fsync d0/df/d20/d25/d55/f5c 0 2024-04-25T01:47:21.912 INFO:tasks.workunit.client.0.smithi162.stdout:3/307: rename d2/d9/d17/d61/c67 to d2/d9/d19/c6d 0 2024-04-25T01:47:22.112 INFO:tasks.workunit.client.0.smithi162.stdout:4/302: read dd/df/f30 [2054979,130384] 0 2024-04-25T01:47:22.174 INFO:tasks.workunit.client.0.smithi162.stdout:7/300: mkdir df/d2e/d4c/d58/d5e 0 2024-04-25T01:47:22.283 INFO:tasks.workunit.client.0.smithi162.stdout:9/250: dwrite f3 [0,4194304] 0 2024-04-25T01:47:22.283 INFO:tasks.workunit.client.0.smithi162.stdout:4/303: chown dd/c2b 1286818 1 2024-04-25T01:47:22.775 INFO:tasks.workunit.client.0.smithi162.stdout:0/343: mkdir d0/df/d20/d25/d55/d6f 0 2024-04-25T01:47:22.819 INFO:tasks.workunit.client.0.smithi162.stdout:8/290: symlink d0/d44/l60 0 2024-04-25T01:47:22.945 INFO:tasks.workunit.client.0.smithi162.stdout:4/304: fdatasync dd/df/f64 0 2024-04-25T01:47:23.044 INFO:tasks.workunit.client.0.smithi162.stdout:1/321: write d15/d1f/d23/d30/f53 [616836,40252] 0 2024-04-25T01:47:23.100 INFO:tasks.workunit.client.0.smithi162.stdout:1/322: readlink d15/d1f/d23/d30/l3b 0 2024-04-25T01:47:23.261 INFO:tasks.workunit.client.0.smithi162.stdout:8/291: sync 2024-04-25T01:47:24.127 INFO:tasks.workunit.client.0.smithi162.stdout:5/288: dwrite d15/d19/f34 [0,4194304] 0 2024-04-25T01:47:24.318 INFO:tasks.workunit.client.0.smithi162.stdout:9/251: creat d4/d8/f5d x:0 0 0 2024-04-25T01:47:24.416 INFO:tasks.workunit.client.0.smithi162.stdout:4/305: dread dd/df/f10 [0,4194304] 0 2024-04-25T01:47:25.608 INFO:tasks.workunit.client.0.smithi162.stdout:4/306: read - dd/d1a/d34/f50 zero size 2024-04-25T01:47:25.641 INFO:tasks.workunit.client.0.smithi162.stdout:5/289: write d15/d19/d24/f2d [2321413,76158] 0 2024-04-25T01:47:25.705 INFO:tasks.workunit.client.0.smithi162.stdout:4/307: dread - dd/d1a/d34/f50 zero size 2024-04-25T01:47:25.836 INFO:tasks.workunit.client.0.smithi162.stdout:0/344: truncate d0/d1/d64/f67 2691470 0 2024-04-25T01:47:25.963 INFO:tasks.workunit.client.0.smithi162.stdout:9/252: creat d4/d8/d13/d38/f5e x:0 0 0 2024-04-25T01:47:26.034 INFO:tasks.workunit.client.0.smithi162.stdout:0/345: sync 2024-04-25T01:47:26.272 INFO:tasks.workunit.client.0.smithi162.stdout:2/279: symlink d0/d3/d1b/d1d/d20/l64 0 2024-04-25T01:47:26.316 INFO:tasks.workunit.client.0.smithi162.stdout:2/280: chown d0/d3/d1b/d1d/d20/c58 5 1 2024-04-25T01:47:26.462 INFO:tasks.workunit.client.0.smithi162.stdout:5/290: mkdir d15/d19/d24/d2b/d3b/d58 0 2024-04-25T01:47:26.805 INFO:tasks.workunit.client.0.smithi162.stdout:0/346: truncate d0/df/f43 2343193 0 2024-04-25T01:47:26.923 INFO:tasks.workunit.client.0.smithi162.stdout:3/308: rename d2/d9/l21 to d2/l6e 0 2024-04-25T01:47:27.300 INFO:tasks.workunit.client.0.smithi162.stdout:0/347: truncate d0/df/f66 39190 0 2024-04-25T01:47:27.602 INFO:tasks.workunit.client.0.smithi162.stdout:3/309: truncate d2/d9/fd 3469893 0 2024-04-25T01:47:27.627 INFO:tasks.workunit.client.0.smithi162.stdout:8/292: dwrite d0/d44/f1c [0,4194304] 0 2024-04-25T01:47:27.796 INFO:tasks.workunit.client.0.smithi162.stdout:0/348: mknod d0/df/d20/d25/c70 0 2024-04-25T01:47:27.881 INFO:tasks.workunit.client.0.smithi162.stdout:6/262: mknod d1/d13/c58 0 2024-04-25T01:47:28.286 INFO:tasks.workunit.client.0.smithi162.stdout:5/291: creat d15/d19/f59 x:0 0 0 2024-04-25T01:47:28.300 INFO:tasks.workunit.client.0.smithi162.stdout:3/310: read - d2/d9/d17/f3d zero size 2024-04-25T01:47:28.793 INFO:tasks.workunit.client.0.smithi162.stdout:3/311: mknod d2/d29/d5d/c6f 0 2024-04-25T01:47:28.890 INFO:tasks.workunit.client.0.smithi162.stdout:0/349: symlink d0/df/d20/d25/d55/d6f/l71 0 2024-04-25T01:47:29.034 INFO:tasks.workunit.client.0.smithi162.stdout:3/312: dread - d2/d9/d10/d4c/d51/f50 zero size 2024-04-25T01:47:29.195 INFO:tasks.workunit.client.0.smithi162.stdout:4/308: write dd/df/f14 [2699350,68205] 0 2024-04-25T01:47:29.271 INFO:tasks.workunit.client.0.smithi162.stdout:5/292: dread d15/d19/d24/d2b/f2c [0,4194304] 0 2024-04-25T01:47:29.707 INFO:tasks.workunit.client.0.smithi162.stdout:7/301: rename df/d2e/l35 to df/d52/l5f 0 2024-04-25T01:47:30.012 INFO:tasks.workunit.client.0.smithi162.stdout:3/313: creat d2/d9/d10/d4c/f70 x:0 0 0 2024-04-25T01:47:30.121 INFO:tasks.workunit.client.0.smithi162.stdout:5/293: rmdir d15/d19/d24/d40 39 2024-04-25T01:47:30.162 INFO:tasks.workunit.client.0.smithi162.stdout:5/294: chown d15/d19/d24/d2b/d3b/d58 17 1 2024-04-25T01:47:30.319 INFO:tasks.workunit.client.0.smithi162.stdout:1/323: rename d15/d1f/d32 to d15/d69 0 2024-04-25T01:47:30.319 INFO:tasks.workunit.client.0.smithi162.stdout:5/295: sync 2024-04-25T01:47:30.526 INFO:tasks.workunit.client.0.smithi162.stdout:0/350: creat d0/d1/d6a/f72 x:0 0 0 2024-04-25T01:47:30.907 INFO:tasks.workunit.client.0.smithi162.stdout:6/263: write d1/f2a [2514053,40190] 0 2024-04-25T01:47:31.189 INFO:tasks.workunit.client.0.smithi162.stdout:2/281: rename d0/d3/d1b/d1d/d3a/f4c to d0/d3/d5/d36/f65 0 2024-04-25T01:47:31.285 INFO:tasks.workunit.client.0.smithi162.stdout:1/324: symlink d15/d1f/d35/d4c/l6a 0 2024-04-25T01:47:32.630 INFO:tasks.workunit.client.0.smithi162.stdout:9/253: symlink d4/l5f 0 2024-04-25T01:47:32.648 INFO:tasks.workunit.client.0.smithi162.stdout:0/351: mknod d0/df/d20/c73 0 2024-04-25T01:47:32.798 INFO:tasks.workunit.client.0.smithi162.stdout:4/309: link f7 dd/df/f6d 0 2024-04-25T01:47:32.822 INFO:tasks.workunit.client.0.smithi162.stdout:4/310: chown dd/d1a/f37 94411 1 2024-04-25T01:47:33.270 INFO:tasks.workunit.client.0.smithi162.stdout:3/314: creat d2/f71 x:0 0 0 2024-04-25T01:47:33.297 INFO:tasks.workunit.client.0.smithi162.stdout:3/315: chown d2/f25 5748484 1 2024-04-25T01:47:33.522 INFO:tasks.workunit.client.0.smithi162.stdout:1/325: symlink d15/d1f/l6b 0 2024-04-25T01:47:33.640 INFO:tasks.workunit.client.0.smithi162.stdout:5/296: link d15/d19/d24/f56 d15/d19/d24/d4d/f5a 0 2024-04-25T01:47:33.834 INFO:tasks.workunit.client.0.smithi162.stdout:8/293: rmdir d0/d1a 39 2024-04-25T01:47:34.019 INFO:tasks.workunit.client.0.smithi162.stdout:4/311: rmdir dd/df 39 2024-04-25T01:47:34.280 INFO:tasks.workunit.client.0.smithi162.stdout:3/316: rename d2/d29/d2e/c55 to d2/d29/d2e/c72 0 2024-04-25T01:47:34.306 INFO:tasks.workunit.client.0.smithi162.stdout:3/317: chown d2/d29/d5d/f68 11846386 1 2024-04-25T01:47:34.420 INFO:tasks.workunit.client.0.smithi162.stdout:1/326: rmdir d15/d1f/d35 39 2024-04-25T01:47:34.795 INFO:tasks.workunit.client.0.smithi162.stdout:9/254: mknod d4/d9/d15/c60 0 2024-04-25T01:47:34.849 INFO:tasks.workunit.client.0.smithi162.stdout:0/352: creat d0/d1/d4e/f74 x:0 0 0 2024-04-25T01:47:34.867 INFO:tasks.workunit.client.0.smithi162.stdout:7/302: dwrite df/d2e/d4c/f4f [0,4194304] 0 2024-04-25T01:47:35.367 INFO:tasks.workunit.client.0.smithi162.stdout:4/312: dread dd/df/f10 [0,4194304] 0 2024-04-25T01:47:35.407 INFO:tasks.workunit.client.0.smithi162.stdout:9/255: dread d4/d9/f47 [0,4194304] 0 2024-04-25T01:47:35.875 INFO:tasks.workunit.client.0.smithi162.stdout:6/264: write d1/d13/f15 [621613,86655] 0 2024-04-25T01:47:35.955 INFO:tasks.workunit.client.0.smithi162.stdout:0/353: creat d0/d1/d6a/f75 x:0 0 0 2024-04-25T01:47:36.168 INFO:tasks.workunit.client.0.smithi162.stdout:9/256: fdatasync d4/d9/d15/f23 0 2024-04-25T01:47:36.325 INFO:tasks.workunit.client.0.smithi162.stdout:4/313: truncate dd/d1a/d34/f50 567531 0 2024-04-25T01:47:36.455 INFO:tasks.workunit.client.0.smithi162.stdout:1/327: creat d15/d1f/f6c x:0 0 0 2024-04-25T01:47:36.611 INFO:tasks.workunit.client.0.smithi162.stdout:2/282: dwrite d0/d3/f1a [4194304,4194304] 0 2024-04-25T01:47:36.735 INFO:tasks.workunit.client.0.smithi162.stdout:6/265: mkdir d1/d13/d28/d45/d59 0 2024-04-25T01:47:36.747 INFO:tasks.workunit.client.0.smithi162.stdout:0/354: mkdir d0/d1/d4e/d76 0 2024-04-25T01:47:36.824 INFO:tasks.workunit.client.0.smithi162.stdout:7/303: creat df/d2c/d49/d5d/f60 x:0 0 0 2024-04-25T01:47:36.874 INFO:tasks.workunit.client.0.smithi162.stdout:7/304: chown df/f15 980 1 2024-04-25T01:47:37.107 INFO:tasks.workunit.client.0.smithi162.stdout:5/297: write d15/f3a [4789981,124970] 0 2024-04-25T01:47:37.671 INFO:tasks.workunit.client.0.smithi162.stdout:3/318: write d2/d9/f2d [1243474,115008] 0 2024-04-25T01:47:38.132 INFO:tasks.workunit.client.0.smithi162.stdout:7/305: rename df/d2c/f47 to df/d52/f61 0 2024-04-25T01:47:38.400 INFO:tasks.workunit.client.0.smithi162.stdout:3/319: write d2/d9/d10/d4c/f70 [778695,28868] 0 2024-04-25T01:47:38.432 INFO:tasks.workunit.client.0.smithi162.stdout:8/294: write d0/d1a/f3d [44746,89306] 0 2024-04-25T01:47:38.509 INFO:tasks.workunit.client.0.smithi162.stdout:6/266: symlink d1/d13/d28/d30/d3a/d57/l5a 0 2024-04-25T01:47:39.068 INFO:tasks.workunit.client.0.smithi162.stdout:3/320: unlink d2/d9/d19/d3f/c44 0 2024-04-25T01:47:39.128 INFO:tasks.workunit.client.0.smithi162.stdout:3/321: dread - d2/d9/d10/d4c/d51/f50 zero size 2024-04-25T01:47:39.331 INFO:tasks.workunit.client.0.smithi162.stdout:4/314: getdents dd/d1a/d34 0 2024-04-25T01:47:39.498 INFO:tasks.workunit.client.0.smithi162.stdout:6/267: dread d1/d13/d28/f29 [0,4194304] 0 2024-04-25T01:47:39.527 INFO:tasks.workunit.client.0.smithi162.stdout:8/295: symlink d0/d1a/l61 0 2024-04-25T01:47:40.428 INFO:tasks.workunit.client.0.smithi162.stdout:2/283: write d0/ff [1204668,40314] 0 2024-04-25T01:47:40.437 INFO:tasks.workunit.client.0.smithi162.stdout:0/355: write d0/df/d20/f45 [726421,14361] 0 2024-04-25T01:47:40.698 INFO:tasks.workunit.client.0.smithi162.stdout:5/298: dwrite d15/f2f [0,4194304] 0 2024-04-25T01:47:40.773 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:58:30.214 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:47:40.808 INFO:tasks.workunit.client.0.smithi162.stdout:1/328: rename d15/d1f/d35/d4c/l6a to d15/l6d 0 2024-04-25T01:47:40.880 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:58:30.321 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:47:40.959 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:58:30.400 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:47:40.989 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:58:30.347 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:47:40.995 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:58:30.353 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:47:40.996 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:58:30.354 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:47:41.000 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:58:30.358 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:47:41.055 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:58:30.413 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:47:41.059 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:58:30.417 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:47:41.127 INFO:tasks.workunit.client.0.smithi162.stdout:9/257: dwrite d4/f52 [0,4194304] 0 2024-04-25T01:47:41.495 INFO:tasks.workunit.client.0.smithi162.stdout:3/322: write d2/f62 [254157,124898] 0 2024-04-25T01:47:41.520 INFO:tasks.workunit.client.0.smithi162.stdout:0/356: mkdir d0/df/d20/d25/d55/d77 0 2024-04-25T01:47:41.590 INFO:tasks.workunit.client.0.smithi162.stdout:0/357: chown d0/fd 214991419 1 2024-04-25T01:47:41.622 INFO:tasks.workunit.client.0.smithi162.stdout:0/358: chown d0/df/d20/d25/d51 10431687 1 2024-04-25T01:47:41.673 INFO:tasks.workunit.client.0.smithi162.stdout:1/329: rmdir d15/d1f/d23/d30/d4a 39 2024-04-25T01:47:41.689 INFO:tasks.workunit.client.0.smithi162.stdout:2/284: rename d0/d3/d1b/d1d/d20/d5e/d61/d27 to d0/d3/d1b/d1d/d20/d5e/d61/d66 0 2024-04-25T01:47:42.388 INFO:tasks.workunit.client.0.smithi162.stdout:5/299: mknod d15/d19/d24/d4d/c5b 0 2024-04-25T01:47:42.644 INFO:tasks.workunit.client.0.smithi162.stdout:3/323: creat d2/d9/d19/f73 x:0 0 0 2024-04-25T01:47:42.821 INFO:tasks.workunit.client.0.smithi162.stdout:1/330: truncate d15/d1f/f27 608119 0 2024-04-25T01:47:42.876 INFO:tasks.workunit.client.0.smithi162.stdout:4/315: dwrite dd/d1a/d34/f50 [0,4194304] 0 2024-04-25T01:47:42.891 INFO:tasks.workunit.client.0.smithi162.stdout:7/306: write df/d52/f61 [218666,62837] 0 2024-04-25T01:47:43.370 INFO:tasks.workunit.client.0.smithi162.stdout:5/300: chown d15/d19/d24/d40 11 1 2024-04-25T01:47:43.441 INFO:tasks.workunit.client.0.smithi162.stdout:6/268: dwrite d1/d13/f17 [0,4194304] 0 2024-04-25T01:47:43.556 INFO:tasks.workunit.client.0.smithi162.stdout:0/359: mknod d0/df/d20/d25/d51/c78 0 2024-04-25T01:47:43.607 INFO:tasks.workunit.client.0.smithi162.stdout:8/296: dwrite d0/d44/f15 [0,4194304] 0 2024-04-25T01:47:43.757 INFO:tasks.workunit.client.0.smithi162.stdout:3/324: creat d2/d9/d10/d4c/f74 x:0 0 0 2024-04-25T01:47:43.886 INFO:tasks.workunit.client.0.smithi162.stdout:1/331: rmdir d15/d1f 39 2024-04-25T01:47:43.970 INFO:tasks.workunit.client.0.smithi162.stdout:4/316: truncate dd/df/d2e/d4b/f54 896552 0 2024-04-25T01:47:44.089 INFO:tasks.workunit.client.0.smithi162.stdout:0/360: symlink d0/df/l79 0 2024-04-25T01:47:44.112 INFO:tasks.workunit.client.0.smithi162.stdout:9/258: write d4/f26 [4389283,42790] 0 2024-04-25T01:47:44.167 INFO:tasks.workunit.client.0.smithi162.stdout:9/259: chown d4/d8 23874211 1 2024-04-25T01:47:44.174 INFO:tasks.workunit.client.0.smithi162.stdout:0/361: stat d0/df/d20/d37 0 2024-04-25T01:47:44.307 INFO:tasks.workunit.client.0.smithi162.stdout:3/325: creat d2/d9/d17/f75 x:0 0 0 2024-04-25T01:47:44.516 INFO:tasks.workunit.client.0.smithi162.stdout:2/285: getdents d0/d3/d1b/d1d/d20 0 2024-04-25T01:47:44.612 INFO:tasks.workunit.client.0.smithi162.stdout:2/286: write d0/ff [4439736,109146] 0 2024-04-25T01:47:44.748 INFO:tasks.workunit.client.0.smithi162.stdout:8/297: truncate d0/d1a/d25/f36 3192419 0 2024-04-25T01:47:44.830 INFO:tasks.workunit.client.0.smithi162.stdout:6/269: truncate d1/d13/d28/d30/d3a/f3e 3745841 0 2024-04-25T01:47:45.063 INFO:tasks.workunit.client.0.smithi162.stdout:5/301: creat d15/d19/d24/d2b/d3b/d58/f5c x:0 0 0 2024-04-25T01:47:45.137 INFO:tasks.workunit.client.0.smithi162.stdout:9/260: creat d4/d9/d15/d4e/f61 x:0 0 0 2024-04-25T01:47:45.350 INFO:tasks.workunit.client.0.smithi162.stdout:0/362: truncate d0/df/f39 2595036 0 2024-04-25T01:47:45.701 INFO:tasks.workunit.client.0.smithi162.stdout:7/307: link df/d2e/f40 df/d52/f62 0 2024-04-25T01:47:45.723 INFO:tasks.workunit.client.0.smithi162.stdout:2/287: rmdir d0/d3/d5/d36 39 2024-04-25T01:47:45.865 INFO:tasks.workunit.client.0.smithi162.stdout:2/288: chown d0/d3/d1b/f4f 113 1 2024-04-25T01:47:45.888 INFO:tasks.workunit.client.0.smithi162.stdout:6/270: dread d1/d13/f15 [0,4194304] 0 2024-04-25T01:47:45.922 INFO:tasks.workunit.client.0.smithi162.stdout:4/317: unlink dd/df/f6d 0 2024-04-25T01:47:46.156 INFO:tasks.workunit.client.0.smithi162.stdout:9/261: fsync d4/d9/d15/d1b/f2e 0 2024-04-25T01:47:46.178 INFO:tasks.workunit.client.0.smithi162.stdout:0/363: rename d0/df/d20/d25/d55/f69 to d0/df/d20/d37/d58/f7a 0 2024-04-25T01:47:46.210 INFO:tasks.workunit.client.0.smithi162.stdout:3/326: mknod d2/d9/c76 0 2024-04-25T01:47:46.626 INFO:tasks.workunit.client.0.smithi162.stdout:5/302: dread f11 [0,4194304] 0 2024-04-25T01:47:46.704 INFO:tasks.workunit.client.0.smithi162.stdout:5/303: dread d15/d1e/f2a [0,4194304] 0 2024-04-25T01:47:46.728 INFO:tasks.workunit.client.0.smithi162.stdout:5/304: readlink d15/d19/l23 0 2024-04-25T01:47:47.759 INFO:tasks.workunit.client.0.smithi162.stdout:3/327: symlink d2/d29/d2e/l77 0 2024-04-25T01:47:48.132 INFO:tasks.workunit.client.0.smithi162.stdout:1/332: write d15/d1f/d23/d30/f5a [946931,57727] 0 2024-04-25T01:47:48.195 INFO:tasks.workunit.client.0.smithi162.stdout:9/262: dread d4/d9/d15/d1b/d2f/d30/f3d [4194304,4194304] 0 2024-04-25T01:47:48.197 INFO:tasks.workunit.client.0.smithi162.stdout:1/333: chown f4 22976922 1 2024-04-25T01:47:48.257 INFO:tasks.workunit.client.0.smithi162.stdout:9/263: stat d4/d8/d13/d38/f5e 0 2024-04-25T01:47:48.358 INFO:tasks.workunit.client.0.smithi162.stdout:5/305: fsync d15/f3a 0 2024-04-25T01:47:48.367 INFO:tasks.workunit.client.0.smithi162.stdout:2/289: fsync d0/f5a 0 2024-04-25T01:47:48.665 INFO:tasks.workunit.client.0.smithi162.stdout:5/306: sync 2024-04-25T01:47:48.671 INFO:tasks.workunit.client.0.smithi162.stdout:5/307: readlink le 0 2024-04-25T01:47:48.786 INFO:tasks.workunit.client.0.smithi162.stdout:3/328: creat d2/d9/d10/d2c/f78 x:0 0 0 2024-04-25T01:47:48.836 INFO:tasks.workunit.client.0.smithi162.stdout:0/364: truncate d0/df/d20/d25/f4d 1767563 0 2024-04-25T01:47:49.016 INFO:tasks.workunit.client.0.smithi162.stdout:8/298: getdents d0/d1a 0 2024-04-25T01:47:49.043 INFO:tasks.workunit.client.0.smithi162.stdout:7/308: rmdir df/d52 39 2024-04-25T01:47:49.106 INFO:tasks.workunit.client.0.smithi162.stdout:1/334: symlink d15/d1f/d35/l6e 0 2024-04-25T01:47:49.134 INFO:tasks.workunit.client.0.smithi162.stdout:1/335: chown d15/d1f/d23/f51 1 1 2024-04-25T01:47:49.273 INFO:tasks.workunit.client.0.smithi162.stdout:9/264: creat d4/d9/d15/d1b/d2f/f62 x:0 0 0 2024-04-25T01:47:49.351 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:47:49.358 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:47:49.725 INFO:tasks.workunit.client.0.smithi162.stdout:6/271: write d1/f27 [650980,46522] 0 2024-04-25T01:47:49.807 INFO:tasks.workunit.client.0.smithi162.stdout:4/318: getdents dd/d1a/d34 0 2024-04-25T01:47:49.913 INFO:tasks.workunit.client.0.smithi162.stdout:2/290: unlink d0/d3/d1b/f56 0 2024-04-25T01:47:50.178 INFO:tasks.workunit.client.0.smithi162.stdout:5/308: symlink d15/d19/d24/d4d/l5d 0 2024-04-25T01:47:50.296 INFO:tasks.workunit.client.0.smithi162.stdout:3/329: rename d2/d9/f56 to d2/d9/d19/d3f/f79 0 2024-04-25T01:47:50.568 INFO:tasks.workunit.client.0.smithi162.stdout:0/365: fsync d0/d1/d6a/f75 0 2024-04-25T01:47:50.828 INFO:tasks.workunit.client.0.smithi162.stdout:7/309: mkdir df/d2c/d63 0 2024-04-25T01:47:50.910 INFO:tasks.workunit.client.0.smithi162.stdout:1/336: fdatasync d15/d1f/d23/f64 0 2024-04-25T01:47:50.960 INFO:tasks.workunit.client.0.smithi162.stdout:9/265: dread - d4/d8/f51 zero size 2024-04-25T01:47:51.001 INFO:tasks.workunit.client.0.smithi162.stdout:9/266: readlink d4/d8/d13/d38/d3b/l46 0 2024-04-25T01:47:51.380 INFO:tasks.workunit.client.0.smithi162.stdout:2/291: mkdir d0/d3/d1b/d1d/d20/d67 0 2024-04-25T01:47:51.435 INFO:tasks.workunit.client.0.smithi162.stdout:2/292: chown d0/d3/d1b/d1d/c48 0 1 2024-04-25T01:47:51.533 INFO:tasks.workunit.client.0.smithi162.stdout:6/272: rename d1/d13/d28/d30/f33 to d1/d13/d28/d30/d3a/f5b 0 2024-04-25T01:47:51.652 INFO:tasks.workunit.client.0.smithi162.stdout:3/330: dread d2/f62 [0,4194304] 0 2024-04-25T01:47:51.866 INFO:tasks.workunit.client.0.smithi162.stdout:0/366: dread - d0/df/d20/d37/f6c zero size 2024-04-25T01:47:52.525 INFO:tasks.workunit.client.0.smithi162.stdout:5/309: mknod d15/d19/d24/c5e 0 2024-04-25T01:47:52.827 INFO:tasks.workunit.client.0.smithi162.stdout:9/267: dread d4/d9/d15/d1b/f28 [0,4194304] 0 2024-04-25T01:47:52.855 INFO:tasks.workunit.client.0.smithi162.stdout:7/310: mknod df/d2c/d63/c64 0 2024-04-25T01:47:53.042 INFO:tasks.workunit.client.0.smithi162.stdout:6/273: mkdir d1/d5c 0 2024-04-25T01:47:53.055 INFO:tasks.workunit.client.0.smithi162.stdout:6/274: readlink d1/l18 0 2024-04-25T01:47:53.421 INFO:tasks.workunit.client.0.smithi162.stdout:2/293: rename d0/d3/d1b/d1d/d20/c50 to d0/d3/d1b/d1d/d20/d67/c68 0 2024-04-25T01:47:54.328 INFO:tasks.workunit.client.0.smithi162.stdout:8/299: dwrite d0/d44/d31/d33/f53 [0,4194304] 0 2024-04-25T01:47:54.414 INFO:tasks.workunit.client.0.smithi162.stdout:7/311: unlink df/d2e/c4e 0 2024-04-25T01:47:54.465 INFO:tasks.workunit.client.0.smithi162.stdout:8/300: chown d0/d1a/d25/c59 137099 1 2024-04-25T01:47:54.561 INFO:tasks.workunit.client.0.smithi162.stdout:3/331: getdents d2/d9/d19 0 2024-04-25T01:47:54.562 INFO:tasks.workunit.client.0.smithi162.stdout:6/275: getdents d1/d13/d28/d53 0 2024-04-25T01:47:54.814 INFO:tasks.workunit.client.0.smithi162.stdout:2/294: mkdir d0/d3/d5/d69 0 2024-04-25T01:47:54.867 INFO:tasks.workunit.client.0.smithi162.stdout:7/312: dread - df/d2c/f3b zero size 2024-04-25T01:47:55.164 INFO:tasks.workunit.client.0.smithi162.stdout:4/319: dwrite dd/d1a/f21 [0,4194304] 0 2024-04-25T01:47:55.265 INFO:tasks.workunit.client.0.smithi162.stdout:3/332: creat d2/d29/d2e/f7a x:0 0 0 2024-04-25T01:47:55.333 INFO:tasks.workunit.client.0.smithi162.stdout:6/276: unlink d1/d13/d28/d30/l4c 0 2024-04-25T01:47:55.334 INFO:tasks.workunit.client.0.smithi162.stdout:4/320: sync 2024-04-25T01:47:55.639 INFO:tasks.workunit.client.0.smithi162.stdout:2/295: dread d0/f9 [0,4194304] 0 2024-04-25T01:47:55.799 INFO:tasks.workunit.client.0.smithi162.stdout:8/301: mknod d0/d12/c62 0 2024-04-25T01:47:55.963 INFO:tasks.workunit.client.0.smithi162.stdout:7/313: mknod df/d2c/d63/c65 0 2024-04-25T01:47:56.347 INFO:tasks.workunit.client.0.smithi162.stdout:3/333: fdatasync d2/d9/f30 0 2024-04-25T01:47:56.575 INFO:tasks.workunit.client.0.smithi162.stdout:9/268: link d4/d8/d13/l5a d4/d8/l63 0 2024-04-25T01:47:56.616 INFO:tasks.workunit.client.0.smithi162.stdout:1/337: dwrite d15/f1a [4194304,4194304] 0 2024-04-25T01:47:57.078 INFO:tasks.workunit.client.0.smithi162.stdout:7/314: truncate df/f37 2210986 0 2024-04-25T01:47:57.450 INFO:tasks.workunit.client.0.smithi162.stdout:6/277: mknod d1/c5d 0 2024-04-25T01:47:57.974 INFO:tasks.workunit.client.0.smithi162.stdout:1/338: creat d15/d1f/d35/d4c/f6f x:0 0 0 2024-04-25T01:47:58.148 INFO:tasks.workunit.client.0.smithi162.stdout:1/339: sync 2024-04-25T01:47:58.649 INFO:tasks.workunit.client.0.smithi162.stdout:7/315: dread fa [0,4194304] 0 2024-04-25T01:47:58.823 INFO:tasks.workunit.client.0.smithi162.stdout:4/321: getdents dd/df/d2e 0 2024-04-25T01:47:58.911 INFO:tasks.workunit.client.0.smithi162.stdout:6/278: mkdir d1/d13/d28/d53/d5e 0 2024-04-25T01:47:59.573 INFO:tasks.workunit.client.0.smithi162.stdout:4/322: symlink dd/d1a/d34/d57/l6e 0 2024-04-25T01:48:00.040 INFO:tasks.workunit.client.0.smithi162.stdout:0/367: mkdir d0/d7b 0 2024-04-25T01:48:00.093 INFO:tasks.workunit.client.0.smithi162.stdout:0/368: chown d0/df/d20/d25/d55/l5f 0 1 2024-04-25T01:48:00.199 INFO:tasks.workunit.client.0.smithi162.stdout:6/279: getdents d1/d13/d28/d53/d5e 0 2024-04-25T01:48:00.300 INFO:tasks.workunit.client.0.smithi162.stdout:9/269: link d4/d9/d15/d1b/l4a d4/d8/d13/l64 0 2024-04-25T01:48:00.421 INFO:tasks.workunit.client.0.smithi162.stdout:0/369: dread - d0/df/d20/d25/f49 zero size 2024-04-25T01:48:00.692 INFO:tasks.workunit.client.0.smithi162.stdout:9/270: creat d4/d9/d15/d4e/f65 x:0 0 0 2024-04-25T01:48:00.694 INFO:tasks.workunit.client.0.smithi162.stdout:0/370: symlink d0/d1/d6a/l7c 0 2024-04-25T01:48:00.878 INFO:tasks.workunit.client.0.smithi162.stdout:6/280: creat d1/d5c/f5f x:0 0 0 2024-04-25T01:48:00.909 INFO:tasks.workunit.client.0.smithi162.stdout:8/302: write d0/d44/f15 [2017758,67498] 0 2024-04-25T01:48:01.308 INFO:tasks.workunit.client.0.smithi162.stdout:0/371: mkdir d0/df/d20/d25/d55/d6f/d7d 0 2024-04-25T01:48:01.629 INFO:tasks.workunit.client.0.smithi162.stdout:0/372: truncate d0/d1/f7 918718 0 2024-04-25T01:48:01.734 INFO:tasks.workunit.client.0.smithi162.stdout:5/310: rename d15/f50 to d15/d19/d24/d40/f5f 0 2024-04-25T01:48:02.102 INFO:tasks.workunit.client.0.smithi162.stdout:0/373: mkdir d0/d59/d7e 0 2024-04-25T01:48:02.269 INFO:tasks.workunit.client.0.smithi162.stdout:5/311: chown d15/c16 2517476 1 2024-04-25T01:48:02.373 INFO:tasks.workunit.client.0.smithi162.stdout:2/296: rename d0/d3/d1b/d1d/d3a/c4a to d0/d3/d5/d36/c6a 0 2024-04-25T01:48:02.539 INFO:tasks.workunit.client.0.smithi162.stdout:9/271: link d4/d9/f47 d4/d9/d15/d4e/f66 0 2024-04-25T01:48:03.255 INFO:tasks.workunit.client.0.smithi162.stdout:5/312: symlink d15/l60 0 2024-04-25T01:48:03.276 INFO:tasks.workunit.client.0.smithi162.stdout:3/334: dwrite d2/d9/d10/f11 [0,4194304] 0 2024-04-25T01:48:03.421 INFO:tasks.workunit.client.0.smithi162.stdout:2/297: mkdir d0/d3/d1b/d6b 0 2024-04-25T01:48:03.651 INFO:tasks.workunit.client.0.smithi162.stdout:7/316: dwrite f4 [0,4194304] 0 2024-04-25T01:48:03.835 INFO:tasks.workunit.client.0.smithi162.stdout:9/272: unlink d4/d25/f34 0 2024-04-25T01:48:03.854 INFO:tasks.workunit.client.0.smithi162.stdout:1/340: write d15/d1f/f27 [1136842,26796] 0 2024-04-25T01:48:04.169 INFO:tasks.workunit.client.0.smithi162.stdout:8/303: write d0/d1a/d25/f56 [797901,130666] 0 2024-04-25T01:48:04.250 INFO:tasks.workunit.client.0.smithi162.stdout:7/317: dread df/f2a [0,4194304] 0 2024-04-25T01:48:04.391 INFO:tasks.workunit.client.0.smithi162.stdout:3/335: mkdir d2/d29/d5d/d7b 0 2024-04-25T01:48:04.467 INFO:tasks.workunit.client.0.smithi162.stdout:4/323: dwrite dd/f2c [0,4194304] 0 2024-04-25T01:48:04.611 INFO:tasks.workunit.client.0.smithi162.stdout:5/313: mknod d15/d19/d24/d4d/c61 0 2024-04-25T01:48:04.678 INFO:tasks.workunit.client.0.smithi162.stdout:3/336: dread - d2/d9/d19/f73 zero size 2024-04-25T01:48:04.701 INFO:tasks.workunit.client.0.smithi162.stdout:6/281: dwrite d1/d13/d28/d30/d3a/f4b [0,4194304] 0 2024-04-25T01:48:04.865 INFO:tasks.workunit.client.0.smithi162.stdout:2/298: symlink d0/d3/d1b/d1d/l6c 0 2024-04-25T01:48:04.917 INFO:tasks.workunit.client.0.smithi162.stdout:3/337: chown d2/d9/c76 1445 1 2024-04-25T01:48:05.021 INFO:tasks.workunit.client.0.smithi162.stdout:3/338: chown d2/d29/d2e/f5e 44786 1 2024-04-25T01:48:05.206 INFO:tasks.workunit.client.0.smithi162.stdout:8/304: mknod d0/d12/d3a/c63 0 2024-04-25T01:48:05.379 INFO:tasks.workunit.client.0.smithi162.stdout:7/318: creat df/d2c/d56/f66 x:0 0 0 2024-04-25T01:48:05.464 INFO:tasks.workunit.client.0.smithi162.stdout:4/324: creat dd/df/d2e/d59/f6f x:0 0 0 2024-04-25T01:48:05.604 INFO:tasks.workunit.client.0.smithi162.stdout:5/314: mknod d15/d19/d24/d40/c62 0 2024-04-25T01:48:05.768 INFO:tasks.workunit.client.0.smithi162.stdout:6/282: symlink d1/d13/d28/d30/d3a/l60 0 2024-04-25T01:48:06.451 INFO:tasks.workunit.client.0.smithi162.stdout:0/374: dwrite d0/df/d20/d25/f4d [0,4194304] 0 2024-04-25T01:48:06.559 INFO:tasks.workunit.client.0.smithi162.stdout:7/319: chown df/c50 25132666 1 2024-04-25T01:48:07.027 INFO:tasks.workunit.client.0.smithi162.stdout:9/273: write d4/f52 [3793839,67163] 0 2024-04-25T01:48:07.654 INFO:tasks.workunit.client.0.smithi162.stdout:7/320: unlink df/d2e/d4c/f4f 0 2024-04-25T01:48:07.940 INFO:tasks.workunit.client.0.smithi162.stdout:6/283: truncate d1/f48 773697 0 2024-04-25T01:48:08.612 INFO:tasks.workunit.client.0.smithi162.stdout:1/341: dwrite d15/d1f/d35/f44 [0,4194304] 0 2024-04-25T01:48:08.806 INFO:tasks.workunit.client.0.smithi162.stdout:7/321: mknod df/d2c/d56/c67 0 2024-04-25T01:48:08.849 INFO:tasks.workunit.client.0.smithi162.stdout:2/299: getdents d0/d3/d1b/d1d/d20/d42 0 2024-04-25T01:48:09.002 INFO:tasks.workunit.client.0.smithi162.stdout:3/339: getdents d2/d29/d2e 0 2024-04-25T01:48:09.033 INFO:tasks.workunit.client.0.smithi162.stdout:8/305: getdents d0/d12/d2b 0 2024-04-25T01:48:09.246 INFO:tasks.workunit.client.0.smithi162.stdout:5/315: dwrite f3 [0,4194304] 0 2024-04-25T01:48:09.371 INFO:tasks.workunit.client.0.smithi162.stdout:4/325: getdents dd/d1a/d34/d57 0 2024-04-25T01:48:09.688 INFO:tasks.workunit.client.0.smithi162.stdout:4/326: dwrite dd/df/d2e/f3b [0,4194304] 0 2024-04-25T01:48:10.132 INFO:tasks.workunit.client.0.smithi162.stdout:4/327: dread dd/d1a/f22 [0,4194304] 0 2024-04-25T01:48:10.200 INFO:tasks.workunit.client.0.smithi162.stdout:3/340: dread - d2/d9/d10/d2c/f78 zero size 2024-04-25T01:48:10.401 INFO:tasks.workunit.client.0.smithi162.stdout:9/274: write d4/d9/d15/f35 [196775,106957] 0 2024-04-25T01:48:10.445 INFO:tasks.workunit.client.0.smithi162.stdout:9/275: stat d4/d9/d15/d4e/f65 0 2024-04-25T01:48:10.604 INFO:tasks.workunit.client.0.smithi162.stdout:6/284: link d1/f51 d1/d13/d28/d45/f61 0 2024-04-25T01:48:10.994 INFO:tasks.workunit.client.0.smithi162.stdout:1/342: write d15/d1f/d23/d30/f60 [679689,14094] 0 2024-04-25T01:48:11.271 INFO:tasks.workunit.client.0.smithi162.stdout:0/375: write d0/d1/f1e [960727,36569] 0 2024-04-25T01:48:11.315 INFO:tasks.workunit.client.0.smithi162.stdout:0/376: fsync d0/d1/f1e 0 2024-04-25T01:48:11.644 INFO:tasks.workunit.client.0.smithi162.stdout:3/341: creat d2/d9/d10/d4c/f7c x:0 0 0 2024-04-25T01:48:12.302 INFO:tasks.workunit.client.0.smithi162.stdout:5/316: dwrite d15/d19/f20 [0,4194304] 0 2024-04-25T01:48:12.446 INFO:tasks.workunit.client.0.smithi162.stdout:1/343: truncate d15/d1f/f5f 225905 0 2024-04-25T01:48:12.451 INFO:tasks.workunit.client.0.smithi162.stdout:9/276: dread - d4/d9/d15/f49 zero size 2024-04-25T01:48:12.458 INFO:tasks.workunit.client.0.smithi162.stdout:8/306: dwrite d0/d44/d31/d33/f47 [0,4194304] 0 2024-04-25T01:48:12.586 INFO:tasks.workunit.client.0.smithi162.stdout:7/322: dwrite df/f43 [0,4194304] 0 2024-04-25T01:48:12.698 INFO:tasks.workunit.client.0.smithi162.stdout:5/317: readlink d15/l60 0 2024-04-25T01:48:12.743 INFO:tasks.workunit.client.0.smithi162.stdout:4/328: write dd/d1a/d34/f50 [4162208,98641] 0 2024-04-25T01:48:12.962 INFO:tasks.workunit.client.0.smithi162.stdout:2/300: dwrite d0/d3/f47 [0,4194304] 0 2024-04-25T01:48:13.103 INFO:tasks.workunit.client.0.smithi162.stdout:6/285: rmdir d1/d13/d28/d30 39 2024-04-25T01:48:13.217 INFO:tasks.workunit.client.0.smithi162.stdout:3/342: unlink d2/d9/d10/d4c/d51/f50 0 2024-04-25T01:48:13.420 INFO:tasks.workunit.client.0.smithi162.stdout:8/307: fsync d0/f16 0 2024-04-25T01:48:13.487 INFO:tasks.workunit.client.0.smithi162.stdout:2/301: dread d0/d3/d1b/f22 [0,4194304] 0 2024-04-25T01:48:13.516 INFO:tasks.workunit.client.0.smithi162.stdout:0/377: unlink d0/df/f43 0 2024-04-25T01:48:13.568 INFO:tasks.workunit.client.0.smithi162.stdout:1/344: fsync d15/f34 0 2024-04-25T01:48:14.275 INFO:tasks.workunit.client.0.smithi162.stdout:2/302: mknod d0/d3/d1b/d1d/d20/d42/c6d 0 2024-04-25T01:48:14.372 INFO:tasks.workunit.client.0.smithi162.stdout:7/323: symlink df/l68 0 2024-04-25T01:48:15.148 INFO:tasks.workunit.client.0.smithi162.stdout:8/308: mkdir d0/d44/d64 0 2024-04-25T01:48:15.252 INFO:tasks.workunit.client.0.smithi162.stdout:9/277: dwrite d4/d25/f54 [0,4194304] 0 2024-04-25T01:48:15.384 INFO:tasks.workunit.client.0.smithi162.stdout:7/324: rmdir df 39 2024-04-25T01:48:15.394 INFO:tasks.workunit.client.0.smithi162.stdout:6/286: write d1/f21 [1951103,20451] 0 2024-04-25T01:48:15.472 INFO:tasks.workunit.client.0.smithi162.stdout:5/318: creat d15/d19/f63 x:0 0 0 2024-04-25T01:48:15.645 INFO:tasks.workunit.client.0.smithi162.stdout:3/343: creat d2/d9/f7d x:0 0 0 2024-04-25T01:48:15.875 INFO:tasks.workunit.client.0.smithi162.stdout:5/319: dwrite d15/d19/f20 [0,4194304] 0 2024-04-25T01:48:16.126 INFO:tasks.workunit.client.0.smithi162.stdout:1/345: dwrite d15/d1f/d23/f64 [0,4194304] 0 2024-04-25T01:48:16.246 INFO:tasks.workunit.client.0.smithi162.stdout:0/378: link d0/d59/f68 d0/d7b/f7f 0 2024-04-25T01:48:16.306 INFO:tasks.workunit.client.0.smithi162.stdout:2/303: write d0/d3/d1b/d1d/d3a/f3b [1101070,127771] 0 2024-04-25T01:48:16.523 INFO:tasks.workunit.client.0.smithi162.stdout:4/329: getdents dd/d1a 0 2024-04-25T01:48:16.570 INFO:tasks.workunit.client.0.smithi162.stdout:3/344: dread - d2/d9/f66 zero size 2024-04-25T01:48:16.650 INFO:tasks.workunit.client.0.smithi162.stdout:5/320: dread fd [0,4194304] 0 2024-04-25T01:48:17.148 INFO:tasks.workunit.client.0.smithi162.stdout:7/325: rename df/f2a to df/d2c/d63/f69 0 2024-04-25T01:48:17.195 INFO:tasks.workunit.client.0.smithi162.stdout:8/309: write d0/d44/d31/f34 [1235830,85563] 0 2024-04-25T01:48:17.536 INFO:tasks.workunit.client.0.smithi162.stdout:2/304: truncate d0/d3/d1b/d1d/d20/f54 266367 0 2024-04-25T01:48:17.610 INFO:tasks.workunit.client.0.smithi162.stdout:1/346: dread d15/d1f/d23/f25 [0,4194304] 0 2024-04-25T01:48:17.618 INFO:tasks.workunit.client.0.smithi162.stdout:0/379: dread d0/d1/f53 [0,4194304] 0 2024-04-25T01:48:17.870 INFO:tasks.workunit.client.0.smithi162.stdout:8/310: mkdir d0/d44/d31/d65 0 2024-04-25T01:48:17.910 INFO:tasks.workunit.client.0.smithi162.stdout:4/330: dread dd/df/d2e/d4b/f54 [0,4194304] 0 2024-04-25T01:48:18.011 INFO:tasks.workunit.client.0.smithi162.stdout:9/278: getdents d4/d8/d13 0 2024-04-25T01:48:18.075 INFO:tasks.workunit.client.0.smithi162.stdout:2/305: stat d0/d3/d1b/d1d/d20/d67 0 2024-04-25T01:48:18.214 INFO:tasks.workunit.client.0.smithi162.stdout:5/321: creat d15/d19/d24/f64 x:0 0 0 2024-04-25T01:48:18.252 INFO:tasks.workunit.client.0.smithi162.stdout:6/287: dread d1/d13/d28/d30/d3a/f3d [0,4194304] 0 2024-04-25T01:48:18.528 INFO:tasks.workunit.client.0.smithi162.stdout:6/288: sync 2024-04-25T01:48:18.570 INFO:tasks.workunit.client.0.smithi162.stdout:1/347: dread d15/d1f/d23/f25 [0,4194304] 0 2024-04-25T01:48:18.572 INFO:tasks.workunit.client.0.smithi162.stdout:8/311: fsync d0/d44/d31/f34 0 2024-04-25T01:48:18.707 INFO:tasks.workunit.client.0.smithi162.stdout:0/380: write d0/df/d20/f45 [1676825,29050] 0 2024-04-25T01:48:18.857 INFO:tasks.workunit.client.0.smithi162.stdout:7/326: dread f1 [0,4194304] 0 2024-04-25T01:48:18.884 INFO:tasks.workunit.client.0.smithi162.stdout:5/322: chown d15/d1e/c47 764193 1 2024-04-25T01:48:19.049 INFO:tasks.workunit.client.0.smithi162.stdout:3/345: dwrite d2/d9/d10/d4c/f74 [0,4194304] 0 2024-04-25T01:48:19.153 INFO:tasks.workunit.client.0.smithi162.stdout:7/327: readlink df/d2c/l31 0 2024-04-25T01:48:19.238 INFO:tasks.workunit.client.0.smithi162.stdout:7/328: chown df/f33 145445695 1 2024-04-25T01:48:19.240 INFO:tasks.workunit.client.0.smithi162.stdout:4/331: dread dd/df/d58/f5a [0,4194304] 0 2024-04-25T01:48:19.409 INFO:tasks.workunit.client.0.smithi162.stdout:9/279: symlink d4/d8/d13/d38/d3b/l67 0 2024-04-25T01:48:19.424 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:48:19.427 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:48:19.491 INFO:tasks.workunit.client.0.smithi162.stdout:0/381: creat d0/d59/f80 x:0 0 0 2024-04-25T01:48:19.518 INFO:tasks.workunit.client.0.smithi162.stdout:8/312: mknod d0/d12/c66 0 2024-04-25T01:48:19.621 INFO:tasks.workunit.client.0.smithi162.stdout:4/332: creat dd/d1a/d4e/f70 x:0 0 0 2024-04-25T01:48:19.678 INFO:tasks.workunit.client.0.smithi162.stdout:1/348: write d15/d1f/d23/f57 [466779,32143] 0 2024-04-25T01:48:19.796 INFO:tasks.workunit.client.0.smithi162.stdout:5/323: creat d15/f65 x:0 0 0 2024-04-25T01:48:19.920 INFO:tasks.workunit.client.0.smithi162.stdout:1/349: chown d15/d1f 122 1 2024-04-25T01:48:20.001 INFO:tasks.workunit.client.0.smithi162.stdout:3/346: write d2/f65 [4590105,7160] 0 2024-04-25T01:48:20.245 INFO:tasks.workunit.client.0.smithi162.stdout:7/329: getdents df 0 2024-04-25T01:48:20.257 INFO:tasks.workunit.client.0.smithi162.stdout:6/289: dwrite d1/f3f [0,4194304] 0 2024-04-25T01:48:20.536 INFO:tasks.workunit.client.0.smithi162.stdout:5/324: write d15/f65 [164689,27095] 0 2024-04-25T01:48:20.556 INFO:tasks.workunit.client.0.smithi162.stdout:8/313: write d0/d12/f17 [1759316,116292] 0 2024-04-25T01:48:20.654 INFO:tasks.workunit.client.0.smithi162.stdout:2/306: dwrite d0/f9 [0,4194304] 0 2024-04-25T01:48:20.803 INFO:tasks.workunit.client.0.smithi162.stdout:4/333: unlink dd/df/d2e/d4b/c60 0 2024-04-25T01:48:20.827 INFO:tasks.workunit.client.0.smithi162.stdout:0/382: write d0/df/d20/d25/d55/f5c [119279,128440] 0 2024-04-25T01:48:20.921 INFO:tasks.workunit.client.0.smithi162.stdout:9/280: read d4/d8/f37 [90712,87200] 0 2024-04-25T01:48:21.122 INFO:tasks.workunit.client.0.smithi162.stdout:7/330: creat df/d2e/d4c/f6a x:0 0 0 2024-04-25T01:48:21.387 INFO:tasks.workunit.client.0.smithi162.stdout:1/350: dread f4 [0,4194304] 0 2024-04-25T01:48:21.876 INFO:tasks.workunit.client.0.smithi162.stdout:9/281: mknod d4/d9/d15/d1b/c68 0 2024-04-25T01:48:22.192 INFO:tasks.workunit.client.0.smithi162.stdout:5/325: dread d15/d19/d24/f25 [0,4194304] 0 2024-04-25T01:48:22.257 INFO:tasks.workunit.client.0.smithi162.stdout:4/334: rename dd/df/f24 to dd/d1a/d34/d57/f71 0 2024-04-25T01:48:22.384 INFO:tasks.workunit.client.0.smithi162.stdout:9/282: stat d4/d9/d15/f3f 0 2024-04-25T01:48:22.409 INFO:tasks.workunit.client.0.smithi162.stdout:3/347: dwrite d2/d9/d17/f75 [0,4194304] 0 2024-04-25T01:48:22.430 INFO:tasks.workunit.client.0.smithi162.stdout:8/314: dread d0/d44/d31/d33/f53 [0,4194304] 0 2024-04-25T01:48:22.563 INFO:tasks.workunit.client.0.smithi162.stdout:6/290: dwrite d1/d13/f50 [0,4194304] 0 2024-04-25T01:48:22.820 INFO:tasks.workunit.client.0.smithi162.stdout:9/283: chown d4/d8/d13/l2c 15606952 1 2024-04-25T01:48:23.026 INFO:tasks.workunit.client.0.smithi162.stdout:1/351: mkdir d15/d1f/d35/d4c/d70 0 2024-04-25T01:48:23.492 INFO:tasks.workunit.client.0.smithi162.stdout:4/335: mkdir dd/d1a/d34/d72 0 2024-04-25T01:48:23.910 INFO:tasks.workunit.client.0.smithi162.stdout:5/326: dread d15/d19/d24/d40/f4b [0,4194304] 0 2024-04-25T01:48:24.007 INFO:tasks.workunit.client.0.smithi162.stdout:7/331: dwrite df/d2c/d56/f66 [0,4194304] 0 2024-04-25T01:48:24.124 INFO:tasks.workunit.client.0.smithi162.stdout:9/284: mkdir d4/d9/d15/d1b/d69 0 2024-04-25T01:48:24.214 INFO:tasks.workunit.client.0.smithi162.stdout:1/352: fdatasync d15/d1f/f61 0 2024-04-25T01:48:24.420 INFO:tasks.workunit.client.0.smithi162.stdout:0/383: dwrite d0/df/f66 [0,4194304] 0 2024-04-25T01:48:24.527 INFO:tasks.workunit.client.0.smithi162.stdout:2/307: link d0/d3/d1b/d1d/d20/c58 d0/d3/d1b/d1d/d20/d42/c6e 0 2024-04-25T01:48:24.543 INFO:tasks.workunit.client.0.smithi162.stdout:4/336: mknod dd/df/d2e/d4b/c73 0 2024-04-25T01:48:24.755 INFO:tasks.workunit.client.0.smithi162.stdout:6/291: mknod d1/d13/c62 0 2024-04-25T01:48:24.838 INFO:tasks.workunit.client.0.smithi162.stdout:5/327: fdatasync d15/d19/f20 0 2024-04-25T01:48:25.340 INFO:tasks.workunit.client.0.smithi162.stdout:0/384: fdatasync d0/fd 0 2024-04-25T01:48:25.987 INFO:tasks.workunit.client.0.smithi162.stdout:4/337: symlink dd/df/d2e/d4b/l74 0 2024-04-25T01:48:26.106 INFO:tasks.workunit.client.0.smithi162.stdout:6/292: rename d1/d13/d28/d53/d5e to d1/d13/d28/d30/d63 0 2024-04-25T01:48:26.127 INFO:tasks.workunit.client.0.smithi162.stdout:8/315: write d0/d44/d31/d33/f54 [5101138,125821] 0 2024-04-25T01:48:26.187 INFO:tasks.workunit.client.0.smithi162.stdout:3/348: dwrite d2/d9/f30 [0,4194304] 0 2024-04-25T01:48:26.337 INFO:tasks.workunit.client.0.smithi162.stdout:5/328: truncate d15/d19/f59 486108 0 2024-04-25T01:48:26.572 INFO:tasks.workunit.client.0.smithi162.stdout:5/329: sync 2024-04-25T01:48:26.756 INFO:tasks.workunit.client.0.smithi162.stdout:1/353: symlink d15/l71 0 2024-04-25T01:48:26.888 INFO:tasks.workunit.client.0.smithi162.stdout:0/385: fsync d0/d1/f3d 0 2024-04-25T01:48:26.967 INFO:tasks.workunit.client.0.smithi162.stdout:2/308: mknod d0/d3/d30/c6f 0 2024-04-25T01:48:27.139 INFO:tasks.workunit.client.0.smithi162.stdout:9/285: write f3 [4893266,33042] 0 2024-04-25T01:48:27.312 INFO:tasks.workunit.client.0.smithi162.stdout:7/332: write df/f4d [3595732,60692] 0 2024-04-25T01:48:27.582 INFO:tasks.workunit.client.0.smithi162.stdout:9/286: dread d4/d9/d15/d1b/f2e [0,4194304] 0 2024-04-25T01:48:27.746 INFO:tasks.workunit.client.0.smithi162.stdout:9/287: dread - d4/d9/d15/f49 zero size 2024-04-25T01:48:27.817 INFO:tasks.workunit.client.0.smithi162.stdout:3/349: creat d2/d9/d10/d4c/d51/f7e x:0 0 0 2024-04-25T01:48:27.847 INFO:tasks.workunit.client.0.smithi162.stdout:8/316: dread - d0/d1a/d25/f58 zero size 2024-04-25T01:48:27.851 INFO:tasks.workunit.client.0.smithi162.stdout:6/293: creat d1/d13/d28/d30/d3a/d57/f64 x:0 0 0 2024-04-25T01:48:27.885 INFO:tasks.workunit.client.0.smithi162.stdout:7/333: dwrite df/f20 [0,4194304] 0 2024-04-25T01:48:27.900 INFO:tasks.workunit.client.0.smithi162.stdout:9/288: chown d4 3123 1 2024-04-25T01:48:28.371 INFO:tasks.workunit.client.0.smithi162.stdout:0/386: chown d0/df/d20/d37/d58/f7a 8977 1 2024-04-25T01:48:28.862 INFO:tasks.workunit.client.0.smithi162.stdout:2/309: dread d0/d3/d1b/d1d/d3a/f3b [0,4194304] 0 2024-04-25T01:48:29.230 INFO:tasks.workunit.client.0.smithi162.stdout:5/330: symlink d15/d19/l66 0 2024-04-25T01:48:29.697 INFO:tasks.workunit.client.0.smithi162.stdout:1/354: symlink d15/d69/l72 0 2024-04-25T01:48:29.818 INFO:tasks.workunit.client.0.smithi162.stdout:0/387: truncate d0/df/f14 1950863 0 2024-04-25T01:48:29.941 INFO:tasks.workunit.client.0.smithi162.stdout:4/338: link dd/d1a/d34/l3c dd/df/l75 0 2024-04-25T01:48:31.015 INFO:tasks.workunit.client.0.smithi162.stdout:0/388: mkdir d0/df/d20/d37/d81 0 2024-04-25T01:48:31.033 INFO:tasks.workunit.client.0.smithi162.stdout:2/310: fdatasync d0/d3/f35 0 2024-04-25T01:48:31.330 INFO:tasks.workunit.client.0.smithi162.stdout:7/334: rmdir df/d2e/d4c/d58/d5e 0 2024-04-25T01:48:31.350 INFO:tasks.workunit.client.0.smithi162.stdout:1/355: mkdir d15/d1f/d35/d4c/d70/d73 0 2024-04-25T01:48:32.165 INFO:tasks.workunit.client.0.smithi162.stdout:6/294: write d1/d13/f17 [3941755,57502] 0 2024-04-25T01:48:32.339 INFO:tasks.workunit.client.0.smithi162.stdout:6/295: readlink d1/d13/d28/l54 0 2024-04-25T01:48:32.397 INFO:tasks.workunit.client.0.smithi162.stdout:5/331: creat d15/d19/f67 x:0 0 0 2024-04-25T01:48:32.573 INFO:tasks.workunit.client.0.smithi162.stdout:4/339: link fb dd/df/d2e/d59/f76 0 2024-04-25T01:48:32.672 INFO:tasks.workunit.client.0.smithi162.stdout:9/289: dwrite d4/f52 [4194304,4194304] 0 2024-04-25T01:48:32.677 INFO:tasks.workunit.client.0.smithi162.stdout:5/332: chown le 0 1 2024-04-25T01:48:32.719 INFO:tasks.workunit.client.0.smithi162.stdout:8/317: mkdir d0/d67 0 2024-04-25T01:48:32.885 INFO:tasks.workunit.client.0.smithi162.stdout:2/311: symlink d0/d3/d5/l70 0 2024-04-25T01:48:32.926 INFO:tasks.workunit.client.0.smithi162.stdout:1/356: creat d15/d1f/d35/d5c/f74 x:0 0 0 2024-04-25T01:48:33.091 INFO:tasks.workunit.client.0.smithi162.stdout:3/350: dwrite d2/d9/d19/f36 [0,4194304] 0 2024-04-25T01:48:33.234 INFO:tasks.workunit.client.0.smithi162.stdout:2/312: stat d0/d3/d5/d69 0 2024-04-25T01:48:33.614 INFO:tasks.workunit.client.0.smithi162.stdout:4/340: read dd/d1a/d34/d57/f71 [814802,43515] 0 2024-04-25T01:48:33.658 INFO:tasks.workunit.client.0.smithi162.stdout:4/341: dread dd/df/d2e/d4b/f54 [0,4194304] 0 2024-04-25T01:48:34.182 INFO:tasks.workunit.client.0.smithi162.stdout:9/290: mkdir d4/d8/d13/d6a 0 2024-04-25T01:48:34.312 INFO:tasks.workunit.client.0.smithi162.stdout:8/318: dread d0/d12/d3a/f42 [0,4194304] 0 2024-04-25T01:48:34.378 INFO:tasks.workunit.client.0.smithi162.stdout:2/313: fdatasync d0/d3/d1b/d1d/d20/d5e/d61/d66/f24 0 2024-04-25T01:48:34.536 INFO:tasks.workunit.client.0.smithi162.stdout:3/351: rename d2/d9/d10/d40/c59 to d2/d9/d19/d3f/c7f 0 2024-04-25T01:48:35.088 INFO:tasks.workunit.client.0.smithi162.stdout:5/333: unlink d15/d19/d24/d2b/d3b/l55 0 2024-04-25T01:48:35.112 INFO:tasks.workunit.client.0.smithi162.stdout:9/291: fsync d4/d8/f10 0 2024-04-25T01:48:35.624 INFO:tasks.workunit.client.0.smithi162.stdout:2/314: fdatasync d0/d3/d1b/d1d/d20/d5e/d61/d66/f24 0 2024-04-25T01:48:35.654 INFO:tasks.workunit.client.0.smithi162.stdout:3/352: creat d2/d29/f80 x:0 0 0 2024-04-25T01:48:35.756 INFO:tasks.workunit.client.0.smithi162.stdout:1/357: creat d15/d69/f75 x:0 0 0 2024-04-25T01:48:36.140 INFO:tasks.workunit.client.0.smithi162.stdout:7/335: truncate df/f4d 938909 0 2024-04-25T01:48:36.219 INFO:tasks.workunit.client.0.smithi162.stdout:5/334: dread - d15/d19/d24/d2b/d3b/f46 zero size 2024-04-25T01:48:36.338 INFO:tasks.workunit.client.0.smithi162.stdout:6/296: write d1/d13/d28/d30/f4e [88099,113542] 0 2024-04-25T01:48:37.184 INFO:tasks.workunit.client.0.smithi162.stdout:7/336: mknod df/d2e/d4c/c6b 0 2024-04-25T01:48:37.333 INFO:tasks.workunit.client.0.smithi162.stdout:6/297: creat d1/d13/d28/d30/d3a/d57/f65 x:0 0 0 2024-04-25T01:48:37.463 INFO:tasks.workunit.client.0.smithi162.stdout:4/342: getdents dd/df/d2e/d4b 0 2024-04-25T01:48:37.719 INFO:tasks.workunit.client.0.smithi162.stdout:2/315: creat d0/d3/d1b/d1d/d3a/d63/f71 x:0 0 0 2024-04-25T01:48:38.002 INFO:tasks.workunit.client.0.smithi162.stdout:5/335: mknod d15/d19/d24/d2b/c68 0 2024-04-25T01:48:38.004 INFO:tasks.workunit.client.0.smithi162.stdout:9/292: creat d4/d9/f6b x:0 0 0 2024-04-25T01:48:38.055 INFO:tasks.workunit.client.0.smithi162.stdout:7/337: creat df/d2e/f6c x:0 0 0 2024-04-25T01:48:38.294 INFO:tasks.workunit.client.0.smithi162.stdout:6/298: mkdir d1/d13/d28/d30/d66 0 2024-04-25T01:48:38.305 INFO:tasks.workunit.client.0.smithi162.stdout:4/343: mkdir dd/df/d77 0 2024-04-25T01:48:38.479 INFO:tasks.workunit.client.0.smithi162.stdout:2/316: dread - d0/f5c zero size 2024-04-25T01:48:39.430 INFO:tasks.workunit.client.0.smithi162.stdout:8/319: dwrite d0/d1a/d25/f56 [0,4194304] 0 2024-04-25T01:48:39.588 INFO:tasks.workunit.client.0.smithi162.stdout:3/353: link d2/d9/f5f d2/d9/d10/d40/f81 0 2024-04-25T01:48:39.681 INFO:tasks.workunit.client.0.smithi162.stdout:2/317: creat d0/d3/d1b/d1d/d20/d5e/f72 x:0 0 0 2024-04-25T01:48:39.703 INFO:tasks.workunit.client.0.smithi162.stdout:5/336: symlink d15/d19/l69 0 2024-04-25T01:48:40.069 INFO:tasks.workunit.client.0.smithi162.stdout:6/299: creat d1/d13/d28/d30/d66/f67 x:0 0 0 2024-04-25T01:48:40.307 INFO:tasks.workunit.client.0.smithi162.stdout:0/389: creat d0/f82 x:0 0 0 2024-04-25T01:48:40.309 INFO:tasks.workunit.client.0.smithi162.stdout:4/344: truncate dd/d1a/f6b 1939914 0 2024-04-25T01:48:40.329 INFO:tasks.workunit.client.0.smithi162.stdout:8/320: rename d0/l10 to d0/d12/d1b/l68 0 2024-04-25T01:48:40.359 INFO:tasks.workunit.client.0.smithi162.stdout:8/321: stat d0/d44 0 2024-04-25T01:48:40.442 INFO:tasks.workunit.client.0.smithi162.stdout:5/337: rmdir d15 39 2024-04-25T01:48:40.496 INFO:tasks.workunit.client.0.smithi162.stdout:2/318: truncate d0/d3/d1b/f4f 1043487 0 2024-04-25T01:48:40.914 INFO:tasks.workunit.client.0.smithi162.stdout:4/345: creat dd/d1a/f78 x:0 0 0 2024-04-25T01:48:40.932 INFO:tasks.workunit.client.0.smithi162.stdout:6/300: chown d1/d13/c26 0 1 2024-04-25T01:48:41.602 INFO:tasks.workunit.client.0.smithi162.stdout:1/358: dwrite d15/d69/f3e [0,4194304] 0 2024-04-25T01:48:41.750 INFO:tasks.workunit.client.0.smithi162.stdout:2/319: unlink d0/d3/d1b/d1d/d20/d5e/d61/d66/l26 0 2024-04-25T01:48:41.773 INFO:tasks.workunit.client.0.smithi162.stdout:8/322: dread d0/d12/f17 [0,4194304] 0 2024-04-25T01:48:42.416 INFO:tasks.workunit.client.0.smithi162.stdout:9/293: dwrite d4/d9/d15/d4e/f61 [0,4194304] 0 2024-04-25T01:48:43.523 INFO:tasks.workunit.client.0.smithi162.stdout:7/338: mknod df/c6d 0 2024-04-25T01:48:43.526 INFO:tasks.workunit.client.0.smithi162.stdout:4/346: fsync dd/df/d2e/d59/f76 0 2024-04-25T01:48:43.828 INFO:tasks.workunit.client.0.smithi162.stdout:0/390: dwrite d0/df/f66 [4194304,4194304] 0 2024-04-25T01:48:43.980 INFO:tasks.workunit.client.0.smithi162.stdout:9/294: read d4/f21 [2692955,20608] 0 2024-04-25T01:48:44.128 INFO:tasks.workunit.client.0.smithi162.stdout:3/354: write d2/d9/d17/f2f [823336,55292] 0 2024-04-25T01:48:44.174 INFO:tasks.workunit.client.0.smithi162.stdout:3/355: dread - d2/d29/f46 zero size 2024-04-25T01:48:44.517 INFO:tasks.workunit.client.0.smithi162.stdout:3/356: sync 2024-04-25T01:48:44.554 INFO:tasks.workunit.client.0.smithi162.stdout:3/357: chown d2/d9/d10/d4c/d51/f7e 11961607 1 2024-04-25T01:48:44.623 INFO:tasks.workunit.client.0.smithi162.stdout:2/320: creat d0/d3/d1b/d1d/d20/d42/d57/f73 x:0 0 0 2024-04-25T01:48:44.807 INFO:tasks.workunit.client.0.smithi162.stdout:6/301: rename d1/d13/f17 to d1/f68 0 2024-04-25T01:48:44.929 INFO:tasks.workunit.client.0.smithi162.stdout:4/347: fsync dd/d1a/f37 0 2024-04-25T01:48:45.365 INFO:tasks.workunit.client.0.smithi162.stdout:3/358: unlink d2/d29/c64 0 2024-04-25T01:48:45.394 INFO:tasks.workunit.client.0.smithi162.stdout:9/295: dread d4/d25/f54 [0,4194304] 0 2024-04-25T01:48:45.694 INFO:tasks.workunit.client.0.smithi162.stdout:2/321: rmdir d0/d3/d1b/d1d/d20/d67 39 2024-04-25T01:48:46.495 INFO:tasks.workunit.client.0.smithi162.stdout:1/359: dwrite d15/d69/f62 [0,4194304] 0 2024-04-25T01:48:46.619 INFO:tasks.workunit.client.0.smithi162.stdout:8/323: dwrite d0/d12/f17 [0,4194304] 0 2024-04-25T01:48:46.737 INFO:tasks.workunit.client.0.smithi162.stdout:0/391: unlink d0/df/f14 0 2024-04-25T01:48:46.766 INFO:tasks.workunit.client.0.smithi162.stdout:8/324: readlink d0/d12/l22 0 2024-04-25T01:48:46.796 INFO:tasks.workunit.client.0.smithi162.stdout:8/325: readlink d0/d12/d2b/l35 0 2024-04-25T01:48:46.860 INFO:tasks.workunit.client.0.smithi162.stdout:3/359: mknod d2/d9/d17/c82 0 2024-04-25T01:48:46.890 INFO:tasks.workunit.client.0.smithi162.stdout:5/338: link d15/d19/d24/d40/l4e d15/l6a 0 2024-04-25T01:48:46.946 INFO:tasks.workunit.client.0.smithi162.stdout:5/339: read d15/d19/f1b [604771,99982] 0 2024-04-25T01:48:47.226 INFO:tasks.workunit.client.0.smithi162.stdout:2/322: rename d0/d3/d1b/d1d/d20/d5e/f72 to d0/f74 0 2024-04-25T01:48:47.903 INFO:tasks.workunit.client.0.smithi162.stdout:9/296: chown d4/d8/d13/f5b 16385485 1 2024-04-25T01:48:47.950 INFO:tasks.workunit.client.0.smithi162.stdout:4/348: write dd/d1a/f48 [4504025,91933] 0 2024-04-25T01:48:48.126 INFO:tasks.workunit.client.0.smithi162.stdout:4/349: sync 2024-04-25T01:48:48.164 INFO:tasks.workunit.client.0.smithi162.stdout:3/360: mknod d2/d9/d10/d4c/c83 0 2024-04-25T01:48:48.207 INFO:tasks.workunit.client.0.smithi162.stdout:3/361: chown d2/d9/d19/c6d 8 1 2024-04-25T01:48:48.873 INFO:tasks.workunit.client.0.smithi162.stdout:7/339: creat df/d2c/f6e x:0 0 0 2024-04-25T01:48:48.952 INFO:tasks.workunit.client.0.smithi162.stdout:1/360: dread - d15/d1f/d23/d30/d4a/f65 zero size 2024-04-25T01:48:49.053 INFO:tasks.workunit.client.0.smithi162.stdout:9/297: truncate d4/d25/f54 1061544 0 2024-04-25T01:48:49.229 INFO:tasks.workunit.client.0.smithi162.stdout:4/350: fdatasync dd/df/f6c 0 2024-04-25T01:48:49.517 INFO:tasks.workunit.client.0.smithi162.stdout:8/326: rename d0/d44/f38 to d0/d44/d31/d65/f69 0 2024-04-25T01:48:49.556 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:48:49.559 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:48:49.603 INFO:tasks.workunit.client.0.smithi162.stdout:6/302: getdents d1/d13/d28/d30/d66 0 2024-04-25T01:48:50.112 INFO:tasks.workunit.client.0.smithi162.stdout:0/392: dwrite d0/d1/d6a/f75 [0,4194304] 0 2024-04-25T01:48:50.423 INFO:tasks.workunit.client.0.smithi162.stdout:4/351: mkdir dd/df/d2e/d4b/d79 0 2024-04-25T01:48:50.636 INFO:tasks.workunit.client.0.smithi162.stdout:5/340: rename d15/d19/f63 to d15/d1e/f6b 0 2024-04-25T01:48:50.774 INFO:tasks.workunit.client.0.smithi162.stdout:1/361: rmdir d15 39 2024-04-25T01:48:50.873 INFO:tasks.workunit.client.0.smithi162.stdout:8/327: truncate d0/d44/d31/d33/f54 4135378 0 2024-04-25T01:48:51.128 INFO:tasks.workunit.client.0.smithi162.stdout:7/340: rmdir df/d2e 39 2024-04-25T01:48:51.203 INFO:tasks.workunit.client.0.smithi162.stdout:8/328: dread d0/d12/f2e [0,4194304] 0 2024-04-25T01:48:51.436 INFO:tasks.workunit.client.0.smithi162.stdout:4/352: truncate dd/df/d58/f66 135194 0 2024-04-25T01:48:51.596 INFO:tasks.workunit.client.0.smithi162.stdout:2/323: link d0/d3/d1b/d1d/d20/d5e/d61/d66/l55 d0/d3/d1b/d1d/d20/d42/d57/l75 0 2024-04-25T01:48:51.773 INFO:tasks.workunit.client.0.smithi162.stdout:5/341: fdatasync d15/d19/d24/d2b/d3b/d3c/d3f/f51 0 2024-04-25T01:48:51.795 INFO:tasks.workunit.client.0.smithi162.stdout:5/342: chown le 0 1 2024-04-25T01:48:51.931 INFO:tasks.workunit.client.0.smithi162.stdout:6/303: fdatasync d1/d13/f20 0 2024-04-25T01:48:52.097 INFO:tasks.workunit.client.0.smithi162.stdout:1/362: chown d15/d1f/d23/d30/d4a/f58 2 1 2024-04-25T01:48:52.662 INFO:tasks.workunit.client.0.smithi162.stdout:4/353: creat dd/d1a/d34/d57/f7a x:0 0 0 2024-04-25T01:48:52.686 INFO:tasks.workunit.client.0.smithi162.stdout:4/354: chown f5 13521048 1 2024-04-25T01:48:52.967 INFO:tasks.workunit.client.0.smithi162.stdout:3/362: getdents d2/d9/d17/d61 0 2024-04-25T01:48:53.294 INFO:tasks.workunit.client.0.smithi162.stdout:3/363: dread d2/f25 [0,4194304] 0 2024-04-25T01:48:53.445 INFO:tasks.workunit.client.0.smithi162.stdout:0/393: rename d0/df/d20/d37/f36 to d0/d1/d64/f83 0 2024-04-25T01:48:53.514 INFO:tasks.workunit.client.0.smithi162.stdout:9/298: dwrite d4/d9/d15/d4e/f66 [0,4194304] 0 2024-04-25T01:48:53.649 INFO:tasks.workunit.client.0.smithi162.stdout:5/343: truncate d15/d19/d24/d2b/d3b/d3c/d3f/f43 372771 0 2024-04-25T01:48:53.765 INFO:tasks.workunit.client.0.smithi162.stdout:1/363: truncate d15/f34 740293 0 2024-04-25T01:48:54.308 INFO:tasks.workunit.client.0.smithi162.stdout:4/355: truncate dd/f33 763964 0 2024-04-25T01:48:54.437 INFO:tasks.workunit.client.0.smithi162.stdout:6/304: creat d1/d13/d28/d30/f69 x:0 0 0 2024-04-25T01:48:54.595 INFO:tasks.workunit.client.0.smithi162.stdout:8/329: rename d0/d12/f5d to d0/d12/d3a/f6a 0 2024-04-25T01:48:54.646 INFO:tasks.workunit.client.0.smithi162.stdout:3/364: truncate d2/d29/d2e/f3a 4051210 0 2024-04-25T01:48:55.146 INFO:tasks.workunit.client.0.smithi162.stdout:5/344: truncate d15/d19/d24/d40/f4b 784832 0 2024-04-25T01:48:55.176 INFO:tasks.workunit.client.0.smithi162.stdout:5/345: chown d15/d19/d24/f2d 1497936 1 2024-04-25T01:48:55.184 INFO:tasks.workunit.client.0.smithi162.stdout:5/346: readlink l5 0 2024-04-25T01:48:55.534 INFO:tasks.workunit.client.0.smithi162.stdout:4/356: symlink dd/d1a/d4e/l7b 0 2024-04-25T01:48:55.803 INFO:tasks.workunit.client.0.smithi162.stdout:2/324: write d0/f5c [934455,104878] 0 2024-04-25T01:48:55.937 INFO:tasks.workunit.client.0.smithi162.stdout:3/365: dread d2/d9/d10/d4c/f70 [0,4194304] 0 2024-04-25T01:48:55.960 INFO:tasks.workunit.client.0.smithi162.stdout:2/325: stat d0/d3/d1b/d1d/d20/d5e/d61/d66/l23 0 2024-04-25T01:48:56.018 INFO:tasks.workunit.client.0.smithi162.stdout:0/394: symlink d0/d1/d4e/d76/l84 0 2024-04-25T01:48:56.131 INFO:tasks.workunit.client.0.smithi162.stdout:5/347: dread d15/d19/f35 [0,4194304] 0 2024-04-25T01:48:56.201 INFO:tasks.workunit.client.0.smithi162.stdout:1/364: symlink d15/d69/l76 0 2024-04-25T01:48:56.220 INFO:tasks.workunit.client.0.smithi162.stdout:1/365: chown d15/d1f/d35 189353 1 2024-04-25T01:48:56.802 INFO:tasks.workunit.client.0.smithi162.stdout:2/326: creat d0/d3/d30/f76 x:0 0 0 2024-04-25T01:48:57.469 INFO:tasks.workunit.client.0.smithi162.stdout:5/348: creat d15/d1e/f6c x:0 0 0 2024-04-25T01:48:57.733 INFO:tasks.workunit.client.0.smithi162.stdout:4/357: mknod dd/df/d77/c7c 0 2024-04-25T01:48:58.158 INFO:tasks.workunit.client.0.smithi162.stdout:3/366: mknod d2/d9/d10/d4c/d51/d63/c84 0 2024-04-25T01:48:58.290 INFO:tasks.workunit.client.0.smithi162.stdout:9/299: dwrite d4/f39 [0,4194304] 0 2024-04-25T01:48:58.458 INFO:tasks.workunit.client.0.smithi162.stdout:1/366: creat d15/d1f/d35/d4c/d70/d73/f77 x:0 0 0 2024-04-25T01:48:58.527 INFO:tasks.workunit.client.0.smithi162.stdout:7/341: getdents df/d52 0 2024-04-25T01:48:58.811 INFO:tasks.workunit.client.0.smithi162.stdout:9/300: dread d4/d9/d15/f23 [0,4194304] 0 2024-04-25T01:48:58.830 INFO:tasks.workunit.client.0.smithi162.stdout:8/330: creat d0/f6b x:0 0 0 2024-04-25T01:48:58.871 INFO:tasks.workunit.client.0.smithi162.stdout:3/367: rmdir d2 39 2024-04-25T01:48:59.239 INFO:tasks.workunit.client.0.smithi162.stdout:1/367: truncate d15/d1f/d23/d30/f60 946365 0 2024-04-25T01:48:59.653 INFO:tasks.workunit.client.0.smithi162.stdout:5/349: creat d15/f6d x:0 0 0 2024-04-25T01:48:59.726 INFO:tasks.workunit.client.0.smithi162.stdout:6/305: dwrite d1/f25 [0,4194304] 0 2024-04-25T01:48:59.853 INFO:tasks.workunit.client.0.smithi162.stdout:7/342: symlink df/d2c/l6f 0 2024-04-25T01:49:00.146 INFO:tasks.workunit.client.0.smithi162.stdout:3/368: symlink d2/d9/d10/d4c/l85 0 2024-04-25T01:49:00.298 INFO:tasks.workunit.client.0.smithi162.stdout:0/395: dwrite d0/d1/f7 [0,4194304] 0 2024-04-25T01:49:00.396 INFO:tasks.workunit.client.0.smithi162.stdout:3/369: chown d2/d29/d5d/f68 210 1 2024-04-25T01:49:00.491 INFO:tasks.workunit.client.0.smithi162.stdout:5/350: mknod d15/d19/d24/d4d/c6e 0 2024-04-25T01:49:00.494 INFO:tasks.workunit.client.0.smithi162.stdout:7/343: rmdir df/d2c/d49 39 2024-04-25T01:49:01.204 INFO:tasks.workunit.client.0.smithi162.stdout:4/358: write dd/df/d58/f5a [1133506,67705] 0 2024-04-25T01:49:01.315 INFO:tasks.workunit.client.0.smithi162.stdout:3/370: fdatasync d2/d9/d10/f11 0 2024-04-25T01:49:01.404 INFO:tasks.workunit.client.0.smithi162.stdout:8/331: write d0/d44/d31/d33/f53 [4230600,87657] 0 2024-04-25T01:49:01.427 INFO:tasks.workunit.client.0.smithi162.stdout:2/327: dwrite d0/d3/f1a [4194304,4194304] 0 2024-04-25T01:49:01.458 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:59:50.897 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:49:01.461 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:59:50.901 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:49:01.499 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:00:59:50.938 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:49:01.506 INFO:tasks.workunit.client.0.smithi162.stdout:4/359: chown dd/df/d2e/d59/c5e 42 1 2024-04-25T01:49:01.575 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:59:50.932 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:49:01.585 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:59:50.941 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:49:01.588 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:59:50.944 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:49:01.591 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:59:50.948 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:49:01.638 INFO:tasks.workunit.client.0.smithi162.stdout:5/351: creat d15/d19/d24/d2b/d3b/d3c/d3f/f6f x:0 0 0 2024-04-25T01:49:01.656 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:00:59:51.013 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:49:01.664 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:00:59:51.021 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:49:01.866 INFO:tasks.workunit.client.0.smithi162.stdout:1/368: dwrite d15/d69/f62 [0,4194304] 0 2024-04-25T01:49:02.111 INFO:tasks.workunit.client.0.smithi162.stdout:3/371: mkdir d2/d9/d17/d61/d86 0 2024-04-25T01:49:02.860 INFO:tasks.workunit.client.0.smithi162.stdout:6/306: rename d1/d13/f20 to d1/d5c/f6a 0 2024-04-25T01:49:02.992 INFO:tasks.workunit.client.0.smithi162.stdout:9/301: creat d4/f6c x:0 0 0 2024-04-25T01:49:03.368 INFO:tasks.workunit.client.0.smithi162.stdout:1/369: fsync d15/f3f 0 2024-04-25T01:49:03.376 INFO:tasks.workunit.client.0.smithi162.stdout:8/332: truncate d0/d12/d3a/f6a 617366 0 2024-04-25T01:49:03.561 INFO:tasks.workunit.client.0.smithi162.stdout:8/333: stat d0/d44/d31/d65 0 2024-04-25T01:49:03.643 INFO:tasks.workunit.client.0.smithi162.stdout:5/352: fdatasync d15/d19/f59 0 2024-04-25T01:49:03.698 INFO:tasks.workunit.client.0.smithi162.stdout:0/396: dwrite d0/df/d20/d25/d55/f5a [0,4194304] 0 2024-04-25T01:49:03.823 INFO:tasks.workunit.client.0.smithi162.stdout:2/328: mknod d0/d3/d1b/d1d/d20/d5e/d61/d62/c77 0 2024-04-25T01:49:03.833 INFO:tasks.workunit.client.0.smithi162.stdout:8/334: sync 2024-04-25T01:49:04.102 INFO:tasks.workunit.client.0.smithi162.stdout:6/307: dread d1/f3f [0,4194304] 0 2024-04-25T01:49:04.148 INFO:tasks.workunit.client.0.smithi162.stdout:2/329: chown d0/d3/d1b/d1d/d20/d5e/d61/d66/f24 7977 1 2024-04-25T01:49:04.225 INFO:tasks.workunit.client.0.smithi162.stdout:3/372: rename d2/d9/d17/d61 to d2/d9/d10/d4c/d51/d63/d87 0 2024-04-25T01:49:04.240 INFO:tasks.workunit.client.0.smithi162.stdout:0/397: dread d0/d1/f53 [0,4194304] 0 2024-04-25T01:49:04.339 INFO:tasks.workunit.client.0.smithi162.stdout:7/344: rename df/c46 to df/c70 0 2024-04-25T01:49:04.375 INFO:tasks.workunit.client.0.smithi162.stdout:2/330: read d0/d3/d1b/d1d/d20/d5e/d61/d66/f24 [7708084,82651] 0 2024-04-25T01:49:05.220 INFO:tasks.workunit.client.0.smithi162.stdout:8/335: creat d0/d44/d31/f6c x:0 0 0 2024-04-25T01:49:05.748 INFO:tasks.workunit.client.0.smithi162.stdout:3/373: rmdir d2/d29 39 2024-04-25T01:49:06.112 INFO:tasks.workunit.client.0.smithi162.stdout:4/360: dwrite dd/df/d58/f66 [0,4194304] 0 2024-04-25T01:49:06.267 INFO:tasks.workunit.client.0.smithi162.stdout:8/336: creat d0/d12/d1b/f6d x:0 0 0 2024-04-25T01:49:06.273 INFO:tasks.workunit.client.0.smithi162.stdout:6/308: getdents d1/d13/d28/d45/d59 0 2024-04-25T01:49:06.752 INFO:tasks.workunit.client.0.smithi162.stdout:1/370: write d15/f1a [6643665,5613] 0 2024-04-25T01:49:07.311 INFO:tasks.workunit.client.0.smithi162.stdout:2/331: rename d0/d3/d1b/d1d/d20/d42/d57/l75 to d0/d3/d5/d36/l78 0 2024-04-25T01:49:07.331 INFO:tasks.workunit.client.0.smithi162.stdout:5/353: creat d15/d19/d24/d2b/d3b/d3c/f70 x:0 0 0 2024-04-25T01:49:07.493 INFO:tasks.workunit.client.0.smithi162.stdout:8/337: symlink d0/d1a/l6e 0 2024-04-25T01:49:08.309 INFO:tasks.workunit.client.0.smithi162.stdout:0/398: write d0/df/f66 [6413256,108822] 0 2024-04-25T01:49:08.469 INFO:tasks.workunit.client.0.smithi162.stdout:9/302: dwrite d4/d8/d13/d38/f5e [0,4194304] 0 2024-04-25T01:49:08.597 INFO:tasks.workunit.client.0.smithi162.stdout:2/332: truncate d0/f9 2085950 0 2024-04-25T01:49:08.643 INFO:tasks.workunit.client.0.smithi162.stdout:0/399: readlink d0/df/d20/d25/d55/d6f/l71 0 2024-04-25T01:49:08.924 INFO:tasks.workunit.client.0.smithi162.stdout:7/345: write df/f2d [3436736,65514] 0 2024-04-25T01:49:09.442 INFO:tasks.workunit.client.0.smithi162.stdout:4/361: write dd/d1a/f21 [1089184,58607] 0 2024-04-25T01:49:09.805 INFO:tasks.workunit.client.0.smithi162.stdout:2/333: fsync d0/d3/d1b/d1d/d3a/d63/f71 0 2024-04-25T01:49:10.262 INFO:tasks.workunit.client.0.smithi162.stdout:1/371: creat d15/d1f/d23/d30/f78 x:0 0 0 2024-04-25T01:49:10.309 INFO:tasks.workunit.client.0.smithi162.stdout:9/303: symlink d4/d9/d15/l6d 0 2024-04-25T01:49:10.448 INFO:tasks.workunit.client.0.smithi162.stdout:1/372: read d15/f1c [2592645,44239] 0 2024-04-25T01:49:10.606 INFO:tasks.workunit.client.0.smithi162.stdout:3/374: write d2/d9/f5f [5734832,20815] 0 2024-04-25T01:49:10.678 INFO:tasks.workunit.client.0.smithi162.stdout:6/309: dwrite d1/d5c/f5f [0,4194304] 0 2024-04-25T01:49:10.680 INFO:tasks.workunit.client.0.smithi162.stdout:2/334: creat d0/d3/d1b/d1d/d3a/d63/f79 x:0 0 0 2024-04-25T01:49:10.814 INFO:tasks.workunit.client.0.smithi162.stdout:3/375: sync 2024-04-25T01:49:10.992 INFO:tasks.workunit.client.0.smithi162.stdout:2/335: read d0/d3/d1b/d1d/f38 [2172740,3540] 0 2024-04-25T01:49:11.055 INFO:tasks.workunit.client.0.smithi162.stdout:1/373: chown c11 0 1 2024-04-25T01:49:11.116 INFO:tasks.workunit.client.0.smithi162.stdout:5/354: dwrite fd [4194304,4194304] 0 2024-04-25T01:49:11.444 INFO:tasks.workunit.client.0.smithi162.stdout:8/338: dwrite d0/d44/f15 [4194304,4194304] 0 2024-04-25T01:49:11.552 INFO:tasks.workunit.client.0.smithi162.stdout:8/339: chown d0/d12/c20 0 1 2024-04-25T01:49:11.817 INFO:tasks.workunit.client.0.smithi162.stdout:0/400: write d0/df/d20/d25/d55/f5c [779943,114108] 0 2024-04-25T01:49:11.821 INFO:tasks.workunit.client.0.smithi162.stdout:7/346: write df/d2c/f3c [2219205,57120] 0 2024-04-25T01:49:11.828 INFO:tasks.workunit.client.0.smithi162.stdout:4/362: write dd/df/d2e/f3d [1364923,51062] 0 2024-04-25T01:49:11.974 INFO:tasks.workunit.client.0.smithi162.stdout:3/376: mknod d2/d9/d19/d3f/c88 0 2024-04-25T01:49:12.364 INFO:tasks.workunit.client.0.smithi162.stdout:1/374: write d15/d1f/d23/d30/f5a [1571119,47682] 0 2024-04-25T01:49:12.404 INFO:tasks.workunit.client.0.smithi162.stdout:4/363: dwrite dd/df/d2e/f3d [0,4194304] 0 2024-04-25T01:49:12.543 INFO:tasks.workunit.client.0.smithi162.stdout:9/304: link d4/d9/d15/d1b/f29 d4/d25/f6e 0 2024-04-25T01:49:12.544 INFO:tasks.workunit.client.0.smithi162.stdout:6/310: creat d1/d13/d28/d45/d59/f6b x:0 0 0 2024-04-25T01:49:12.561 INFO:tasks.workunit.client.0.smithi162.stdout:2/336: mkdir d0/d3/d7a 0 2024-04-25T01:49:12.703 INFO:tasks.workunit.client.0.smithi162.stdout:5/355: mknod d15/d19/c71 0 2024-04-25T01:49:12.728 INFO:tasks.workunit.client.0.smithi162.stdout:7/347: creat df/d52/f71 x:0 0 0 2024-04-25T01:49:12.744 INFO:tasks.workunit.client.0.smithi162.stdout:0/401: truncate d0/d1/d6a/f75 1679463 0 2024-04-25T01:49:12.768 INFO:tasks.workunit.client.0.smithi162.stdout:8/340: mknod d0/d67/c6f 0 2024-04-25T01:49:12.997 INFO:tasks.workunit.client.0.smithi162.stdout:3/377: dread d2/d9/d19/f36 [0,4194304] 0 2024-04-25T01:49:13.130 INFO:tasks.workunit.client.0.smithi162.stdout:4/364: symlink dd/d1a/d34/d57/l7d 0 2024-04-25T01:49:13.890 INFO:tasks.workunit.client.0.smithi162.stdout:6/311: creat d1/d13/d28/d30/d3a/f6c x:0 0 0 2024-04-25T01:49:14.121 INFO:tasks.workunit.client.0.smithi162.stdout:7/348: mknod df/d2c/d56/c72 0 2024-04-25T01:49:14.150 INFO:tasks.workunit.client.0.smithi162.stdout:7/349: readlink df/d2c/d56/l59 0 2024-04-25T01:49:14.333 INFO:tasks.workunit.client.0.smithi162.stdout:0/402: creat d0/d1/d4b/f85 x:0 0 0 2024-04-25T01:49:14.389 INFO:tasks.workunit.client.0.smithi162.stdout:8/341: fdatasync d0/d44/d31/d33/f4f 0 2024-04-25T01:49:14.517 INFO:tasks.workunit.client.0.smithi162.stdout:8/342: dread d0/f16 [0,4194304] 0 2024-04-25T01:49:15.310 INFO:tasks.workunit.client.0.smithi162.stdout:6/312: readlink d1/d13/l2c 0 2024-04-25T01:49:15.531 INFO:tasks.workunit.client.0.smithi162.stdout:6/313: sync 2024-04-25T01:49:15.660 INFO:tasks.workunit.client.0.smithi162.stdout:9/305: write d4/d8/d13/d38/f4c [1044430,39341] 0 2024-04-25T01:49:15.720 INFO:tasks.workunit.client.0.smithi162.stdout:9/306: chown d4/d9/d15/d1b/l1e 640820 1 2024-04-25T01:49:15.742 INFO:tasks.workunit.client.0.smithi162.stdout:9/307: read d4/d8/f2d [439360,18575] 0 2024-04-25T01:49:16.141 INFO:tasks.workunit.client.0.smithi162.stdout:1/375: creat d15/f79 x:0 0 0 2024-04-25T01:49:16.309 INFO:tasks.workunit.client.0.smithi162.stdout:3/378: mkdir d2/d9/d48/d89 0 2024-04-25T01:49:16.735 INFO:tasks.workunit.client.0.smithi162.stdout:7/350: mknod df/d2c/d49/c73 0 2024-04-25T01:49:16.961 INFO:tasks.workunit.client.0.smithi162.stdout:6/314: dread d1/d13/d28/d30/d3a/f44 [0,4194304] 0 2024-04-25T01:49:17.075 INFO:tasks.workunit.client.0.smithi162.stdout:4/365: write dd/d1a/d34/d57/f7a [48923,33917] 0 2024-04-25T01:49:17.432 INFO:tasks.workunit.client.0.smithi162.stdout:5/356: link d15/d19/d24/c36 d15/d19/d24/d2b/d3b/d58/c72 0 2024-04-25T01:49:17.454 INFO:tasks.workunit.client.0.smithi162.stdout:0/403: write d0/d59/f80 [955187,28569] 0 2024-04-25T01:49:17.544 INFO:tasks.workunit.client.0.smithi162.stdout:5/357: chown d15/d19/d24/d2b/d3b/d3c/d3f/f6f 7 1 2024-04-25T01:49:17.564 INFO:tasks.workunit.client.0.smithi162.stdout:0/404: sync 2024-04-25T01:49:17.818 INFO:tasks.workunit.client.0.smithi162.stdout:3/379: rename d2/d9/d19/c1f to d2/d9/d48/d89/c8a 0 2024-04-25T01:49:17.928 INFO:tasks.workunit.client.0.smithi162.stdout:5/358: dread d15/d1e/f22 [0,4194304] 0 2024-04-25T01:49:18.943 INFO:tasks.workunit.client.0.smithi162.stdout:2/337: dwrite d0/d3/d1b/f4f [0,4194304] 0 2024-04-25T01:49:19.290 INFO:tasks.workunit.client.0.smithi162.stdout:8/343: rename d0/d1a/d25/l46 to d0/d44/d31/d33/l70 0 2024-04-25T01:49:19.312 INFO:tasks.workunit.client.0.smithi162.stdout:3/380: rmdir d2/d9/d19/d3f 39 2024-04-25T01:49:19.620 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:49:19.623 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:49:20.239 INFO:tasks.workunit.client.0.smithi162.stdout:1/376: link d15/c41 d15/d1f/d35/c7a 0 2024-04-25T01:49:20.614 INFO:tasks.workunit.client.0.smithi162.stdout:6/315: write d1/d13/d28/d30/d66/f67 [38760,71056] 0 2024-04-25T01:49:20.716 INFO:tasks.workunit.client.0.smithi162.stdout:5/359: mkdir d15/d19/d24/d73 0 2024-04-25T01:49:21.155 INFO:tasks.workunit.client.0.smithi162.stdout:7/351: rename df/d52/l5f to df/d2e/d4c/d58/l74 0 2024-04-25T01:49:21.243 INFO:tasks.workunit.client.0.smithi162.stdout:8/344: creat d0/d44/d31/d65/f71 x:0 0 0 2024-04-25T01:49:21.251 INFO:tasks.workunit.client.0.smithi162.stdout:0/405: write d0/df/d20/d25/f4d [217134,14860] 0 2024-04-25T01:49:21.530 INFO:tasks.workunit.client.0.smithi162.stdout:9/308: getdents d4/d9/d15 0 2024-04-25T01:49:21.822 INFO:tasks.workunit.client.0.smithi162.stdout:6/316: mkdir d1/d13/d28/d53/d6d 0 2024-04-25T01:49:21.955 INFO:tasks.workunit.client.0.smithi162.stdout:5/360: truncate d15/d19/d24/f64 1039137 0 2024-04-25T01:49:22.243 INFO:tasks.workunit.client.0.smithi162.stdout:7/352: truncate df/d52/f71 683654 0 2024-04-25T01:49:22.544 INFO:tasks.workunit.client.0.smithi162.stdout:8/345: rename d0/l6 to d0/d1a/d25/l72 0 2024-04-25T01:49:22.664 INFO:tasks.workunit.client.0.smithi162.stdout:1/377: mknod d15/c7b 0 2024-04-25T01:49:22.680 INFO:tasks.workunit.client.0.smithi162.stdout:1/378: chown c1 1829 1 2024-04-25T01:49:22.716 INFO:tasks.workunit.client.0.smithi162.stdout:4/366: write f7 [2108758,17666] 0 2024-04-25T01:49:22.777 INFO:tasks.workunit.client.0.smithi162.stdout:6/317: rmdir d1/d13/d28/d53 39 2024-04-25T01:49:22.887 INFO:tasks.workunit.client.0.smithi162.stdout:5/361: creat d15/d19/d24/d40/f74 x:0 0 0 2024-04-25T01:49:22.912 INFO:tasks.workunit.client.0.smithi162.stdout:5/362: readlink d15/d19/l23 0 2024-04-25T01:49:23.749 INFO:tasks.workunit.client.0.smithi162.stdout:3/381: dwrite d2/d9/d10/d4c/f53 [0,4194304] 0 2024-04-25T01:49:23.919 INFO:tasks.workunit.client.0.smithi162.stdout:3/382: write d2/d9/d10/d4c/f53 [1193498,3265] 0 2024-04-25T01:49:24.114 INFO:tasks.workunit.client.0.smithi162.stdout:8/346: truncate d0/d1a/d25/f58 883860 0 2024-04-25T01:49:24.334 INFO:tasks.workunit.client.0.smithi162.stdout:2/338: dwrite d0/d3/d1b/d1d/d20/f54 [0,4194304] 0 2024-04-25T01:49:24.455 INFO:tasks.workunit.client.0.smithi162.stdout:4/367: mkdir dd/df/d7e 0 2024-04-25T01:49:24.480 INFO:tasks.workunit.client.0.smithi162.stdout:5/363: symlink d15/d1e/l75 0 2024-04-25T01:49:24.490 INFO:tasks.workunit.client.0.smithi162.stdout:6/318: read - d1/d13/d28/d30/f4a zero size 2024-04-25T01:49:24.529 INFO:tasks.workunit.client.0.smithi162.stdout:5/364: chown d15/d1e 31 1 2024-04-25T01:49:24.558 INFO:tasks.workunit.client.0.smithi162.stdout:4/368: readlink dd/df/d2e/l4f 0 2024-04-25T01:49:24.775 INFO:tasks.workunit.client.0.smithi162.stdout:1/379: truncate d15/f79 811163 0 2024-04-25T01:49:25.041 INFO:tasks.workunit.client.0.smithi162.stdout:7/353: write df/d2e/d4c/f53 [2395284,59253] 0 2024-04-25T01:49:25.390 INFO:tasks.workunit.client.0.smithi162.stdout:8/347: rmdir d0/d44/d31/d65 39 2024-04-25T01:49:25.401 INFO:tasks.workunit.client.0.smithi162.stdout:0/406: write d0/d7b/f7f [189244,73462] 0 2024-04-25T01:49:25.842 INFO:tasks.workunit.client.0.smithi162.stdout:5/365: unlink d15/d19/d24/d4d/c5b 0 2024-04-25T01:49:25.865 INFO:tasks.workunit.client.0.smithi162.stdout:5/366: readlink l4 0 2024-04-25T01:49:26.054 INFO:tasks.workunit.client.0.smithi162.stdout:1/380: truncate f4 4821870 0 2024-04-25T01:49:26.599 INFO:tasks.workunit.client.0.smithi162.stdout:3/383: symlink d2/l8b 0 2024-04-25T01:49:26.628 INFO:tasks.workunit.client.0.smithi162.stdout:9/309: rename d4/d9/d15/d1b/l1e to d4/l6f 0 2024-04-25T01:49:26.694 INFO:tasks.workunit.client.0.smithi162.stdout:0/407: creat d0/d1/d4e/f86 x:0 0 0 2024-04-25T01:49:26.838 INFO:tasks.workunit.client.0.smithi162.stdout:5/367: mknod d15/d19/d24/d2b/d3b/c76 0 2024-04-25T01:49:26.993 INFO:tasks.workunit.client.0.smithi162.stdout:1/381: mkdir d15/d69/d4f/d7c 0 2024-04-25T01:49:27.326 INFO:tasks.workunit.client.0.smithi162.stdout:7/354: dread df/f1c [0,4194304] 0 2024-04-25T01:49:27.385 INFO:tasks.workunit.client.0.smithi162.stdout:5/368: dread d15/d1e/f2a [0,4194304] 0 2024-04-25T01:49:27.425 INFO:tasks.workunit.client.0.smithi162.stdout:5/369: chown c9 30604602 1 2024-04-25T01:49:27.436 INFO:tasks.workunit.client.0.smithi162.stdout:8/348: rename d0 to d0/d12/d73 22 2024-04-25T01:49:27.512 INFO:tasks.workunit.client.0.smithi162.stdout:9/310: chown d4/d8/d13/f2a 40403 1 2024-04-25T01:49:27.617 INFO:tasks.workunit.client.0.smithi162.stdout:3/384: symlink d2/d9/d10/d40/l8c 0 2024-04-25T01:49:28.035 INFO:tasks.workunit.client.0.smithi162.stdout:2/339: getdents d0 0 2024-04-25T01:49:28.050 INFO:tasks.workunit.client.0.smithi162.stdout:0/408: truncate d0/df/d20/d37/f60 1044107 0 2024-04-25T01:49:28.340 INFO:tasks.workunit.client.0.smithi162.stdout:6/319: dwrite d1/d46/f56 [0,4194304] 0 2024-04-25T01:49:28.518 INFO:tasks.workunit.client.0.smithi162.stdout:6/320: chown d1/d13/c26 181027769 1 2024-04-25T01:49:28.629 INFO:tasks.workunit.client.0.smithi162.stdout:4/369: getdents dd/df/d2e/d4b 0 2024-04-25T01:49:28.660 INFO:tasks.workunit.client.0.smithi162.stdout:4/370: stat dd/df/d58/f66 0 2024-04-25T01:49:28.901 INFO:tasks.workunit.client.0.smithi162.stdout:8/349: unlink d0/d44/d31/f5c 0 2024-04-25T01:49:28.925 INFO:tasks.workunit.client.0.smithi162.stdout:9/311: creat d4/d9/d15/d1b/d2f/d30/f70 x:0 0 0 2024-04-25T01:49:28.982 INFO:tasks.workunit.client.0.smithi162.stdout:3/385: mkdir d2/d9/d10/d4c/d8d 0 2024-04-25T01:49:29.034 INFO:tasks.workunit.client.0.smithi162.stdout:4/371: dread dd/d1a/d34/d57/f71 [0,4194304] 0 2024-04-25T01:49:29.596 INFO:tasks.workunit.client.0.smithi162.stdout:0/409: creat d0/df/d20/d25/d55/f87 x:0 0 0 2024-04-25T01:49:29.872 INFO:tasks.workunit.client.0.smithi162.stdout:7/355: fsync df/f21 0 2024-04-25T01:49:30.425 INFO:tasks.workunit.client.0.smithi162.stdout:9/312: mkdir d4/d9/d15/d71 0 2024-04-25T01:49:30.444 INFO:tasks.workunit.client.0.smithi162.stdout:8/350: mkdir d0/d12/d1b/d74 0 2024-04-25T01:49:30.478 INFO:tasks.workunit.client.0.smithi162.stdout:4/372: fdatasync dd/df/f64 0 2024-04-25T01:49:30.655 INFO:tasks.workunit.client.0.smithi162.stdout:1/382: creat d15/d69/f7d x:0 0 0 2024-04-25T01:49:30.961 INFO:tasks.workunit.client.0.smithi162.stdout:5/370: dwrite d15/d1e/f6c [0,4194304] 0 2024-04-25T01:49:31.349 INFO:tasks.workunit.client.0.smithi162.stdout:7/356: chown df/d52/f71 418530 1 2024-04-25T01:49:32.033 INFO:tasks.workunit.client.0.smithi162.stdout:6/321: dwrite d1/d13/f15 [0,4194304] 0 2024-04-25T01:49:32.589 INFO:tasks.workunit.client.0.smithi162.stdout:5/371: rmdir d15/d19/d24/d2b/d3b 39 2024-04-25T01:49:32.597 INFO:tasks.workunit.client.0.smithi162.stdout:2/340: link d0/d3/d1b/d1d/d20/l64 d0/d3/d1b/d6b/l7b 0 2024-04-25T01:49:32.814 INFO:tasks.workunit.client.0.smithi162.stdout:3/386: rename d2/d9/f30 to d2/f8e 0 2024-04-25T01:49:32.871 INFO:tasks.workunit.client.0.smithi162.stdout:3/387: chown d2/d9/d10/d2c/l35 40 1 2024-04-25T01:49:32.902 INFO:tasks.workunit.client.0.smithi162.stdout:3/388: dread - d2/d9/d10/d2c/f5c zero size 2024-04-25T01:49:33.279 INFO:tasks.workunit.client.0.smithi162.stdout:0/410: dwrite d0/df/d20/f40 [0,4194304] 0 2024-04-25T01:49:33.429 INFO:tasks.workunit.client.0.smithi162.stdout:0/411: dread - d0/d1/f3c zero size 2024-04-25T01:49:33.670 INFO:tasks.workunit.client.0.smithi162.stdout:8/351: write d0/d44/f15 [965380,16771] 0 2024-04-25T01:49:33.719 INFO:tasks.workunit.client.0.smithi162.stdout:5/372: stat d15/d19/d24/d2b/d3b/c76 0 2024-04-25T01:49:33.878 INFO:tasks.workunit.client.0.smithi162.stdout:7/357: rename df/f1c to df/d2c/d63/f75 0 2024-04-25T01:49:33.894 INFO:tasks.workunit.client.0.smithi162.stdout:4/373: write dd/d1a/f21 [1862192,33501] 0 2024-04-25T01:49:34.039 INFO:tasks.workunit.client.0.smithi162.stdout:9/313: mknod d4/d8/d13/d6a/c72 0 2024-04-25T01:49:34.469 INFO:tasks.workunit.client.0.smithi162.stdout:1/383: dwrite d15/d1f/d23/f51 [0,4194304] 0 2024-04-25T01:49:34.590 INFO:tasks.workunit.client.0.smithi162.stdout:0/412: read d0/df/d20/d37/f60 [900379,24052] 0 2024-04-25T01:49:35.117 INFO:tasks.workunit.client.0.smithi162.stdout:6/322: dwrite d1/d46/f47 [0,4194304] 0 2024-04-25T01:49:35.502 INFO:tasks.workunit.client.0.smithi162.stdout:1/384: creat d15/d1f/d35/d4c/d70/f7e x:0 0 0 2024-04-25T01:49:35.533 INFO:tasks.workunit.client.0.smithi162.stdout:1/385: stat d15/d1f/d23/d30/l3b 0 2024-04-25T01:49:35.662 INFO:tasks.workunit.client.0.smithi162.stdout:0/413: dread - d0/d1/d4e/f74 zero size 2024-04-25T01:49:35.786 INFO:tasks.workunit.client.0.smithi162.stdout:3/389: fdatasync d2/d9/d19/d3f/f79 0 2024-04-25T01:49:36.337 INFO:tasks.workunit.client.0.smithi162.stdout:6/323: truncate d1/f48 1785811 0 2024-04-25T01:49:36.751 INFO:tasks.workunit.client.0.smithi162.stdout:7/358: read df/d2c/d63/f75 [2327960,7286] 0 2024-04-25T01:49:36.767 INFO:tasks.workunit.client.0.smithi162.stdout:8/352: rename d0/d12/f3c to d0/f75 0 2024-04-25T01:49:36.779 INFO:tasks.workunit.client.0.smithi162.stdout:2/341: write d0/d3/f35 [536671,76559] 0 2024-04-25T01:49:36.828 INFO:tasks.workunit.client.0.smithi162.stdout:5/373: write d15/d19/d24/d2b/d3b/d3c/f70 [651021,107782] 0 2024-04-25T01:49:37.100 INFO:tasks.workunit.client.0.smithi162.stdout:5/374: sync 2024-04-25T01:49:37.248 INFO:tasks.workunit.client.0.smithi162.stdout:9/314: unlink d4/d9/d15/f3f 0 2024-04-25T01:49:37.606 INFO:tasks.workunit.client.0.smithi162.stdout:4/374: dwrite dd/df/f14 [0,4194304] 0 2024-04-25T01:49:37.776 INFO:tasks.workunit.client.0.smithi162.stdout:0/414: rename d0/df/d20/d37/c4a to d0/d1/d4b/c88 0 2024-04-25T01:49:37.845 INFO:tasks.workunit.client.0.smithi162.stdout:0/415: sync 2024-04-25T01:49:37.993 INFO:tasks.workunit.client.0.smithi162.stdout:8/353: creat d0/d12/d3a/f76 x:0 0 0 2024-04-25T01:49:38.019 INFO:tasks.workunit.client.0.smithi162.stdout:8/354: readlink d0/d44/d31/l45 0 2024-04-25T01:49:38.268 INFO:tasks.workunit.client.0.smithi162.stdout:9/315: readlink d4/d8/d13/l64 0 2024-04-25T01:49:38.468 INFO:tasks.workunit.client.0.smithi162.stdout:3/390: truncate d2/d29/f3c 4912360 0 2024-04-25T01:49:38.994 INFO:tasks.workunit.client.0.smithi162.stdout:4/375: creat dd/d1a/d4e/f7f x:0 0 0 2024-04-25T01:49:39.191 INFO:tasks.workunit.client.0.smithi162.stdout:0/416: fdatasync d0/df/d20/d37/f57 0 2024-04-25T01:49:39.659 INFO:tasks.workunit.client.0.smithi162.stdout:8/355: dread d0/d12/f4e [0,4194304] 0 2024-04-25T01:49:39.963 INFO:tasks.workunit.client.0.smithi162.stdout:5/375: write fd [8489192,6461] 0 2024-04-25T01:49:40.015 INFO:tasks.workunit.client.0.smithi162.stdout:1/386: dwrite d15/f34 [0,4194304] 0 2024-04-25T01:49:40.149 INFO:tasks.workunit.client.0.smithi162.stdout:3/391: dread d2/d9/d10/d4c/f53 [0,4194304] 0 2024-04-25T01:49:40.405 INFO:tasks.workunit.client.0.smithi162.stdout:3/392: dread - d2/d9/d10/d2c/f78 zero size 2024-04-25T01:49:40.592 INFO:tasks.workunit.client.0.smithi162.stdout:6/324: dwrite d1/d13/d28/d30/d3a/f44 [0,4194304] 0 2024-04-25T01:49:40.866 INFO:tasks.workunit.client.0.smithi162.stdout:6/325: dread d1/d13/d28/d30/d3a/f44 [0,4194304] 0 2024-04-25T01:49:40.912 INFO:tasks.workunit.client.0.smithi162.stdout:7/359: getdents df/d2c/d56 0 2024-04-25T01:49:40.973 INFO:tasks.workunit.client.0.smithi162.stdout:6/326: rename d1 to d1/d13/d28/d30/d3a/d6e 22 2024-04-25T01:49:41.211 INFO:tasks.workunit.client.0.smithi162.stdout:5/376: truncate d15/d19/f67 753307 0 2024-04-25T01:49:41.413 INFO:tasks.workunit.client.0.smithi162.stdout:9/316: dwrite d4/d8/d13/d38/f4c [0,4194304] 0 2024-04-25T01:49:41.725 INFO:tasks.workunit.client.0.smithi162.stdout:4/376: dwrite dd/d1a/f22 [0,4194304] 0 2024-04-25T01:49:41.727 INFO:tasks.workunit.client.0.smithi162.stdout:3/393: fsync d2/d9/fd 0 2024-04-25T01:49:41.890 INFO:tasks.workunit.client.0.smithi162.stdout:4/377: readlink dd/df/d2e/d4b/l74 0 2024-04-25T01:49:41.921 INFO:tasks.workunit.client.0.smithi162.stdout:4/378: chown dd/df/d2e/d4b/c4c 439784568 1 2024-04-25T01:49:41.939 INFO:tasks.workunit.client.0.smithi162.stdout:4/379: readlink dd/d1a/l45 0 2024-04-25T01:49:42.062 INFO:tasks.workunit.client.0.smithi162.stdout:0/417: write d0/d1/d4b/f61 [1006125,109406] 0 2024-04-25T01:49:42.084 INFO:tasks.workunit.client.0.smithi162.stdout:8/356: creat d0/d12/d1b/d74/f77 x:0 0 0 2024-04-25T01:49:42.139 INFO:tasks.workunit.client.0.smithi162.stdout:6/327: fsync d1/d13/d28/f29 0 2024-04-25T01:49:42.225 INFO:tasks.workunit.client.0.smithi162.stdout:4/380: dread dd/d1a/d34/d57/f71 [0,4194304] 0 2024-04-25T01:49:43.466 INFO:tasks.workunit.client.0.smithi162.stdout:9/317: symlink d4/l73 0 2024-04-25T01:49:43.853 INFO:tasks.workunit.client.0.smithi162.stdout:2/342: link d0/d3/d5/d36/c6a d0/d3/d1b/c7c 0 2024-04-25T01:49:43.969 INFO:tasks.workunit.client.0.smithi162.stdout:7/360: creat df/f76 x:0 0 0 2024-04-25T01:49:44.333 INFO:tasks.workunit.client.0.smithi162.stdout:1/387: getdents d15/d69 0 2024-04-25T01:49:44.465 INFO:tasks.workunit.client.0.smithi162.stdout:5/377: rename d15/d1e/f27 to d15/d19/d24/f77 0 2024-04-25T01:49:44.477 INFO:tasks.workunit.client.0.smithi162.stdout:6/328: write d1/f3f [3982466,107072] 0 2024-04-25T01:49:44.634 INFO:tasks.workunit.client.0.smithi162.stdout:8/357: creat d0/d44/d64/f78 x:0 0 0 2024-04-25T01:49:44.717 INFO:tasks.workunit.client.0.smithi162.stdout:3/394: dwrite d2/f25 [0,4194304] 0 2024-04-25T01:49:44.874 INFO:tasks.workunit.client.0.smithi162.stdout:0/418: mknod d0/d7b/c89 0 2024-04-25T01:49:44.920 INFO:tasks.workunit.client.0.smithi162.stdout:8/358: stat d0/d44/d31/f3e 0 2024-04-25T01:49:44.957 INFO:tasks.workunit.client.0.smithi162.stdout:9/318: readlink d4/d8/d13/l42 0 2024-04-25T01:49:45.117 INFO:tasks.workunit.client.0.smithi162.stdout:4/381: dwrite dd/df/f52 [4194304,4194304] 0 2024-04-25T01:49:45.266 INFO:tasks.workunit.client.0.smithi162.stdout:8/359: fdatasync d0/d12/d1b/d74/f77 0 2024-04-25T01:49:45.326 INFO:tasks.workunit.client.0.smithi162.stdout:1/388: mkdir d15/d1f/d23/d30/d4a/d7f 0 2024-04-25T01:49:45.395 INFO:tasks.workunit.client.0.smithi162.stdout:8/360: chown d0/d67/c6f 107 1 2024-04-25T01:49:45.404 INFO:tasks.workunit.client.0.smithi162.stdout:4/382: chown dd/df/d2e/d4b/c4c 1801 1 2024-04-25T01:49:46.197 INFO:tasks.workunit.client.0.smithi162.stdout:0/419: truncate d0/df/d20/d25/f4c 640617 0 2024-04-25T01:49:46.477 INFO:tasks.workunit.client.0.smithi162.stdout:0/420: dwrite d0/d1/d4b/f61 [0,4194304] 0 2024-04-25T01:49:46.617 INFO:tasks.workunit.client.0.smithi162.stdout:4/383: creat dd/d1a/d4e/f80 x:0 0 0 2024-04-25T01:49:46.974 INFO:tasks.workunit.client.0.smithi162.stdout:6/329: write d1/d13/d28/d30/d3a/f44 [233778,86791] 0 2024-04-25T01:49:47.048 INFO:tasks.workunit.client.0.smithi162.stdout:3/395: write d2/d9/d17/f3d [409891,36199] 0 2024-04-25T01:49:47.216 INFO:tasks.workunit.client.0.smithi162.stdout:7/361: write df/f33 [639830,123094] 0 2024-04-25T01:49:47.417 INFO:tasks.workunit.client.0.smithi162.stdout:9/319: dread d4/d9/d15/d4e/f61 [0,4194304] 0 2024-04-25T01:49:47.545 INFO:tasks.workunit.client.0.smithi162.stdout:0/421: mknod d0/df/d20/d25/d55/c8a 0 2024-04-25T01:49:47.732 INFO:tasks.workunit.client.0.smithi162.stdout:7/362: chown df/d2e/d4c/d58/c5a 2121 1 2024-04-25T01:49:48.019 INFO:tasks.workunit.client.0.smithi162.stdout:2/343: dwrite d0/d3/d30/f76 [0,4194304] 0 2024-04-25T01:49:48.039 INFO:tasks.workunit.client.0.smithi162.stdout:5/378: dwrite d15/d19/d24/d2b/d3b/d3c/d3f/f51 [0,4194304] 0 2024-04-25T01:49:48.136 INFO:tasks.workunit.client.0.smithi162.stdout:8/361: write d0/d12/d1b/f1f [1578236,44783] 0 2024-04-25T01:49:48.177 INFO:tasks.workunit.client.0.smithi162.stdout:7/363: rename df to df/d2c/d56/d77 22 2024-04-25T01:49:48.412 INFO:tasks.workunit.client.0.smithi162.stdout:1/389: dwrite d15/d1f/d35/f44 [0,4194304] 0 2024-04-25T01:49:48.546 INFO:tasks.workunit.client.0.smithi162.stdout:9/320: fsync d4/d25/f6e 0 2024-04-25T01:49:48.629 INFO:tasks.workunit.client.0.smithi162.stdout:6/330: write d1/d46/f56 [1085119,81619] 0 2024-04-25T01:49:48.860 INFO:tasks.workunit.client.0.smithi162.stdout:6/331: read d1/f1e [1909538,58768] 0 2024-04-25T01:49:48.915 INFO:tasks.workunit.client.0.smithi162.stdout:3/396: dread d2/f8e [0,4194304] 0 2024-04-25T01:49:49.018 INFO:tasks.workunit.client.0.smithi162.stdout:8/362: readlink d0/d12/d1b/l68 0 2024-04-25T01:49:49.145 INFO:tasks.workunit.client.0.smithi162.stdout:7/364: dread f6 [0,4194304] 0 2024-04-25T01:49:49.389 INFO:tasks.workunit.client.0.smithi162.stdout:2/344: write d0/d3/d30/f76 [4517019,21864] 0 2024-04-25T01:49:49.389 INFO:tasks.workunit.client.0.smithi162.stdout:4/384: truncate dd/d1a/f22 437996 0 2024-04-25T01:49:49.469 INFO:tasks.workunit.client.0.smithi162.stdout:4/385: chown dd/df/f6c 5 1 2024-04-25T01:49:49.653 INFO:tasks.workunit.client.0.smithi162.stdout:5/379: symlink d15/d19/d24/d2b/l78 0 2024-04-25T01:49:49.686 INFO:tasks.workunit.client.0.smithi162.stdout:0/422: write d0/df/d20/f31 [1191684,119478] 0 2024-04-25T01:49:49.752 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:49:49.756 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:49:49.893 INFO:tasks.workunit.client.0.smithi162.stdout:8/363: rename d0/d67/c6f to d0/d12/d1b/c79 0 2024-04-25T01:49:49.941 INFO:tasks.workunit.client.0.smithi162.stdout:7/365: stat df/f20 0 2024-04-25T01:49:49.954 INFO:tasks.workunit.client.0.smithi162.stdout:4/386: dwrite dd/d1a/d4e/f80 [0,4194304] 0 2024-04-25T01:49:50.090 INFO:tasks.workunit.client.0.smithi162.stdout:4/387: chown dd/f16 15590 1 2024-04-25T01:49:50.148 INFO:tasks.workunit.client.0.smithi162.stdout:2/345: fsync d0/d3/d1b/f22 0 2024-04-25T01:49:50.345 INFO:tasks.workunit.client.0.smithi162.stdout:3/397: creat d2/d29/d5d/d7b/f8f x:0 0 0 2024-04-25T01:49:50.396 INFO:tasks.workunit.client.0.smithi162.stdout:6/332: truncate d1/f51 388402 0 2024-04-25T01:49:50.423 INFO:tasks.workunit.client.0.smithi162.stdout:6/333: stat d1/d13/d28/l38 0 2024-04-25T01:49:51.108 INFO:tasks.workunit.client.0.smithi162.stdout:1/390: dwrite d15/d1f/d23/d30/d4a/f58 [0,4194304] 0 2024-04-25T01:49:51.258 INFO:tasks.workunit.client.0.smithi162.stdout:1/391: chown d15/d1f/d23/d30/f78 198 1 2024-04-25T01:49:51.320 INFO:tasks.workunit.client.0.smithi162.stdout:9/321: creat d4/f74 x:0 0 0 2024-04-25T01:49:51.330 INFO:tasks.workunit.client.0.smithi162.stdout:7/366: creat df/d2e/f78 x:0 0 0 2024-04-25T01:49:51.395 INFO:tasks.workunit.client.0.smithi162.stdout:7/367: read fa [1873413,119009] 0 2024-04-25T01:49:51.516 INFO:tasks.workunit.client.0.smithi162.stdout:0/423: rename d0/d1/d4e/f74 to d0/df/d20/d37/d58/f8b 0 2024-04-25T01:49:51.531 INFO:tasks.workunit.client.0.smithi162.stdout:8/364: truncate d0/f11 1827270 0 2024-04-25T01:49:51.701 INFO:tasks.workunit.client.0.smithi162.stdout:4/388: chown dd/c18 1770685 1 2024-04-25T01:49:52.219 INFO:tasks.workunit.client.0.smithi162.stdout:3/398: dread d2/d9/d10/d40/f81 [0,4194304] 0 2024-04-25T01:49:52.240 INFO:tasks.workunit.client.0.smithi162.stdout:6/334: chown d1/d13/d28/d53/d6d 14788054 1 2024-04-25T01:49:52.572 INFO:tasks.workunit.client.0.smithi162.stdout:7/368: stat df/f37 0 2024-04-25T01:49:52.697 INFO:tasks.workunit.client.0.smithi162.stdout:2/346: rename d0/d3/d1b/d1d/l6c to d0/d3/d1b/d1d/d3a/l7d 0 2024-04-25T01:49:53.010 INFO:tasks.workunit.client.0.smithi162.stdout:0/424: truncate d0/df/d20/d37/f5b 419836 0 2024-04-25T01:49:53.055 INFO:tasks.workunit.client.0.smithi162.stdout:0/425: chown d0/d1/f46 1507 1 2024-04-25T01:49:53.069 INFO:tasks.workunit.client.0.smithi162.stdout:0/426: readlink d0/l26 0 2024-04-25T01:49:53.352 INFO:tasks.workunit.client.0.smithi162.stdout:6/335: creat d1/d13/d28/d30/d63/f6f x:0 0 0 2024-04-25T01:49:53.582 INFO:tasks.workunit.client.0.smithi162.stdout:9/322: symlink d4/d8/d13/l75 0 2024-04-25T01:49:54.851 INFO:tasks.workunit.client.0.smithi162.stdout:0/427: creat d0/d1/d64/f8c x:0 0 0 2024-04-25T01:49:55.083 INFO:tasks.workunit.client.0.smithi162.stdout:6/336: mknod d1/d13/d28/d30/d66/c70 0 2024-04-25T01:49:55.109 INFO:tasks.workunit.client.0.smithi162.stdout:1/392: write d15/d1f/d35/d5c/f74 [893477,23059] 0 2024-04-25T01:49:55.263 INFO:tasks.workunit.client.0.smithi162.stdout:5/380: getdents d15/d19 0 2024-04-25T01:49:55.389 INFO:tasks.workunit.client.0.smithi162.stdout:9/323: truncate d4/f39 696995 0 2024-04-25T01:49:55.752 INFO:tasks.workunit.client.0.smithi162.stdout:2/347: creat d0/d3/d5/d69/f7e x:0 0 0 2024-04-25T01:49:55.806 INFO:tasks.workunit.client.0.smithi162.stdout:3/399: write d2/d29/d5d/f68 [1008502,43426] 0 2024-04-25T01:49:56.142 INFO:tasks.workunit.client.0.smithi162.stdout:7/369: write df/d2c/f3e [721080,5899] 0 2024-04-25T01:49:56.216 INFO:tasks.workunit.client.0.smithi162.stdout:7/370: dread f1 [0,4194304] 0 2024-04-25T01:49:56.431 INFO:tasks.workunit.client.0.smithi162.stdout:0/428: fsync d0/df/d20/d25/f49 0 2024-04-25T01:49:56.680 INFO:tasks.workunit.client.0.smithi162.stdout:6/337: mkdir d1/d13/d28/d53/d71 0 2024-04-25T01:49:56.710 INFO:tasks.workunit.client.0.smithi162.stdout:8/365: write d0/d12/d3a/f6a [312709,92166] 0 2024-04-25T01:49:56.752 INFO:tasks.workunit.client.0.smithi162.stdout:5/381: symlink d15/d1e/l79 0 2024-04-25T01:49:57.057 INFO:tasks.workunit.client.0.smithi162.stdout:3/400: truncate d2/d29/d2e/f4f 1034959 0 2024-04-25T01:49:57.317 INFO:tasks.workunit.client.0.smithi162.stdout:4/389: truncate dd/d1a/d4e/f80 2660602 0 2024-04-25T01:49:57.344 INFO:tasks.workunit.client.0.smithi162.stdout:4/390: readlink dd/d1a/l5b 0 2024-04-25T01:49:57.374 INFO:tasks.workunit.client.0.smithi162.stdout:7/371: rmdir df/d52 39 2024-04-25T01:49:57.423 INFO:tasks.workunit.client.0.smithi162.stdout:7/372: chown df/d2c/f5b 101140761 1 2024-04-25T01:49:58.058 INFO:tasks.workunit.client.0.smithi162.stdout:5/382: rmdir d15/d19/d24/d2b 39 2024-04-25T01:49:58.202 INFO:tasks.workunit.client.0.smithi162.stdout:9/324: mknod d4/d9/d15/d1b/d2f/c76 0 2024-04-25T01:49:58.292 INFO:tasks.workunit.client.0.smithi162.stdout:6/338: truncate d1/d13/d28/d45/f4f 192939 0 2024-04-25T01:49:59.023 INFO:tasks.workunit.client.0.smithi162.stdout:3/401: read d2/d9/d10/d4c/f74 [1572532,21255] 0 2024-04-25T01:49:59.371 INFO:tasks.workunit.client.0.smithi162.stdout:7/373: write df/d2c/f3e [927946,127058] 0 2024-04-25T01:49:59.508 INFO:tasks.workunit.client.0.smithi162.stdout:1/393: rmdir d15/d69/d4f/d7c 0 2024-04-25T01:49:59.854 INFO:tasks.workunit.client.0.smithi162.stdout:6/339: creat d1/d13/d28/d53/f72 x:0 0 0 2024-04-25T01:50:00.378 INFO:tasks.workunit.client.0.smithi162.stdout:4/391: creat dd/df/d2e/d4b/d79/f81 x:0 0 0 2024-04-25T01:50:00.446 INFO:tasks.workunit.client.0.smithi162.stdout:1/394: fsync d15/f3f 0 2024-04-25T01:50:00.494 INFO:tasks.workunit.client.0.smithi162.stdout:9/325: dread d4/d8/f18 [0,4194304] 0 2024-04-25T01:50:00.635 INFO:tasks.workunit.client.0.smithi162.stdout:7/374: truncate df/f4d 2059937 0 2024-04-25T01:50:00.645 INFO:tasks.workunit.client.0.smithi162.stdout:2/348: dwrite d0/d3/d5/f18 [4194304,4194304] 0 2024-04-25T01:50:00.808 INFO:tasks.workunit.client.0.smithi162.stdout:0/429: write d0/df/d20/d37/f6c [1002088,47377] 0 2024-04-25T01:50:00.942 INFO:tasks.workunit.client.0.smithi162.stdout:8/366: write d0/d44/d31/f51 [911052,111639] 0 2024-04-25T01:50:01.305 INFO:tasks.workunit.client.0.smithi162.stdout:2/349: dwrite d0/d3/d5/d69/f7e [0,4194304] 0 2024-04-25T01:50:01.710 INFO:tasks.workunit.client.0.smithi162.stdout:6/340: mkdir d1/d73 0 2024-04-25T01:50:01.998 INFO:tasks.workunit.client.0.smithi162.stdout:0/430: mknod d0/d1/d4e/c8d 0 2024-04-25T01:50:01.999 INFO:tasks.workunit.client.0.smithi162.stdout:7/375: creat df/d2c/d63/f79 x:0 0 0 2024-04-25T01:50:02.074 INFO:tasks.workunit.client.0.smithi162.stdout:1/395: truncate d15/d1f/d23/f56 1483225 0 2024-04-25T01:50:02.192 INFO:tasks.workunit.client.0.smithi162.stdout:9/326: rmdir d4/d8 39 2024-04-25T01:50:02.688 INFO:tasks.workunit.client.0.smithi162.stdout:2/350: creat d0/d3/d1b/d1d/d20/d42/d57/f7f x:0 0 0 2024-04-25T01:50:02.762 INFO:tasks.workunit.client.0.smithi162.stdout:6/341: fdatasync d1/f25 0 2024-04-25T01:50:02.796 INFO:tasks.workunit.client.0.smithi162.stdout:6/342: read d1/f25 [3174957,123842] 0 2024-04-25T01:50:02.939 INFO:tasks.workunit.client.0.smithi162.stdout:7/376: mkdir df/d2c/d49/d7a 0 2024-04-25T01:50:03.220 INFO:tasks.workunit.client.0.smithi162.stdout:0/431: write d0/d1/d64/f8c [975422,33948] 0 2024-04-25T01:50:03.279 INFO:tasks.workunit.client.0.smithi162.stdout:1/396: readlink d15/l68 0 2024-04-25T01:50:03.282 INFO:tasks.workunit.client.0.smithi162.stdout:0/432: chown d0/df/d20/d25 0 1 2024-04-25T01:50:03.720 INFO:tasks.workunit.client.0.smithi162.stdout:8/367: mknod d0/d1a/c7a 0 2024-04-25T01:50:03.729 INFO:tasks.workunit.client.0.smithi162.stdout:3/402: write d2/d9/f66 [717037,37506] 0 2024-04-25T01:50:03.744 INFO:tasks.workunit.client.0.smithi162.stdout:2/351: mknod d0/d3/d1b/d1d/d20/d42/d57/c80 0 2024-04-25T01:50:03.758 INFO:tasks.workunit.client.0.smithi162.stdout:6/343: truncate d1/f24 2093638 0 2024-04-25T01:50:03.827 INFO:tasks.workunit.client.0.smithi162.stdout:1/397: mknod d15/d1f/d23/d30/d4a/c80 0 2024-04-25T01:50:03.912 INFO:tasks.workunit.client.0.smithi162.stdout:3/403: chown d2/d9/f2d 534544 1 2024-04-25T01:50:04.042 INFO:tasks.workunit.client.0.smithi162.stdout:5/383: write d15/d19/d24/d4d/f5a [8703,68851] 0 2024-04-25T01:50:04.157 INFO:tasks.workunit.client.0.smithi162.stdout:4/392: write dd/d1a/d34/f50 [1487765,103146] 0 2024-04-25T01:50:05.148 INFO:tasks.workunit.client.0.smithi162.stdout:1/398: creat d15/d1f/d35/d4c/d70/f81 x:0 0 0 2024-04-25T01:50:05.282 INFO:tasks.workunit.client.0.smithi162.stdout:3/404: mkdir d2/d9/d10/d4c/d51/d63/d87/d90 0 2024-04-25T01:50:05.648 INFO:tasks.workunit.client.0.smithi162.stdout:4/393: symlink dd/df/d2e/l82 0 2024-04-25T01:50:05.722 INFO:tasks.workunit.client.0.smithi162.stdout:4/394: dread dd/df/d2e/d4b/f54 [0,4194304] 0 2024-04-25T01:50:05.962 INFO:tasks.workunit.client.0.smithi162.stdout:8/368: creat d0/d44/d31/d65/f7b x:0 0 0 2024-04-25T01:50:06.009 INFO:tasks.workunit.client.0.smithi162.stdout:4/395: dread dd/df/f64 [0,4194304] 0 2024-04-25T01:50:06.235 INFO:tasks.workunit.client.0.smithi162.stdout:4/396: dread dd/d1a/d34/d57/f71 [0,4194304] 0 2024-04-25T01:50:06.418 INFO:tasks.workunit.client.0.smithi162.stdout:5/384: mkdir d15/d19/d24/d73/d7a 0 2024-04-25T01:50:06.429 INFO:tasks.workunit.client.0.smithi162.stdout:0/433: link d0/d1/c33 d0/df/d20/d25/d55/d6f/c8e 0 2024-04-25T01:50:06.465 INFO:tasks.workunit.client.0.smithi162.stdout:0/434: chown d0/d1/f3d 15 1 2024-04-25T01:50:06.549 INFO:tasks.workunit.client.0.smithi162.stdout:2/352: rename d0/ff to d0/d3/d5/f81 0 2024-04-25T01:50:06.762 INFO:tasks.workunit.client.0.smithi162.stdout:8/369: creat d0/d12/d2b/f7c x:0 0 0 2024-04-25T01:50:06.998 INFO:tasks.workunit.client.0.smithi162.stdout:9/327: dwrite d4/d9/fa [0,4194304] 0 2024-04-25T01:50:07.978 INFO:tasks.workunit.client.0.smithi162.stdout:5/385: dread f11 [0,4194304] 0 2024-04-25T01:50:08.086 INFO:tasks.workunit.client.0.smithi162.stdout:7/377: creat df/f7b x:0 0 0 2024-04-25T01:50:08.263 INFO:tasks.workunit.client.0.smithi162.stdout:9/328: symlink d4/d9/d15/d1b/l77 0 2024-04-25T01:50:08.290 INFO:tasks.workunit.client.0.smithi162.stdout:8/370: dread d0/f11 [0,4194304] 0 2024-04-25T01:50:08.443 INFO:tasks.workunit.client.0.smithi162.stdout:3/405: link d2/c1d d2/d9/d10/d4c/d51/d63/d87/d90/c91 0 2024-04-25T01:50:08.590 INFO:tasks.workunit.client.0.smithi162.stdout:3/406: dread d2/d9/d10/d4c/f70 [0,4194304] 0 2024-04-25T01:50:09.085 INFO:tasks.workunit.client.0.smithi162.stdout:9/329: mknod d4/d9/d15/d1b/d2f/d30/c78 0 2024-04-25T01:50:09.694 INFO:tasks.workunit.client.0.smithi162.stdout:2/353: fsync d0/d3/d1b/d1d/d3a/f40 0 2024-04-25T01:50:10.879 INFO:tasks.workunit.client.0.smithi162.stdout:4/397: getdents dd/df 0 2024-04-25T01:50:10.904 INFO:tasks.workunit.client.0.smithi162.stdout:3/407: creat d2/d9/d10/d4c/d8d/f92 x:0 0 0 2024-04-25T01:50:11.010 INFO:tasks.workunit.client.0.smithi162.stdout:5/386: link fd d15/d19/d24/d40/f7b 0 2024-04-25T01:50:11.372 INFO:tasks.workunit.client.0.smithi162.stdout:0/435: write d0/d59/f68 [258064,113201] 0 2024-04-25T01:50:11.377 INFO:tasks.workunit.client.0.smithi162.stdout:7/378: creat df/f7c x:0 0 0 2024-04-25T01:50:11.574 INFO:tasks.workunit.client.0.smithi162.stdout:8/371: rename d0/d44/d31/d33/f4f to d0/d44/f7d 0 2024-04-25T01:50:11.605 INFO:tasks.workunit.client.0.smithi162.stdout:8/372: chown d0/d12/d3a 260 1 2024-04-25T01:50:11.825 INFO:tasks.workunit.client.0.smithi162.stdout:3/408: read d2/d9/f49 [1971215,8231] 0 2024-04-25T01:50:11.881 INFO:tasks.workunit.client.0.smithi162.stdout:4/398: truncate dd/df/d2e/f3d 922514 0 2024-04-25T01:50:12.257 INFO:tasks.workunit.client.0.smithi162.stdout:9/330: fsync d4/d8/d13/f27 0 2024-04-25T01:50:12.908 INFO:tasks.workunit.client.0.smithi162.stdout:4/399: creat dd/df/d58/f83 x:0 0 0 2024-04-25T01:50:13.137 INFO:tasks.workunit.client.0.smithi162.stdout:5/387: fsync d15/d19/d24/d2b/d3b/d58/f5c 0 2024-04-25T01:50:13.349 INFO:tasks.workunit.client.0.smithi162.stdout:6/344: creat d1/d13/d28/d30/f74 x:0 0 0 2024-04-25T01:50:14.218 INFO:tasks.workunit.client.0.smithi162.stdout:1/399: rmdir d15/d69 39 2024-04-25T01:50:14.288 INFO:tasks.workunit.client.0.smithi162.stdout:5/388: mkdir d15/d19/d24/d4d/d7c 0 2024-04-25T01:50:14.923 INFO:tasks.workunit.client.0.smithi162.stdout:6/345: dread d1/f21 [0,4194304] 0 2024-04-25T01:50:15.215 INFO:tasks.workunit.client.0.smithi162.stdout:1/400: dread d15/d1f/d23/d30/d4a/f58 [0,4194304] 0 2024-04-25T01:50:15.576 INFO:tasks.workunit.client.0.smithi162.stdout:1/401: dread - d15/d69/f7d zero size 2024-04-25T01:50:15.754 INFO:tasks.workunit.client.0.smithi162.stdout:2/354: rename d0/d3/d1b/d1d/d20/d42/c6e to d0/d3/d1b/d1d/d20/c82 0 2024-04-25T01:50:15.941 INFO:tasks.workunit.client.0.smithi162.stdout:0/436: write d0/d1/d4b/f85 [491957,33493] 0 2024-04-25T01:50:16.108 INFO:tasks.workunit.client.0.smithi162.stdout:3/409: rename d2/d9/f7d to d2/d29/f93 0 2024-04-25T01:50:16.158 INFO:tasks.workunit.client.0.smithi162.stdout:8/373: write d0/d44/f15 [5699269,78827] 0 2024-04-25T01:50:16.200 INFO:tasks.workunit.client.0.smithi162.stdout:2/355: rmdir d0/d3/d1b/d1d/d20/d5e/d61/d66 39 2024-04-25T01:50:16.319 INFO:tasks.workunit.client.0.smithi162.stdout:7/379: dwrite df/d2e/d4c/f54 [0,4194304] 0 2024-04-25T01:50:16.481 INFO:tasks.workunit.client.0.smithi162.stdout:9/331: write d4/d9/d15/d1b/f28 [1601809,120541] 0 2024-04-25T01:50:16.607 INFO:tasks.workunit.client.0.smithi162.stdout:4/400: dwrite fc [0,4194304] 0 2024-04-25T01:50:17.235 INFO:tasks.workunit.client.0.smithi162.stdout:8/374: dread - d0/f6b zero size 2024-04-25T01:50:17.490 INFO:tasks.workunit.client.0.smithi162.stdout:2/356: mknod d0/d3/d5/d36/c83 0 2024-04-25T01:50:17.541 INFO:tasks.workunit.client.0.smithi162.stdout:5/389: dwrite d15/d19/d24/d40/f74 [0,4194304] 0 2024-04-25T01:50:17.923 INFO:tasks.workunit.client.0.smithi162.stdout:6/346: link d1/d13/l1a d1/d13/d28/d53/l75 0 2024-04-25T01:50:17.986 INFO:tasks.workunit.client.0.smithi162.stdout:8/375: dread d0/d12/f23 [0,4194304] 0 2024-04-25T01:50:18.109 INFO:tasks.workunit.client.0.smithi162.stdout:0/437: truncate d0/df/d20/d37/f5b 1103825 0 2024-04-25T01:50:18.128 INFO:tasks.workunit.client.0.smithi162.stdout:0/438: readlink d0/df/l79 0 2024-04-25T01:50:18.399 INFO:tasks.workunit.client.0.smithi162.stdout:3/410: mkdir d2/d9/d94 0 2024-04-25T01:50:18.689 INFO:tasks.workunit.client.0.smithi162.stdout:7/380: fsync df/d2e/f40 0 2024-04-25T01:50:18.706 INFO:tasks.workunit.client.0.smithi162.stdout:1/402: dwrite d15/d1f/d23/f25 [0,4194304] 0 2024-04-25T01:50:19.134 INFO:tasks.workunit.client.0.smithi162.stdout:5/390: truncate d15/d1e/f6c 3219511 0 2024-04-25T01:50:19.157 INFO:tasks.workunit.client.0.smithi162.stdout:5/391: chown d15/d19 6299 1 2024-04-25T01:50:19.484 INFO:tasks.workunit.client.0.smithi162.stdout:0/439: creat d0/d1/d6a/f8f x:0 0 0 2024-04-25T01:50:19.682 INFO:tasks.workunit.client.0.smithi162.stdout:0/440: sync 2024-04-25T01:50:19.834 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:50:19.837 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:50:19.878 INFO:tasks.workunit.client.0.smithi162.stdout:3/411: creat d2/d9/d10/f95 x:0 0 0 2024-04-25T01:50:20.195 INFO:tasks.workunit.client.0.smithi162.stdout:9/332: write d4/d9/d15/d4e/f61 [4447307,51969] 0 2024-04-25T01:50:20.261 INFO:tasks.workunit.client.0.smithi162.stdout:1/403: stat d15/l6d 0 2024-04-25T01:50:20.275 INFO:tasks.workunit.client.0.smithi162.stdout:1/404: chown l5 61 1 2024-04-25T01:50:20.775 INFO:tasks.workunit.client.0.smithi162.stdout:0/441: rename d0/df/d20/d25/d55/f87 to d0/df/d20/d25/d55/d77/f90 0 2024-04-25T01:50:20.979 INFO:tasks.workunit.client.0.smithi162.stdout:3/412: mknod d2/d9/d10/d4c/d51/d63/d87/c96 0 2024-04-25T01:50:21.195 INFO:tasks.workunit.client.0.smithi162.stdout:1/405: read - d15/d1f/d35/d4c/d70/f7e zero size 2024-04-25T01:50:21.223 INFO:tasks.workunit.client.0.smithi162.stdout:1/406: readlink d15/d69/l76 0 2024-04-25T01:50:21.390 INFO:tasks.workunit.client.0.smithi162.stdout:8/376: creat d0/d12/f7e x:0 0 0 2024-04-25T01:50:21.574 INFO:tasks.workunit.client.0.smithi162.stdout:4/401: dwrite dd/d1a/d4e/f80 [0,4194304] 0 2024-04-25T01:50:21.700 INFO:tasks.workunit.client.0.smithi162.stdout:0/442: unlink d0/df/d20/c73 0 2024-04-25T01:50:21.726 INFO:tasks.workunit.client.0.smithi162.stdout:2/357: write d0/d3/d5/d69/f7e [77643,4760] 0 2024-04-25T01:50:21.828 INFO:tasks.workunit.client.0.smithi162.stdout:8/377: dread d0/d12/f23 [0,4194304] 0 2024-04-25T01:50:21.929 INFO:tasks.workunit.client.0.smithi162.stdout:8/378: chown d0/d12/f24 1 1 2024-04-25T01:50:22.011 INFO:tasks.workunit.client.0.smithi162.stdout:6/347: write d1/d13/d28/d30/d3a/f44 [4658783,118696] 0 2024-04-25T01:50:22.157 INFO:tasks.workunit.client.0.smithi162.stdout:1/407: fdatasync d15/d1f/d35/d4c/f6f 0 2024-04-25T01:50:22.256 INFO:tasks.workunit.client.0.smithi162.stdout:0/443: dread d0/d1/f3d [0,4194304] 0 2024-04-25T01:50:22.268 INFO:tasks.workunit.client.0.smithi162.stdout:1/408: readlink d15/d69/d4f/l5e 0 2024-04-25T01:50:22.593 INFO:tasks.workunit.client.0.smithi162.stdout:4/402: creat dd/d1a/d4e/f84 x:0 0 0 2024-04-25T01:50:22.918 INFO:tasks.workunit.client.0.smithi162.stdout:0/444: mknod d0/df/c91 0 2024-04-25T01:50:22.933 INFO:tasks.workunit.client.0.smithi162.stdout:4/403: dread f5 [0,4194304] 0 2024-04-25T01:50:22.986 INFO:tasks.workunit.client.0.smithi162.stdout:4/404: chown dd/l1f 14 1 2024-04-25T01:50:23.031 INFO:tasks.workunit.client.0.smithi162.stdout:4/405: write dd/d1a/d4e/f84 [183625,62493] 0 2024-04-25T01:50:23.111 INFO:tasks.workunit.client.0.smithi162.stdout:5/392: write d15/d19/d24/f2d [3619841,6142] 0 2024-04-25T01:50:23.266 INFO:tasks.workunit.client.0.smithi162.stdout:4/406: truncate dd/d1a/d4e/f84 448016 0 2024-04-25T01:50:23.413 INFO:tasks.workunit.client.0.smithi162.stdout:7/381: dwrite df/f12 [0,4194304] 0 2024-04-25T01:50:23.713 INFO:tasks.workunit.client.0.smithi162.stdout:1/409: fsync d15/d1f/f5f 0 2024-04-25T01:50:23.792 INFO:tasks.workunit.client.0.smithi162.stdout:3/413: getdents d2/d9 0 2024-04-25T01:50:24.013 INFO:tasks.workunit.client.0.smithi162.stdout:4/407: creat dd/df/d2e/d4b/d79/f85 x:0 0 0 2024-04-25T01:50:24.078 INFO:tasks.workunit.client.0.smithi162.stdout:9/333: dwrite d4/d8/d13/f55 [0,4194304] 0 2024-04-25T01:50:24.104 INFO:tasks.workunit.client.0.smithi162.stdout:0/445: mkdir d0/df/d20/d37/d81/d92 0 2024-04-25T01:50:24.517 INFO:tasks.workunit.client.0.smithi162.stdout:6/348: write d1/d13/d28/d53/f72 [815065,34904] 0 2024-04-25T01:50:24.631 INFO:tasks.workunit.client.0.smithi162.stdout:6/349: readlink d1/d13/d28/l38 0 2024-04-25T01:50:24.693 INFO:tasks.workunit.client.0.smithi162.stdout:7/382: rename df/d2e/d4c/f6a to df/d2c/d49/d7a/f7d 0 2024-04-25T01:50:24.941 INFO:tasks.workunit.client.0.smithi162.stdout:1/410: mknod d15/d1f/d35/d5c/c82 0 2024-04-25T01:50:25.167 INFO:tasks.workunit.client.0.smithi162.stdout:3/414: mkdir d2/d9/d48/d89/d97 0 2024-04-25T01:50:25.347 INFO:tasks.workunit.client.0.smithi162.stdout:4/408: creat dd/df/f86 x:0 0 0 2024-04-25T01:50:25.380 INFO:tasks.workunit.client.0.smithi162.stdout:4/409: chown dd/d1a/d4e/c55 1331535 1 2024-04-25T01:50:25.428 INFO:tasks.workunit.client.0.smithi162.stdout:2/358: write d0/d3/f47 [4169192,96024] 0 2024-04-25T01:50:25.501 INFO:tasks.workunit.client.0.smithi162.stdout:2/359: chown d0/d3/d1b/d1d/d20/d5e/d61/l28 31025634 1 2024-04-25T01:50:25.674 INFO:tasks.workunit.client.0.smithi162.stdout:8/379: getdents d0/d12/d1b 0 2024-04-25T01:50:25.733 INFO:tasks.workunit.client.0.smithi162.stdout:0/446: creat d0/df/d20/d37/f93 x:0 0 0 2024-04-25T01:50:25.799 INFO:tasks.workunit.client.0.smithi162.stdout:9/334: read d4/d9/d15/d1b/f28 [3668723,129902] 0 2024-04-25T01:50:26.328 INFO:tasks.workunit.client.0.smithi162.stdout:5/393: write d15/d19/d24/d40/f7b [1841925,84016] 0 2024-04-25T01:50:26.444 INFO:tasks.workunit.client.0.smithi162.stdout:5/394: chown d15/d19/d24/d2b/d3b/d3c/d3f/f6f 54 1 2024-04-25T01:50:26.853 INFO:tasks.workunit.client.0.smithi162.stdout:2/360: rmdir d0/d3/d1b/d1d/d20/d42 39 2024-04-25T01:50:26.917 INFO:tasks.workunit.client.0.smithi162.stdout:4/410: dread dd/d1a/f21 [0,4194304] 0 2024-04-25T01:50:27.316 INFO:tasks.workunit.client.0.smithi162.stdout:0/447: truncate d0/d1/f53 1796631 0 2024-04-25T01:50:27.481 INFO:tasks.workunit.client.0.smithi162.stdout:9/335: unlink d4/d9/c1f 0 2024-04-25T01:50:28.261 INFO:tasks.workunit.client.0.smithi162.stdout:5/395: creat d15/d19/d24/d2b/d3b/d58/f7d x:0 0 0 2024-04-25T01:50:28.615 INFO:tasks.workunit.client.0.smithi162.stdout:4/411: mkdir dd/df/d77/d87 0 2024-04-25T01:50:29.231 INFO:tasks.workunit.client.0.smithi162.stdout:6/350: link d1/d5c/f5f d1/d13/d28/d30/d66/f76 0 2024-04-25T01:50:29.245 INFO:tasks.workunit.client.0.smithi162.stdout:1/411: dwrite d15/f1a [4194304,4194304] 0 2024-04-25T01:50:29.810 INFO:tasks.workunit.client.0.smithi162.stdout:2/361: mkdir d0/d3/d1b/d1d/d20/d5e/d61/d66/d84 0 2024-04-25T01:50:30.009 INFO:tasks.workunit.client.0.smithi162.stdout:4/412: read dd/d1a/f22 [121084,59092] 0 2024-04-25T01:50:30.334 INFO:tasks.workunit.client.0.smithi162.stdout:8/380: dwrite d0/d44/d31/d65/f7b [0,4194304] 0 2024-04-25T01:50:30.496 INFO:tasks.workunit.client.0.smithi162.stdout:6/351: fdatasync d1/d13/d28/f29 0 2024-04-25T01:50:30.668 INFO:tasks.workunit.client.0.smithi162.stdout:1/412: mkdir d15/d1f/d35/d5c/d83 0 2024-04-25T01:50:30.689 INFO:tasks.workunit.client.0.smithi162.stdout:3/415: link d2/d29/d2e/f4f d2/d9/d10/d4c/d51/d63/d87/d90/f98 0 2024-04-25T01:50:30.843 INFO:tasks.workunit.client.0.smithi162.stdout:5/396: mkdir d15/d19/d24/d73/d7a/d7e 0 2024-04-25T01:50:31.111 INFO:tasks.workunit.client.0.smithi162.stdout:7/383: dwrite df/d2c/f3f [0,4194304] 0 2024-04-25T01:50:31.424 INFO:tasks.workunit.client.0.smithi162.stdout:4/413: symlink dd/df/d2e/d4b/d79/l88 0 2024-04-25T01:50:31.730 INFO:tasks.workunit.client.0.smithi162.stdout:6/352: fdatasync d1/f10 0 2024-04-25T01:50:31.880 INFO:tasks.workunit.client.0.smithi162.stdout:0/448: write d0/d1/d64/f8c [1622158,101142] 0 2024-04-25T01:50:32.210 INFO:tasks.workunit.client.0.smithi162.stdout:5/397: symlink d15/d1e/l7f 0 2024-04-25T01:50:32.319 INFO:tasks.workunit.client.0.smithi162.stdout:9/336: dwrite d4/d8/f10 [4194304,4194304] 0 2024-04-25T01:50:32.339 INFO:tasks.workunit.client.0.smithi162.stdout:5/398: readlink d15/d1e/l79 0 2024-04-25T01:50:33.289 INFO:tasks.workunit.client.0.smithi162.stdout:6/353: fdatasync d1/d13/d28/d30/d3a/d57/f65 0 2024-04-25T01:50:33.444 INFO:tasks.workunit.client.0.smithi162.stdout:0/449: stat d0/df/d20/d37/l44 0 2024-04-25T01:50:33.906 INFO:tasks.workunit.client.0.smithi162.stdout:2/362: link d0/l14 d0/d3/d1b/d1d/d20/d5e/d61/d66/l85 0 2024-04-25T01:50:34.412 INFO:tasks.workunit.client.0.smithi162.stdout:0/450: stat d0/d1/d64/f67 0 2024-04-25T01:50:34.430 INFO:tasks.workunit.client.0.smithi162.stdout:0/451: chown d0/d1/d4b 82451 1 2024-04-25T01:50:34.938 INFO:tasks.workunit.client.0.smithi162.stdout:4/414: link dd/d1a/d4e/l7b dd/df/d58/l89 0 2024-04-25T01:50:35.194 INFO:tasks.workunit.client.0.smithi162.stdout:8/381: write d0/d44/d31/d65/f71 [830487,1164] 0 2024-04-25T01:50:35.315 INFO:tasks.workunit.client.0.smithi162.stdout:1/413: write d15/d69/d4f/f63 [758917,115976] 0 2024-04-25T01:50:35.456 INFO:tasks.workunit.client.0.smithi162.stdout:3/416: write d2/d9/d10/d2c/f5c [817636,21399] 0 2024-04-25T01:50:35.526 INFO:tasks.workunit.client.0.smithi162.stdout:3/417: chown d2/d9/d19/c24 2400835 1 2024-04-25T01:50:35.612 INFO:tasks.workunit.client.0.smithi162.stdout:3/418: truncate d2/d9/d10/d2c/f5c 1658555 0 2024-04-25T01:50:35.760 INFO:tasks.workunit.client.0.smithi162.stdout:0/452: mknod d0/df/d20/d25/d51/c94 0 2024-04-25T01:50:36.085 INFO:tasks.workunit.client.0.smithi162.stdout:1/414: mknod d15/d1f/d23/d30/d4a/c84 0 2024-04-25T01:50:36.146 INFO:tasks.workunit.client.0.smithi162.stdout:8/382: dread d0/d44/d31/f51 [0,4194304] 0 2024-04-25T01:50:36.224 INFO:tasks.workunit.client.0.smithi162.stdout:7/384: dwrite df/d2c/f3e [0,4194304] 0 2024-04-25T01:50:36.358 INFO:tasks.workunit.client.0.smithi162.stdout:2/363: creat d0/d3/d1b/d1d/d20/f86 x:0 0 0 2024-04-25T01:50:36.422 INFO:tasks.workunit.client.0.smithi162.stdout:7/385: stat df/d2e/f40 0 2024-04-25T01:50:36.692 INFO:tasks.workunit.client.0.smithi162.stdout:7/386: sync 2024-04-25T01:50:37.046 INFO:tasks.workunit.client.0.smithi162.stdout:2/364: fdatasync d0/d3/d1b/d1d/d3a/f40 0 2024-04-25T01:50:37.144 INFO:tasks.workunit.client.0.smithi162.stdout:7/387: creat df/d2c/d49/f7e x:0 0 0 2024-04-25T01:50:37.230 INFO:tasks.workunit.client.0.smithi162.stdout:5/399: write d15/d19/f59 [911903,104798] 0 2024-04-25T01:50:37.525 INFO:tasks.workunit.client.0.smithi162.stdout:9/337: dwrite d4/d8/f5d [0,4194304] 0 2024-04-25T01:50:37.723 INFO:tasks.workunit.client.0.smithi162.stdout:7/388: symlink df/d2e/l7f 0 2024-04-25T01:50:37.798 INFO:tasks.workunit.client.0.smithi162.stdout:6/354: write d1/f39 [1999550,120180] 0 2024-04-25T01:50:38.183 INFO:tasks.workunit.client.0.smithi162.stdout:7/389: dread df/d2c/d56/f66 [0,4194304] 0 2024-04-25T01:50:38.713 INFO:tasks.workunit.client.0.smithi162.stdout:5/400: unlink d15/d19/d24/c36 0 2024-04-25T01:50:39.144 INFO:tasks.workunit.client.0.smithi162.stdout:5/401: mkdir d15/d19/d24/d2b/d3b/d80 0 2024-04-25T01:50:39.201 INFO:tasks.workunit.client.0.smithi162.stdout:7/390: dread df/f23 [0,4194304] 0 2024-04-25T01:50:39.345 INFO:tasks.workunit.client.0.smithi162.stdout:2/365: getdents d0/d3/d1b/d1d/d20/d42/d57 0 2024-04-25T01:50:39.371 INFO:tasks.workunit.client.0.smithi162.stdout:7/391: chown df/f12 73001 1 2024-04-25T01:50:39.402 INFO:tasks.workunit.client.0.smithi162.stdout:5/402: readlink d15/d19/d24/d4d/l5d 0 2024-04-25T01:50:39.434 INFO:tasks.workunit.client.0.smithi162.stdout:4/415: dwrite dd/d1a/f37 [0,4194304] 0 2024-04-25T01:50:39.846 INFO:tasks.workunit.client.0.smithi162.stdout:8/383: write d0/d12/d3a/f42 [510384,106790] 0 2024-04-25T01:50:40.083 INFO:tasks.workunit.client.0.smithi162.stdout:6/355: write d1/d13/d28/d30/d66/f67 [663125,101860] 0 2024-04-25T01:50:40.182 INFO:tasks.workunit.client.0.smithi162.stdout:2/366: dread d0/d3/d1b/d1d/d20/d5e/d61/d66/f24 [4194304,4194304] 0 2024-04-25T01:50:40.489 INFO:tasks.workunit.client.0.smithi162.stdout:0/453: dwrite d0/d1/d4b/f61 [0,4194304] 0 2024-04-25T01:50:40.659 INFO:tasks.workunit.client.0.smithi162.stdout:5/403: symlink d15/d19/d24/d40/l81 0 2024-04-25T01:50:40.741 INFO:tasks.workunit.client.0.smithi162.stdout:9/338: dwrite d4/d9/d15/f49 [0,4194304] 0 2024-04-25T01:50:40.896 INFO:tasks.workunit.client.0.smithi162.stdout:7/392: creat df/d52/f80 x:0 0 0 2024-04-25T01:50:41.054 INFO:tasks.workunit.client.0.smithi162.stdout:5/404: dread d15/d19/f67 [0,4194304] 0 2024-04-25T01:50:41.411 INFO:tasks.workunit.client.0.smithi162.stdout:6/356: fsync d1/d13/d28/d30/d63/f6f 0 2024-04-25T01:50:41.432 INFO:tasks.workunit.client.0.smithi162.stdout:3/419: rename d2/d9/d17 to d2/d9/d99 0 2024-04-25T01:50:41.435 INFO:tasks.workunit.client.0.smithi162.stdout:1/415: rename c11 to d15/d1f/d23/d30/d4a/c85 0 2024-04-25T01:50:41.530 INFO:tasks.workunit.client.0.smithi162.stdout:6/357: dread - d1/d13/d28/d30/d63/f6f zero size 2024-04-25T01:50:42.065 INFO:tasks.workunit.client.0.smithi162.stdout:7/393: chown df/c16 1541344841 1 2024-04-25T01:50:42.312 INFO:tasks.workunit.client.0.smithi162.stdout:0/454: creat d0/df/d20/d37/d58/f95 x:0 0 0 2024-04-25T01:50:42.455 INFO:tasks.workunit.client.0.smithi162.stdout:0/455: sync 2024-04-25T01:50:42.672 INFO:tasks.workunit.client.0.smithi162.stdout:2/367: truncate d0/d3/d1b/d1d/d20/d5e/d61/d66/f24 3398392 0 2024-04-25T01:50:43.172 INFO:tasks.workunit.client.0.smithi162.stdout:3/420: dread d2/d29/d2e/f4f [0,4194304] 0 2024-04-25T01:50:43.295 INFO:tasks.workunit.client.0.smithi162.stdout:8/384: dwrite d0/d1a/d25/f58 [0,4194304] 0 2024-04-25T01:50:43.428 INFO:tasks.workunit.client.0.smithi162.stdout:7/394: mknod df/d2e/d4c/d58/c81 0 2024-04-25T01:50:43.622 INFO:tasks.workunit.client.0.smithi162.stdout:0/456: creat d0/df/f96 x:0 0 0 2024-04-25T01:50:43.770 INFO:tasks.workunit.client.0.smithi162.stdout:6/358: dread d1/d5c/f5f [0,4194304] 0 2024-04-25T01:50:43.965 INFO:tasks.workunit.client.0.smithi162.stdout:9/339: creat d4/d8/d13/f79 x:0 0 0 2024-04-25T01:50:43.983 INFO:tasks.workunit.client.0.smithi162.stdout:5/405: dwrite d15/d19/f1b [0,4194304] 0 2024-04-25T01:50:44.447 INFO:tasks.workunit.client.0.smithi162.stdout:4/416: rename dd/d1a/f6b to dd/f8a 0 2024-04-25T01:50:44.906 INFO:tasks.workunit.client.0.smithi162.stdout:6/359: dread d1/f24 [0,4194304] 0 2024-04-25T01:50:44.969 INFO:tasks.workunit.client.0.smithi162.stdout:3/421: unlink d2/d9/d10/d40/f5b 0 2024-04-25T01:50:45.541 INFO:tasks.workunit.client.0.smithi162.stdout:8/385: write d0/d12/d1b/f1f [1928654,53725] 0 2024-04-25T01:50:45.576 INFO:tasks.workunit.client.0.smithi162.stdout:8/386: chown d0/d1a/d25 30231405 1 2024-04-25T01:50:45.642 INFO:tasks.workunit.client.0.smithi162.stdout:7/395: write df/f4d [1028757,68782] 0 2024-04-25T01:50:45.828 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:01:35.266 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:50:45.833 INFO:tasks.workunit.client.0.smithi162.stdout:1/416: link d15/d1f/l66 d15/d1f/d23/d30/l86 0 2024-04-25T01:50:45.867 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:01:35.221 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:50:45.869 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:01:35.224 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:50:45.872 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:01:35.227 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:50:45.881 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:01:35.236 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:50:45.884 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:01:35.322 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:50:45.982 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:01:35.337 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:50:45.987 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:01:35.342 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:50:46.071 INFO:tasks.workunit.client.0.smithi162.stdout:0/457: symlink d0/d59/d7e/l97 0 2024-04-25T01:50:46.151 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:01:35.588 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:50:46.168 INFO:tasks.workunit.client.0.smithi162.stdout:6/360: unlink d1/d13/d28/d30/f4a 0 2024-04-25T01:50:46.339 INFO:tasks.workunit.client.0.smithi162.stdout:2/368: dwrite d0/d3/d5/d36/f65 [0,4194304] 0 2024-04-25T01:50:46.643 INFO:tasks.workunit.client.0.smithi162.stdout:5/406: dwrite d15/d19/d24/d2b/f3d [4194304,4194304] 0 2024-04-25T01:50:46.781 INFO:tasks.workunit.client.0.smithi162.stdout:5/407: readlink d15/d19/d24/l45 0 2024-04-25T01:50:46.868 INFO:tasks.workunit.client.0.smithi162.stdout:7/396: rmdir df/d2c/d49 39 2024-04-25T01:50:47.107 INFO:tasks.workunit.client.0.smithi162.stdout:1/417: truncate d15/d69/f62 4106134 0 2024-04-25T01:50:47.239 INFO:tasks.workunit.client.0.smithi162.stdout:4/417: dwrite dd/df/f49 [0,4194304] 0 2024-04-25T01:50:48.496 INFO:tasks.workunit.client.0.smithi162.stdout:9/340: dwrite d4/d8/d13/f16 [0,4194304] 0 2024-04-25T01:50:48.617 INFO:tasks.workunit.client.0.smithi162.stdout:5/408: creat d15/d19/d24/d73/f82 x:0 0 0 2024-04-25T01:50:48.668 INFO:tasks.workunit.client.0.smithi162.stdout:7/397: readlink df/l68 0 2024-04-25T01:50:48.728 INFO:tasks.workunit.client.0.smithi162.stdout:9/341: chown d4/d8 279 1 2024-04-25T01:50:48.750 INFO:tasks.workunit.client.0.smithi162.stdout:6/361: dread d1/d13/d28/f2f [0,4194304] 0 2024-04-25T01:50:48.844 INFO:tasks.workunit.client.0.smithi162.stdout:9/342: chown d4/d8/d13 180567 1 2024-04-25T01:50:49.537 INFO:tasks.workunit.client.0.smithi162.stdout:2/369: dread d0/d3/d5/d36/f37 [0,4194304] 0 2024-04-25T01:50:49.758 INFO:tasks.workunit.client.0.smithi162.stdout:3/422: dwrite d2/d9/d19/f73 [0,4194304] 0 2024-04-25T01:50:49.897 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:50:49.898 INFO:tasks.workunit.client.0.smithi162.stdout:6/362: mknod d1/d13/d28/d45/d59/c77 0 2024-04-25T01:50:49.899 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:50:49.932 INFO:tasks.workunit.client.0.smithi162.stdout:9/343: creat d4/d8/d13/d38/d3b/f7a x:0 0 0 2024-04-25T01:50:49.947 INFO:tasks.workunit.client.0.smithi162.stdout:0/458: write d0/df/d20/d25/d55/d77/f90 [473187,126360] 0 2024-04-25T01:50:49.960 INFO:tasks.workunit.client.0.smithi162.stdout:1/418: dread d15/f34 [0,4194304] 0 2024-04-25T01:50:49.993 INFO:tasks.workunit.client.0.smithi162.stdout:5/409: rename d15/d19/d24/d2b/d3b/c76 to d15/d19/d24/d40/c83 0 2024-04-25T01:50:50.274 INFO:tasks.workunit.client.0.smithi162.stdout:8/387: dwrite d0/d44/f7d [0,4194304] 0 2024-04-25T01:50:50.469 INFO:tasks.workunit.client.0.smithi162.stdout:4/418: dwrite dd/f3a [0,4194304] 0 2024-04-25T01:50:50.598 INFO:tasks.workunit.client.0.smithi162.stdout:7/398: dread df/f15 [4194304,4194304] 0 2024-04-25T01:50:51.061 INFO:tasks.workunit.client.0.smithi162.stdout:1/419: creat d15/d1f/f87 x:0 0 0 2024-04-25T01:50:51.160 INFO:tasks.workunit.client.0.smithi162.stdout:0/459: rename d0/d1/d6a/l7c to d0/df/d20/d25/d55/d6f/l98 0 2024-04-25T01:50:51.384 INFO:tasks.workunit.client.0.smithi162.stdout:5/410: dread d15/d19/d24/d2b/d3b/d3c/d3f/f43 [0,4194304] 0 2024-04-25T01:50:51.411 INFO:tasks.workunit.client.0.smithi162.stdout:3/423: dwrite d2/d29/d2e/f7a [0,4194304] 0 2024-04-25T01:50:51.448 INFO:tasks.workunit.client.0.smithi162.stdout:9/344: dwrite d4/d25/f6e [0,4194304] 0 2024-04-25T01:50:51.557 INFO:tasks.workunit.client.0.smithi162.stdout:6/363: truncate d1/d13/d28/d30/f74 853186 0 2024-04-25T01:50:51.560 INFO:tasks.workunit.client.0.smithi162.stdout:4/419: truncate dd/d1a/d4e/f7f 320795 0 2024-04-25T01:50:51.727 INFO:tasks.workunit.client.0.smithi162.stdout:4/420: stat dd/df/d2e/l82 0 2024-04-25T01:50:51.763 INFO:tasks.workunit.client.0.smithi162.stdout:2/370: link d0/d3/d5/l70 d0/d3/d1b/d1d/d20/d5e/d61/d62/l87 0 2024-04-25T01:50:52.050 INFO:tasks.workunit.client.0.smithi162.stdout:8/388: dwrite d0/d12/f24 [0,4194304] 0 2024-04-25T01:50:52.182 INFO:tasks.workunit.client.0.smithi162.stdout:1/420: creat d15/d1f/d35/d4c/f88 x:0 0 0 2024-04-25T01:50:52.215 INFO:tasks.workunit.client.0.smithi162.stdout:8/389: chown d0/d12/f24 97484 1 2024-04-25T01:50:52.280 INFO:tasks.workunit.client.0.smithi162.stdout:0/460: creat d0/df/d20/d25/d55/d77/f99 x:0 0 0 2024-04-25T01:50:52.658 INFO:tasks.workunit.client.0.smithi162.stdout:4/421: dread dd/f33 [0,4194304] 0 2024-04-25T01:50:52.761 INFO:tasks.workunit.client.0.smithi162.stdout:9/345: creat d4/d8/d13/d38/d3b/f7b x:0 0 0 2024-04-25T01:50:53.145 INFO:tasks.workunit.client.0.smithi162.stdout:3/424: dwrite d2/d9/d10/f11 [0,4194304] 0 2024-04-25T01:50:53.359 INFO:tasks.workunit.client.0.smithi162.stdout:1/421: creat d15/d1f/d35/d4c/d70/f89 x:0 0 0 2024-04-25T01:50:53.398 INFO:tasks.workunit.client.0.smithi162.stdout:4/422: symlink dd/d1a/d4e/l8b 0 2024-04-25T01:50:53.436 INFO:tasks.workunit.client.0.smithi162.stdout:5/411: read - d15/d19/d24/d2b/d3b/d58/f5c zero size 2024-04-25T01:50:53.483 INFO:tasks.workunit.client.0.smithi162.stdout:1/422: chown d15/d1f/l59 976 1 2024-04-25T01:50:53.564 INFO:tasks.workunit.client.0.smithi162.stdout:2/371: write d0/d3/d5/d69/f7e [2634820,93739] 0 2024-04-25T01:50:53.615 INFO:tasks.workunit.client.0.smithi162.stdout:7/399: getdents df/d2c/d49/d7a 0 2024-04-25T01:50:53.904 INFO:tasks.workunit.client.0.smithi162.stdout:4/423: symlink dd/d1a/d34/d57/l8c 0 2024-04-25T01:50:54.020 INFO:tasks.workunit.client.0.smithi162.stdout:5/412: mknod d15/d19/d24/d4d/c84 0 2024-04-25T01:50:54.092 INFO:tasks.workunit.client.0.smithi162.stdout:8/390: dwrite d0/d44/f1c [4194304,4194304] 0 2024-04-25T01:50:54.177 INFO:tasks.workunit.client.0.smithi162.stdout:1/423: mknod d15/d69/d4f/c8a 0 2024-04-25T01:50:54.184 INFO:tasks.workunit.client.0.smithi162.stdout:6/364: link d1/d13/d28/l54 d1/l78 0 2024-04-25T01:50:54.354 INFO:tasks.workunit.client.0.smithi162.stdout:5/413: sync 2024-04-25T01:50:54.393 INFO:tasks.workunit.client.0.smithi162.stdout:9/346: rename d4/d8/d13/d6a to d4/d7c 0 2024-04-25T01:50:54.443 INFO:tasks.workunit.client.0.smithi162.stdout:4/424: symlink dd/df/d2e/d59/l8d 0 2024-04-25T01:50:54.554 INFO:tasks.workunit.client.0.smithi162.stdout:2/372: mkdir d0/d3/d7a/d88 0 2024-04-25T01:50:54.558 INFO:tasks.workunit.client.0.smithi162.stdout:8/391: creat d0/d12/d3a/f7f x:0 0 0 2024-04-25T01:50:54.570 INFO:tasks.workunit.client.0.smithi162.stdout:0/461: dwrite d0/df/d20/d25/d55/f5c [0,4194304] 0 2024-04-25T01:50:54.713 INFO:tasks.workunit.client.0.smithi162.stdout:5/414: readlink d15/d19/d24/d40/l81 0 2024-04-25T01:50:54.970 INFO:tasks.workunit.client.0.smithi162.stdout:6/365: dread d1/d13/d28/d30/d66/f67 [0,4194304] 0 2024-04-25T01:50:55.000 INFO:tasks.workunit.client.0.smithi162.stdout:6/366: chown d1/c5d 178 1 2024-04-25T01:50:55.113 INFO:tasks.workunit.client.0.smithi162.stdout:7/400: write df/d2c/d56/f66 [3389453,108666] 0 2024-04-25T01:50:55.698 INFO:tasks.workunit.client.0.smithi162.stdout:8/392: fsync d0/d12/d3a/f42 0 2024-04-25T01:50:55.863 INFO:tasks.workunit.client.0.smithi162.stdout:5/415: fsync d15/d1e/f22 0 2024-04-25T01:50:56.357 INFO:tasks.workunit.client.0.smithi162.stdout:3/425: rename d2/d29/f93 to d2/d29/d5d/f9a 0 2024-04-25T01:50:56.820 INFO:tasks.workunit.client.0.smithi162.stdout:2/373: write d0/f74 [282282,28598] 0 2024-04-25T01:50:56.826 INFO:tasks.workunit.client.0.smithi162.stdout:1/424: dwrite d15/d1f/d35/d4c/d70/d73/f77 [0,4194304] 0 2024-04-25T01:50:56.831 INFO:tasks.workunit.client.0.smithi162.stdout:7/401: fdatasync df/f4d 0 2024-04-25T01:50:56.968 INFO:tasks.workunit.client.0.smithi162.stdout:6/367: rmdir d1/d13/d28/d45 39 2024-04-25T01:50:57.022 INFO:tasks.workunit.client.0.smithi162.stdout:1/425: chown d15/d1f/f87 122 1 2024-04-25T01:50:57.679 INFO:tasks.workunit.client.0.smithi162.stdout:0/462: fsync d0/df/d20/d37/f5b 0 2024-04-25T01:50:58.086 INFO:tasks.workunit.client.0.smithi162.stdout:4/425: rename dd/df/d2e/d59/f67 to dd/d1a/d34/f8e 0 2024-04-25T01:50:58.182 INFO:tasks.workunit.client.0.smithi162.stdout:3/426: unlink d2/d9/d99/c82 0 2024-04-25T01:50:58.801 INFO:tasks.workunit.client.0.smithi162.stdout:7/402: dread df/f33 [0,4194304] 0 2024-04-25T01:50:58.940 INFO:tasks.workunit.client.0.smithi162.stdout:2/374: creat d0/f89 x:0 0 0 2024-04-25T01:50:58.952 INFO:tasks.workunit.client.0.smithi162.stdout:1/426: readlink d15/d1f/l66 0 2024-04-25T01:50:59.532 INFO:tasks.workunit.client.0.smithi162.stdout:0/463: fsync d0/df/d20/d37/f5b 0 2024-04-25T01:50:59.567 INFO:tasks.workunit.client.0.smithi162.stdout:0/464: chown d0/d59/f68 5851 1 2024-04-25T01:50:59.703 INFO:tasks.workunit.client.0.smithi162.stdout:5/416: mkdir d15/d19/d24/d4d/d7c/d85 0 2024-04-25T01:50:59.743 INFO:tasks.workunit.client.0.smithi162.stdout:5/417: chown d15/d19/d24/d40/f74 240 1 2024-04-25T01:50:59.766 INFO:tasks.workunit.client.0.smithi162.stdout:5/418: chown d15/d19/c71 5254 1 2024-04-25T01:51:00.187 INFO:tasks.workunit.client.0.smithi162.stdout:9/347: link d4/d8/d13/l75 d4/d9/l7d 0 2024-04-25T01:51:00.202 INFO:tasks.workunit.client.0.smithi162.stdout:9/348: chown d4/d8 5 1 2024-04-25T01:51:00.479 INFO:tasks.workunit.client.0.smithi162.stdout:7/403: mkdir df/d2e/d4c/d58/d82 0 2024-04-25T01:51:00.591 INFO:tasks.workunit.client.0.smithi162.stdout:9/349: dread d4/d8/d13/f2a [0,4194304] 0 2024-04-25T01:51:00.807 INFO:tasks.workunit.client.0.smithi162.stdout:7/404: sync 2024-04-25T01:51:00.831 INFO:tasks.workunit.client.0.smithi162.stdout:7/405: dread - df/d52/f62 zero size 2024-04-25T01:51:00.859 INFO:tasks.workunit.client.0.smithi162.stdout:7/406: readlink df/l68 0 2024-04-25T01:51:00.860 INFO:tasks.workunit.client.0.smithi162.stdout:9/350: sync 2024-04-25T01:51:01.605 INFO:tasks.workunit.client.0.smithi162.stdout:3/427: creat d2/d9/d10/d4c/d51/d63/d87/d86/f9b x:0 0 0 2024-04-25T01:51:02.509 INFO:tasks.workunit.client.0.smithi162.stdout:8/393: dwrite d0/d44/d31/d65/f69 [0,4194304] 0 2024-04-25T01:51:02.661 INFO:tasks.workunit.client.0.smithi162.stdout:4/426: link dd/d1a/f48 dd/d1a/f8f 0 2024-04-25T01:51:02.862 INFO:tasks.workunit.client.0.smithi162.stdout:3/428: symlink d2/d9/d10/d4c/d51/d63/d87/l9c 0 2024-04-25T01:51:02.927 INFO:tasks.workunit.client.0.smithi162.stdout:7/407: dread df/f28 [0,4194304] 0 2024-04-25T01:51:03.023 INFO:tasks.workunit.client.0.smithi162.stdout:1/427: link d15/d1f/d35/l6e d15/d1f/d35/d4c/l8b 0 2024-04-25T01:51:03.075 INFO:tasks.workunit.client.0.smithi162.stdout:6/368: getdents d1/d13/d28/d30/d66 0 2024-04-25T01:51:03.161 INFO:tasks.workunit.client.0.smithi162.stdout:6/369: dread d1/d13/d28/d30/d3a/f3c [0,4194304] 0 2024-04-25T01:51:03.288 INFO:tasks.workunit.client.0.smithi162.stdout:9/351: mknod d4/c7e 0 2024-04-25T01:51:03.592 INFO:tasks.workunit.client.0.smithi162.stdout:2/375: getdents d0/d3/d1b/d1d/d20 0 2024-04-25T01:51:03.686 INFO:tasks.workunit.client.0.smithi162.stdout:8/394: mknod d0/d44/d31/d65/c80 0 2024-04-25T01:51:03.713 INFO:tasks.workunit.client.0.smithi162.stdout:8/395: chown d0/d1a/d25/c59 272 1 2024-04-25T01:51:03.731 INFO:tasks.workunit.client.0.smithi162.stdout:8/396: stat d0/d1a/d25/c59 0 2024-04-25T01:51:03.793 INFO:tasks.workunit.client.0.smithi162.stdout:4/427: symlink dd/df/d77/l90 0 2024-04-25T01:51:03.826 INFO:tasks.workunit.client.0.smithi162.stdout:4/428: chown dd/d1a/d4e/f70 16583736 1 2024-04-25T01:51:04.081 INFO:tasks.workunit.client.0.smithi162.stdout:5/419: write f3 [5074103,14629] 0 2024-04-25T01:51:04.174 INFO:tasks.workunit.client.0.smithi162.stdout:5/420: readlink d15/d19/d24/d40/l81 0 2024-04-25T01:51:04.442 INFO:tasks.workunit.client.0.smithi162.stdout:9/352: symlink d4/d9/d15/d1b/d2f/d30/l7f 0 2024-04-25T01:51:04.504 INFO:tasks.workunit.client.0.smithi162.stdout:7/408: dread df/f43 [0,4194304] 0 2024-04-25T01:51:04.645 INFO:tasks.workunit.client.0.smithi162.stdout:2/376: fdatasync d0/d3/d5/d69/f7e 0 2024-04-25T01:51:04.747 INFO:tasks.workunit.client.0.smithi162.stdout:8/397: chown d0/d1a/f28 1533486 1 2024-04-25T01:51:04.847 INFO:tasks.workunit.client.0.smithi162.stdout:4/429: creat dd/df/d2e/d59/f91 x:0 0 0 2024-04-25T01:51:05.299 INFO:tasks.workunit.client.0.smithi162.stdout:6/370: unlink d1/lb 0 2024-04-25T01:51:05.528 INFO:tasks.workunit.client.0.smithi162.stdout:0/465: dwrite d0/df/d20/d25/f4c [0,4194304] 0 2024-04-25T01:51:05.652 INFO:tasks.workunit.client.0.smithi162.stdout:7/409: rename df/d2c/d56 to df/d2c/d63/d83 0 2024-04-25T01:51:06.290 INFO:tasks.workunit.client.0.smithi162.stdout:8/398: mknod d0/d44/d64/c81 0 2024-04-25T01:51:06.344 INFO:tasks.workunit.client.0.smithi162.stdout:8/399: chown d0/d44/d31/d33/f53 2269430 1 2024-04-25T01:51:06.784 INFO:tasks.workunit.client.0.smithi162.stdout:3/429: write d2/d9/d10/d4c/f57 [190767,7075] 0 2024-04-25T01:51:06.804 INFO:tasks.workunit.client.0.smithi162.stdout:3/430: stat d2 0 2024-04-25T01:51:07.496 INFO:tasks.workunit.client.0.smithi162.stdout:5/421: dwrite d15/d19/d24/d73/f82 [0,4194304] 0 2024-04-25T01:51:07.905 INFO:tasks.workunit.client.0.smithi162.stdout:8/400: symlink d0/d12/d1b/l82 0 2024-04-25T01:51:08.126 INFO:tasks.workunit.client.0.smithi162.stdout:9/353: mknod d4/d8/d13/c80 0 2024-04-25T01:51:08.343 INFO:tasks.workunit.client.0.smithi162.stdout:1/428: getdents d15/d1f/d35 0 2024-04-25T01:51:08.364 INFO:tasks.workunit.client.0.smithi162.stdout:2/377: write d0/d3/d1b/d1d/d20/f86 [614445,26843] 0 2024-04-25T01:51:08.425 INFO:tasks.workunit.client.0.smithi162.stdout:6/371: mkdir d1/d13/d79 0 2024-04-25T01:51:08.784 INFO:tasks.workunit.client.0.smithi162.stdout:2/378: dread d0/d3/d5/d69/f7e [0,4194304] 0 2024-04-25T01:51:09.057 INFO:tasks.workunit.client.0.smithi162.stdout:4/430: write dd/d1a/f26 [506832,116806] 0 2024-04-25T01:51:09.158 INFO:tasks.workunit.client.0.smithi162.stdout:2/379: dread d0/d3/d1b/d1d/d3a/f3b [0,4194304] 0 2024-04-25T01:51:09.219 INFO:tasks.workunit.client.0.smithi162.stdout:9/354: unlink d4/d9/d15/f49 0 2024-04-25T01:51:09.371 INFO:tasks.workunit.client.0.smithi162.stdout:3/431: mkdir d2/d9/d19/d9d 0 2024-04-25T01:51:09.535 INFO:tasks.workunit.client.0.smithi162.stdout:8/401: dread d0/d1a/f32 [0,4194304] 0 2024-04-25T01:51:10.338 INFO:tasks.workunit.client.0.smithi162.stdout:9/355: creat d4/d25/f81 x:0 0 0 2024-04-25T01:51:10.402 INFO:tasks.workunit.client.0.smithi162.stdout:9/356: chown d4/d9/d15/d1b/d2f/d30/l3e 3688768 1 2024-04-25T01:51:10.715 INFO:tasks.workunit.client.0.smithi162.stdout:4/431: truncate dd/df/d2e/f3d 499608 0 2024-04-25T01:51:10.738 INFO:tasks.workunit.client.0.smithi162.stdout:2/380: truncate d0/d3/f16 2720460 0 2024-04-25T01:51:11.035 INFO:tasks.workunit.client.0.smithi162.stdout:9/357: fdatasync d4/d9/d15/d1b/d2f/d30/f56 0 2024-04-25T01:51:11.113 INFO:tasks.workunit.client.0.smithi162.stdout:7/410: dwrite df/d52/f62 [0,4194304] 0 2024-04-25T01:51:11.285 INFO:tasks.workunit.client.0.smithi162.stdout:7/411: sync 2024-04-25T01:51:11.603 INFO:tasks.workunit.client.0.smithi162.stdout:2/381: rmdir d0/d3/d1b/d1d/d20/d5e/d61/d62 39 2024-04-25T01:51:11.677 INFO:tasks.workunit.client.0.smithi162.stdout:2/382: sync 2024-04-25T01:51:11.690 INFO:tasks.workunit.client.0.smithi162.stdout:5/422: write fd [4243426,39950] 0 2024-04-25T01:51:11.733 INFO:tasks.workunit.client.0.smithi162.stdout:4/432: dread fc [0,4194304] 0 2024-04-25T01:51:11.751 INFO:tasks.workunit.client.0.smithi162.stdout:9/358: creat d4/d8/d13/d38/f82 x:0 0 0 2024-04-25T01:51:11.770 INFO:tasks.workunit.client.0.smithi162.stdout:5/423: fsync fd 0 2024-04-25T01:51:11.822 INFO:tasks.workunit.client.0.smithi162.stdout:7/412: creat df/d2c/d63/f84 x:0 0 0 2024-04-25T01:51:11.934 INFO:tasks.workunit.client.0.smithi162.stdout:9/359: chown d4/d8/d13/d38/f4c 32 1 2024-04-25T01:51:12.057 INFO:tasks.workunit.client.0.smithi162.stdout:8/402: truncate d0/d44/d31/d65/f69 4816926 0 2024-04-25T01:51:12.148 INFO:tasks.workunit.client.0.smithi162.stdout:0/466: rename d0/f82 to d0/df/f9a 0 2024-04-25T01:51:12.154 INFO:tasks.workunit.client.0.smithi162.stdout:6/372: write d1/f1e [1360015,80568] 0 2024-04-25T01:51:12.267 INFO:tasks.workunit.client.0.smithi162.stdout:3/432: write d2/d29/d5d/d7b/f8f [986431,130606] 0 2024-04-25T01:51:12.282 INFO:tasks.workunit.client.0.smithi162.stdout:5/424: dwrite d15/d19/d24/d2b/f3d [0,4194304] 0 2024-04-25T01:51:12.304 INFO:tasks.workunit.client.0.smithi162.stdout:8/403: chown d0/c3 0 1 2024-04-25T01:51:12.528 INFO:tasks.workunit.client.0.smithi162.stdout:2/383: symlink d0/d3/d1b/d1d/d20/d42/l8a 0 2024-04-25T01:51:12.542 INFO:tasks.workunit.client.0.smithi162.stdout:4/433: write dd/df/d2e/d59/f91 [571656,35527] 0 2024-04-25T01:51:12.618 INFO:tasks.workunit.client.0.smithi162.stdout:2/384: sync 2024-04-25T01:51:12.759 INFO:tasks.workunit.client.0.smithi162.stdout:1/429: dwrite d15/d1f/f27 [0,4194304] 0 2024-04-25T01:51:13.014 INFO:tasks.workunit.client.0.smithi162.stdout:3/433: symlink d2/d29/l9e 0 2024-04-25T01:51:13.252 INFO:tasks.workunit.client.0.smithi162.stdout:9/360: dread d4/d9/d15/f23 [0,4194304] 0 2024-04-25T01:51:13.332 INFO:tasks.workunit.client.0.smithi162.stdout:5/425: mknod d15/d19/d24/d73/d7a/c86 0 2024-04-25T01:51:13.424 INFO:tasks.workunit.client.0.smithi162.stdout:7/413: truncate df/f1b 4001619 0 2024-04-25T01:51:13.795 INFO:tasks.workunit.client.0.smithi162.stdout:4/434: dread - dd/df/d58/f83 zero size 2024-04-25T01:51:13.954 INFO:tasks.workunit.client.0.smithi162.stdout:9/361: chown d4/c19 2472 1 2024-04-25T01:51:13.973 INFO:tasks.workunit.client.0.smithi162.stdout:9/362: stat d4/d8/f5d 0 2024-04-25T01:51:14.143 INFO:tasks.workunit.client.0.smithi162.stdout:7/414: read f5 [2624665,9768] 0 2024-04-25T01:51:14.427 INFO:tasks.workunit.client.0.smithi162.stdout:8/404: rmdir d0/d67 0 2024-04-25T01:51:14.460 INFO:tasks.workunit.client.0.smithi162.stdout:6/373: mkdir d1/d46/d7a 0 2024-04-25T01:51:14.726 INFO:tasks.workunit.client.0.smithi162.stdout:4/435: fsync dd/f53 0 2024-04-25T01:51:14.984 INFO:tasks.workunit.client.0.smithi162.stdout:4/436: dread dd/df/d2e/d59/f76 [0,4194304] 0 2024-04-25T01:51:15.026 INFO:tasks.workunit.client.0.smithi162.stdout:3/434: rename d2/d9/d48/d89 to d2/d9/d10/d40/d9f 0 2024-04-25T01:51:15.133 INFO:tasks.workunit.client.0.smithi162.stdout:4/437: dread fb [0,4194304] 0 2024-04-25T01:51:15.162 INFO:tasks.workunit.client.0.smithi162.stdout:7/415: truncate df/f15 6621698 0 2024-04-25T01:51:15.395 INFO:tasks.workunit.client.0.smithi162.stdout:8/405: fsync d0/f16 0 2024-04-25T01:51:15.961 INFO:tasks.workunit.client.0.smithi162.stdout:4/438: rename l2 to dd/df/d2e/d59/l92 0 2024-04-25T01:51:16.049 INFO:tasks.workunit.client.0.smithi162.stdout:7/416: unlink df/d2c/d63/f75 0 2024-04-25T01:51:16.958 INFO:tasks.workunit.client.0.smithi162.stdout:6/374: mkdir d1/d13/d28/d7b 0 2024-04-25T01:51:17.079 INFO:tasks.workunit.client.0.smithi162.stdout:2/385: dwrite d0/f89 [0,4194304] 0 2024-04-25T01:51:17.269 INFO:tasks.workunit.client.0.smithi162.stdout:1/430: write d15/d1f/d35/d4c/f6f [510298,83057] 0 2024-04-25T01:51:17.338 INFO:tasks.workunit.client.0.smithi162.stdout:5/426: write d15/d19/d24/d4d/f5a [541437,84191] 0 2024-04-25T01:51:17.402 INFO:tasks.workunit.client.0.smithi162.stdout:4/439: mkdir dd/d1a/d4e/d93 0 2024-04-25T01:51:17.626 INFO:tasks.workunit.client.0.smithi162.stdout:8/406: fsync d0/d1a/d25/f36 0 2024-04-25T01:51:17.654 INFO:tasks.workunit.client.0.smithi162.stdout:0/467: dwrite d0/d1/f53 [0,4194304] 0 2024-04-25T01:51:17.812 INFO:tasks.workunit.client.0.smithi162.stdout:9/363: getdents d4/d9/d15/d4e 0 2024-04-25T01:51:18.113 INFO:tasks.workunit.client.0.smithi162.stdout:6/375: fdatasync d1/d13/d28/d30/d3a/f3c 0 2024-04-25T01:51:18.235 INFO:tasks.workunit.client.0.smithi162.stdout:2/386: dread d0/f74 [0,4194304] 0 2024-04-25T01:51:18.589 INFO:tasks.workunit.client.0.smithi162.stdout:4/440: fsync dd/df/f52 0 2024-04-25T01:51:18.901 INFO:tasks.workunit.client.0.smithi162.stdout:0/468: creat d0/d7b/f9b x:0 0 0 2024-04-25T01:51:18.932 INFO:tasks.workunit.client.0.smithi162.stdout:0/469: chown d0/d1/f7 0 1 2024-04-25T01:51:18.977 INFO:tasks.workunit.client.0.smithi162.stdout:0/470: write d0/d1/f53 [2152214,62338] 0 2024-04-25T01:51:19.031 INFO:tasks.workunit.client.0.smithi162.stdout:8/407: mknod d0/d12/d1b/d74/c83 0 2024-04-25T01:51:19.069 INFO:tasks.workunit.client.0.smithi162.stdout:9/364: rmdir d4/d9/d15/d1b/d2f/d30 39 2024-04-25T01:51:20.037 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:51:20.040 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:51:20.160 INFO:tasks.workunit.client.0.smithi162.stdout:2/387: creat d0/d3/d1b/d1d/d20/d42/d57/f8b x:0 0 0 2024-04-25T01:51:20.613 INFO:tasks.workunit.client.0.smithi162.stdout:4/441: rename dd/df/f64 to dd/df/d2e/d4b/f94 0 2024-04-25T01:51:20.640 INFO:tasks.workunit.client.0.smithi162.stdout:5/427: mknod d15/d19/d24/d2b/d3b/d80/c87 0 2024-04-25T01:51:20.871 INFO:tasks.workunit.client.0.smithi162.stdout:5/428: fdatasync d15/d19/d24/d4d/f5a 0 2024-04-25T01:51:20.926 INFO:tasks.workunit.client.0.smithi162.stdout:3/435: dwrite d2/d9/f49 [0,4194304] 0 2024-04-25T01:51:20.943 INFO:tasks.workunit.client.0.smithi162.stdout:9/365: truncate d4/d8/d13/d38/d3b/f7a 279754 0 2024-04-25T01:51:21.097 INFO:tasks.workunit.client.0.smithi162.stdout:6/376: getdents d1/d13/d28/d53/d6d 0 2024-04-25T01:51:21.528 INFO:tasks.workunit.client.0.smithi162.stdout:0/471: rename d0/d1/f46 to d0/d1/d64/f9c 0 2024-04-25T01:51:21.930 INFO:tasks.workunit.client.0.smithi162.stdout:1/431: write f14 [2185943,5996] 0 2024-04-25T01:51:22.148 INFO:tasks.workunit.client.0.smithi162.stdout:6/377: creat d1/d13/d28/d30/f7c x:0 0 0 2024-04-25T01:51:22.356 INFO:tasks.workunit.client.0.smithi162.stdout:6/378: dread d1/d13/d28/d30/d66/f76 [0,4194304] 0 2024-04-25T01:51:22.720 INFO:tasks.workunit.client.0.smithi162.stdout:9/366: truncate d4/d9/d15/d1b/d2f/d30/f70 248573 0 2024-04-25T01:51:22.728 INFO:tasks.workunit.client.0.smithi162.stdout:1/432: fdatasync d15/d1f/d23/d30/f78 0 2024-04-25T01:51:22.982 INFO:tasks.workunit.client.0.smithi162.stdout:5/429: getdents d15/d19 0 2024-04-25T01:51:23.144 INFO:tasks.workunit.client.0.smithi162.stdout:1/433: mknod d15/d1f/d35/d5c/c8c 0 2024-04-25T01:51:23.268 INFO:tasks.workunit.client.0.smithi162.stdout:9/367: truncate d4/d8/d13/d38/f5e 2177198 0 2024-04-25T01:51:23.382 INFO:tasks.workunit.client.0.smithi162.stdout:6/379: dread d1/d13/d28/d45/f61 [0,4194304] 0 2024-04-25T01:51:23.457 INFO:tasks.workunit.client.0.smithi162.stdout:5/430: rename d15/d19/d24/d2b/d3b/d3c/d3f/c4f to d15/d19/d24/d73/d7a/d7e/c88 0 2024-04-25T01:51:23.482 INFO:tasks.workunit.client.0.smithi162.stdout:5/431: chown d15/d19/d24/d2b/d3b/d80 0 1 2024-04-25T01:51:23.519 INFO:tasks.workunit.client.0.smithi162.stdout:9/368: sync 2024-04-25T01:51:23.915 INFO:tasks.workunit.client.0.smithi162.stdout:4/442: truncate dd/df/f52 2300243 0 2024-04-25T01:51:23.930 INFO:tasks.workunit.client.0.smithi162.stdout:4/443: chown ca 25 1 2024-04-25T01:51:24.342 INFO:tasks.workunit.client.0.smithi162.stdout:5/432: rmdir d15/d19/d24/d2b/d3b/d58 39 2024-04-25T01:51:24.359 INFO:tasks.workunit.client.0.smithi162.stdout:0/472: rmdir d0/d1 39 2024-04-25T01:51:24.441 INFO:tasks.workunit.client.0.smithi162.stdout:6/380: symlink d1/d13/d28/d53/d71/l7d 0 2024-04-25T01:51:24.586 INFO:tasks.workunit.client.0.smithi162.stdout:4/444: read dd/df/d2e/d4b/f94 [57582,52288] 0 2024-04-25T01:51:24.792 INFO:tasks.workunit.client.0.smithi162.stdout:8/408: write d0/d12/f4e [2126139,13279] 0 2024-04-25T01:51:24.873 INFO:tasks.workunit.client.0.smithi162.stdout:5/433: chown d15/d1e/f6c 2 1 2024-04-25T01:51:24.895 INFO:tasks.workunit.client.0.smithi162.stdout:5/434: chown d15/d1e/f2a 1540374902 1 2024-04-25T01:51:25.207 INFO:tasks.workunit.client.0.smithi162.stdout:2/388: dwrite d0/d3/d5/f81 [0,4194304] 0 2024-04-25T01:51:25.572 INFO:tasks.workunit.client.0.smithi162.stdout:8/409: mknod d0/d44/d64/c84 0 2024-04-25T01:51:26.009 INFO:tasks.workunit.client.0.smithi162.stdout:3/436: write d2/d9/d99/f3d [740303,122570] 0 2024-04-25T01:51:26.093 INFO:tasks.workunit.client.0.smithi162.stdout:8/410: symlink d0/d1a/d25/l85 0 2024-04-25T01:51:26.541 INFO:tasks.workunit.client.0.smithi162.stdout:3/437: readlink d2/d9/l6b 0 2024-04-25T01:51:26.642 INFO:tasks.workunit.client.0.smithi162.stdout:7/417: dread df/f15 [4194304,4194304] 0 2024-04-25T01:51:26.714 INFO:tasks.workunit.client.0.smithi162.stdout:8/411: chown d0/d1a/f3d 4541 1 2024-04-25T01:51:26.997 INFO:tasks.workunit.client.0.smithi162.stdout:5/435: rename d15/d19/d24/d2b/f42 to d15/d19/d24/d2b/d3b/f89 0 2024-04-25T01:51:27.009 INFO:tasks.workunit.client.0.smithi162.stdout:5/436: readlink l5 0 2024-04-25T01:51:27.386 INFO:tasks.workunit.client.0.smithi162.stdout:6/381: creat d1/d46/f7e x:0 0 0 2024-04-25T01:51:27.702 INFO:tasks.workunit.client.0.smithi162.stdout:1/434: dwrite d15/f34 [0,4194304] 0 2024-04-25T01:51:27.984 INFO:tasks.workunit.client.0.smithi162.stdout:8/412: stat d0/d1a/d25/l72 0 2024-04-25T01:51:28.242 INFO:tasks.workunit.client.0.smithi162.stdout:9/369: dwrite d4/d8/d13/f55 [4194304,4194304] 0 2024-04-25T01:51:28.522 INFO:tasks.workunit.client.0.smithi162.stdout:1/435: dread d15/f79 [0,4194304] 0 2024-04-25T01:51:28.978 INFO:tasks.workunit.client.0.smithi162.stdout:4/445: write fc [2704471,37620] 0 2024-04-25T01:51:29.153 INFO:tasks.workunit.client.0.smithi162.stdout:9/370: symlink d4/d9/d15/d4e/l83 0 2024-04-25T01:51:29.242 INFO:tasks.workunit.client.0.smithi162.stdout:1/436: rename d15/d1f/c50 to d15/d1f/d23/d30/d4a/c8d 0 2024-04-25T01:51:29.672 INFO:tasks.workunit.client.0.smithi162.stdout:0/473: write d0/df/f39 [572467,61485] 0 2024-04-25T01:51:29.750 INFO:tasks.workunit.client.0.smithi162.stdout:4/446: dread dd/d1a/d4e/f7f [0,4194304] 0 2024-04-25T01:51:29.809 INFO:tasks.workunit.client.0.smithi162.stdout:1/437: mkdir d15/d1f/d35/d4c/d8e 0 2024-04-25T01:51:29.823 INFO:tasks.workunit.client.0.smithi162.stdout:4/447: write fc [288675,92172] 0 2024-04-25T01:51:30.061 INFO:tasks.workunit.client.0.smithi162.stdout:2/389: dwrite d0/d3/f16 [0,4194304] 0 2024-04-25T01:51:30.343 INFO:tasks.workunit.client.0.smithi162.stdout:3/438: write d2/d9/d10/d4c/d51/f7e [258399,116859] 0 2024-04-25T01:51:30.439 INFO:tasks.workunit.client.0.smithi162.stdout:8/413: mkdir d0/d86 0 2024-04-25T01:51:30.657 INFO:tasks.workunit.client.0.smithi162.stdout:0/474: fsync d0/df/d20/d25/f4c 0 2024-04-25T01:51:30.670 INFO:tasks.workunit.client.0.smithi162.stdout:9/371: write d4/d9/d15/d4e/f65 [613416,14293] 0 2024-04-25T01:51:30.788 INFO:tasks.workunit.client.0.smithi162.stdout:4/448: rmdir dd/df/d2e/d59 39 2024-04-25T01:51:30.818 INFO:tasks.workunit.client.0.smithi162.stdout:1/438: fdatasync d15/d1f/d35/d5c/f74 0 2024-04-25T01:51:31.275 INFO:tasks.workunit.client.0.smithi162.stdout:7/418: dwrite df/d2c/f3c [0,4194304] 0 2024-04-25T01:51:31.288 INFO:tasks.workunit.client.0.smithi162.stdout:5/437: dwrite d15/d19/d24/d2b/d3b/d58/f5c [0,4194304] 0 2024-04-25T01:51:31.428 INFO:tasks.workunit.client.0.smithi162.stdout:6/382: dwrite d1/f68 [0,4194304] 0 2024-04-25T01:51:31.610 INFO:tasks.workunit.client.0.smithi162.stdout:1/439: chown d15/d1f/d35/d5c/d83 156492 1 2024-04-25T01:51:32.053 INFO:tasks.workunit.client.0.smithi162.stdout:2/390: write d0/d3/d1b/d1d/d20/d42/d57/f73 [144316,116524] 0 2024-04-25T01:51:32.235 INFO:tasks.workunit.client.0.smithi162.stdout:2/391: dread d0/d3/f16 [0,4194304] 0 2024-04-25T01:51:32.334 INFO:tasks.workunit.client.0.smithi162.stdout:2/392: chown d0/d3/d1b/d1d/d20/c34 240830 1 2024-04-25T01:51:32.532 INFO:tasks.workunit.client.0.smithi162.stdout:7/419: fsync df/f7b 0 2024-04-25T01:51:33.179 INFO:tasks.workunit.client.0.smithi162.stdout:0/475: mknod d0/d1/c9d 0 2024-04-25T01:51:33.518 INFO:tasks.workunit.client.0.smithi162.stdout:2/393: mknod d0/d3/d1b/d1d/d20/d5e/c8c 0 2024-04-25T01:51:33.709 INFO:tasks.workunit.client.0.smithi162.stdout:2/394: sync 2024-04-25T01:51:33.878 INFO:tasks.workunit.client.0.smithi162.stdout:7/420: mkdir df/d2c/d49/d7a/d85 0 2024-04-25T01:51:34.168 INFO:tasks.workunit.client.0.smithi162.stdout:6/383: write d1/f48 [763888,38043] 0 2024-04-25T01:51:34.216 INFO:tasks.workunit.client.0.smithi162.stdout:8/414: dwrite d0/f75 [0,4194304] 0 2024-04-25T01:51:34.361 INFO:tasks.workunit.client.0.smithi162.stdout:0/476: creat d0/d1/f9e x:0 0 0 2024-04-25T01:51:34.462 INFO:tasks.workunit.client.0.smithi162.stdout:6/384: dread d1/d13/d28/d45/f61 [0,4194304] 0 2024-04-25T01:51:34.577 INFO:tasks.workunit.client.0.smithi162.stdout:9/372: creat d4/d8/d13/f84 x:0 0 0 2024-04-25T01:51:34.590 INFO:tasks.workunit.client.0.smithi162.stdout:1/440: write d15/d1f/d23/f64 [129514,126190] 0 2024-04-25T01:51:34.658 INFO:tasks.workunit.client.0.smithi162.stdout:9/373: chown d4/d8/f5d 0 1 2024-04-25T01:51:34.821 INFO:tasks.workunit.client.0.smithi162.stdout:3/439: getdents d2/d9/d10/d4c/d51/d63/d87 0 2024-04-25T01:51:34.942 INFO:tasks.workunit.client.0.smithi162.stdout:2/395: truncate d0/d3/d1b/f5f 486803 0 2024-04-25T01:51:34.960 INFO:tasks.workunit.client.0.smithi162.stdout:4/449: rename dd/d1a/d34/f50 to dd/df/d2e/f95 0 2024-04-25T01:51:35.325 INFO:tasks.workunit.client.0.smithi162.stdout:0/477: rmdir d0/d1/d6a 39 2024-04-25T01:51:35.399 INFO:tasks.workunit.client.0.smithi162.stdout:5/438: write d15/d19/d24/d40/f5f [1255657,85302] 0 2024-04-25T01:51:35.469 INFO:tasks.workunit.client.0.smithi162.stdout:8/415: mkdir d0/d12/d2b/d87 0 2024-04-25T01:51:35.494 INFO:tasks.workunit.client.0.smithi162.stdout:5/439: chown d15/d19/d24/d40/c62 1297 1 2024-04-25T01:51:35.726 INFO:tasks.workunit.client.0.smithi162.stdout:1/441: creat d15/d1f/d35/d4c/d70/d73/f8f x:0 0 0 2024-04-25T01:51:35.787 INFO:tasks.workunit.client.0.smithi162.stdout:9/374: dread - d4/d25/f81 zero size 2024-04-25T01:51:35.875 INFO:tasks.workunit.client.0.smithi162.stdout:3/440: dread - d2/d9/d99/f52 zero size 2024-04-25T01:51:35.994 INFO:tasks.workunit.client.0.smithi162.stdout:4/450: creat dd/df/d77/f96 x:0 0 0 2024-04-25T01:51:36.747 INFO:tasks.workunit.client.0.smithi162.stdout:0/478: mkdir d0/d59/d7e/d9f 0 2024-04-25T01:51:37.253 INFO:tasks.workunit.client.0.smithi162.stdout:5/440: creat d15/d1e/f8a x:0 0 0 2024-04-25T01:51:37.271 INFO:tasks.workunit.client.0.smithi162.stdout:9/375: fdatasync d4/d9/d15/d4e/f66 0 2024-04-25T01:51:37.305 INFO:tasks.workunit.client.0.smithi162.stdout:3/441: rename d2/d9/d10/d40/d9f/d97 to d2/d9/d10/d2c/da0 0 2024-04-25T01:51:37.342 INFO:tasks.workunit.client.0.smithi162.stdout:2/396: rmdir d0/d3/d1b/d1d/d20/d5e/d61/d62 39 2024-04-25T01:51:37.432 INFO:tasks.workunit.client.0.smithi162.stdout:2/397: stat d0/d3/d1b/d1d/c25 0 2024-04-25T01:51:37.531 INFO:tasks.workunit.client.0.smithi162.stdout:1/442: creat d15/d1f/d35/d4c/d8e/f90 x:0 0 0 2024-04-25T01:51:37.537 INFO:tasks.workunit.client.0.smithi162.stdout:7/421: link df/c16 df/c86 0 2024-04-25T01:51:37.603 INFO:tasks.workunit.client.0.smithi162.stdout:1/443: readlink d15/d69/d4f/l5e 0 2024-04-25T01:51:38.561 INFO:tasks.workunit.client.0.smithi162.stdout:7/422: unlink df/d2c/d63/d83/f66 0 2024-04-25T01:51:38.587 INFO:tasks.workunit.client.0.smithi162.stdout:7/423: chown df/d2e/l51 14270 1 2024-04-25T01:51:39.153 INFO:tasks.workunit.client.0.smithi162.stdout:7/424: fdatasync fa 0 2024-04-25T01:51:39.280 INFO:tasks.workunit.client.0.smithi162.stdout:3/442: creat d2/d9/d19/fa1 x:0 0 0 2024-04-25T01:51:39.342 INFO:tasks.workunit.client.0.smithi162.stdout:0/479: rmdir d0/df/d20/d37 39 2024-04-25T01:51:39.669 INFO:tasks.workunit.client.0.smithi162.stdout:8/416: dwrite d0/d12/d1b/f1f [0,4194304] 0 2024-04-25T01:51:39.807 INFO:tasks.workunit.client.0.smithi162.stdout:8/417: sync 2024-04-25T01:51:39.807 INFO:tasks.workunit.client.0.smithi162.stdout:6/385: write d1/d13/d28/d30/f74 [1197111,99621] 0 2024-04-25T01:51:39.890 INFO:tasks.workunit.client.0.smithi162.stdout:8/418: sync 2024-04-25T01:51:40.229 INFO:tasks.workunit.client.0.smithi162.stdout:3/443: fdatasync d2/d9/fd 0 2024-04-25T01:51:40.349 INFO:tasks.workunit.client.0.smithi162.stdout:4/451: dwrite dd/d1a/d4e/f84 [0,4194304] 0 2024-04-25T01:51:40.457 INFO:tasks.workunit.client.0.smithi162.stdout:4/452: read fb [2609668,8608] 0 2024-04-25T01:51:40.490 INFO:tasks.workunit.client.0.smithi162.stdout:3/444: chown d2/d9/d10/d4c/f74 2778715 1 2024-04-25T01:51:40.523 INFO:tasks.workunit.client.0.smithi162.stdout:8/419: rename d0/d44/d31/f51 to d0/d44/d31/d65/f88 0 2024-04-25T01:51:40.567 INFO:tasks.workunit.client.0.smithi162.stdout:5/441: write f3 [1037474,32566] 0 2024-04-25T01:51:40.575 INFO:tasks.workunit.client.0.smithi162.stdout:9/376: write d4/d8/f37 [125383,99914] 0 2024-04-25T01:51:40.642 INFO:tasks.workunit.client.0.smithi162.stdout:8/420: dread d0/f2d [0,4194304] 0 2024-04-25T01:51:40.642 INFO:tasks.workunit.client.0.smithi162.stdout:5/442: stat d15/d19/f67 0 2024-04-25T01:51:41.087 INFO:tasks.workunit.client.0.smithi162.stdout:4/453: dread dd/df/f52 [0,4194304] 0 2024-04-25T01:51:41.266 INFO:tasks.workunit.client.0.smithi162.stdout:7/425: getdents df/d2c/d49/d5d 0 2024-04-25T01:51:41.372 INFO:tasks.workunit.client.0.smithi162.stdout:0/480: getdents d0/df/d20/d25/d55/d6f 0 2024-04-25T01:51:41.549 INFO:tasks.workunit.client.0.smithi162.stdout:9/377: stat d4/d9/d15/d1b/d2f/d30/f70 0 2024-04-25T01:51:41.625 INFO:tasks.workunit.client.0.smithi162.stdout:1/444: write d15/d69/f7d [377180,57372] 0 2024-04-25T01:51:41.814 INFO:tasks.workunit.client.0.smithi162.stdout:6/386: link d1/l1c d1/d13/d28/d30/d66/l7f 0 2024-04-25T01:51:41.937 INFO:tasks.workunit.client.0.smithi162.stdout:4/454: creat dd/df/f97 x:0 0 0 2024-04-25T01:51:42.057 INFO:tasks.workunit.client.0.smithi162.stdout:5/443: dread d15/d19/d24/d2b/f2c [0,4194304] 0 2024-04-25T01:51:42.099 INFO:tasks.workunit.client.0.smithi162.stdout:7/426: creat df/d2e/d4c/d58/f87 x:0 0 0 2024-04-25T01:51:42.302 INFO:tasks.workunit.client.0.smithi162.stdout:2/398: dwrite d0/d3/f1a [4194304,4194304] 0 2024-04-25T01:51:42.615 INFO:tasks.workunit.client.0.smithi162.stdout:8/421: symlink d0/d44/l89 0 2024-04-25T01:51:42.629 INFO:tasks.workunit.client.0.smithi162.stdout:9/378: truncate d4/d9/d15/d1b/f2e 1461230 0 2024-04-25T01:51:43.029 INFO:tasks.workunit.client.0.smithi162.stdout:5/444: read d15/d19/d24/d40/f7b [7443619,103975] 0 2024-04-25T01:51:43.140 INFO:tasks.workunit.client.0.smithi162.stdout:7/427: creat df/d2e/d4c/d58/f88 x:0 0 0 2024-04-25T01:51:43.370 INFO:tasks.workunit.client.0.smithi162.stdout:2/399: unlink d0/d3/d1b/d1d/c48 0 2024-04-25T01:51:43.384 INFO:tasks.workunit.client.0.smithi162.stdout:3/445: write d2/d9/fd [594444,17115] 0 2024-04-25T01:51:43.847 INFO:tasks.workunit.client.0.smithi162.stdout:2/400: dread d0/d3/d1b/d1d/d20/f54 [0,4194304] 0 2024-04-25T01:51:43.937 INFO:tasks.workunit.client.0.smithi162.stdout:8/422: dread d0/d44/d31/d65/f71 [0,4194304] 0 2024-04-25T01:51:44.199 INFO:tasks.workunit.client.0.smithi162.stdout:7/428: truncate df/d2c/d63/f84 579930 0 2024-04-25T01:51:44.455 INFO:tasks.workunit.client.0.smithi162.stdout:5/445: dread d15/d1e/f22 [0,4194304] 0 2024-04-25T01:51:44.507 INFO:tasks.workunit.client.0.smithi162.stdout:3/446: dread d2/d29/f3c [4194304,4194304] 0 2024-04-25T01:51:44.645 INFO:tasks.workunit.client.0.smithi162.stdout:5/446: chown d15/d19/d24/d2b/d3b/d3c/d3f/f6f 414917082 1 2024-04-25T01:51:45.038 INFO:tasks.workunit.client.0.smithi162.stdout:9/379: getdents d4/d9/d15/d71 0 2024-04-25T01:51:45.107 INFO:tasks.workunit.client.0.smithi162.stdout:8/423: dread d0/d44/d31/d33/f53 [0,4194304] 0 2024-04-25T01:51:45.509 INFO:tasks.workunit.client.0.smithi162.stdout:1/445: write d15/f34 [1645206,6836] 0 2024-04-25T01:51:45.562 INFO:tasks.workunit.client.0.smithi162.stdout:1/446: dread - d15/d1f/d23/d30/d4a/f65 zero size 2024-04-25T01:51:45.644 INFO:tasks.workunit.client.0.smithi162.stdout:6/387: write d1/f21 [1864337,106410] 0 2024-04-25T01:51:46.266 INFO:tasks.workunit.client.0.smithi162.stdout:0/481: dwrite d0/df/d20/d37/f57 [0,4194304] 0 2024-04-25T01:51:46.612 INFO:tasks.workunit.client.0.smithi162.stdout:1/447: symlink d15/d1f/d35/d5c/l91 0 2024-04-25T01:51:46.648 INFO:tasks.workunit.client.0.smithi162.stdout:1/448: chown d15/l16 1757653952 1 2024-04-25T01:51:46.728 INFO:tasks.workunit.client.0.smithi162.stdout:3/447: link d2/d29/d2e/f3a d2/d9/d10/d4c/d51/d63/d87/d86/fa2 0 2024-04-25T01:51:46.756 INFO:tasks.workunit.client.0.smithi162.stdout:3/448: stat d2/d9/d10/d2c/l35 0 2024-04-25T01:51:47.502 INFO:tasks.workunit.client.0.smithi162.stdout:4/455: dwrite dd/f8a [0,4194304] 0 2024-04-25T01:51:47.642 INFO:tasks.workunit.client.0.smithi162.stdout:2/401: write d0/d3/d1b/f21 [711262,34316] 0 2024-04-25T01:51:47.719 INFO:tasks.workunit.client.0.smithi162.stdout:1/449: unlink d15/d1f/d35/c40 0 2024-04-25T01:51:47.908 INFO:tasks.workunit.client.0.smithi162.stdout:2/402: sync 2024-04-25T01:51:47.954 INFO:tasks.workunit.client.0.smithi162.stdout:3/449: mkdir d2/d9/d10/d2c/da3 0 2024-04-25T01:51:47.965 INFO:tasks.workunit.client.0.smithi162.stdout:2/403: readlink d0/d3/d1b/d1d/d20/d5e/d61/d66/l23 0 2024-04-25T01:51:48.028 INFO:tasks.workunit.client.0.smithi162.stdout:5/447: link d15/d19/d24/d40/f4b d15/d19/d24/d4d/d7c/d85/f8b 0 2024-04-25T01:51:48.290 INFO:tasks.workunit.client.0.smithi162.stdout:7/429: dwrite df/d2e/d4c/f53 [0,4194304] 0 2024-04-25T01:51:48.415 INFO:tasks.workunit.client.0.smithi162.stdout:8/424: write d0/d44/d31/d33/f54 [3406964,121904] 0 2024-04-25T01:51:48.465 INFO:tasks.workunit.client.0.smithi162.stdout:8/425: chown d0/d12/d2b/c52 1 1 2024-04-25T01:51:48.744 INFO:tasks.workunit.client.0.smithi162.stdout:0/482: fdatasync d0/d1/d64/f9c 0 2024-04-25T01:51:49.067 INFO:tasks.workunit.client.0.smithi162.stdout:1/450: write d15/d69/f7d [1018525,89353] 0 2024-04-25T01:51:49.384 INFO:tasks.workunit.client.0.smithi162.stdout:3/450: creat d2/d9/d10/d4c/d51/d63/d87/d86/fa4 x:0 0 0 2024-04-25T01:51:49.399 INFO:tasks.workunit.client.0.smithi162.stdout:2/404: dwrite d0/d3/f1a [0,4194304] 0 2024-04-25T01:51:49.582 INFO:tasks.workunit.client.0.smithi162.stdout:2/405: write d0/d3/d1b/f21 [1658456,3017] 0 2024-04-25T01:51:49.669 INFO:tasks.workunit.client.0.smithi162.stdout:9/380: rename d4/d8/d13/d38/d3b to d4/d8/d85 0 2024-04-25T01:51:49.744 INFO:tasks.workunit.client.0.smithi162.stdout:7/430: unlink df/f20 0 2024-04-25T01:51:49.877 INFO:tasks.workunit.client.0.smithi162.stdout:8/426: fdatasync d0/d44/d31/f39 0 2024-04-25T01:51:49.917 INFO:tasks.workunit.client.0.smithi162.stdout:8/427: read - d0/d12/d1b/f50 zero size 2024-04-25T01:51:49.935 INFO:tasks.workunit.client.0.smithi162.stdout:8/428: chown d0/d86 2 1 2024-04-25T01:51:50.190 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:51:50.193 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:51:50.324 INFO:tasks.workunit.client.0.smithi162.stdout:4/456: truncate dd/df/d2e/d59/f76 453476 0 2024-04-25T01:51:50.511 INFO:tasks.workunit.client.0.smithi162.stdout:4/457: dwrite dd/f8a [0,4194304] 0 2024-04-25T01:51:50.795 INFO:tasks.workunit.client.0.smithi162.stdout:6/388: write d1/d46/f7e [247788,62620] 0 2024-04-25T01:51:50.834 INFO:tasks.workunit.client.0.smithi162.stdout:6/389: chown d1/d13/d28 128 1 2024-04-25T01:51:50.952 INFO:tasks.workunit.client.0.smithi162.stdout:7/431: truncate df/f23 1224884 0 2024-04-25T01:51:51.105 INFO:tasks.workunit.client.0.smithi162.stdout:7/432: dread f2 [0,4194304] 0 2024-04-25T01:51:51.240 INFO:tasks.workunit.client.0.smithi162.stdout:8/429: mkdir d0/d12/d1b/d74/d8a 0 2024-04-25T01:51:51.418 INFO:tasks.workunit.client.0.smithi162.stdout:0/483: mknod d0/df/d20/d25/d55/d6f/d7d/ca0 0 2024-04-25T01:51:52.339 INFO:tasks.workunit.client.0.smithi162.stdout:6/390: dread d1/d13/d28/d30/f74 [0,4194304] 0 2024-04-25T01:51:52.526 INFO:tasks.workunit.client.0.smithi162.stdout:8/430: dread - d0/d44/d31/f6c zero size 2024-04-25T01:51:52.773 INFO:tasks.workunit.client.0.smithi162.stdout:0/484: read - d0/df/d20/d37/f93 zero size 2024-04-25T01:51:52.823 INFO:tasks.workunit.client.0.smithi162.stdout:5/448: dwrite d15/d19/d24/d40/f7b [4194304,4194304] 0 2024-04-25T01:51:52.989 INFO:tasks.workunit.client.0.smithi162.stdout:5/449: read d15/d19/d24/f56 [252661,119032] 0 2024-04-25T01:51:53.481 INFO:tasks.workunit.client.0.smithi162.stdout:2/406: getdents d0/d3/d1b/d6b 0 2024-04-25T01:51:53.494 INFO:tasks.workunit.client.0.smithi162.stdout:4/458: fsync dd/df/d2e/d59/f76 0 2024-04-25T01:51:53.557 INFO:tasks.workunit.client.0.smithi162.stdout:0/485: mkdir d0/df/d20/d37/da1 0 2024-04-25T01:51:53.579 INFO:tasks.workunit.client.0.smithi162.stdout:8/431: dread d0/d44/f7d [0,4194304] 0 2024-04-25T01:51:53.661 INFO:tasks.workunit.client.0.smithi162.stdout:1/451: write d15/d1f/d35/d4c/d70/d73/f77 [2900397,118708] 0 2024-04-25T01:51:53.782 INFO:tasks.workunit.client.0.smithi162.stdout:6/391: unlink d1/d46/f47 0 2024-04-25T01:51:54.034 INFO:tasks.workunit.client.0.smithi162.stdout:3/451: dwrite d2/d9/d99/f52 [0,4194304] 0 2024-04-25T01:51:54.066 INFO:tasks.workunit.client.0.smithi162.stdout:6/392: sync 2024-04-25T01:51:54.293 INFO:tasks.workunit.client.0.smithi162.stdout:4/459: fdatasync dd/df/d2e/d4b/f94 0 2024-04-25T01:51:54.656 INFO:tasks.workunit.client.0.smithi162.stdout:1/452: fsync d15/f1a 0 2024-04-25T01:51:55.425 INFO:tasks.workunit.client.0.smithi162.stdout:6/393: mkdir d1/d13/d28/d45/d59/d80 0 2024-04-25T01:51:55.629 INFO:tasks.workunit.client.0.smithi162.stdout:8/432: unlink d0/d1a/l27 0 2024-04-25T01:51:55.979 INFO:tasks.workunit.client.0.smithi162.stdout:1/453: fsync d15/f1d 0 2024-04-25T01:51:56.036 INFO:tasks.workunit.client.0.smithi162.stdout:6/394: dread d1/f10 [0,4194304] 0 2024-04-25T01:51:56.126 INFO:tasks.workunit.client.0.smithi162.stdout:9/381: dwrite d4/d9/d15/f5c [0,4194304] 0 2024-04-25T01:51:56.291 INFO:tasks.workunit.client.0.smithi162.stdout:7/433: dwrite df/d2e/d4c/d58/f87 [0,4194304] 0 2024-04-25T01:51:56.413 INFO:tasks.workunit.client.0.smithi162.stdout:5/450: link d15/f6d d15/d19/d24/f8c 0 2024-04-25T01:51:56.639 INFO:tasks.workunit.client.0.smithi162.stdout:0/486: write d0/d1/f7 [3337156,34436] 0 2024-04-25T01:51:56.763 INFO:tasks.workunit.client.0.smithi162.stdout:2/407: dwrite d0/d3/d1b/f4f [0,4194304] 0 2024-04-25T01:51:56.858 INFO:tasks.workunit.client.0.smithi162.stdout:4/460: creat dd/f98 x:0 0 0 2024-04-25T01:51:57.273 INFO:tasks.workunit.client.0.smithi162.stdout:3/452: write d2/f8e [1300673,86711] 0 2024-04-25T01:51:57.311 INFO:tasks.workunit.client.0.smithi162.stdout:3/453: chown d2/f62 110 1 2024-04-25T01:51:57.355 INFO:tasks.workunit.client.0.smithi162.stdout:7/434: symlink df/d2e/l89 0 2024-04-25T01:51:57.799 INFO:tasks.workunit.client.0.smithi162.stdout:9/382: rename d4/d9/c58 to d4/d9/d15/d1b/d69/c86 0 2024-04-25T01:51:57.849 INFO:tasks.workunit.client.0.smithi162.stdout:2/408: fsync d0/f74 0 2024-04-25T01:51:58.131 INFO:tasks.workunit.client.0.smithi162.stdout:5/451: unlink d15/f6d 0 2024-04-25T01:51:58.945 INFO:tasks.workunit.client.0.smithi162.stdout:8/433: link d0/d12/c66 d0/d12/c8b 0 2024-04-25T01:51:59.623 INFO:tasks.workunit.client.0.smithi162.stdout:6/395: truncate d1/d46/f7e 551991 0 2024-04-25T01:51:59.878 INFO:tasks.workunit.client.0.smithi162.stdout:1/454: dwrite d15/d1f/d23/d30/f5a [0,4194304] 0 2024-04-25T01:52:00.007 INFO:tasks.workunit.client.0.smithi162.stdout:8/434: fsync d0/d44/d31/d33/f53 0 2024-04-25T01:52:00.026 INFO:tasks.workunit.client.0.smithi162.stdout:0/487: rename d0/d1/f1e to d0/fa2 0 2024-04-25T01:52:00.106 INFO:tasks.workunit.client.0.smithi162.stdout:1/455: chown d15/d1f/d23/f64 1634 1 2024-04-25T01:52:00.259 INFO:tasks.workunit.client.0.smithi162.stdout:2/409: link d0/d3/d1b/d1d/d20/d42/d57/f7f d0/f8d 0 2024-04-25T01:52:00.759 INFO:tasks.workunit.client.0.smithi162.stdout:3/454: dwrite d2/d9/d10/f95 [0,4194304] 0 2024-04-25T01:52:00.952 INFO:tasks.workunit.client.0.smithi162.stdout:7/435: dwrite df/f32 [0,4194304] 0 2024-04-25T01:52:01.075 INFO:tasks.workunit.client.0.smithi162.stdout:9/383: getdents d4/d9/d15/d1b/d69 0 2024-04-25T01:52:01.185 INFO:tasks.workunit.client.0.smithi162.stdout:4/461: rename l8 to dd/d1a/d34/l99 0 2024-04-25T01:52:01.291 INFO:tasks.workunit.client.0.smithi162.stdout:8/435: symlink d0/d12/d2b/l8c 0 2024-04-25T01:52:01.386 INFO:tasks.workunit.client.0.smithi162.stdout:0/488: symlink d0/d1/d64/la3 0 2024-04-25T01:52:01.464 INFO:tasks.workunit.client.0.smithi162.stdout:8/436: sync 2024-04-25T01:52:01.589 INFO:tasks.workunit.client.0.smithi162.stdout:3/455: dread d2/d9/d10/d4c/f53 [0,4194304] 0 2024-04-25T01:52:01.600 INFO:tasks.workunit.client.0.smithi162.stdout:0/489: chown d0/d1/f3d 40066 1 2024-04-25T01:52:01.675 INFO:tasks.workunit.client.0.smithi162.stdout:6/396: symlink d1/d13/d28/d7b/l81 0 2024-04-25T01:52:01.711 INFO:tasks.workunit.client.0.smithi162.stdout:3/456: chown d2/d29/d2e/f4f 313545 1 2024-04-25T01:52:01.886 INFO:tasks.workunit.client.0.smithi162.stdout:2/410: creat d0/d3/d1b/d6b/f8e x:0 0 0 2024-04-25T01:52:02.166 INFO:tasks.workunit.client.0.smithi162.stdout:5/452: rename d15/l1c to d15/d19/d24/d4d/d7c/l8d 0 2024-04-25T01:52:02.243 INFO:tasks.workunit.client.0.smithi162.stdout:4/462: chown dd/df/d2e/c4a 367 1 2024-04-25T01:52:02.439 INFO:tasks.workunit.client.0.smithi162.stdout:9/384: truncate d4/d9/d15/d1b/d2f/f62 269300 0 2024-04-25T01:52:02.540 INFO:tasks.workunit.client.0.smithi162.stdout:8/437: mkdir d0/d12/d1b/d8d 0 2024-04-25T01:52:02.939 INFO:tasks.workunit.client.0.smithi162.stdout:8/438: sync 2024-04-25T01:52:02.991 INFO:tasks.workunit.client.0.smithi162.stdout:0/490: truncate d0/df/d20/d25/f4d 1318740 0 2024-04-25T01:52:03.374 INFO:tasks.workunit.client.0.smithi162.stdout:1/456: dwrite d15/d1f/f33 [0,4194304] 0 2024-04-25T01:52:03.695 INFO:tasks.workunit.client.0.smithi162.stdout:7/436: rename df/d52 to df/d2e/d4c/d8a 0 2024-04-25T01:52:03.727 INFO:tasks.workunit.client.0.smithi162.stdout:9/385: fsync d4/d8/f18 0 2024-04-25T01:52:03.814 INFO:tasks.workunit.client.0.smithi162.stdout:9/386: sync 2024-04-25T01:52:04.266 INFO:tasks.workunit.client.0.smithi162.stdout:4/463: symlink dd/df/d7e/l9a 0 2024-04-25T01:52:04.640 INFO:tasks.workunit.client.0.smithi162.stdout:8/439: rename d0/ca to d0/d12/d1b/d74/c8e 0 2024-04-25T01:52:05.196 INFO:tasks.workunit.client.0.smithi162.stdout:0/491: read d0/d1/f53 [906404,38500] 0 2024-04-25T01:52:05.245 INFO:tasks.workunit.client.0.smithi162.stdout:6/397: dwrite d1/d13/d28/d30/d3a/f3d [4194304,4194304] 0 2024-04-25T01:52:05.540 INFO:tasks.workunit.client.0.smithi162.stdout:9/387: dread d4/d8/d13/d38/f5e [0,4194304] 0 2024-04-25T01:52:05.684 INFO:tasks.workunit.client.0.smithi162.stdout:2/411: dwrite d0/d3/d1b/d1d/d20/f86 [0,4194304] 0 2024-04-25T01:52:05.913 INFO:tasks.workunit.client.0.smithi162.stdout:8/440: mkdir d0/d12/d1b/d74/d8a/d8f 0 2024-04-25T01:52:06.206 INFO:tasks.workunit.client.0.smithi162.stdout:3/457: dwrite d2/d9/f2d [0,4194304] 0 2024-04-25T01:52:06.535 INFO:tasks.workunit.client.0.smithi162.stdout:1/457: dwrite d15/f34 [0,4194304] 0 2024-04-25T01:52:06.627 INFO:tasks.workunit.client.0.smithi162.stdout:7/437: rmdir df/d2c/d49/d7a/d85 0 2024-04-25T01:52:06.675 INFO:tasks.workunit.client.0.smithi162.stdout:2/412: stat d0/d3/c10 0 2024-04-25T01:52:06.863 INFO:tasks.workunit.client.0.smithi162.stdout:8/441: stat d0/d1a/l61 0 2024-04-25T01:52:06.868 INFO:tasks.workunit.client.0.smithi162.stdout:0/492: fdatasync d0/d1/d6a/f8f 0 2024-04-25T01:52:07.116 INFO:tasks.workunit.client.0.smithi162.stdout:7/438: mkdir df/d2c/d63/d83/d8b 0 2024-04-25T01:52:07.406 INFO:tasks.workunit.client.0.smithi162.stdout:1/458: unlink d15/d1f/d35/d4c/d70/f89 0 2024-04-25T01:52:07.419 INFO:tasks.workunit.client.0.smithi162.stdout:2/413: truncate d0/d3/d5/d69/f7e 496927 0 2024-04-25T01:52:07.860 INFO:tasks.workunit.client.0.smithi162.stdout:4/464: dwrite dd/d1a/f22 [0,4194304] 0 2024-04-25T01:52:08.414 INFO:tasks.workunit.client.0.smithi162.stdout:6/398: write d1/f3f [1995422,23268] 0 2024-04-25T01:52:08.419 INFO:tasks.workunit.client.0.smithi162.stdout:7/439: fsync df/d2c/d49/f7e 0 2024-04-25T01:52:08.682 INFO:tasks.workunit.client.0.smithi162.stdout:1/459: symlink d15/d69/d4f/l92 0 2024-04-25T01:52:08.772 INFO:tasks.workunit.client.0.smithi162.stdout:5/453: dwrite d15/d19/d24/d2b/d3b/d3c/d3f/f51 [4194304,4194304] 0 2024-04-25T01:52:08.917 INFO:tasks.workunit.client.0.smithi162.stdout:1/460: dread - d15/d1f/d23/d30/d4a/f65 zero size 2024-04-25T01:52:08.967 INFO:tasks.workunit.client.0.smithi162.stdout:5/454: write d15/d19/d24/d2b/d3b/d3c/d3f/f51 [1390655,96138] 0 2024-04-25T01:52:08.978 INFO:tasks.workunit.client.0.smithi162.stdout:1/461: chown d15/d1f/l4e 8 1 2024-04-25T01:52:09.056 INFO:tasks.workunit.client.0.smithi162.stdout:1/462: dread d15/d1f/f5f [0,4194304] 0 2024-04-25T01:52:09.191 INFO:tasks.workunit.client.0.smithi162.stdout:0/493: creat d0/df/d20/d37/d81/d92/fa4 x:0 0 0 2024-04-25T01:52:09.321 INFO:tasks.workunit.client.0.smithi162.stdout:9/388: getdents d4/d8/d85 0 2024-04-25T01:52:09.410 INFO:tasks.workunit.client.0.smithi162.stdout:3/458: dwrite d2/d29/d2e/f31 [0,4194304] 0 2024-04-25T01:52:09.640 INFO:tasks.workunit.client.0.smithi162.stdout:7/440: symlink df/d2c/d63/l8c 0 2024-04-25T01:52:09.660 INFO:tasks.workunit.client.0.smithi162.stdout:7/441: chown df/f33 6880110 1 2024-04-25T01:52:10.186 INFO:tasks.workunit.client.0.smithi162.stdout:8/442: creat d0/f90 x:0 0 0 2024-04-25T01:52:10.975 INFO:tasks.workunit.client.0.smithi162.stdout:2/414: write d0/d3/d1b/d1d/d3a/d63/f71 [344369,111125] 0 2024-04-25T01:52:11.444 INFO:tasks.workunit.client.0.smithi162.stdout:4/465: write dd/df/d2e/d59/f76 [153102,99039] 0 2024-04-25T01:52:12.043 INFO:tasks.workunit.client.0.smithi162.stdout:4/466: mknod dd/df/d77/c9b 0 2024-04-25T01:52:12.429 INFO:tasks.workunit.client.0.smithi162.stdout:8/443: fsync d0/f90 0 2024-04-25T01:52:12.501 INFO:tasks.workunit.client.0.smithi162.stdout:6/399: dwrite d1/fe [0,4194304] 0 2024-04-25T01:52:12.509 INFO:tasks.workunit.client.0.smithi162.stdout:2/415: rename d0/f9 to d0/d3/d30/f8f 0 2024-04-25T01:52:12.982 INFO:tasks.workunit.client.0.smithi162.stdout:0/494: getdents d0/df/d20/d25 0 2024-04-25T01:52:13.011 INFO:tasks.workunit.client.0.smithi162.stdout:9/389: write d4/d9/d15/f35 [1111690,16312] 0 2024-04-25T01:52:13.354 INFO:tasks.workunit.client.0.smithi162.stdout:3/459: mkdir d2/da5 0 2024-04-25T01:52:13.441 INFO:tasks.workunit.client.0.smithi162.stdout:0/495: readlink d0/df/l21 0 2024-04-25T01:52:13.599 INFO:tasks.workunit.client.0.smithi162.stdout:5/455: dwrite d15/d19/d24/d2b/d3b/d3c/d3f/f43 [0,4194304] 0 2024-04-25T01:52:13.742 INFO:tasks.workunit.client.0.smithi162.stdout:1/463: dwrite d15/d1f/d35/d4c/f88 [0,4194304] 0 2024-04-25T01:52:13.811 INFO:tasks.workunit.client.0.smithi162.stdout:7/442: dwrite df/d2e/d4c/d8a/f62 [0,4194304] 0 2024-04-25T01:52:13.929 INFO:tasks.workunit.client.0.smithi162.stdout:6/400: dread - d1/d13/d28/d30/d3a/d57/f64 zero size 2024-04-25T01:52:13.949 INFO:tasks.workunit.client.0.smithi162.stdout:3/460: chown d2/d9/d99/f75 112853 1 2024-04-25T01:52:14.053 INFO:tasks.workunit.client.0.smithi162.stdout:8/444: unlink d0/d12/d1b/c4c 0 2024-04-25T01:52:14.589 INFO:tasks.workunit.client.0.smithi162.stdout:0/496: fdatasync d0/df/d20/d25/f49 0 2024-04-25T01:52:14.678 INFO:tasks.workunit.client.0.smithi162.stdout:1/464: mknod d15/d1f/d35/d4c/c93 0 2024-04-25T01:52:14.843 INFO:tasks.workunit.client.0.smithi162.stdout:3/461: mknod d2/d29/d5d/d7b/ca6 0 2024-04-25T01:52:15.017 INFO:tasks.workunit.client.0.smithi162.stdout:6/401: truncate d1/d13/f50 1180095 0 2024-04-25T01:52:15.144 INFO:tasks.workunit.client.0.smithi162.stdout:9/390: truncate d4/d9/d15/d1b/d2f/f62 378395 0 2024-04-25T01:52:15.198 INFO:tasks.workunit.client.0.smithi162.stdout:1/465: read - d15/d69/f75 zero size 2024-04-25T01:52:15.275 INFO:tasks.workunit.client.0.smithi162.stdout:0/497: dread d0/fa2 [0,4194304] 0 2024-04-25T01:52:15.345 INFO:tasks.workunit.client.0.smithi162.stdout:4/467: dwrite dd/df/d2e/d59/f91 [0,4194304] 0 2024-04-25T01:52:15.525 INFO:tasks.workunit.client.0.smithi162.stdout:5/456: creat d15/d19/d24/d4d/d7c/f8e x:0 0 0 2024-04-25T01:52:15.823 INFO:tasks.workunit.client.0.smithi162.stdout:7/443: creat df/d2e/d4c/d58/d82/f8d x:0 0 0 2024-04-25T01:52:15.853 INFO:tasks.workunit.client.0.smithi162.stdout:7/444: chown df/d2e/d4c/l5c 2437743 1 2024-04-25T01:52:16.201 INFO:tasks.workunit.client.0.smithi162.stdout:3/462: dread d2/d9/f66 [0,4194304] 0 2024-04-25T01:52:16.427 INFO:tasks.workunit.client.0.smithi162.stdout:9/391: dread d4/d25/f45 [4194304,4194304] 0 2024-04-25T01:52:16.699 INFO:tasks.workunit.client.0.smithi162.stdout:2/416: write d0/d3/d5/d36/f65 [4192991,57005] 0 2024-04-25T01:52:17.054 INFO:tasks.workunit.client.0.smithi162.stdout:8/445: rename d0/d1a/d25 to d0/d44/d91 0 2024-04-25T01:52:17.140 INFO:tasks.workunit.client.0.smithi162.stdout:4/468: dread dd/d1a/d4e/f80 [0,4194304] 0 2024-04-25T01:52:17.202 INFO:tasks.workunit.client.0.smithi162.stdout:4/469: stat dd/d1a/l6a 0 2024-04-25T01:52:17.550 INFO:tasks.workunit.client.0.smithi162.stdout:3/463: truncate d2/d29/f3c 2443458 0 2024-04-25T01:52:18.073 INFO:tasks.workunit.client.0.smithi162.stdout:5/457: mknod d15/d19/d24/d73/d7a/c8f 0 2024-04-25T01:52:18.599 INFO:tasks.workunit.client.0.smithi162.stdout:8/446: truncate d0/d12/d3a/f6a 147378 0 2024-04-25T01:52:18.666 INFO:tasks.workunit.client.0.smithi162.stdout:8/447: stat d0/f6b 0 2024-04-25T01:52:18.740 INFO:tasks.workunit.client.0.smithi162.stdout:4/470: creat dd/df/d2e/d4b/d79/f9c x:0 0 0 2024-04-25T01:52:18.752 INFO:tasks.workunit.client.0.smithi162.stdout:1/466: dwrite f14 [4194304,4194304] 0 2024-04-25T01:52:18.914 INFO:tasks.workunit.client.0.smithi162.stdout:8/448: chown d0/d44/d31/l45 97072476 1 2024-04-25T01:52:18.992 INFO:tasks.workunit.client.0.smithi162.stdout:3/464: unlink d2/d9/d10/d4c/l6a 0 2024-04-25T01:52:19.008 INFO:tasks.workunit.client.0.smithi162.stdout:9/392: getdents d4/d8/d85 0 2024-04-25T01:52:19.253 INFO:tasks.workunit.client.0.smithi162.stdout:0/498: dwrite d0/d1/f12 [0,4194304] 0 2024-04-25T01:52:19.376 INFO:tasks.workunit.client.0.smithi162.stdout:2/417: symlink d0/d3/d1b/d1d/d20/d5e/d61/d66/d84/l90 0 2024-04-25T01:52:19.761 INFO:tasks.workunit.client.0.smithi162.stdout:6/402: dwrite d1/d46/f7e [0,4194304] 0 2024-04-25T01:52:20.182 INFO:tasks.workunit.client.0.smithi162.stdout:1/467: mknod d15/c94 0 2024-04-25T01:52:20.233 INFO:tasks.workunit.client.0.smithi162.stdout:1/468: stat d15/d1f/d35/d4c/d70/d73/f8f 0 2024-04-25T01:52:20.307 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:52:20.310 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:52:20.423 INFO:tasks.workunit.client.0.smithi162.stdout:9/393: truncate d4/d8/d13/f79 1011628 0 2024-04-25T01:52:20.444 INFO:tasks.workunit.client.0.smithi162.stdout:7/445: creat df/f8e x:0 0 0 2024-04-25T01:52:20.504 INFO:tasks.workunit.client.0.smithi162.stdout:7/446: dread - df/f7b zero size 2024-04-25T01:52:21.047 INFO:tasks.workunit.client.0.smithi162.stdout:2/418: creat d0/d3/d1b/d1d/d20/d5e/d61/d66/d84/f91 x:0 0 0 2024-04-25T01:52:21.353 INFO:tasks.workunit.client.0.smithi162.stdout:6/403: rmdir d1/d13/d28/d7b 39 2024-04-25T01:52:21.550 INFO:tasks.workunit.client.0.smithi162.stdout:8/449: rename d0/d1a/l48 to d0/d12/d1b/l92 0 2024-04-25T01:52:21.896 INFO:tasks.workunit.client.0.smithi162.stdout:1/469: mknod d15/d1f/d35/d4c/d8e/c95 0 2024-04-25T01:52:21.913 INFO:tasks.workunit.client.0.smithi162.stdout:0/499: mknod d0/df/d20/ca5 0 2024-04-25T01:52:22.271 INFO:tasks.workunit.client.0.smithi162.stdout:9/394: dread d4/d9/fa [0,4194304] 0 2024-04-25T01:52:22.294 INFO:tasks.workunit.client.0.smithi162.stdout:9/395: stat d4/d9/c4b 0 2024-04-25T01:52:22.358 INFO:tasks.workunit.client.0.smithi162.stdout:4/471: write dd/d1a/f21 [3129280,8359] 0 2024-04-25T01:52:22.768 INFO:tasks.workunit.client.0.smithi162.stdout:2/419: mkdir d0/d3/d1b/d6b/d92 0 2024-04-25T01:52:22.974 INFO:tasks.workunit.client.0.smithi162.stdout:2/420: chown d0/d3/d1b/d6b/f8e 43493 1 2024-04-25T01:52:23.015 INFO:tasks.workunit.client.0.smithi162.stdout:5/458: dwrite d15/d19/d24/d40/f41 [0,4194304] 0 2024-04-25T01:52:23.166 INFO:tasks.workunit.client.0.smithi162.stdout:3/465: link d2/d9/d10/c45 d2/d9/d10/d4c/d8d/ca7 0 2024-04-25T01:52:23.187 INFO:tasks.workunit.client.0.smithi162.stdout:2/421: read d0/d3/d5/d36/f37 [2552401,63010] 0 2024-04-25T01:52:23.434 INFO:tasks.workunit.client.0.smithi162.stdout:1/470: dread d15/d1f/d23/f56 [0,4194304] 0 2024-04-25T01:52:23.841 INFO:tasks.workunit.client.0.smithi162.stdout:0/500: dread d0/df/d20/f31 [0,4194304] 0 2024-04-25T01:52:24.431 INFO:tasks.workunit.client.0.smithi162.stdout:3/466: rmdir d2/d9/d10/d4c/d8d 39 2024-04-25T01:52:24.476 INFO:tasks.workunit.client.0.smithi162.stdout:2/422: dwrite d0/d3/d30/f8f [0,4194304] 0 2024-04-25T01:52:24.638 INFO:tasks.workunit.client.0.smithi162.stdout:1/471: mkdir d15/d69/d4f/d96 0 2024-04-25T01:52:25.105 INFO:tasks.workunit.client.0.smithi162.stdout:8/450: link d0/d44/d31/d33/f54 d0/d12/d1b/d74/d8a/f93 0 2024-04-25T01:52:25.303 INFO:tasks.workunit.client.0.smithi162.stdout:7/447: dwrite df/f43 [0,4194304] 0 2024-04-25T01:52:25.740 INFO:tasks.workunit.client.0.smithi162.stdout:7/448: dread df/f33 [0,4194304] 0 2024-04-25T01:52:25.786 INFO:tasks.workunit.client.0.smithi162.stdout:6/404: write d1/d13/d28/d30/d3a/f3d [5047686,124310] 0 2024-04-25T01:52:25.817 INFO:tasks.workunit.client.0.smithi162.stdout:3/467: dread d2/d9/fd [0,4194304] 0 2024-04-25T01:52:25.868 INFO:tasks.workunit.client.0.smithi162.stdout:7/449: chown df/d2c/d63/d83/l59 11060 1 2024-04-25T01:52:25.891 INFO:tasks.workunit.client.0.smithi162.stdout:2/423: fsync d0/d3/d1b/d6b/f8e 0 2024-04-25T01:52:25.925 INFO:tasks.workunit.client.0.smithi162.stdout:2/424: readlink d0/d3/d1b/d1d/d20/l44 0 2024-04-25T01:52:26.045 INFO:tasks.workunit.client.0.smithi162.stdout:7/450: sync 2024-04-25T01:52:26.046 INFO:tasks.workunit.client.0.smithi162.stdout:3/468: sync 2024-04-25T01:52:26.191 INFO:tasks.workunit.client.0.smithi162.stdout:1/472: unlink d15/c7b 0 2024-04-25T01:52:26.275 INFO:tasks.workunit.client.0.smithi162.stdout:4/472: write dd/df/d2e/d59/f76 [1200908,21436] 0 2024-04-25T01:52:26.402 INFO:tasks.workunit.client.0.smithi162.stdout:9/396: link d4/d8/d85/f7a d4/d9/f87 0 2024-04-25T01:52:27.054 INFO:tasks.workunit.client.0.smithi162.stdout:3/469: symlink d2/d29/la8 0 2024-04-25T01:52:27.080 INFO:tasks.workunit.client.0.smithi162.stdout:3/470: stat d2/d29/d2e/f7a 0 2024-04-25T01:52:27.161 INFO:tasks.workunit.client.0.smithi162.stdout:7/451: creat df/d2e/d4c/d8a/f8f x:0 0 0 2024-04-25T01:52:27.253 INFO:tasks.workunit.client.0.smithi162.stdout:0/501: creat d0/d1/fa6 x:0 0 0 2024-04-25T01:52:27.386 INFO:tasks.workunit.client.0.smithi162.stdout:5/459: getdents d15/d19/d24/d4d/d7c 0 2024-04-25T01:52:27.483 INFO:tasks.workunit.client.0.smithi162.stdout:1/473: dread - d15/d1f/d35/d4c/d70/d73/f8f zero size 2024-04-25T01:52:27.770 INFO:tasks.workunit.client.0.smithi162.stdout:4/473: fsync dd/d1a/f26 0 2024-04-25T01:52:27.800 INFO:tasks.workunit.client.0.smithi162.stdout:9/397: dread - d4/d8/d13/d38/f82 zero size 2024-04-25T01:52:27.862 INFO:tasks.workunit.client.0.smithi162.stdout:1/474: sync 2024-04-25T01:52:28.462 INFO:tasks.workunit.client.0.smithi162.stdout:8/451: truncate d0/d1a/f32 1918108 0 2024-04-25T01:52:28.695 INFO:tasks.workunit.client.0.smithi162.stdout:0/502: dread d0/df/f66 [0,4194304] 0 2024-04-25T01:52:28.760 INFO:tasks.workunit.client.0.smithi162.stdout:5/460: mknod d15/d19/d24/d73/c90 0 2024-04-25T01:52:28.880 INFO:tasks.workunit.client.0.smithi162.stdout:5/461: chown d15/d19/d24/d4d/c84 11843088 1 2024-04-25T01:52:29.772 INFO:tasks.workunit.client.0.smithi162.stdout:7/452: mkdir df/d2c/d63/d83/d8b/d90 0 2024-04-25T01:52:29.869 INFO:tasks.workunit.client.0.smithi162.stdout:6/405: dwrite d1/d13/d28/d30/d66/f76 [0,4194304] 0 2024-04-25T01:52:29.955 INFO:tasks.workunit.client.0.smithi162.stdout:2/425: dwrite d0/d3/d30/f76 [4194304,4194304] 0 2024-04-25T01:52:30.072 INFO:tasks.workunit.client.0.smithi162.stdout:0/503: truncate d0/fd 198634 0 2024-04-25T01:52:30.098 INFO:tasks.workunit.client.0.smithi162.stdout:8/452: dread - d0/d12/f7e zero size 2024-04-25T01:52:30.223 INFO:tasks.workunit.client.0.smithi162.stdout:3/471: dwrite d2/d9/d19/d3f/f79 [0,4194304] 0 2024-04-25T01:52:30.362 INFO:tasks.workunit.client.0.smithi162.stdout:1/475: mkdir d15/d1f/d23/d30/d4a/d7f/d97 0 2024-04-25T01:52:30.988 INFO:tasks.workunit.client.0.smithi162.stdout:9/398: creat d4/d9/d15/f88 x:0 0 0 2024-04-25T01:52:31.355 INFO:tasks.workunit.client.0.smithi162.stdout:7/453: creat df/d2e/d4c/d58/d82/f91 x:0 0 0 2024-04-25T01:52:31.464 INFO:tasks.workunit.client.0.smithi162.stdout:4/474: dwrite dd/df/d2e/d4b/d79/f85 [0,4194304] 0 2024-04-25T01:52:31.478 INFO:tasks.workunit.client.0.smithi162.stdout:3/472: creat d2/d9/d19/d3f/fa9 x:0 0 0 2024-04-25T01:52:31.640 INFO:tasks.workunit.client.0.smithi162.stdout:0/504: mkdir d0/df/d20/d25/d55/d6f/d7d/da7 0 2024-04-25T01:52:31.671 INFO:tasks.workunit.client.0.smithi162.stdout:4/475: sync 2024-04-25T01:52:31.675 INFO:tasks.workunit.client.0.smithi162.stdout:5/462: creat d15/d19/d24/d2b/d3b/f91 x:0 0 0 2024-04-25T01:52:31.753 INFO:tasks.workunit.client.0.smithi162.stdout:0/505: readlink d0/d1/d64/la3 0 2024-04-25T01:52:31.776 INFO:tasks.workunit.client.0.smithi162.stdout:2/426: dwrite d0/d3/d30/f8f [0,4194304] 0 2024-04-25T01:52:32.512 INFO:tasks.workunit.client.0.smithi162.stdout:1/476: fsync d15/d1f/d23/d30/f60 0 2024-04-25T01:52:32.585 INFO:tasks.workunit.client.0.smithi162.stdout:3/473: fdatasync d2/f65 0 2024-04-25T01:52:32.917 INFO:tasks.workunit.client.0.smithi162.stdout:0/506: fdatasync d0/df/d20/f31 0 2024-04-25T01:52:32.961 INFO:tasks.workunit.client.0.smithi162.stdout:4/476: truncate dd/df/f52 1604426 0 2024-04-25T01:52:33.143 INFO:tasks.workunit.client.0.smithi162.stdout:8/453: creat d0/d12/f94 x:0 0 0 2024-04-25T01:52:33.173 INFO:tasks.workunit.client.0.smithi162.stdout:8/454: readlink d0/d44/d31/l45 0 2024-04-25T01:52:33.329 INFO:tasks.workunit.client.0.smithi162.stdout:2/427: rename d0/d3/d30 to d0/d3/d5/d36/d93 0 2024-04-25T01:52:33.595 INFO:tasks.workunit.client.0.smithi162.stdout:5/463: truncate d15/d19/d24/d4d/f5a 2936677 0 2024-04-25T01:52:33.762 INFO:tasks.workunit.client.0.smithi162.stdout:6/406: link d1/d13/l22 d1/d13/d28/d45/d59/l82 0 2024-04-25T01:52:34.080 INFO:tasks.workunit.client.0.smithi162.stdout:9/399: write d4/f6c [723883,50107] 0 2024-04-25T01:52:34.846 INFO:tasks.workunit.client.0.smithi162.stdout:0/507: creat d0/df/d20/d37/d81/fa8 x:0 0 0 2024-04-25T01:52:34.875 INFO:tasks.workunit.client.0.smithi162.stdout:0/508: stat d0/d1/d6a/f72 0 2024-04-25T01:52:35.077 INFO:tasks.workunit.client.0.smithi162.stdout:8/455: mknod d0/d44/d91/c95 0 2024-04-25T01:52:35.552 INFO:tasks.workunit.client.0.smithi162.stdout:5/464: creat d15/d19/d24/d73/f92 x:0 0 0 2024-04-25T01:52:35.865 INFO:tasks.workunit.client.0.smithi162.stdout:9/400: dread - d4/d8/d13/f84 zero size 2024-04-25T01:52:35.900 INFO:tasks.workunit.client.0.smithi162.stdout:7/454: link df/d2c/f3b df/d2e/d4c/f92 0 2024-04-25T01:52:35.982 INFO:tasks.workunit.client.0.smithi162.stdout:0/509: mkdir d0/d1/d6a/da9 0 2024-04-25T01:52:36.216 INFO:tasks.workunit.client.0.smithi162.stdout:1/477: dwrite d15/d1f/d35/d4c/d70/f7e [0,4194304] 0 2024-04-25T01:52:36.422 INFO:tasks.workunit.client.0.smithi162.stdout:6/407: mknod d1/c83 0 2024-04-25T01:52:36.768 INFO:tasks.workunit.client.0.smithi162.stdout:3/474: dwrite d2/d9/d10/d4c/d51/d63/d87/d86/f9b [0,4194304] 0 2024-04-25T01:52:36.890 INFO:tasks.workunit.client.0.smithi162.stdout:3/475: readlink d2/d9/d99/l1b 0 2024-04-25T01:52:36.942 INFO:tasks.workunit.client.0.smithi162.stdout:7/455: mkdir df/d2e/d4c/d58/d93 0 2024-04-25T01:52:37.197 INFO:tasks.workunit.client.0.smithi162.stdout:8/456: symlink d0/d12/d1b/d74/d8a/d8f/l96 0 2024-04-25T01:52:37.217 INFO:tasks.workunit.client.0.smithi162.stdout:4/477: write dd/d1a/f22 [1281512,68931] 0 2024-04-25T01:52:37.295 INFO:tasks.workunit.client.0.smithi162.stdout:0/510: creat d0/df/d20/d25/d55/d6f/d7d/faa x:0 0 0 2024-04-25T01:52:37.385 INFO:tasks.workunit.client.0.smithi162.stdout:4/478: dread dd/df/d2e/f35 [0,4194304] 0 2024-04-25T01:52:38.105 INFO:tasks.workunit.client.0.smithi162.stdout:7/456: unlink f4 0 2024-04-25T01:52:39.093 INFO:tasks.workunit.client.0.smithi162.stdout:2/428: getdents d0/d3/d1b/d1d/d20/d67 0 2024-04-25T01:52:39.187 INFO:tasks.workunit.client.0.smithi162.stdout:8/457: read d0/d44/f15 [4827136,51626] 0 2024-04-25T01:52:39.212 INFO:tasks.workunit.client.0.smithi162.stdout:9/401: write d4/d9/fa [4923874,62049] 0 2024-04-25T01:52:39.285 INFO:tasks.workunit.client.0.smithi162.stdout:8/458: stat d0/d44/d31/l45 0 2024-04-25T01:52:39.529 INFO:tasks.workunit.client.0.smithi162.stdout:4/479: mkdir dd/d1a/d34/d9d 0 2024-04-25T01:52:39.662 INFO:tasks.workunit.client.0.smithi162.stdout:5/465: link d15/d1e/l75 d15/d19/l93 0 2024-04-25T01:52:40.203 INFO:tasks.workunit.client.0.smithi162.stdout:6/408: rename d1/d13/d28/d45/d59/c77 to d1/d46/d7a/c84 0 2024-04-25T01:52:40.508 INFO:tasks.workunit.client.0.smithi162.stdout:7/457: creat df/d2c/d49/f94 x:0 0 0 2024-04-25T01:52:40.791 INFO:tasks.workunit.client.0.smithi162.stdout:1/478: dwrite d15/d1f/f2d [0,4194304] 0 2024-04-25T01:52:40.920 INFO:tasks.workunit.client.0.smithi162.stdout:0/511: mkdir d0/d1/dab 0 2024-04-25T01:52:41.047 INFO:tasks.workunit.client.0.smithi162.stdout:5/466: mknod d15/d19/d24/d73/d7a/c94 0 2024-04-25T01:52:41.086 INFO:tasks.workunit.client.0.smithi162.stdout:2/429: dread d0/d3/d5/d36/f65 [0,4194304] 0 2024-04-25T01:52:41.381 INFO:tasks.workunit.client.0.smithi162.stdout:2/430: chown d0/d3/d1b/d1d/d20/c34 6756 1 2024-04-25T01:52:41.414 INFO:tasks.workunit.client.0.smithi162.stdout:0/512: dread d0/d1/f3d [0,4194304] 0 2024-04-25T01:52:41.977 INFO:tasks.workunit.client.0.smithi162.stdout:7/458: dread df/f1b [0,4194304] 0 2024-04-25T01:52:42.349 INFO:tasks.workunit.client.0.smithi162.stdout:0/513: creat d0/d1/d4e/fac x:0 0 0 2024-04-25T01:52:42.376 INFO:tasks.workunit.client.0.smithi162.stdout:2/431: rename d0/d3/d1b/d1d/d20/d5e/d61/d66/l23 to d0/d3/d1b/d6b/d92/l94 0 2024-04-25T01:52:42.594 INFO:tasks.workunit.client.0.smithi162.stdout:0/514: sync 2024-04-25T01:52:42.682 INFO:tasks.workunit.client.0.smithi162.stdout:3/476: getdents d2/d29/d5d 0 2024-04-25T01:52:42.815 INFO:tasks.workunit.client.0.smithi162.stdout:4/480: link dd/d1a/l45 dd/d1a/d4e/l9e 0 2024-04-25T01:52:43.393 INFO:tasks.workunit.client.0.smithi162.stdout:2/432: symlink d0/d3/d5/d36/d93/l95 0 2024-04-25T01:52:43.405 INFO:tasks.workunit.client.0.smithi162.stdout:0/515: mkdir d0/df/d20/d37/d81/dad 0 2024-04-25T01:52:43.426 INFO:tasks.workunit.client.0.smithi162.stdout:3/477: truncate d2/d29/f80 846590 0 2024-04-25T01:52:43.436 INFO:tasks.workunit.client.0.smithi162.stdout:7/459: dread f6 [0,4194304] 0 2024-04-25T01:52:43.683 INFO:tasks.workunit.client.0.smithi162.stdout:9/402: dwrite d4/d9/f47 [0,4194304] 0 2024-04-25T01:52:43.890 INFO:tasks.workunit.client.0.smithi162.stdout:0/516: dread d0/df/f66 [0,4194304] 0 2024-04-25T01:52:44.369 INFO:tasks.workunit.client.0.smithi162.stdout:2/433: creat d0/d3/d1b/d1d/d20/d5e/f96 x:0 0 0 2024-04-25T01:52:44.456 INFO:tasks.workunit.client.0.smithi162.stdout:6/409: write d1/d13/d28/f2f [238615,127272] 0 2024-04-25T01:52:44.837 INFO:tasks.workunit.client.0.smithi162.stdout:8/459: dwrite d0/d12/d1b/d74/d8a/f93 [0,4194304] 0 2024-04-25T01:52:44.989 INFO:tasks.workunit.client.0.smithi162.stdout:5/467: write d15/d1e/f6c [3405943,20288] 0 2024-04-25T01:52:45.533 INFO:tasks.workunit.client.0.smithi162.stdout:3/478: rename d2/d9/d10/d4c/d8d/ca7 to d2/d9/d19/d9d/caa 0 2024-04-25T01:52:45.705 INFO:tasks.workunit.client.0.smithi162.stdout:9/403: creat d4/d8/d13/f89 x:0 0 0 2024-04-25T01:52:45.815 INFO:tasks.workunit.client.0.smithi162.stdout:1/479: dwrite f3 [4194304,4194304] 0 2024-04-25T01:52:46.295 INFO:tasks.workunit.client.0.smithi162.stdout:4/481: write dd/df/f86 [540360,125214] 0 2024-04-25T01:52:46.296 INFO:tasks.workunit.client.0.smithi162.stdout:7/460: creat df/f95 x:0 0 0 2024-04-25T01:52:46.354 INFO:tasks.workunit.client.0.smithi162.stdout:4/482: chown dd/f2c 38 1 2024-04-25T01:52:46.854 INFO:tasks.workunit.client.0.smithi162.stdout:6/410: write d1/f48 [1293230,97914] 0 2024-04-25T01:52:46.983 INFO:tasks.workunit.client.0.smithi162.stdout:2/434: dwrite d0/f5c [0,4194304] 0 2024-04-25T01:52:47.098 INFO:tasks.workunit.client.0.smithi162.stdout:1/480: dread d15/d1f/d35/d4c/f88 [0,4194304] 0 2024-04-25T01:52:47.128 INFO:tasks.workunit.client.0.smithi162.stdout:6/411: chown d1/f10 38785839 1 2024-04-25T01:52:47.192 INFO:tasks.workunit.client.0.smithi162.stdout:6/412: chown d1/d13/d28/d53 56609 1 2024-04-25T01:52:47.377 INFO:tasks.workunit.client.0.smithi162.stdout:7/461: fdatasync df/f32 0 2024-04-25T01:52:47.488 INFO:tasks.workunit.client.0.smithi162.stdout:4/483: fsync dd/f16 0 2024-04-25T01:52:47.539 INFO:tasks.workunit.client.0.smithi162.stdout:6/413: dwrite d1/d13/d28/f2f [0,4194304] 0 2024-04-25T01:52:47.693 INFO:tasks.workunit.client.0.smithi162.stdout:6/414: sync 2024-04-25T01:52:47.781 INFO:tasks.workunit.client.0.smithi162.stdout:9/404: mkdir d4/d9/d15/d8a 0 2024-04-25T01:52:48.140 INFO:tasks.workunit.client.0.smithi162.stdout:5/468: link d15/d1e/l79 d15/d19/d24/d4d/d7c/d85/l95 0 2024-04-25T01:52:48.240 INFO:tasks.workunit.client.0.smithi162.stdout:2/435: mknod d0/d3/d1b/d1d/d20/c97 0 2024-04-25T01:52:48.595 INFO:tasks.workunit.client.0.smithi162.stdout:7/462: truncate df/d2e/f48 704088 0 2024-04-25T01:52:48.639 INFO:tasks.workunit.client.0.smithi162.stdout:6/415: mkdir d1/d46/d7a/d85 0 2024-04-25T01:52:48.791 INFO:tasks.workunit.client.0.smithi162.stdout:3/479: dwrite d2/d9/d99/f75 [4194304,4194304] 0 2024-04-25T01:52:48.927 INFO:tasks.workunit.client.0.smithi162.stdout:8/460: link d0/cf d0/d12/d1b/d74/d8a/d8f/c97 0 2024-04-25T01:52:49.249 INFO:tasks.workunit.client.0.smithi162.stdout:2/436: creat d0/d3/d7a/f98 x:0 0 0 2024-04-25T01:52:49.390 INFO:tasks.workunit.client.0.smithi162.stdout:1/481: creat d15/d1f/d23/d30/d4a/d7f/d97/f98 x:0 0 0 2024-04-25T01:52:49.502 INFO:tasks.workunit.client.0.smithi162.stdout:1/482: sync 2024-04-25T01:52:49.862 INFO:tasks.workunit.client.0.smithi162.stdout:0/517: creat d0/df/d20/fae x:0 0 0 2024-04-25T01:52:49.889 INFO:tasks.workunit.client.0.smithi162.stdout:0/518: chown d0/df/f1b 22681 1 2024-04-25T01:52:50.078 INFO:tasks.workunit.client.0.smithi162.stdout:8/461: rmdir d0/d12/d1b/d74/d8a 39 2024-04-25T01:52:50.432 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:52:50.436 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:52:50.511 INFO:tasks.workunit.client.0.smithi162.stdout:2/437: truncate d0/d3/d5/d36/d93/f76 8500383 0 2024-04-25T01:52:50.769 INFO:tasks.workunit.client.0.smithi162.stdout:4/484: write dd/d1a/d4e/f84 [3152380,17731] 0 2024-04-25T01:52:50.814 INFO:tasks.workunit.client.0.smithi162.stdout:4/485: readlink dd/d1a/d34/l38 0 2024-04-25T01:52:51.143 INFO:tasks.workunit.client.0.smithi162.stdout:8/462: fsync d0/d12/d3a/f5a 0 2024-04-25T01:52:51.416 INFO:tasks.workunit.client.0.smithi162.stdout:9/405: dwrite d4/f21 [0,4194304] 0 2024-04-25T01:52:51.758 INFO:tasks.workunit.client.0.smithi162.stdout:1/483: mknod d15/d1f/d23/c99 0 2024-04-25T01:52:51.784 INFO:tasks.workunit.client.0.smithi162.stdout:1/484: readlink d15/d1f/l66 0 2024-04-25T01:52:51.928 INFO:tasks.workunit.client.0.smithi162.stdout:4/486: readlink dd/df/d58/l89 0 2024-04-25T01:52:52.139 INFO:tasks.workunit.client.0.smithi162.stdout:6/416: dwrite d1/d13/d28/d30/d3a/d57/f65 [0,4194304] 0 2024-04-25T01:52:52.285 INFO:tasks.workunit.client.0.smithi162.stdout:3/480: write d2/d9/d10/d4c/f74 [3548565,121773] 0 2024-04-25T01:52:52.759 INFO:tasks.workunit.client.0.smithi162.stdout:5/469: dwrite d15/d19/d24/d2b/d3b/f89 [0,4194304] 0 2024-04-25T01:52:52.870 INFO:tasks.workunit.client.0.smithi162.stdout:2/438: mknod d0/d3/d7a/d88/c99 0 2024-04-25T01:52:52.963 INFO:tasks.workunit.client.0.smithi162.stdout:9/406: truncate d4/d25/f45 2439645 0 2024-04-25T01:52:53.524 INFO:tasks.workunit.client.0.smithi162.stdout:4/487: dread - dd/d1a/f78 zero size 2024-04-25T01:52:54.773 INFO:tasks.workunit.client.0.smithi162.stdout:0/519: getdents d0/d1/d4b 0 2024-04-25T01:52:54.945 INFO:tasks.workunit.client.0.smithi162.stdout:4/488: dread - dd/df/f97 zero size 2024-04-25T01:52:55.218 INFO:tasks.workunit.client.0.smithi162.stdout:5/470: mkdir d15/d19/d24/d4d/d7c/d85/d96 0 2024-04-25T01:52:55.367 INFO:tasks.workunit.client.0.smithi162.stdout:1/485: write f14 [7822165,91034] 0 2024-04-25T01:52:55.775 INFO:tasks.workunit.client.0.smithi162.stdout:7/463: link df/f22 df/f96 0 2024-04-25T01:52:55.869 INFO:tasks.workunit.client.0.smithi162.stdout:9/407: mknod d4/d9/d15/c8b 0 2024-04-25T01:52:56.111 INFO:tasks.workunit.client.0.smithi162.stdout:4/489: fsync dd/df/d77/f96 0 2024-04-25T01:52:56.343 INFO:tasks.workunit.client.0.smithi162.stdout:6/417: dwrite d1/f39 [0,4194304] 0 2024-04-25T01:52:56.830 INFO:tasks.workunit.client.0.smithi162.stdout:8/463: link d0/d12/d1b/l68 d0/l98 0 2024-04-25T01:52:57.238 INFO:tasks.workunit.client.0.smithi162.stdout:7/464: truncate df/f8e 166413 0 2024-04-25T01:52:57.476 INFO:tasks.workunit.client.0.smithi162.stdout:4/490: creat dd/df/d2e/d59/f9f x:0 0 0 2024-04-25T01:52:57.637 INFO:tasks.workunit.client.0.smithi162.stdout:3/481: dwrite d2/d29/f2a [0,4194304] 0 2024-04-25T01:52:57.784 INFO:tasks.workunit.client.0.smithi162.stdout:8/464: mknod d0/d12/d1b/c99 0 2024-04-25T01:52:57.822 INFO:tasks.workunit.client.0.smithi162.stdout:8/465: stat d0/d12/d1b/d8d 0 2024-04-25T01:52:57.836 INFO:tasks.workunit.client.0.smithi162.stdout:8/466: readlink d0/d12/d1b/l41 0 2024-04-25T01:52:58.129 INFO:tasks.workunit.client.0.smithi162.stdout:2/439: dwrite d0/d3/d1b/d1d/d20/d42/d57/f7f [0,4194304] 0 2024-04-25T01:52:58.224 INFO:tasks.workunit.client.0.smithi162.stdout:0/520: write d0/d1/d4b/f61 [4816038,18564] 0 2024-04-25T01:52:58.577 INFO:tasks.workunit.client.0.smithi162.stdout:4/491: read dd/df/d2e/d59/f76 [442603,32089] 0 2024-04-25T01:52:58.829 INFO:tasks.workunit.client.0.smithi162.stdout:5/471: dwrite d15/d19/d24/d40/f74 [0,4194304] 0 2024-04-25T01:52:58.998 INFO:tasks.workunit.client.0.smithi162.stdout:8/467: creat d0/d44/d31/d33/f9a x:0 0 0 2024-04-25T01:52:59.277 INFO:tasks.workunit.client.0.smithi162.stdout:2/440: mkdir d0/d3/d1b/d6b/d92/d9a 0 2024-04-25T01:52:59.774 INFO:tasks.workunit.client.0.smithi162.stdout:5/472: creat d15/d19/d24/d73/f97 x:0 0 0 2024-04-25T01:52:59.978 INFO:tasks.workunit.client.0.smithi162.stdout:1/486: dwrite d15/d1f/d35/d4c/d70/f81 [0,4194304] 0 2024-04-25T01:53:00.496 INFO:tasks.workunit.client.0.smithi162.stdout:9/408: dwrite d4/d8/d13/f5b [0,4194304] 0 2024-04-25T01:53:00.787 INFO:tasks.workunit.client.0.smithi162.stdout:2/441: truncate d0/d3/d5/d69/f7e 820388 0 2024-04-25T01:53:00.827 INFO:tasks.workunit.client.0.smithi162.stdout:6/418: link d1/d46/l55 d1/d13/l86 0 2024-04-25T01:53:00.879 INFO:tasks.workunit.client.0.smithi162.stdout:0/521: link d0/df/d20/c27 d0/df/d20/d25/d51/caf 0 2024-04-25T01:53:01.425 INFO:tasks.workunit.client.0.smithi162.stdout:1/487: symlink d15/d1f/d23/d30/l9a 0 2024-04-25T01:53:01.586 INFO:tasks.workunit.client.0.smithi162.stdout:6/419: truncate d1/d13/d28/d30/f69 714489 0 2024-04-25T01:53:01.653 INFO:tasks.workunit.client.0.smithi162.stdout:1/488: sync 2024-04-25T01:53:02.094 INFO:tasks.workunit.client.0.smithi162.stdout:5/473: rmdir d15/d19/d24/d4d/d7c/d85/d96 0 2024-04-25T01:53:02.106 INFO:tasks.workunit.client.0.smithi162.stdout:3/482: rename d2/l8b to d2/d29/d5d/lab 0 2024-04-25T01:53:02.289 INFO:tasks.workunit.client.0.smithi162.stdout:6/420: symlink d1/d5c/l87 0 2024-04-25T01:53:02.788 INFO:tasks.workunit.client.0.smithi162.stdout:4/492: rename dd/df/d2e/c4a to dd/df/d2e/d4b/d79/ca0 0 2024-04-25T01:53:02.819 INFO:tasks.workunit.client.0.smithi162.stdout:7/465: unlink df/f7c 0 2024-04-25T01:53:02.964 INFO:tasks.workunit.client.0.smithi162.stdout:1/489: dread d15/d1f/d23/f48 [0,4194304] 0 2024-04-25T01:53:03.006 INFO:tasks.workunit.client.0.smithi162.stdout:3/483: mknod d2/d9/d10/d4c/d8d/cac 0 2024-04-25T01:53:03.144 INFO:tasks.workunit.client.0.smithi162.stdout:6/421: stat d1/d13/l86 0 2024-04-25T01:53:03.288 INFO:tasks.workunit.client.0.smithi162.stdout:8/468: dwrite d0/d44/d31/f3e [0,4194304] 0 2024-04-25T01:53:03.383 INFO:tasks.workunit.client.0.smithi162.stdout:1/490: chown d15/d69/d4f/c8a 23 1 2024-04-25T01:53:03.817 INFO:tasks.workunit.client.0.smithi162.stdout:2/442: write d0/d3/d1b/d1d/d20/d5e/f96 [991793,89063] 0 2024-04-25T01:53:04.338 INFO:tasks.workunit.client.0.smithi162.stdout:9/409: dwrite d4/d8/d13/d38/f82 [0,4194304] 0 2024-04-25T01:53:04.501 INFO:tasks.workunit.client.0.smithi162.stdout:8/469: fsync d0/d44/d31/f6c 0 2024-04-25T01:53:04.580 INFO:tasks.workunit.client.0.smithi162.stdout:0/522: dwrite d0/df/d20/d25/d55/d77/f90 [0,4194304] 0 2024-04-25T01:53:04.815 INFO:tasks.workunit.client.0.smithi162.stdout:1/491: creat d15/d1f/d35/d4c/d70/d73/f9b x:0 0 0 2024-04-25T01:53:05.030 INFO:tasks.workunit.client.0.smithi162.stdout:5/474: creat d15/d19/d24/d2b/d3b/f98 x:0 0 0 2024-04-25T01:53:05.053 INFO:tasks.workunit.client.0.smithi162.stdout:3/484: write d2/d29/d5d/f68 [1674117,107288] 0 2024-04-25T01:53:05.081 INFO:tasks.workunit.client.0.smithi162.stdout:8/470: dwrite d0/d44/d31/d33/f9a [0,4194304] 0 2024-04-25T01:53:05.499 INFO:tasks.workunit.client.0.smithi162.stdout:2/443: creat d0/d3/d1b/d1d/d20/d5e/d61/d66/f9b x:0 0 0 2024-04-25T01:53:05.935 INFO:tasks.workunit.client.0.smithi162.stdout:0/523: mkdir d0/d1/d4e/d76/db0 0 2024-04-25T01:53:06.416 INFO:tasks.workunit.client.0.smithi162.stdout:5/475: fdatasync d15/d19/d24/d40/f7b 0 2024-04-25T01:53:06.756 INFO:tasks.workunit.client.0.smithi162.stdout:8/471: dread d0/d44/d31/d65/f88 [0,4194304] 0 2024-04-25T01:53:06.795 INFO:tasks.workunit.client.0.smithi162.stdout:6/422: creat d1/f88 x:0 0 0 2024-04-25T01:53:07.513 INFO:tasks.workunit.client.0.smithi162.stdout:4/493: rename dd/d1a/f78 to dd/fa1 0 2024-04-25T01:53:07.603 INFO:tasks.workunit.client.0.smithi162.stdout:9/410: mknod d4/d9/d15/d71/c8c 0 2024-04-25T01:53:07.928 INFO:tasks.workunit.client.0.smithi162.stdout:5/476: truncate d15/d19/d24/d2b/d3b/f46 778955 0 2024-04-25T01:53:08.081 INFO:tasks.workunit.client.0.smithi162.stdout:7/466: getdents df/d2e/d4c 0 2024-04-25T01:53:08.344 INFO:tasks.workunit.client.0.smithi162.stdout:8/472: fdatasync d0/d12/d1b/f1f 0 2024-04-25T01:53:08.380 INFO:tasks.workunit.client.0.smithi162.stdout:8/473: chown d0/d44/f7d 327365491 1 2024-04-25T01:53:08.437 INFO:tasks.workunit.client.0.smithi162.stdout:6/423: mkdir d1/d13/d28/d30/d66/d89 0 2024-04-25T01:53:08.530 INFO:tasks.workunit.client.0.smithi162.stdout:2/444: write d0/d3/d5/d36/f65 [1970516,4896] 0 2024-04-25T01:53:08.706 INFO:tasks.workunit.client.0.smithi162.stdout:3/485: rename d2/d29/la8 to d2/d9/d48/lad 0 2024-04-25T01:53:08.964 INFO:tasks.workunit.client.0.smithi162.stdout:2/445: dread d0/f5a [0,4194304] 0 2024-04-25T01:53:08.981 INFO:tasks.workunit.client.0.smithi162.stdout:0/524: mknod d0/df/d20/d37/da1/cb1 0 2024-04-25T01:53:09.043 INFO:tasks.workunit.client.0.smithi162.stdout:3/486: chown d2/d9/d10/d4c/d51/d63/d87/d86 952 1 2024-04-25T01:53:09.076 INFO:tasks.workunit.client.0.smithi162.stdout:1/492: creat d15/d1f/d23/d30/f9c x:0 0 0 2024-04-25T01:53:09.200 INFO:tasks.workunit.client.0.smithi162.stdout:3/487: write d2/d29/d5d/f68 [2716083,102552] 0 2024-04-25T01:53:09.303 INFO:tasks.workunit.client.0.smithi162.stdout:7/467: fsync df/d2e/d4c/f53 0 2024-04-25T01:53:09.719 INFO:tasks.workunit.client.0.smithi162.stdout:8/474: creat d0/d12/d1b/f9b x:0 0 0 2024-04-25T01:53:09.865 INFO:tasks.workunit.client.0.smithi162.stdout:6/424: mkdir d1/d13/d28/d30/d8a 0 2024-04-25T01:53:10.214 INFO:tasks.workunit.client.0.smithi162.stdout:9/411: mknod d4/d9/d15/d1b/d2f/c8d 0 2024-04-25T01:53:10.309 INFO:tasks.workunit.client.0.smithi162.stdout:2/446: mkdir d0/d3/d1b/d1d/d20/d67/d9c 0 2024-04-25T01:53:10.731 INFO:tasks.workunit.client.0.smithi162.stdout:5/477: fdatasync d15/d19/d24/f25 0 2024-04-25T01:53:11.066 INFO:tasks.workunit.client.0.smithi162.stdout:1/493: rename d15/d69/d4f/l5e to d15/d1f/d35/d4c/l9d 0 2024-04-25T01:53:12.146 INFO:tasks.workunit.client.0.smithi162.stdout:6/425: truncate d1/f48 2102901 0 2024-04-25T01:53:12.420 INFO:tasks.workunit.client.0.smithi162.stdout:9/412: unlink d4/d8/f18 0 2024-04-25T01:53:12.575 INFO:tasks.workunit.client.0.smithi162.stdout:0/525: creat d0/df/d20/d25/d55/d6f/d7d/da7/fb2 x:0 0 0 2024-04-25T01:53:12.814 INFO:tasks.workunit.client.0.smithi162.stdout:0/526: chown d0/df/d20/d25/c70 0 1 2024-04-25T01:53:12.877 INFO:tasks.workunit.client.0.smithi162.stdout:4/494: dwrite dd/df/f52 [0,4194304] 0 2024-04-25T01:53:13.594 INFO:tasks.workunit.client.0.smithi162.stdout:8/475: unlink d0/cf 0 2024-04-25T01:53:13.932 INFO:tasks.workunit.client.0.smithi162.stdout:7/468: write df/d2e/d4c/f54 [3523501,21937] 0 2024-04-25T01:53:14.302 INFO:tasks.workunit.client.0.smithi162.stdout:3/488: dwrite d2/d9/d10/d4c/d51/d63/d87/d86/f9b [0,4194304] 0 2024-04-25T01:53:14.690 INFO:tasks.workunit.client.0.smithi162.stdout:1/494: mknod d15/d1f/d23/d30/c9e 0 2024-04-25T01:53:14.810 INFO:tasks.workunit.client.0.smithi162.stdout:8/476: truncate d0/d1a/f32 2628611 0 2024-04-25T01:53:15.261 INFO:tasks.workunit.client.0.smithi162.stdout:3/489: fdatasync d2/f62 0 2024-04-25T01:53:15.580 INFO:tasks.workunit.client.0.smithi162.stdout:8/477: fdatasync d0/d12/f24 0 2024-04-25T01:53:15.613 INFO:tasks.workunit.client.0.smithi162.stdout:2/447: dwrite d0/f74 [0,4194304] 0 2024-04-25T01:53:15.765 INFO:tasks.workunit.client.0.smithi162.stdout:5/478: write f11 [7708405,58147] 0 2024-04-25T01:53:15.900 INFO:tasks.workunit.client.0.smithi162.stdout:3/490: chown d2/d9/l16 741561 1 2024-04-25T01:53:16.461 INFO:tasks.workunit.client.0.smithi162.stdout:8/478: creat d0/d44/d31/d65/f9c x:0 0 0 2024-04-25T01:53:16.634 INFO:tasks.workunit.client.0.smithi162.stdout:6/426: write d1/f24 [2386494,17699] 0 2024-04-25T01:53:16.906 INFO:tasks.workunit.client.0.smithi162.stdout:6/427: dread d1/d13/f42 [0,4194304] 0 2024-04-25T01:53:16.952 INFO:tasks.workunit.client.0.smithi162.stdout:8/479: unlink d0/d12/c20 0 2024-04-25T01:53:16.960 INFO:tasks.workunit.client.0.smithi162.stdout:9/413: write d4/d9/d15/d4e/f65 [1480521,43400] 0 2024-04-25T01:53:17.038 INFO:tasks.workunit.client.0.smithi162.stdout:3/491: read d2/d29/f3c [425660,94995] 0 2024-04-25T01:53:17.733 INFO:tasks.workunit.client.0.smithi162.stdout:2/448: creat d0/d3/d1b/d1d/d20/d5e/d61/f9d x:0 0 0 2024-04-25T01:53:17.842 INFO:tasks.workunit.client.0.smithi162.stdout:5/479: rename d15/d19/d24/d2b/c38 to d15/d19/d24/d2b/c99 0 2024-04-25T01:53:17.977 INFO:tasks.workunit.client.0.smithi162.stdout:9/414: symlink d4/d8/d85/l8e 0 2024-04-25T01:53:18.180 INFO:tasks.workunit.client.0.smithi162.stdout:7/469: dwrite df/d2c/d49/f94 [0,4194304] 0 2024-04-25T01:53:18.307 INFO:tasks.workunit.client.0.smithi162.stdout:0/527: dwrite d0/d1/d4b/f4f [0,4194304] 0 2024-04-25T01:53:18.608 INFO:tasks.workunit.client.0.smithi162.stdout:1/495: dwrite d15/d1f/d35/d4c/f6f [0,4194304] 0 2024-04-25T01:53:18.622 INFO:tasks.workunit.client.0.smithi162.stdout:4/495: dwrite dd/df/d2e/f95 [0,4194304] 0 2024-04-25T01:53:18.861 INFO:tasks.workunit.client.0.smithi162.stdout:2/449: mkdir d0/d3/d1b/d6b/d9e 0 2024-04-25T01:53:18.931 INFO:tasks.workunit.client.0.smithi162.stdout:9/415: creat d4/d7c/f8f x:0 0 0 2024-04-25T01:53:18.946 INFO:tasks.workunit.client.0.smithi162.stdout:9/416: chown d4/f6c 12 1 2024-04-25T01:53:19.077 INFO:tasks.workunit.client.0.smithi162.stdout:3/492: creat d2/d9/d10/d4c/fae x:0 0 0 2024-04-25T01:53:19.106 INFO:tasks.workunit.client.0.smithi162.stdout:3/493: chown d2/d29/f46 1488265070 1 2024-04-25T01:53:19.278 INFO:tasks.workunit.client.0.smithi162.stdout:5/480: fdatasync d15/d19/d24/d2b/d3b/d3c/d3f/f6f 0 2024-04-25T01:53:19.993 INFO:tasks.workunit.client.0.smithi162.stdout:2/450: creat d0/d3/d7a/d88/f9f x:0 0 0 2024-04-25T01:53:20.149 INFO:tasks.workunit.client.0.smithi162.stdout:9/417: read d4/d8/f5d [592009,55910] 0 2024-04-25T01:53:20.367 INFO:tasks.workunit.client.0.smithi162.stdout:6/428: write d1/f25 [5029910,121769] 0 2024-04-25T01:53:20.508 INFO:tasks.workunit.client.0.smithi162.stdout:3/494: mknod d2/d9/d10/d40/caf 0 2024-04-25T01:53:20.548 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:53:20.551 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:53:20.732 INFO:tasks.workunit.client.0.smithi162.stdout:5/481: chown d15/l6a 56362 1 2024-04-25T01:53:21.167 INFO:tasks.workunit.client.0.smithi162.stdout:8/480: rmdir d0/d1a 39 2024-04-25T01:53:21.193 INFO:tasks.workunit.client.0.smithi162.stdout:1/496: write d15/d1f/d23/d30/d4a/f58 [2180281,82613] 0 2024-04-25T01:53:21.226 INFO:tasks.workunit.client.0.smithi162.stdout:1/497: stat d15 0 2024-04-25T01:53:21.405 INFO:tasks.workunit.client.0.smithi162.stdout:7/470: creat df/d2c/d63/d83/d8b/d90/f97 x:0 0 0 2024-04-25T01:53:21.424 INFO:tasks.workunit.client.0.smithi162.stdout:7/471: readlink df/d2e/l7f 0 2024-04-25T01:53:21.448 INFO:tasks.workunit.client.0.smithi162.stdout:7/472: chown df/d2c/c42 20652 1 2024-04-25T01:53:21.463 INFO:tasks.workunit.client.0.smithi162.stdout:7/473: chown df/f4d 61595204 1 2024-04-25T01:53:21.575 INFO:tasks.workunit.client.0.smithi162.stdout:1/498: sync 2024-04-25T01:53:22.130 INFO:tasks.workunit.client.0.smithi162.stdout:9/418: truncate d4/d9/d15/f35 796224 0 2024-04-25T01:53:22.543 INFO:tasks.workunit.client.0.smithi162.stdout:7/474: dread df/f32 [0,4194304] 0 2024-04-25T01:53:22.725 INFO:tasks.workunit.client.0.smithi162.stdout:4/496: rename dd/df/d2e/d59/l8d to dd/la2 0 2024-04-25T01:53:22.925 INFO:tasks.workunit.client.0.smithi162.stdout:1/499: unlink d15/l68 0 2024-04-25T01:53:23.248 INFO:tasks.workunit.client.0.smithi162.stdout:3/495: getdents d2/d9/d10/d2c/da3 0 2024-04-25T01:53:23.341 INFO:tasks.workunit.client.0.smithi162.stdout:8/481: symlink d0/d44/d31/l9d 0 2024-04-25T01:53:23.469 INFO:tasks.workunit.client.0.smithi162.stdout:0/528: getdents d0/df/d20/d25 0 2024-04-25T01:53:23.949 INFO:tasks.workunit.client.0.smithi162.stdout:2/451: write d0/d3/d1b/d1d/d3a/f3b [5040845,100138] 0 2024-04-25T01:53:24.018 INFO:tasks.workunit.client.0.smithi162.stdout:4/497: dread dd/df/d2e/d59/f91 [0,4194304] 0 2024-04-25T01:53:24.113 INFO:tasks.workunit.client.0.smithi162.stdout:5/482: creat d15/d19/d24/d2b/d3b/d58/f9a x:0 0 0 2024-04-25T01:53:24.243 INFO:tasks.workunit.client.0.smithi162.stdout:3/496: mknod d2/d9/d48/cb0 0 2024-04-25T01:53:24.439 INFO:tasks.workunit.client.0.smithi162.stdout:0/529: fdatasync d0/df/d20/d25/d55/f5a 0 2024-04-25T01:53:24.583 INFO:tasks.workunit.client.0.smithi162.stdout:6/429: dwrite d1/d13/d28/d45/d59/f6b [0,4194304] 0 2024-04-25T01:53:24.705 INFO:tasks.workunit.client.0.smithi162.stdout:4/498: rename dd/c2a to dd/df/d58/ca3 0 2024-04-25T01:53:25.608 INFO:tasks.workunit.client.0.smithi162.stdout:2/452: truncate d0/d3/d5/d36/d93/f8f 2173115 0 2024-04-25T01:53:25.857 INFO:tasks.workunit.client.0.smithi162.stdout:9/419: creat d4/d8/d13/f90 x:0 0 0 2024-04-25T01:53:26.294 INFO:tasks.workunit.client.0.smithi162.stdout:3/497: truncate d2/d9/d10/d4c/f7c 196943 0 2024-04-25T01:53:26.384 INFO:tasks.workunit.client.0.smithi162.stdout:1/500: write d15/d1f/d23/d30/f5a [2943590,55524] 0 2024-04-25T01:53:26.546 INFO:tasks.workunit.client.0.smithi162.stdout:1/501: chown c10 1409961 1 2024-04-25T01:53:26.627 INFO:tasks.workunit.client.0.smithi162.stdout:7/475: dwrite df/d2e/d4c/d8a/f80 [0,4194304] 0 2024-04-25T01:53:26.736 INFO:tasks.workunit.client.0.smithi162.stdout:4/499: unlink dd/df/d2e/d4b/f54 0 2024-04-25T01:53:26.737 INFO:tasks.workunit.client.0.smithi162.stdout:1/502: chown d15/f1d 7 1 2024-04-25T01:53:26.809 INFO:tasks.workunit.client.0.smithi162.stdout:2/453: creat d0/d3/d1b/d6b/fa0 x:0 0 0 2024-04-25T01:53:26.849 INFO:tasks.workunit.client.0.smithi162.stdout:4/500: chown dd/df/f6c 860181 1 2024-04-25T01:53:26.937 INFO:tasks.workunit.client.0.smithi162.stdout:4/501: read dd/df/f30 [3023503,48491] 0 2024-04-25T01:53:26.964 INFO:tasks.workunit.client.0.smithi162.stdout:5/483: mknod d15/d19/d24/d2b/d3b/d3c/c9b 0 2024-04-25T01:53:26.982 INFO:tasks.workunit.client.0.smithi162.stdout:1/503: dread d15/d1f/d23/f48 [0,4194304] 0 2024-04-25T01:53:27.004 INFO:tasks.workunit.client.0.smithi162.stdout:9/420: symlink d4/d8/d13/d38/l91 0 2024-04-25T01:53:27.092 INFO:tasks.workunit.client.0.smithi162.stdout:1/504: dread d15/d1f/d23/f56 [0,4194304] 0 2024-04-25T01:53:27.097 INFO:tasks.workunit.client.0.smithi162.stdout:9/421: read d4/d9/d15/d4e/f61 [1643924,49268] 0 2024-04-25T01:53:27.139 INFO:tasks.workunit.client.0.smithi162.stdout:5/484: sync 2024-04-25T01:53:27.178 INFO:tasks.workunit.client.0.smithi162.stdout:6/430: getdents d1/d13/d79 0 2024-04-25T01:53:27.757 INFO:tasks.workunit.client.0.smithi162.stdout:7/476: fdatasync df/d2c/f3c 0 2024-04-25T01:53:27.940 INFO:tasks.workunit.client.0.smithi162.stdout:2/454: chown d0/d3/d1b/d1d/d20/d5e/d61/d62 7168 1 2024-04-25T01:53:27.968 INFO:tasks.workunit.client.0.smithi162.stdout:2/455: chown d0/d3/f47 50734 1 2024-04-25T01:53:28.129 INFO:tasks.workunit.client.0.smithi162.stdout:9/422: mknod d4/d25/c92 0 2024-04-25T01:53:28.361 INFO:tasks.workunit.client.0.smithi162.stdout:5/485: fsync d15/d19/d24/d4d/d7c/f8e 0 2024-04-25T01:53:28.598 INFO:tasks.workunit.client.0.smithi162.stdout:3/498: truncate d2/d29/f80 1331676 0 2024-04-25T01:53:29.025 INFO:tasks.workunit.client.0.smithi162.stdout:4/502: mknod dd/d1a/d4e/d93/ca4 0 2024-04-25T01:53:29.815 INFO:tasks.workunit.client.0.smithi162.stdout:0/530: link d0/fd d0/df/d20/d25/d55/fb3 0 2024-04-25T01:53:30.464 INFO:tasks.workunit.client.0.smithi162.stdout:4/503: truncate dd/df/d2e/d4b/f94 3535880 0 2024-04-25T01:53:31.276 INFO:tasks.workunit.client.0.smithi162.stdout:0/531: rmdir d0 39 2024-04-25T01:53:31.429 INFO:tasks.workunit.client.0.smithi162.stdout:3/499: chown d2/d9/d10/d4c/f7c 0 1 2024-04-25T01:53:31.455 INFO:tasks.workunit.client.0.smithi162.stdout:3/500: chown d2/d9/d10/d40 5014783 1 2024-04-25T01:53:31.802 INFO:tasks.workunit.client.0.smithi162.stdout:4/504: rename dd/d1a/d4e/f84 to dd/d1a/d4e/d93/fa5 0 2024-04-25T01:53:31.830 INFO:tasks.workunit.client.0.smithi162.stdout:4/505: chown dd/d1a/f20 19868 1 2024-04-25T01:53:32.034 INFO:tasks.workunit.client.0.smithi162.stdout:1/505: getdents d15/d1f/d23/d30 0 2024-04-25T01:53:32.054 INFO:tasks.workunit.client.0.smithi162.stdout:5/486: link le d15/d19/d24/d40/l9c 0 2024-04-25T01:53:32.070 INFO:tasks.workunit.client.0.smithi162.stdout:7/477: write df/f43 [3276541,94830] 0 2024-04-25T01:53:32.249 INFO:tasks.workunit.client.0.smithi162.stdout:6/431: getdents d1 0 2024-04-25T01:53:32.350 INFO:tasks.workunit.client.0.smithi162.stdout:5/487: chown d15/d19/d24/d2b/d3b/c49 1355886697 1 2024-04-25T01:53:32.704 INFO:tasks.workunit.client.0.smithi162.stdout:9/423: dwrite d4/f52 [0,4194304] 0 2024-04-25T01:53:32.886 INFO:tasks.workunit.client.0.smithi162.stdout:1/506: fdatasync f14 0 2024-04-25T01:53:32.895 INFO:tasks.workunit.client.0.smithi162.stdout:1/507: stat c12 0 2024-04-25T01:53:33.383 INFO:tasks.workunit.client.0.smithi162.stdout:2/456: dwrite d0/d3/d1b/f5f [0,4194304] 0 2024-04-25T01:53:33.634 INFO:tasks.workunit.client.0.smithi162.stdout:5/488: unlink d15/d19/d24/d4d/d7c/f8e 0 2024-04-25T01:53:33.912 INFO:tasks.workunit.client.0.smithi162.stdout:4/506: symlink dd/d1a/d34/d72/la6 0 2024-04-25T01:53:34.186 INFO:tasks.workunit.client.0.smithi162.stdout:8/482: symlink d0/l9e 0 2024-04-25T01:53:34.208 INFO:tasks.workunit.client.0.smithi162.stdout:9/424: chown d4/d9/d15/c60 712101432 1 2024-04-25T01:53:34.262 INFO:tasks.workunit.client.0.smithi162.stdout:4/507: dread dd/df/f14 [0,4194304] 0 2024-04-25T01:53:34.422 INFO:tasks.workunit.client.0.smithi162.stdout:9/425: sync 2024-04-25T01:53:34.504 INFO:tasks.workunit.client.0.smithi162.stdout:2/457: mknod d0/d3/d1b/d6b/ca1 0 2024-04-25T01:53:34.638 INFO:tasks.workunit.client.0.smithi162.stdout:5/489: mkdir d15/d19/d24/d4d/d9d 0 2024-04-25T01:53:34.675 INFO:tasks.workunit.client.0.smithi162.stdout:5/490: chown d15/d19/d24/d2b/d3b/d3c/d3f 1 1 2024-04-25T01:53:34.924 INFO:tasks.workunit.client.0.smithi162.stdout:0/532: rename d0/c2b to d0/df/cb4 0 2024-04-25T01:53:35.950 INFO:tasks.workunit.client.0.smithi162.stdout:9/426: rename d4/d8/d13/f84 to d4/d25/f93 0 2024-04-25T01:53:35.975 INFO:tasks.workunit.client.0.smithi162.stdout:7/478: getdents df/d2c/d49/d7a 0 2024-04-25T01:53:35.993 INFO:tasks.workunit.client.0.smithi162.stdout:3/501: write d2/d9/d10/d4c/d8d/f92 [799702,26654] 0 2024-04-25T01:53:36.113 INFO:tasks.workunit.client.0.smithi162.stdout:0/533: symlink d0/d7b/lb5 0 2024-04-25T01:53:36.693 INFO:tasks.workunit.client.0.smithi162.stdout:9/427: read d4/d25/f54 [1000060,34874] 0 2024-04-25T01:53:37.287 INFO:tasks.workunit.client.0.smithi162.stdout:3/502: symlink d2/d9/d10/d4c/lb1 0 2024-04-25T01:53:37.479 INFO:tasks.workunit.client.0.smithi162.stdout:6/432: dwrite d1/d5c/f5f [0,4194304] 0 2024-04-25T01:53:37.606 INFO:tasks.workunit.client.0.smithi162.stdout:6/433: chown d1/d13/d28/d30/d3a/f3c 305 1 2024-04-25T01:53:37.826 INFO:tasks.workunit.client.0.smithi162.stdout:5/491: write d15/d19/d24/d2b/d3b/f46 [175956,127999] 0 2024-04-25T01:53:38.164 INFO:tasks.workunit.client.0.smithi162.stdout:3/503: creat d2/d9/d10/d4c/d8d/fb2 x:0 0 0 2024-04-25T01:53:38.282 INFO:tasks.workunit.client.0.smithi162.stdout:6/434: creat d1/d13/d28/d45/f8b x:0 0 0 2024-04-25T01:53:38.503 INFO:tasks.workunit.client.0.smithi162.stdout:7/479: write df/f7b [381517,113769] 0 2024-04-25T01:53:38.582 INFO:tasks.workunit.client.0.smithi162.stdout:0/534: write d0/df/d20/d25/f49 [707880,19357] 0 2024-04-25T01:53:38.619 INFO:tasks.workunit.client.0.smithi162.stdout:1/508: dwrite f4 [0,4194304] 0 2024-04-25T01:53:38.728 INFO:tasks.workunit.client.0.smithi162.stdout:4/508: dwrite f7 [0,4194304] 0 2024-04-25T01:53:38.859 INFO:tasks.workunit.client.0.smithi162.stdout:9/428: write d4/d8/d13/f90 [201159,103028] 0 2024-04-25T01:53:38.981 INFO:tasks.workunit.client.0.smithi162.stdout:8/483: dwrite d0/d12/d3a/f6a [0,4194304] 0 2024-04-25T01:53:39.015 INFO:tasks.workunit.client.0.smithi162.stdout:3/504: readlink d2/lf 0 2024-04-25T01:53:39.265 INFO:tasks.workunit.client.0.smithi162.stdout:7/480: symlink df/d2c/d49/l98 0 2024-04-25T01:53:39.351 INFO:tasks.workunit.client.0.smithi162.stdout:8/484: chown d0/d44/d64 1195 1 2024-04-25T01:53:39.521 INFO:tasks.workunit.client.0.smithi162.stdout:1/509: mkdir d15/d1f/d35/d4c/d70/d9f 0 2024-04-25T01:53:39.655 INFO:tasks.workunit.client.0.smithi162.stdout:0/535: creat d0/df/d20/d37/d58/fb6 x:0 0 0 2024-04-25T01:53:39.807 INFO:tasks.workunit.client.0.smithi162.stdout:9/429: rename d4/d25/f54 to d4/d8/d85/f94 0 2024-04-25T01:53:39.948 INFO:tasks.workunit.client.0.smithi162.stdout:7/481: symlink df/d2e/d4c/l99 0 2024-04-25T01:53:40.160 INFO:tasks.workunit.client.0.smithi162.stdout:5/492: dwrite d15/d19/d24/d40/f7b [0,4194304] 0 2024-04-25T01:53:40.281 INFO:tasks.workunit.client.0.smithi162.stdout:6/435: dread d1/d46/f56 [0,4194304] 0 2024-04-25T01:53:40.340 INFO:tasks.workunit.client.0.smithi162.stdout:4/509: link dd/d1a/d34/l63 dd/df/d7e/la7 0 2024-04-25T01:53:40.348 INFO:tasks.workunit.client.0.smithi162.stdout:2/458: dwrite d0/d3/d5/d36/d93/f8f [0,4194304] 0 2024-04-25T01:53:40.406 INFO:tasks.workunit.client.0.smithi162.stdout:1/510: symlink d15/d1f/d35/la0 0 2024-04-25T01:53:40.599 INFO:tasks.workunit.client.0.smithi162.stdout:3/505: mkdir d2/d9/d10/d4c/d51/d63/d87/d90/db3 0 2024-04-25T01:53:40.687 INFO:tasks.workunit.client.0.smithi162.stdout:0/536: symlink d0/df/d20/d25/lb7 0 2024-04-25T01:53:40.805 INFO:tasks.workunit.client.0.smithi162.stdout:4/510: symlink dd/df/d7e/la8 0 2024-04-25T01:53:40.917 INFO:tasks.workunit.client.0.smithi162.stdout:9/430: truncate d4/d9/d15/f5c 3699444 0 2024-04-25T01:53:41.191 INFO:tasks.workunit.client.0.smithi162.stdout:5/493: stat d15/d19/d24/d73/d7a/d7e/c88 0 2024-04-25T01:53:41.342 INFO:tasks.workunit.client.0.smithi162.stdout:6/436: read d1/d13/d28/d30/d3a/f3d [2903109,104053] 0 2024-04-25T01:53:41.464 INFO:tasks.workunit.client.0.smithi162.stdout:6/437: dread d1/f10 [0,4194304] 0 2024-04-25T01:53:41.740 INFO:tasks.workunit.client.0.smithi162.stdout:2/459: mkdir d0/d3/d1b/d1d/d20/d5e/d61/d66/d84/da2 0 2024-04-25T01:53:42.120 INFO:tasks.workunit.client.0.smithi162.stdout:4/511: symlink dd/d1a/d34/d57/la9 0 2024-04-25T01:53:42.235 INFO:tasks.workunit.client.0.smithi162.stdout:9/431: mknod d4/d9/d15/d1b/d69/c95 0 2024-04-25T01:53:43.043 INFO:tasks.workunit.client.0.smithi162.stdout:2/460: read - d0/d3/d1b/d1d/d3a/d63/f79 zero size 2024-04-25T01:53:43.196 INFO:tasks.workunit.client.0.smithi162.stdout:8/485: link d0/d44/d31/d65/f7b d0/f9f 0 2024-04-25T01:53:43.202 INFO:tasks.workunit.client.0.smithi162.stdout:7/482: creat df/f9a x:0 0 0 2024-04-25T01:53:43.226 INFO:tasks.workunit.client.0.smithi162.stdout:3/506: write d2/f71 [672586,102583] 0 2024-04-25T01:53:43.321 INFO:tasks.workunit.client.0.smithi162.stdout:3/507: dread - d2/d29/d5d/f9a zero size 2024-04-25T01:53:43.368 INFO:tasks.workunit.client.0.smithi162.stdout:4/512: stat dd/d1a/d34/l3c 0 2024-04-25T01:53:43.660 INFO:tasks.workunit.client.0.smithi162.stdout:1/511: rmdir d15/d69/d4f/d96 0 2024-04-25T01:53:43.679 INFO:tasks.workunit.client.0.smithi162.stdout:9/432: dread d4/d9/d15/d1b/f2e [0,4194304] 0 2024-04-25T01:53:43.761 INFO:tasks.workunit.client.0.smithi162.stdout:5/494: mknod d15/d19/d24/d2b/d3b/d3c/c9e 0 2024-04-25T01:53:43.984 INFO:tasks.workunit.client.0.smithi162.stdout:0/537: dwrite d0/df/d20/d25/d55/d77/f90 [0,4194304] 0 2024-04-25T01:53:44.111 INFO:tasks.workunit.client.0.smithi162.stdout:6/438: creat d1/d13/d28/d30/d8a/f8c x:0 0 0 2024-04-25T01:53:44.577 INFO:tasks.workunit.client.0.smithi162.stdout:3/508: unlink d2/d9/d10/d4c/d51/d63/d87/c96 0 2024-04-25T01:53:44.589 INFO:tasks.workunit.client.0.smithi162.stdout:4/513: truncate dd/df/d77/f96 315858 0 2024-04-25T01:53:44.700 INFO:tasks.workunit.client.0.smithi162.stdout:7/483: dread df/d2c/d63/f69 [0,4194304] 0 2024-04-25T01:53:44.779 INFO:tasks.workunit.client.0.smithi162.stdout:7/484: dread df/d2e/d4c/d8a/f71 [0,4194304] 0 2024-04-25T01:53:44.851 INFO:tasks.workunit.client.0.smithi162.stdout:0/538: creat d0/df/d20/d25/d55/d77/fb8 x:0 0 0 2024-04-25T01:53:44.891 INFO:tasks.workunit.client.0.smithi162.stdout:6/439: chown d1/f48 1605 1 2024-04-25T01:53:45.206 INFO:tasks.workunit.client.0.smithi162.stdout:9/433: dread d4/d9/fa [0,4194304] 0 2024-04-25T01:53:45.310 INFO:tasks.workunit.client.0.smithi162.stdout:4/514: symlink dd/d1a/d34/d72/laa 0 2024-04-25T01:53:45.415 INFO:tasks.workunit.client.0.smithi162.stdout:3/509: mknod d2/d9/d19/d9d/cb4 0 2024-04-25T01:53:45.709 INFO:tasks.workunit.client.0.smithi162.stdout:7/485: symlink df/d2c/d49/d7a/l9b 0 2024-04-25T01:53:46.292 INFO:tasks.workunit.client.0.smithi162.stdout:0/539: mknod d0/df/d20/d37/d81/cb9 0 2024-04-25T01:53:46.381 INFO:tasks.workunit.client.0.smithi162.stdout:9/434: symlink d4/d8/d85/l96 0 2024-04-25T01:53:46.392 INFO:tasks.workunit.client.0.smithi162.stdout:2/461: write d0/d3/f35 [1634884,19722] 0 2024-04-25T01:53:46.488 INFO:tasks.workunit.client.0.smithi162.stdout:4/515: mknod dd/df/d77/cab 0 2024-04-25T01:53:46.496 INFO:tasks.workunit.client.0.smithi162.stdout:8/486: write d0/d44/d31/f34 [1531515,56093] 0 2024-04-25T01:53:46.947 INFO:tasks.workunit.client.0.smithi162.stdout:7/486: symlink df/d2e/d4c/d58/d82/l9c 0 2024-04-25T01:53:47.380 INFO:tasks.workunit.client.0.smithi162.stdout:1/512: dwrite d15/f1d [0,4194304] 0 2024-04-25T01:53:47.395 INFO:tasks.workunit.client.0.smithi162.stdout:9/435: mknod d4/d9/d15/d1b/d2f/d30/c97 0 2024-04-25T01:53:47.548 INFO:tasks.workunit.client.0.smithi162.stdout:1/513: read d15/f1b [1213647,21873] 0 2024-04-25T01:53:47.586 INFO:tasks.workunit.client.0.smithi162.stdout:4/516: fdatasync dd/df/f49 0 2024-04-25T01:53:48.118 INFO:tasks.workunit.client.0.smithi162.stdout:5/495: link d15/d19/d24/d2b/c99 d15/d19/d24/d73/d7a/d7e/c9f 0 2024-04-25T01:53:48.422 INFO:tasks.workunit.client.0.smithi162.stdout:3/510: rename d2/d9/d19/d9d to d2/d9/d10/d2c/da3/db5 0 2024-04-25T01:53:48.446 INFO:tasks.workunit.client.0.smithi162.stdout:0/540: creat d0/d1/d4e/d76/db0/fba x:0 0 0 2024-04-25T01:53:48.604 INFO:tasks.workunit.client.0.smithi162.stdout:2/462: creat d0/d3/d1b/d6b/d92/d9a/fa3 x:0 0 0 2024-04-25T01:53:48.678 INFO:tasks.workunit.client.0.smithi162.stdout:3/511: sync 2024-04-25T01:53:49.176 INFO:tasks.workunit.client.0.smithi162.stdout:6/440: dwrite d1/f24 [0,4194304] 0 2024-04-25T01:53:49.317 INFO:tasks.workunit.client.0.smithi162.stdout:0/541: dread - d0/df/f96 zero size 2024-04-25T01:53:49.438 INFO:tasks.workunit.client.0.smithi162.stdout:2/463: rmdir d0/d3 39 2024-04-25T01:53:49.681 INFO:tasks.workunit.client.0.smithi162.stdout:1/514: mknod d15/d1f/d23/ca1 0 2024-04-25T01:53:50.040 INFO:tasks.workunit.client.0.smithi162.stdout:3/512: rename d2/d29/d5d/d7b to d2/d9/d10/d4c/d51/d63/d87/db6 0 2024-04-25T01:53:50.165 INFO:tasks.workunit.client.0.smithi162.stdout:6/441: dread - d1/d13/d28/d30/d3a/f5b zero size 2024-04-25T01:53:50.288 INFO:tasks.workunit.client.0.smithi162.stdout:0/542: fsync d0/df/d20/d37/d58/f7a 0 2024-04-25T01:53:50.387 INFO:tasks.workunit.client.0.smithi162.stdout:8/487: write d0/d12/d3a/f76 [257471,116345] 0 2024-04-25T01:53:50.445 INFO:tasks.workunit.client.0.smithi162.stdout:9/436: creat d4/d8/d13/f98 x:0 0 0 2024-04-25T01:53:50.456 INFO:tasks.workunit.client.0.smithi162.stdout:8/488: chown d0/d12/f7e 1887 1 2024-04-25T01:53:50.536 INFO:tasks.workunit.client.0.smithi162.stdout:2/464: readlink d0/l14 0 2024-04-25T01:53:50.647 INFO:tasks.workunit.client.0.smithi162.stdout:1/515: read d15/d1f/d23/f25 [1311651,3554] 0 2024-04-25T01:53:50.679 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:53:50.684 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:53:51.159 INFO:tasks.workunit.client.0.smithi162.stdout:7/487: write df/f28 [1994678,13177] 0 2024-04-25T01:53:51.316 INFO:tasks.workunit.client.0.smithi162.stdout:6/442: fdatasync d1/d13/d28/d30/d3a/f3d 0 2024-04-25T01:53:51.638 INFO:tasks.workunit.client.0.smithi162.stdout:0/543: fdatasync d0/df/d20/d25/d55/d77/f90 0 2024-04-25T01:53:51.688 INFO:tasks.workunit.client.0.smithi162.stdout:0/544: chown d0/df/d20/d37/d58/f95 681 1 2024-04-25T01:53:51.762 INFO:tasks.workunit.client.0.smithi162.stdout:8/489: dread - d0/f90 zero size 2024-04-25T01:53:52.115 INFO:tasks.workunit.client.0.smithi162.stdout:1/516: creat d15/d1f/d23/d30/d4a/d7f/d97/fa2 x:0 0 0 2024-04-25T01:53:52.482 INFO:tasks.workunit.client.0.smithi162.stdout:5/496: write d15/f2f [207327,39327] 0 2024-04-25T01:53:52.534 INFO:tasks.workunit.client.0.smithi162.stdout:6/443: truncate d1/d13/f42 3299401 0 2024-04-25T01:53:52.587 INFO:tasks.workunit.client.0.smithi162.stdout:0/545: truncate d0/df/d20/d25/f4d 1246165 0 2024-04-25T01:53:52.624 INFO:tasks.workunit.client.0.smithi162.stdout:0/546: chown d0/df/d20/d37/d58/fb6 0 1 2024-04-25T01:53:53.143 INFO:tasks.workunit.client.0.smithi162.stdout:5/497: dread - d15/d1e/f8a zero size 2024-04-25T01:53:53.340 INFO:tasks.workunit.client.0.smithi162.stdout:6/444: truncate d1/f68 2238273 0 2024-04-25T01:53:53.462 INFO:tasks.workunit.client.0.smithi162.stdout:0/547: creat d0/d1/d4e/fbb x:0 0 0 2024-04-25T01:53:53.893 INFO:tasks.workunit.client.0.smithi162.stdout:6/445: symlink d1/d46/d7a/l8d 0 2024-04-25T01:53:54.155 INFO:tasks.workunit.client.0.smithi162.stdout:4/517: mknod dd/cac 0 2024-04-25T01:53:54.378 INFO:tasks.workunit.client.0.smithi162.stdout:3/513: dwrite d2/d9/d99/f75 [8388608,4194304] 0 2024-04-25T01:53:54.711 INFO:tasks.workunit.client.0.smithi162.stdout:9/437: write d4/d9/d15/d4e/f66 [4706276,45438] 0 2024-04-25T01:53:54.745 INFO:tasks.workunit.client.0.smithi162.stdout:7/488: write df/d2e/d4c/d58/f88 [854322,129014] 0 2024-04-25T01:53:54.829 INFO:tasks.workunit.client.0.smithi162.stdout:8/490: write d0/f75 [2347073,78500] 0 2024-04-25T01:53:54.848 INFO:tasks.workunit.client.0.smithi162.stdout:5/498: write d15/d19/d24/d2b/d3b/d58/f5c [568910,74691] 0 2024-04-25T01:53:54.963 INFO:tasks.workunit.client.0.smithi162.stdout:2/465: rename d0/d3/d1b/d1d/d20/d42/d57 to d0/d3/d1b/d1d/d20/d5e/d61/da4 0 2024-04-25T01:53:54.967 INFO:tasks.workunit.client.0.smithi162.stdout:8/491: chown d0/d44/d31 475 1 2024-04-25T01:53:55.396 INFO:tasks.workunit.client.0.smithi162.stdout:6/446: symlink d1/l8e 0 2024-04-25T01:53:55.484 INFO:tasks.workunit.client.0.smithi162.stdout:3/514: rmdir d2/d9/d10/d4c 39 2024-04-25T01:53:55.813 INFO:tasks.workunit.client.0.smithi162.stdout:7/489: fsync df/d2e/d4c/d8a/f61 0 2024-04-25T01:53:55.846 INFO:tasks.workunit.client.0.smithi162.stdout:3/515: sync 2024-04-25T01:53:56.263 INFO:tasks.workunit.client.0.smithi162.stdout:1/517: rename d15/c17 to d15/d1f/d23/d30/d4a/ca3 0 2024-04-25T01:53:56.288 INFO:tasks.workunit.client.0.smithi162.stdout:1/518: stat d15/d1f/d35/l3d 0 2024-04-25T01:53:56.776 INFO:tasks.workunit.client.0.smithi162.stdout:0/548: creat d0/df/d20/fbc x:0 0 0 2024-04-25T01:53:56.818 INFO:tasks.workunit.client.0.smithi162.stdout:0/549: dread - d0/d1/d64/f9c zero size 2024-04-25T01:53:57.984 INFO:tasks.workunit.client.0.smithi162.stdout:9/438: write d4/d25/f6e [2136133,49217] 0 2024-04-25T01:53:57.984 INFO:tasks.workunit.client.0.smithi162.stdout:8/492: creat d0/d12/d2b/d87/fa0 x:0 0 0 2024-04-25T01:53:58.192 INFO:tasks.workunit.client.0.smithi162.stdout:4/518: creat dd/df/d2e/fad x:0 0 0 2024-04-25T01:53:58.368 INFO:tasks.workunit.client.0.smithi162.stdout:0/550: unlink d0/df/d20/d37/d58/f7a 0 2024-04-25T01:53:59.033 INFO:tasks.workunit.client.0.smithi162.stdout:6/447: dwrite d1/f48 [0,4194304] 0 2024-04-25T01:53:59.183 INFO:tasks.workunit.client.0.smithi162.stdout:5/499: write d15/d19/d24/d2b/d3b/d58/f7d [978477,111909] 0 2024-04-25T01:53:59.188 INFO:tasks.workunit.client.0.smithi162.stdout:7/490: write df/d2c/f36 [588451,70789] 0 2024-04-25T01:53:59.205 INFO:tasks.workunit.client.0.smithi162.stdout:2/466: write d0/d3/d5/d69/f7e [863682,38048] 0 2024-04-25T01:53:59.403 INFO:tasks.workunit.client.0.smithi162.stdout:3/516: dread d2/d9/d10/d4c/d51/d63/d87/d86/f9b [0,4194304] 0 2024-04-25T01:53:59.616 INFO:tasks.workunit.client.0.smithi162.stdout:4/519: mknod dd/df/d2e/d4b/d79/cae 0 2024-04-25T01:53:59.635 INFO:tasks.workunit.client.0.smithi162.stdout:0/551: fsync d0/df/d20/d25/d55/d77/f90 0 2024-04-25T01:53:59.758 INFO:tasks.workunit.client.0.smithi162.stdout:9/439: dread d4/f39 [0,4194304] 0 2024-04-25T01:54:00.045 INFO:tasks.workunit.client.0.smithi162.stdout:2/467: creat d0/d3/d1b/d6b/fa5 x:0 0 0 2024-04-25T01:54:00.077 INFO:tasks.workunit.client.0.smithi162.stdout:1/519: creat d15/fa4 x:0 0 0 2024-04-25T01:54:00.201 INFO:tasks.workunit.client.0.smithi162.stdout:7/491: symlink df/d2c/l9d 0 2024-04-25T01:54:00.595 INFO:tasks.workunit.client.0.smithi162.stdout:9/440: rename d4/d9/d15/d1b/d2f/d30/c3c to d4/d25/c99 0 2024-04-25T01:54:00.857 INFO:tasks.workunit.client.0.smithi162.stdout:6/448: write d1/d13/d28/d30/f4e [329115,108661] 0 2024-04-25T01:54:01.069 INFO:tasks.workunit.client.0.smithi162.stdout:5/500: dwrite d15/f65 [0,4194304] 0 2024-04-25T01:54:01.380 INFO:tasks.workunit.client.0.smithi162.stdout:3/517: write d2/d29/d5d/f68 [3279688,125367] 0 2024-04-25T01:54:01.759 INFO:tasks.workunit.client.0.smithi162.stdout:0/552: write d0/df/d20/d25/d55/f5a [1278293,117712] 0 2024-04-25T01:54:01.976 INFO:tasks.workunit.client.0.smithi162.stdout:4/520: dwrite dd/df/d2e/f2f [4194304,4194304] 0 2024-04-25T01:54:02.281 INFO:tasks.workunit.client.0.smithi162.stdout:2/468: fdatasync d0/d3/d1b/d1d/d3a/f3b 0 2024-04-25T01:54:03.490 INFO:tasks.workunit.client.0.smithi162.stdout:4/521: dread dd/df/d77/f96 [0,4194304] 0 2024-04-25T01:54:03.564 INFO:tasks.workunit.client.0.smithi162.stdout:1/520: write d15/d1f/d35/d4c/f6f [2696171,73723] 0 2024-04-25T01:54:03.773 INFO:tasks.workunit.client.0.smithi162.stdout:8/493: write d0/d1a/fd [3741602,42608] 0 2024-04-25T01:54:03.774 INFO:tasks.workunit.client.0.smithi162.stdout:2/469: creat d0/d3/d1b/d1d/d20/d5e/d61/da4/fa6 x:0 0 0 2024-04-25T01:54:03.798 INFO:tasks.workunit.client.0.smithi162.stdout:7/492: write df/f43 [2117459,68282] 0 2024-04-25T01:54:03.851 INFO:tasks.workunit.client.0.smithi162.stdout:6/449: mknod d1/d73/c8f 0 2024-04-25T01:54:03.867 INFO:tasks.workunit.client.0.smithi162.stdout:7/493: stat df/f2d 0 2024-04-25T01:54:04.104 INFO:tasks.workunit.client.0.smithi162.stdout:3/518: symlink d2/d9/d19/lb7 0 2024-04-25T01:54:04.126 INFO:tasks.workunit.client.0.smithi162.stdout:9/441: write d4/d9/f47 [2329636,88430] 0 2024-04-25T01:54:04.763 INFO:tasks.workunit.client.0.smithi162.stdout:2/470: mknod d0/d3/d5/d69/ca7 0 2024-04-25T01:54:04.934 INFO:tasks.workunit.client.0.smithi162.stdout:5/501: rename d15/d19/d24/d2b/d3b/d58/f7d to d15/d19/d24/d2b/fa0 0 2024-04-25T01:54:05.112 INFO:tasks.workunit.client.0.smithi162.stdout:7/494: creat df/d2e/d4c/f9e x:0 0 0 2024-04-25T01:54:05.173 INFO:tasks.workunit.client.0.smithi162.stdout:1/521: dread d15/d1f/d23/f64 [0,4194304] 0 2024-04-25T01:54:05.316 INFO:tasks.workunit.client.0.smithi162.stdout:5/502: chown d15/d19/d24/d2b/d3b/d3c/c9e 216 1 2024-04-25T01:54:05.429 INFO:tasks.workunit.client.0.smithi162.stdout:3/519: truncate d2/d9/d10/d4c/d51/d63/d87/d86/fa4 264573 0 2024-04-25T01:54:05.526 INFO:tasks.workunit.client.0.smithi162.stdout:0/553: dwrite d0/d1/d4b/f85 [0,4194304] 0 2024-04-25T01:54:05.650 INFO:tasks.workunit.client.0.smithi162.stdout:3/520: stat d2/d9/d10/d4c/f57 0 2024-04-25T01:54:05.691 INFO:tasks.workunit.client.0.smithi162.stdout:2/471: rmdir d0/d3/d7a/d88 39 2024-04-25T01:54:05.720 INFO:tasks.workunit.client.0.smithi162.stdout:3/521: write d2/d29/d5d/f68 [676724,27829] 0 2024-04-25T01:54:05.755 INFO:tasks.workunit.client.0.smithi162.stdout:6/450: getdents d1/d46/d7a/d85 0 2024-04-25T01:54:05.819 INFO:tasks.workunit.client.0.smithi162.stdout:0/554: sync 2024-04-25T01:54:06.525 INFO:tasks.workunit.client.0.smithi162.stdout:7/495: write df/d2c/f36 [1921555,125765] 0 2024-04-25T01:54:06.824 INFO:tasks.workunit.client.0.smithi162.stdout:4/522: dwrite dd/df/f52 [0,4194304] 0 2024-04-25T01:54:06.946 INFO:tasks.workunit.client.0.smithi162.stdout:8/494: creat d0/fa1 x:0 0 0 2024-04-25T01:54:07.122 INFO:tasks.workunit.client.0.smithi162.stdout:5/503: rmdir d15/d19/d24/d2b 39 2024-04-25T01:54:07.381 INFO:tasks.workunit.client.0.smithi162.stdout:6/451: creat d1/d46/d7a/f90 x:0 0 0 2024-04-25T01:54:07.529 INFO:tasks.workunit.client.0.smithi162.stdout:3/522: dread d2/d29/d2e/f31 [0,4194304] 0 2024-04-25T01:54:07.545 INFO:tasks.workunit.client.0.smithi162.stdout:3/523: readlink d2/lc 0 2024-04-25T01:54:07.630 INFO:tasks.workunit.client.0.smithi162.stdout:0/555: truncate d0/df/d20/f45 1550248 0 2024-04-25T01:54:07.655 INFO:tasks.workunit.client.0.smithi162.stdout:0/556: stat d0/d1/d4e/f86 0 2024-04-25T01:54:08.196 INFO:tasks.workunit.client.0.smithi162.stdout:4/523: mknod dd/df/d7e/caf 0 2024-04-25T01:54:08.820 INFO:tasks.workunit.client.0.smithi162.stdout:3/524: truncate d2/f8e 2094058 0 2024-04-25T01:54:08.859 INFO:tasks.workunit.client.0.smithi162.stdout:6/452: read d1/f25 [460121,16038] 0 2024-04-25T01:54:08.970 INFO:tasks.workunit.client.0.smithi162.stdout:2/472: getdents d0/d3/d1b/d1d/d20/d67/d9c 0 2024-04-25T01:54:09.190 INFO:tasks.workunit.client.0.smithi162.stdout:0/557: creat d0/d1/d4e/d76/db0/fbd x:0 0 0 2024-04-25T01:54:09.245 INFO:tasks.workunit.client.0.smithi162.stdout:9/442: getdents d4/d9/d15/d4e 0 2024-04-25T01:54:09.522 INFO:tasks.workunit.client.0.smithi162.stdout:7/496: getdents df/d2e/d4c/d58/d93 0 2024-04-25T01:54:09.596 INFO:tasks.workunit.client.0.smithi162.stdout:4/524: chown dd/d1a/d34/l63 22557747 1 2024-04-25T01:54:10.016 INFO:tasks.workunit.client.0.smithi162.stdout:2/473: dread d0/d3/d1b/d1d/d20/d5e/f96 [0,4194304] 0 2024-04-25T01:54:10.065 INFO:tasks.workunit.client.0.smithi162.stdout:1/522: creat d15/fa5 x:0 0 0 2024-04-25T01:54:10.611 INFO:tasks.workunit.client.0.smithi162.stdout:8/495: dwrite d0/d12/d1b/f1f [0,4194304] 0 2024-04-25T01:54:10.708 INFO:tasks.workunit.client.0.smithi162.stdout:9/443: creat d4/d9/d15/d1b/f9a x:0 0 0 2024-04-25T01:54:10.730 INFO:tasks.workunit.client.0.smithi162.stdout:7/497: creat df/d2c/d63/d83/d8b/f9f x:0 0 0 2024-04-25T01:54:10.880 INFO:tasks.workunit.client.0.smithi162.stdout:5/504: dread - d15/d19/d24/d2b/d3b/f91 zero size 2024-04-25T01:54:11.035 INFO:tasks.workunit.client.0.smithi162.stdout:6/453: symlink d1/d46/d7a/d85/l91 0 2024-04-25T01:54:11.245 INFO:tasks.workunit.client.0.smithi162.stdout:6/454: dread d1/f25 [0,4194304] 0 2024-04-25T01:54:11.416 INFO:tasks.workunit.client.0.smithi162.stdout:0/558: creat d0/d1/dab/fbe x:0 0 0 2024-04-25T01:54:11.560 INFO:tasks.workunit.client.0.smithi162.stdout:0/559: sync 2024-04-25T01:54:11.649 INFO:tasks.workunit.client.0.smithi162.stdout:0/560: sync 2024-04-25T01:54:11.971 INFO:tasks.workunit.client.0.smithi162.stdout:9/444: symlink d4/d9/d15/d71/l9b 0 2024-04-25T01:54:11.982 INFO:tasks.workunit.client.0.smithi162.stdout:3/525: dwrite d2/d9/d19/f73 [4194304,4194304] 0 2024-04-25T01:54:12.210 INFO:tasks.workunit.client.0.smithi162.stdout:2/474: unlink d0/d3/d1b/d1d/d20/d67/c68 0 2024-04-25T01:54:12.388 INFO:tasks.workunit.client.0.smithi162.stdout:6/455: symlink d1/d5c/l92 0 2024-04-25T01:54:13.286 INFO:tasks.workunit.client.0.smithi162.stdout:4/525: dwrite dd/df/d2e/f2f [0,4194304] 0 2024-04-25T01:54:13.879 INFO:tasks.workunit.client.0.smithi162.stdout:6/456: dread - d1/d13/d28/d45/f8b zero size 2024-04-25T01:54:13.943 INFO:tasks.workunit.client.0.smithi162.stdout:5/505: rmdir d15/d19/d24/d4d 39 2024-04-25T01:54:14.039 INFO:tasks.workunit.client.0.smithi162.stdout:1/523: creat d15/d1f/d23/fa6 x:0 0 0 2024-04-25T01:54:14.172 INFO:tasks.workunit.client.0.smithi162.stdout:0/561: mknod d0/d59/d7e/d9f/cbf 0 2024-04-25T01:54:14.195 INFO:tasks.workunit.client.0.smithi162.stdout:0/562: stat d0/d1/d4b/l54 0 2024-04-25T01:54:14.863 INFO:tasks.workunit.client.0.smithi162.stdout:4/526: rename dd/df/d58/c5f to dd/df/d58/cb0 0 2024-04-25T01:54:15.027 INFO:tasks.workunit.client.0.smithi162.stdout:6/457: mkdir d1/d13/d28/d45/d59/d93 0 2024-04-25T01:54:15.507 INFO:tasks.workunit.client.0.smithi162.stdout:0/563: truncate d0/df/d20/d25/f49 330923 0 2024-04-25T01:54:15.557 INFO:tasks.workunit.client.0.smithi162.stdout:7/498: link df/d2c/l31 df/d2c/la0 0 2024-04-25T01:54:15.589 INFO:tasks.workunit.client.0.smithi162.stdout:0/564: read d0/df/d20/d37/f5b [581235,92037] 0 2024-04-25T01:54:15.616 INFO:tasks.workunit.client.0.smithi162.stdout:7/499: read df/f15 [4755756,9758] 0 2024-04-25T01:54:15.779 INFO:tasks.workunit.client.0.smithi162.stdout:3/526: rename d2/lc to d2/d9/lb8 0 2024-04-25T01:54:16.083 INFO:tasks.workunit.client.0.smithi162.stdout:6/458: readlink d1/d46/l49 0 2024-04-25T01:54:16.127 INFO:tasks.workunit.client.0.smithi162.stdout:2/475: write d0/d3/d5/f81 [896578,5690] 0 2024-04-25T01:54:16.156 INFO:tasks.workunit.client.0.smithi162.stdout:9/445: dwrite d4/f21 [0,4194304] 0 2024-04-25T01:54:16.259 INFO:tasks.workunit.client.0.smithi162.stdout:2/476: sync 2024-04-25T01:54:16.295 INFO:tasks.workunit.client.0.smithi162.stdout:0/565: mknod d0/df/d20/d37/d58/cc0 0 2024-04-25T01:54:16.474 INFO:tasks.workunit.client.0.smithi162.stdout:7/500: mknod df/d2c/d63/d83/d8b/ca1 0 2024-04-25T01:54:16.501 INFO:tasks.workunit.client.0.smithi162.stdout:5/506: creat d15/d19/d24/d2b/d3b/d3c/fa1 x:0 0 0 2024-04-25T01:54:16.549 INFO:tasks.workunit.client.0.smithi162.stdout:7/501: chown df/f12 10433633 1 2024-04-25T01:54:16.835 INFO:tasks.workunit.client.0.smithi162.stdout:5/507: dread d15/d1e/f22 [0,4194304] 0 2024-04-25T01:54:16.938 INFO:tasks.workunit.client.0.smithi162.stdout:6/459: symlink d1/d13/d28/d30/d3a/d57/l94 0 2024-04-25T01:54:16.940 INFO:tasks.workunit.client.0.smithi162.stdout:9/446: fsync d4/d8/d13/f98 0 2024-04-25T01:54:17.058 INFO:tasks.workunit.client.0.smithi162.stdout:2/477: mknod d0/d3/d1b/d6b/ca8 0 2024-04-25T01:54:17.706 INFO:tasks.workunit.client.0.smithi162.stdout:7/502: mkdir df/d2c/d63/d83/d8b/da2 0 2024-04-25T01:54:17.871 INFO:tasks.workunit.client.0.smithi162.stdout:5/508: chown d15/d19/d24/c4a 229037919 1 2024-04-25T01:54:17.887 INFO:tasks.workunit.client.0.smithi162.stdout:5/509: stat d15/l1d 0 2024-04-25T01:54:17.956 INFO:tasks.workunit.client.0.smithi162.stdout:8/496: rmdir d0/d12 39 2024-04-25T01:54:18.292 INFO:tasks.workunit.client.0.smithi162.stdout:1/524: dwrite d15/d1f/d23/f64 [0,4194304] 0 2024-04-25T01:54:18.662 INFO:tasks.workunit.client.0.smithi162.stdout:4/527: write dd/d1a/f20 [1750928,112385] 0 2024-04-25T01:54:18.702 INFO:tasks.workunit.client.0.smithi162.stdout:7/503: fsync df/f28 0 2024-04-25T01:54:18.769 INFO:tasks.workunit.client.0.smithi162.stdout:5/510: truncate f11 4830203 0 2024-04-25T01:54:18.844 INFO:tasks.workunit.client.0.smithi162.stdout:4/528: sync 2024-04-25T01:54:18.984 INFO:tasks.workunit.client.0.smithi162.stdout:9/447: creat d4/d9/d15/d4e/d59/f9c x:0 0 0 2024-04-25T01:54:19.608 INFO:tasks.workunit.client.0.smithi162.stdout:7/504: chown df/l27 387549934 1 2024-04-25T01:54:19.768 INFO:tasks.workunit.client.0.smithi162.stdout:3/527: dwrite d2/d29/d2e/f7a [4194304,4194304] 0 2024-04-25T01:54:19.917 INFO:tasks.workunit.client.0.smithi162.stdout:7/505: chown df/d2c/d63/d83/d8b/d90/f97 222 1 2024-04-25T01:54:20.038 INFO:tasks.workunit.client.0.smithi162.stdout:8/497: readlink d0/d12/d1b/l68 0 2024-04-25T01:54:20.079 INFO:tasks.workunit.client.0.smithi162.stdout:8/498: read d0/d44/f15 [5237435,2001] 0 2024-04-25T01:54:20.142 INFO:tasks.workunit.client.0.smithi162.stdout:4/529: mkdir dd/d1a/d34/db1 0 2024-04-25T01:54:20.166 INFO:tasks.workunit.client.0.smithi162.stdout:0/566: write d0/df/f66 [5154597,32418] 0 2024-04-25T01:54:20.194 INFO:tasks.workunit.client.0.smithi162.stdout:2/478: rename d0/d3/d1b/f22 to d0/fa9 0 2024-04-25T01:54:20.802 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:54:20.805 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:54:21.039 INFO:tasks.workunit.client.0.smithi162.stdout:1/525: link d15/d1f/d35/c55 d15/d1f/d35/d4c/ca7 0 2024-04-25T01:54:21.062 INFO:tasks.workunit.client.0.smithi162.stdout:4/530: symlink dd/d1a/d4e/lb2 0 2024-04-25T01:54:21.152 INFO:tasks.workunit.client.0.smithi162.stdout:2/479: symlink d0/d3/d1b/d1d/d20/d5e/d61/d62/laa 0 2024-04-25T01:54:21.239 INFO:tasks.workunit.client.0.smithi162.stdout:4/531: sync 2024-04-25T01:54:21.302 INFO:tasks.workunit.client.0.smithi162.stdout:6/460: dwrite d1/fe [0,4194304] 0 2024-04-25T01:54:21.724 INFO:tasks.workunit.client.0.smithi162.stdout:8/499: rename d0/d44/d91/f56 to d0/fa2 0 2024-04-25T01:54:21.911 INFO:tasks.workunit.client.0.smithi162.stdout:1/526: dread d15/d1f/f27 [0,4194304] 0 2024-04-25T01:54:22.288 INFO:tasks.workunit.client.0.smithi162.stdout:8/500: dread d0/d12/f24 [0,4194304] 0 2024-04-25T01:54:22.798 INFO:tasks.workunit.client.0.smithi162.stdout:4/532: unlink dd/df/d2e/d4b/f94 0 2024-04-25T01:54:23.035 INFO:tasks.workunit.client.0.smithi162.stdout:1/527: unlink d15/d1f/d23/d30/f78 0 2024-04-25T01:54:23.041 INFO:tasks.workunit.client.0.smithi162.stdout:5/511: dwrite d15/f17 [0,4194304] 0 2024-04-25T01:54:23.271 INFO:tasks.workunit.client.0.smithi162.stdout:9/448: write d4/f6c [164134,9872] 0 2024-04-25T01:54:23.642 INFO:tasks.workunit.client.0.smithi162.stdout:4/533: dread dd/d1a/d4e/d93/fa5 [0,4194304] 0 2024-04-25T01:54:23.658 INFO:tasks.workunit.client.0.smithi162.stdout:4/534: readlink dd/le 0 2024-04-25T01:54:23.765 INFO:tasks.workunit.client.0.smithi162.stdout:1/528: readlink d15/d1f/d35/d4c/l9d 0 2024-04-25T01:54:23.784 INFO:tasks.workunit.client.0.smithi162.stdout:5/512: creat d15/d19/d24/d2b/d3b/d80/fa2 x:0 0 0 2024-04-25T01:54:23.991 INFO:tasks.workunit.client.0.smithi162.stdout:3/528: write d2/d9/d10/d4c/d51/f7e [1032201,129802] 0 2024-04-25T01:54:23.996 INFO:tasks.workunit.client.0.smithi162.stdout:9/449: dread - d4/d8/d13/f89 zero size 2024-04-25T01:54:24.067 INFO:tasks.workunit.client.0.smithi162.stdout:3/529: dread - d2/d29/d5d/f9a zero size 2024-04-25T01:54:24.211 INFO:tasks.workunit.client.0.smithi162.stdout:6/461: link d1/d13/l86 d1/d13/l95 0 2024-04-25T01:54:24.223 INFO:tasks.workunit.client.0.smithi162.stdout:7/506: write df/d2c/d63/f69 [4005640,48362] 0 2024-04-25T01:54:24.367 INFO:tasks.workunit.client.0.smithi162.stdout:1/529: dread - d15/d1f/d35/d4c/d70/d73/f9b zero size 2024-04-25T01:54:24.645 INFO:tasks.workunit.client.0.smithi162.stdout:3/530: mknod d2/d9/d10/d4c/d51/cb9 0 2024-04-25T01:54:24.659 INFO:tasks.workunit.client.0.smithi162.stdout:9/450: chown d4/d8/d13/f53 23 1 2024-04-25T01:54:24.698 INFO:tasks.workunit.client.0.smithi162.stdout:0/567: dwrite d0/d1/d4e/d76/db0/fba [0,4194304] 0 2024-04-25T01:54:25.426 INFO:tasks.workunit.client.0.smithi162.stdout:1/530: mknod d15/d1f/d35/d4c/d70/d73/ca8 0 2024-04-25T01:54:25.435 INFO:tasks.workunit.client.0.smithi162.stdout:2/480: write d0/d3/d5/d36/d93/f8f [3360500,20270] 0 2024-04-25T01:54:25.492 INFO:tasks.workunit.client.0.smithi162.stdout:9/451: readlink d4/d8/d13/l2c 0 2024-04-25T01:54:25.518 INFO:tasks.workunit.client.0.smithi162.stdout:1/531: chown d15/f1a 143 1 2024-04-25T01:54:25.541 INFO:tasks.workunit.client.0.smithi162.stdout:4/535: link dd/df/f30 dd/d1a/d4e/fb3 0 2024-04-25T01:54:25.784 INFO:tasks.workunit.client.0.smithi162.stdout:5/513: rename d15/f2f to d15/fa3 0 2024-04-25T01:54:25.930 INFO:tasks.workunit.client.0.smithi162.stdout:0/568: symlink d0/d59/d7e/d9f/lc1 0 2024-04-25T01:54:25.950 INFO:tasks.workunit.client.0.smithi162.stdout:3/531: rename d2/d9/d10/d40 to d2/d9/d10/d2c/da3/dba 0 2024-04-25T01:54:26.042 INFO:tasks.workunit.client.0.smithi162.stdout:2/481: dread d0/d3/d1b/d1d/d20/d42/f43 [0,4194304] 0 2024-04-25T01:54:26.094 INFO:tasks.workunit.client.0.smithi162.stdout:6/462: fsync d1/d13/f50 0 2024-04-25T01:54:26.239 INFO:tasks.workunit.client.0.smithi162.stdout:2/482: chown d0/d3/d1b/d1d/d20/d5e/d61/d66/d84/da2 32786944 1 2024-04-25T01:54:26.423 INFO:tasks.workunit.client.0.smithi162.stdout:9/452: creat d4/d9/d15/d1b/d2f/d30/f9d x:0 0 0 2024-04-25T01:54:26.580 INFO:tasks.workunit.client.0.smithi162.stdout:5/514: mknod d15/d19/ca4 0 2024-04-25T01:54:26.929 INFO:tasks.workunit.client.0.smithi162.stdout:3/532: chown d2/d9/lb8 0 1 2024-04-25T01:54:27.180 INFO:tasks.workunit.client.0.smithi162.stdout:8/501: dwrite d0/fa1 [0,4194304] 0 2024-04-25T01:54:27.358 INFO:tasks.workunit.client.0.smithi162.stdout:0/569: rename d0/d59/d7e/l97 to d0/df/d20/d25/d55/d6f/d7d/da7/lc2 0 2024-04-25T01:54:27.841 INFO:tasks.workunit.client.0.smithi162.stdout:2/483: dread d0/d3/d5/f18 [4194304,4194304] 0 2024-04-25T01:54:27.841 INFO:tasks.workunit.client.0.smithi162.stdout:9/453: creat d4/d9/d15/d1b/d69/f9e x:0 0 0 2024-04-25T01:54:27.895 INFO:tasks.workunit.client.0.smithi162.stdout:2/484: chown d0/d3/d1b/f21 15712 1 2024-04-25T01:54:28.329 INFO:tasks.workunit.client.0.smithi162.stdout:7/507: getdents df/d2e/d4c/d58 0 2024-04-25T01:54:28.895 INFO:tasks.workunit.client.0.smithi162.stdout:3/533: dread d2/d29/d5d/f68 [0,4194304] 0 2024-04-25T01:54:29.061 INFO:tasks.workunit.client.0.smithi162.stdout:9/454: rmdir d4/d8/d85 39 2024-04-25T01:54:29.076 INFO:tasks.workunit.client.0.smithi162.stdout:3/534: sync 2024-04-25T01:54:29.174 INFO:tasks.workunit.client.0.smithi162.stdout:1/532: creat d15/d1f/d23/d30/d4a/fa9 x:0 0 0 2024-04-25T01:54:29.280 INFO:tasks.workunit.client.0.smithi162.stdout:0/570: dread d0/d1/d4b/f4f [0,4194304] 0 2024-04-25T01:54:29.347 INFO:tasks.workunit.client.0.smithi162.stdout:1/533: stat d15/d1f/d23/d30/d4a/f58 0 2024-04-25T01:54:29.528 INFO:tasks.workunit.client.0.smithi162.stdout:8/502: mkdir d0/d12/d1b/d74/d8a/da3 0 2024-04-25T01:54:29.742 INFO:tasks.workunit.client.0.smithi162.stdout:6/463: rename d1/d13/c14 to d1/d13/d28/d45/c96 0 2024-04-25T01:54:29.960 INFO:tasks.workunit.client.0.smithi162.stdout:4/536: write dd/df/d2e/d59/f9f [420981,2449] 0 2024-04-25T01:54:30.389 INFO:tasks.workunit.client.0.smithi162.stdout:9/455: unlink d4/d9/d15/d4e/f66 0 2024-04-25T01:54:30.423 INFO:tasks.workunit.client.0.smithi162.stdout:3/535: creat d2/d9/d10/d4c/d51/d63/d87/d90/fbb x:0 0 0 2024-04-25T01:54:30.518 INFO:tasks.workunit.client.0.smithi162.stdout:1/534: mknod d15/d1f/d23/d30/d4a/d7f/caa 0 2024-04-25T01:54:30.692 INFO:tasks.workunit.client.0.smithi162.stdout:8/503: unlink d0/d12/f94 0 2024-04-25T01:54:31.302 INFO:tasks.workunit.client.0.smithi162.stdout:2/485: rename d0/d3/d1b/d6b/ca1 to d0/d3/d1b/d1d/d20/d5e/d61/d66/cab 0 2024-04-25T01:54:31.464 INFO:tasks.workunit.client.0.smithi162.stdout:6/464: fsync d1/d13/f50 0 2024-04-25T01:54:31.736 INFO:tasks.workunit.client.0.smithi162.stdout:5/515: write d15/d19/d24/d2b/d3b/d3c/d3f/f43 [2895912,26032] 0 2024-04-25T01:54:31.905 INFO:tasks.workunit.client.0.smithi162.stdout:3/536: fsync d2/d9/d10/f95 0 2024-04-25T01:54:31.933 INFO:tasks.workunit.client.0.smithi162.stdout:3/537: chown d2/d9 1 1 2024-04-25T01:54:32.558 INFO:tasks.workunit.client.0.smithi162.stdout:7/508: link df/d2c/d49/c4b df/d2c/ca3 0 2024-04-25T01:54:32.715 INFO:tasks.workunit.client.0.smithi162.stdout:0/571: creat d0/d1/fc3 x:0 0 0 2024-04-25T01:54:33.449 INFO:tasks.workunit.client.0.smithi162.stdout:2/486: symlink d0/d3/d1b/d6b/d9e/lac 0 2024-04-25T01:54:33.629 INFO:tasks.workunit.client.0.smithi162.stdout:3/538: dread d2/d9/d10/d4c/d51/d63/d87/d86/fa2 [0,4194304] 0 2024-04-25T01:54:34.027 INFO:tasks.workunit.client.0.smithi162.stdout:0/572: dread - d0/df/d20/d25/d55/d77/fb8 zero size 2024-04-25T01:54:34.204 INFO:tasks.workunit.client.0.smithi162.stdout:5/516: dread d15/d19/d24/d73/f82 [0,4194304] 0 2024-04-25T01:54:34.261 INFO:tasks.workunit.client.0.smithi162.stdout:5/517: chown d15/d19/d24/d73/f92 0 1 2024-04-25T01:54:34.296 INFO:tasks.workunit.client.0.smithi162.stdout:5/518: stat d15/d19/d24/d2b/d3b/d58 0 2024-04-25T01:54:34.372 INFO:tasks.workunit.client.0.smithi162.stdout:6/465: creat d1/d46/f97 x:0 0 0 2024-04-25T01:54:34.598 INFO:tasks.workunit.client.0.smithi162.stdout:4/537: getdents dd/d1a/d34/d57 0 2024-04-25T01:54:34.715 INFO:tasks.workunit.client.0.smithi162.stdout:2/487: truncate d0/d3/d1b/d1d/d20/d5e/d61/da4/f8b 456135 0 2024-04-25T01:54:35.414 INFO:tasks.workunit.client.0.smithi162.stdout:6/466: fsync d1/f24 0 2024-04-25T01:54:35.418 INFO:tasks.workunit.client.0.smithi162.stdout:7/509: creat df/fa4 x:0 0 0 2024-04-25T01:54:35.520 INFO:tasks.workunit.client.0.smithi162.stdout:3/539: creat d2/da5/fbc x:0 0 0 2024-04-25T01:54:35.536 INFO:tasks.workunit.client.0.smithi162.stdout:7/510: chown df/d2e/d4c/d58/d82/l9c 92 1 2024-04-25T01:54:35.842 INFO:tasks.workunit.client.0.smithi162.stdout:2/488: creat d0/d3/d1b/d1d/d20/d5e/fad x:0 0 0 2024-04-25T01:54:36.234 INFO:tasks.workunit.client.0.smithi162.stdout:7/511: unlink df/d2c/d49/d7a/l9b 0 2024-04-25T01:54:36.447 INFO:tasks.workunit.client.0.smithi162.stdout:2/489: symlink d0/d3/d1b/d1d/d20/d42/lae 0 2024-04-25T01:54:36.663 INFO:tasks.workunit.client.0.smithi162.stdout:9/456: write d4/d25/f93 [156513,36621] 0 2024-04-25T01:54:36.759 INFO:tasks.workunit.client.0.smithi162.stdout:6/467: creat d1/d13/d28/d45/d59/d80/f98 x:0 0 0 2024-04-25T01:54:37.001 INFO:tasks.workunit.client.0.smithi162.stdout:2/490: dread - d0/d3/d1b/d1d/d20/d5e/d61/d66/d84/f91 zero size 2024-04-25T01:54:37.219 INFO:tasks.workunit.client.0.smithi162.stdout:9/457: mkdir d4/d9/d15/d4e/d9f 0 2024-04-25T01:54:37.238 INFO:tasks.workunit.client.0.smithi162.stdout:9/458: stat d4/d9/d15 0 2024-04-25T01:54:37.301 INFO:tasks.workunit.client.0.smithi162.stdout:3/540: creat d2/d9/fbd x:0 0 0 2024-04-25T01:54:37.442 INFO:tasks.workunit.client.0.smithi162.stdout:3/541: dread d2/d29/d2e/f31 [0,4194304] 0 2024-04-25T01:54:37.536 INFO:tasks.workunit.client.0.smithi162.stdout:6/468: truncate d1/d13/d28/d30/d3a/f3d 7099092 0 2024-04-25T01:54:37.610 INFO:tasks.workunit.client.0.smithi162.stdout:6/469: dread d1/d13/d28/d45/f61 [0,4194304] 0 2024-04-25T01:54:38.272 INFO:tasks.workunit.client.0.smithi162.stdout:9/459: fdatasync d4/f52 0 2024-04-25T01:54:38.377 INFO:tasks.workunit.client.0.smithi162.stdout:3/542: truncate d2/d9/d99/f3d 107726 0 2024-04-25T01:54:38.511 INFO:tasks.workunit.client.0.smithi162.stdout:5/519: write d15/d19/d24/d2b/d3b/d58/f5c [2675533,93493] 0 2024-04-25T01:54:38.567 INFO:tasks.workunit.client.0.smithi162.stdout:9/460: sync 2024-04-25T01:54:38.669 INFO:tasks.workunit.client.0.smithi162.stdout:0/573: dwrite d0/d1/d4e/d76/db0/fbd [0,4194304] 0 2024-04-25T01:54:38.944 INFO:tasks.workunit.client.0.smithi162.stdout:7/512: getdents df/d2e/d4c/d8a 0 2024-04-25T01:54:38.999 INFO:tasks.workunit.client.0.smithi162.stdout:3/543: mknod d2/d29/cbe 0 2024-04-25T01:54:39.033 INFO:tasks.workunit.client.0.smithi162.stdout:7/513: sync 2024-04-25T01:54:39.255 INFO:tasks.workunit.client.0.smithi162.stdout:7/514: chown df/d2e/d4c/l5c 0 1 2024-04-25T01:54:39.274 INFO:tasks.workunit.client.0.smithi162.stdout:4/538: dwrite dd/f33 [0,4194304] 0 2024-04-25T01:54:39.401 INFO:tasks.workunit.client.0.smithi162.stdout:0/574: truncate d0/df/d20/d25/d55/d77/f99 814984 0 2024-04-25T01:54:39.460 INFO:tasks.workunit.client.0.smithi162.stdout:0/575: readlink d0/df/d20/d25/lb7 0 2024-04-25T01:54:39.875 INFO:tasks.workunit.client.0.smithi162.stdout:2/491: write d0/d3/d5/d36/d93/f8f [801214,69610] 0 2024-04-25T01:54:39.917 INFO:tasks.workunit.client.0.smithi162.stdout:2/492: readlink d0/d3/d1b/d1d/d20/l44 0 2024-04-25T01:54:40.263 INFO:tasks.workunit.client.0.smithi162.stdout:1/535: rename d15/d1f/d23/d30/d4a/d7f/d97/f98 to d15/fab 0 2024-04-25T01:54:40.469 INFO:tasks.workunit.client.0.smithi162.stdout:3/544: symlink d2/d9/d10/d4c/d51/d63/d87/db6/lbf 0 2024-04-25T01:54:40.664 INFO:tasks.workunit.client.0.smithi162.stdout:7/515: creat df/d2c/d49/d7a/fa5 x:0 0 0 2024-04-25T01:54:40.914 INFO:tasks.workunit.client.0.smithi162.stdout:0/576: unlink d0/d7b/f7f 0 2024-04-25T01:54:41.341 INFO:tasks.workunit.client.0.smithi162.stdout:2/493: dread d0/d3/d1b/d1d/d3a/f40 [0,4194304] 0 2024-04-25T01:54:41.571 INFO:tasks.workunit.client.0.smithi162.stdout:3/545: truncate d2/d9/d19/fa1 842385 0 2024-04-25T01:54:41.892 INFO:tasks.workunit.client.0.smithi162.stdout:7/516: rmdir df/d2c/d63/d83/d8b/d90 39 2024-04-25T01:54:41.921 INFO:tasks.workunit.client.0.smithi162.stdout:5/520: getdents d15/d19/d24/d2b/d3b/d58 0 2024-04-25T01:54:42.475 INFO:tasks.workunit.client.0.smithi162.stdout:0/577: creat d0/df/d20/d25/d55/fc4 x:0 0 0 2024-04-25T01:54:42.493 INFO:tasks.workunit.client.0.smithi162.stdout:4/539: write fc [1480798,126115] 0 2024-04-25T01:54:42.539 INFO:tasks.workunit.client.0.smithi162.stdout:9/461: link d4/d9/d15/d1b/f2e d4/d9/fa0 0 2024-04-25T01:54:42.866 INFO:tasks.workunit.client.0.smithi162.stdout:2/494: unlink d0/d3/d5/f81 0 2024-04-25T01:54:43.910 INFO:tasks.workunit.client.0.smithi162.stdout:1/536: dwrite d15/d69/f75 [0,4194304] 0 2024-04-25T01:54:44.002 INFO:tasks.workunit.client.0.smithi162.stdout:4/540: symlink dd/d1a/d34/d72/lb4 0 2024-04-25T01:54:44.016 INFO:tasks.workunit.client.0.smithi162.stdout:0/578: truncate d0/df/f66 573632 0 2024-04-25T01:54:44.177 INFO:tasks.workunit.client.0.smithi162.stdout:8/504: rename d0/c9 to d0/d12/d1b/d74/ca4 0 2024-04-25T01:54:44.422 INFO:tasks.workunit.client.0.smithi162.stdout:5/521: symlink d15/d19/d24/d4d/la5 0 2024-04-25T01:54:44.477 INFO:tasks.workunit.client.0.smithi162.stdout:1/537: dread d15/f1b [0,4194304] 0 2024-04-25T01:54:45.051 INFO:tasks.workunit.client.0.smithi162.stdout:0/579: mknod d0/df/d20/d25/d55/cc5 0 2024-04-25T01:54:45.426 INFO:tasks.workunit.client.0.smithi162.stdout:2/495: mknod d0/d3/d1b/d1d/d20/d5e/d61/d66/d84/da2/caf 0 2024-04-25T01:54:45.686 INFO:tasks.workunit.client.0.smithi162.stdout:5/522: creat d15/d19/d24/d4d/fa6 x:0 0 0 2024-04-25T01:54:45.864 INFO:tasks.workunit.client.0.smithi162.stdout:1/538: dread - d15/d1f/d23/d30/f9c zero size 2024-04-25T01:54:46.134 INFO:tasks.workunit.client.0.smithi162.stdout:7/517: dwrite df/d2c/d63/f79 [0,4194304] 0 2024-04-25T01:54:46.298 INFO:tasks.workunit.client.0.smithi162.stdout:7/518: dread - df/d2c/d49/d5d/f60 zero size 2024-04-25T01:54:46.782 INFO:tasks.workunit.client.0.smithi162.stdout:9/462: link d4/d9/f47 d4/d9/d15/d8a/fa1 0 2024-04-25T01:54:47.285 INFO:tasks.workunit.client.0.smithi162.stdout:1/539: truncate d15/d69/f3e 1754468 0 2024-04-25T01:54:47.612 INFO:tasks.workunit.client.0.smithi162.stdout:1/540: truncate d15/d1f/d23/fa6 594548 0 2024-04-25T01:54:47.989 INFO:tasks.workunit.client.0.smithi162.stdout:9/463: truncate d4/d8/d85/f7b 672223 0 2024-04-25T01:54:48.012 INFO:tasks.workunit.client.0.smithi162.stdout:9/464: dread - d4/d8/f51 zero size 2024-04-25T01:54:48.251 INFO:tasks.workunit.client.0.smithi162.stdout:8/505: write d0/d44/d31/f4a [1031253,53322] 0 2024-04-25T01:54:48.517 INFO:tasks.workunit.client.0.smithi162.stdout:6/470: rename d1/c32 to d1/d13/d28/d53/d71/c99 0 2024-04-25T01:54:48.716 INFO:tasks.workunit.client.0.smithi162.stdout:0/580: write d0/d1/f9e [817676,76636] 0 2024-04-25T01:54:48.757 INFO:tasks.workunit.client.0.smithi162.stdout:2/496: rmdir d0/d3/d1b/d1d/d20/d67 39 2024-04-25T01:54:48.777 INFO:tasks.workunit.client.0.smithi162.stdout:4/541: dwrite dd/f16 [0,4194304] 0 2024-04-25T01:54:48.996 INFO:tasks.workunit.client.0.smithi162.stdout:5/523: getdents d15/d19/d24/d40 0 2024-04-25T01:54:49.044 INFO:tasks.workunit.client.0.smithi162.stdout:2/497: readlink d0/d3/d1b/d1d/d20/d5e/d61/d66/d84/l90 0 2024-04-25T01:54:49.109 INFO:tasks.workunit.client.0.smithi162.stdout:5/524: dread d15/d19/f35 [0,4194304] 0 2024-04-25T01:54:49.417 INFO:tasks.workunit.client.0.smithi162.stdout:9/465: write d4/d7c/f8f [297867,122401] 0 2024-04-25T01:54:49.617 INFO:tasks.workunit.client.0.smithi162.stdout:8/506: dread - d0/d12/d3a/f7f zero size 2024-04-25T01:54:49.993 INFO:tasks.workunit.client.0.smithi162.stdout:0/581: mkdir d0/d1/d6a/dc6 0 2024-04-25T01:54:50.140 INFO:tasks.workunit.client.0.smithi162.stdout:3/546: rename d2/d9/fd to d2/d9/d10/d2c/da3/db5/fc0 0 2024-04-25T01:54:50.385 INFO:tasks.workunit.client.0.smithi162.stdout:2/498: unlink d0/c59 0 2024-04-25T01:54:50.561 INFO:tasks.workunit.client.0.smithi162.stdout:5/525: mknod d15/d19/d24/d2b/d3b/d3c/d3f/ca7 0 2024-04-25T01:54:50.639 INFO:tasks.workunit.client.0.smithi162.stdout:4/542: dread dd/d1a/f48 [0,4194304] 0 2024-04-25T01:54:50.687 INFO:tasks.workunit.client.0.smithi162.stdout:5/526: chown d15/d19/c71 7442707 1 2024-04-25T01:54:50.815 INFO:tasks.workunit.client.0.smithi162.stdout:9/466: creat d4/d9/d15/d4e/fa2 x:0 0 0 2024-04-25T01:54:50.918 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:54:50.920 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:54:51.008 INFO:tasks.workunit.client.0.smithi162.stdout:6/471: dwrite d1/f3f [4194304,4194304] 0 2024-04-25T01:54:51.099 INFO:tasks.workunit.client.0.smithi162.stdout:8/507: mkdir d0/d12/d3a/da5 0 2024-04-25T01:54:51.129 INFO:tasks.workunit.client.0.smithi162.stdout:7/519: rename df/d2c/l4a to df/d2e/d4c/d58/d93/la6 0 2024-04-25T01:54:51.157 INFO:tasks.workunit.client.0.smithi162.stdout:2/499: rmdir d0/d3/d1b/d1d/d20/d5e/d61/d62 39 2024-04-25T01:54:51.195 INFO:tasks.workunit.client.0.smithi162.stdout:4/543: truncate dd/d1a/f20 384377 0 2024-04-25T01:54:51.197 INFO:tasks.workunit.client.0.smithi162.stdout:0/582: read d0/df/d20/f40 [2138998,107791] 0 2024-04-25T01:54:51.381 INFO:tasks.workunit.client.0.smithi162.stdout:0/583: stat d0/df/d20/d25/d55/l5f 0 2024-04-25T01:54:51.700 INFO:tasks.workunit.client.0.smithi162.stdout:2/500: fdatasync d0/f74 0 2024-04-25T01:54:52.134 INFO:tasks.workunit.client.0.smithi162.stdout:7/520: creat df/d2e/d4c/d58/d93/fa7 x:0 0 0 2024-04-25T01:54:52.465 INFO:tasks.workunit.client.0.smithi162.stdout:3/547: write d2/d9/d10/d4c/f53 [5146249,105275] 0 2024-04-25T01:54:52.565 INFO:tasks.workunit.client.0.smithi162.stdout:5/527: truncate d15/d19/d24/f8c 241628 0 2024-04-25T01:54:52.740 INFO:tasks.workunit.client.0.smithi162.stdout:0/584: symlink d0/d1/d4e/d76/db0/lc7 0 2024-04-25T01:54:53.072 INFO:tasks.workunit.client.0.smithi162.stdout:8/508: dwrite d0/d12/f7e [0,4194304] 0 2024-04-25T01:54:53.289 INFO:tasks.workunit.client.0.smithi162.stdout:9/467: write d4/d9/f47 [504871,85015] 0 2024-04-25T01:54:53.363 INFO:tasks.workunit.client.0.smithi162.stdout:8/509: dread d0/d44/d31/d65/f71 [0,4194304] 0 2024-04-25T01:54:53.407 INFO:tasks.workunit.client.0.smithi162.stdout:6/472: write d1/d13/d28/d30/d3a/f4b [4279324,122963] 0 2024-04-25T01:54:53.497 INFO:tasks.workunit.client.0.smithi162.stdout:4/544: write dd/d1a/d34/f51 [900475,62933] 0 2024-04-25T01:54:53.565 INFO:tasks.workunit.client.0.smithi162.stdout:4/545: readlink dd/d1a/d4e/l7b 0 2024-04-25T01:54:54.045 INFO:tasks.workunit.client.0.smithi162.stdout:1/541: rename d15/d1f/d35/d4c/d70/d73/f8f to d15/d1f/fac 0 2024-04-25T01:54:54.086 INFO:tasks.workunit.client.0.smithi162.stdout:1/542: chown d15/d1f/d35/c47 4042962 1 2024-04-25T01:54:54.748 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:05:44.183 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:54:54.774 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:05:44.209 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:54:54.800 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:05:44.152 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:54:54.811 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:05:44.163 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:54:54.813 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:05:44.165 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:54:54.819 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:05:44.171 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:54:54.944 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:05:44.379 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:54:54.991 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:05:44.344 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:54:54.991 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:05:44.344 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:54:55.390 INFO:tasks.workunit.client.0.smithi162.stdout:3/548: write d2/d9/d10/d4c/d8d/f92 [1809866,28635] 0 2024-04-25T01:54:55.541 INFO:tasks.workunit.client.0.smithi162.stdout:0/585: mkdir d0/df/d20/d37/d81/dad/dc8 0 2024-04-25T01:54:55.787 INFO:tasks.workunit.client.0.smithi162.stdout:1/543: mkdir d15/d69/d4f/dad 0 2024-04-25T01:54:56.292 INFO:tasks.workunit.client.0.smithi162.stdout:2/501: dwrite d0/d3/d1b/d1d/d3a/f40 [0,4194304] 0 2024-04-25T01:54:56.565 INFO:tasks.workunit.client.0.smithi162.stdout:0/586: stat d0/df/d20/d25/f4d 0 2024-04-25T01:54:56.630 INFO:tasks.workunit.client.0.smithi162.stdout:0/587: chown d0/df/d20/d25/d55/d6f/d7d/da7/fb2 36364032 1 2024-04-25T01:54:56.698 INFO:tasks.workunit.client.0.smithi162.stdout:1/544: mknod d15/d1f/d35/d4c/cae 0 2024-04-25T01:54:56.930 INFO:tasks.workunit.client.0.smithi162.stdout:2/502: creat d0/d3/d1b/d1d/d20/d5e/d61/d66/d84/da2/fb0 x:0 0 0 2024-04-25T01:54:57.427 INFO:tasks.workunit.client.0.smithi162.stdout:4/546: creat dd/df/d2e/fb5 x:0 0 0 2024-04-25T01:54:57.438 INFO:tasks.workunit.client.0.smithi162.stdout:5/528: rename d15/d19/l69 to d15/d19/d24/d2b/la8 0 2024-04-25T01:54:57.451 INFO:tasks.workunit.client.0.smithi162.stdout:9/468: dwrite d4/f6c [0,4194304] 0 2024-04-25T01:54:57.521 INFO:tasks.workunit.client.0.smithi162.stdout:6/473: dwrite d1/f25 [0,4194304] 0 2024-04-25T01:54:57.558 INFO:tasks.workunit.client.0.smithi162.stdout:8/510: creat d0/d12/d1b/d74/d8a/d8f/fa6 x:0 0 0 2024-04-25T01:54:57.581 INFO:tasks.workunit.client.0.smithi162.stdout:1/545: truncate d15/d1f/d23/f48 274189 0 2024-04-25T01:54:57.663 INFO:tasks.workunit.client.0.smithi162.stdout:0/588: read d0/d1/f7 [941874,99805] 0 2024-04-25T01:54:57.866 INFO:tasks.workunit.client.0.smithi162.stdout:7/521: dwrite df/f23 [0,4194304] 0 2024-04-25T01:54:58.032 INFO:tasks.workunit.client.0.smithi162.stdout:9/469: chown d4/d8/d13/f16 1952 1 2024-04-25T01:54:58.336 INFO:tasks.workunit.client.0.smithi162.stdout:2/503: dread d0/d3/d5/d36/d93/f76 [4194304,4194304] 0 2024-04-25T01:54:58.849 INFO:tasks.workunit.client.0.smithi162.stdout:1/546: chown d15/d1f/d23/d30/l86 22 1 2024-04-25T01:54:58.865 INFO:tasks.workunit.client.0.smithi162.stdout:6/474: mkdir d1/d73/d9a 0 2024-04-25T01:54:59.021 INFO:tasks.workunit.client.0.smithi162.stdout:8/511: fsync d0/d44/d91/f58 0 2024-04-25T01:54:59.423 INFO:tasks.workunit.client.0.smithi162.stdout:9/470: mkdir d4/d25/da3 0 2024-04-25T01:54:59.974 INFO:tasks.workunit.client.0.smithi162.stdout:0/589: write d0/df/f96 [838322,113126] 0 2024-04-25T01:55:00.043 INFO:tasks.workunit.client.0.smithi162.stdout:4/547: mkdir dd/df/d77/d87/db6 0 2024-04-25T01:55:00.144 INFO:tasks.workunit.client.0.smithi162.stdout:6/475: creat d1/d13/d28/d30/d66/f9b x:0 0 0 2024-04-25T01:55:00.287 INFO:tasks.workunit.client.0.smithi162.stdout:1/547: truncate d15/d69/f7d 904137 0 2024-04-25T01:55:00.444 INFO:tasks.workunit.client.0.smithi162.stdout:8/512: truncate d0/d12/d1b/f9b 997522 0 2024-04-25T01:55:00.837 INFO:tasks.workunit.client.0.smithi162.stdout:5/529: creat d15/d19/d24/fa9 x:0 0 0 2024-04-25T01:55:00.995 INFO:tasks.workunit.client.0.smithi162.stdout:5/530: dread d15/d19/d24/d40/f5f [0,4194304] 0 2024-04-25T01:55:01.041 INFO:tasks.workunit.client.0.smithi162.stdout:0/590: mknod d0/df/d20/d25/d55/d6f/cc9 0 2024-04-25T01:55:01.219 INFO:tasks.workunit.client.0.smithi162.stdout:6/476: mknod d1/d13/d28/d30/d8a/c9c 0 2024-04-25T01:55:01.583 INFO:tasks.workunit.client.0.smithi162.stdout:6/477: sync 2024-04-25T01:55:01.875 INFO:tasks.workunit.client.0.smithi162.stdout:9/471: mknod d4/ca4 0 2024-04-25T01:55:02.010 INFO:tasks.workunit.client.0.smithi162.stdout:1/548: unlink f3 0 2024-04-25T01:55:02.188 INFO:tasks.workunit.client.0.smithi162.stdout:4/548: symlink dd/d1a/d34/d9d/lb7 0 2024-04-25T01:55:02.280 INFO:tasks.workunit.client.0.smithi162.stdout:8/513: truncate d0/d44/d31/d65/f69 3904366 0 2024-04-25T01:55:02.504 INFO:tasks.workunit.client.0.smithi162.stdout:6/478: fsync d1/f39 0 2024-04-25T01:55:02.589 INFO:tasks.workunit.client.0.smithi162.stdout:6/479: sync 2024-04-25T01:55:02.730 INFO:tasks.workunit.client.0.smithi162.stdout:7/522: link df/c1a df/d2c/d63/d83/ca8 0 2024-04-25T01:55:02.832 INFO:tasks.workunit.client.0.smithi162.stdout:5/531: mknod d15/d19/d24/d2b/caa 0 2024-04-25T01:55:03.057 INFO:tasks.workunit.client.0.smithi162.stdout:1/549: unlink d15/d1f/l4e 0 2024-04-25T01:55:03.252 INFO:tasks.workunit.client.0.smithi162.stdout:0/591: truncate d0/fd 348110 0 2024-04-25T01:55:03.465 INFO:tasks.workunit.client.0.smithi162.stdout:8/514: creat d0/d12/d1b/d74/d8a/fa7 x:0 0 0 2024-04-25T01:55:04.197 INFO:tasks.workunit.client.0.smithi162.stdout:3/549: rename d2/d9/l6b to d2/d9/d10/d4c/d51/d63/d87/lc1 0 2024-04-25T01:55:04.295 INFO:tasks.workunit.client.0.smithi162.stdout:7/523: mknod df/d2e/d4c/d58/d82/ca9 0 2024-04-25T01:55:04.298 INFO:tasks.workunit.client.0.smithi162.stdout:9/472: creat d4/d9/d15/d8a/fa5 x:0 0 0 2024-04-25T01:55:04.676 INFO:tasks.workunit.client.0.smithi162.stdout:4/549: mkdir dd/df/d77/d87/db6/db8 0 2024-04-25T01:55:05.517 INFO:tasks.workunit.client.0.smithi162.stdout:2/504: rename d0/d3/d5/f18 to d0/d3/d1b/d1d/d3a/d63/fb1 0 2024-04-25T01:55:05.856 INFO:tasks.workunit.client.0.smithi162.stdout:7/524: fdatasync df/d2c/f3c 0 2024-04-25T01:55:06.132 INFO:tasks.workunit.client.0.smithi162.stdout:9/473: symlink d4/d9/d15/d1b/la6 0 2024-04-25T01:55:06.337 INFO:tasks.workunit.client.0.smithi162.stdout:1/550: fsync d15/fab 0 2024-04-25T01:55:06.483 INFO:tasks.workunit.client.0.smithi162.stdout:4/550: mknod dd/d1a/d4e/d93/cb9 0 2024-04-25T01:55:06.659 INFO:tasks.workunit.client.0.smithi162.stdout:0/592: creat d0/d1/d6a/da9/fca x:0 0 0 2024-04-25T01:55:07.159 INFO:tasks.workunit.client.0.smithi162.stdout:7/525: creat df/d2e/d4c/d58/d82/faa x:0 0 0 2024-04-25T01:55:07.172 INFO:tasks.workunit.client.0.smithi162.stdout:6/480: write d1/d13/d28/d30/d63/f6f [1041654,107394] 0 2024-04-25T01:55:07.570 INFO:tasks.workunit.client.0.smithi162.stdout:5/532: creat d15/d19/d24/d2b/fab x:0 0 0 2024-04-25T01:55:07.857 INFO:tasks.workunit.client.0.smithi162.stdout:1/551: symlink d15/d1f/d35/d4c/d70/d73/laf 0 2024-04-25T01:55:08.016 INFO:tasks.workunit.client.0.smithi162.stdout:4/551: dread dd/d1a/d34/f51 [0,4194304] 0 2024-04-25T01:55:08.061 INFO:tasks.workunit.client.0.smithi162.stdout:8/515: creat d0/d12/fa8 x:0 0 0 2024-04-25T01:55:08.164 INFO:tasks.workunit.client.0.smithi162.stdout:4/552: sync 2024-04-25T01:55:08.215 INFO:tasks.workunit.client.0.smithi162.stdout:8/516: dread d0/d1a/f28 [0,4194304] 0 2024-04-25T01:55:08.850 INFO:tasks.workunit.client.0.smithi162.stdout:0/593: mknod d0/df/d20/d37/da1/ccb 0 2024-04-25T01:55:08.894 INFO:tasks.workunit.client.0.smithi162.stdout:0/594: read d0/df/d20/f31 [1338603,4296] 0 2024-04-25T01:55:09.111 INFO:tasks.workunit.client.0.smithi162.stdout:7/526: dread df/f23 [0,4194304] 0 2024-04-25T01:55:09.393 INFO:tasks.workunit.client.0.smithi162.stdout:3/550: write d2/d29/d5d/f68 [4249788,45948] 0 2024-04-25T01:55:10.067 INFO:tasks.workunit.client.0.smithi162.stdout:2/505: rename d0/d3/d1b/f21 to d0/d3/d7a/fb2 0 2024-04-25T01:55:10.374 INFO:tasks.workunit.client.0.smithi162.stdout:7/527: rmdir df/d2c/d63 39 2024-04-25T01:55:11.147 INFO:tasks.workunit.client.0.smithi162.stdout:9/474: unlink d4/l57 0 2024-04-25T01:55:11.377 INFO:tasks.workunit.client.0.smithi162.stdout:2/506: fdatasync d0/d3/d1b/d1d/d20/d5e/fad 0 2024-04-25T01:55:11.441 INFO:tasks.workunit.client.0.smithi162.stdout:2/507: chown d0/d3/d1b/d1d/d20/d5e/d61/d66 998188 1 2024-04-25T01:55:11.539 INFO:tasks.workunit.client.0.smithi162.stdout:7/528: symlink df/d2e/lab 0 2024-04-25T01:55:11.939 INFO:tasks.workunit.client.0.smithi162.stdout:9/475: mkdir d4/d9/d15/d1b/da7 0 2024-04-25T01:55:11.942 INFO:tasks.workunit.client.0.smithi162.stdout:8/517: creat d0/d44/fa9 x:0 0 0 2024-04-25T01:55:12.140 INFO:tasks.workunit.client.0.smithi162.stdout:0/595: rename d0/df/d20/d25/d51/l3b to d0/d1/d64/lcc 0 2024-04-25T01:55:12.146 INFO:tasks.workunit.client.0.smithi162.stdout:8/518: sync 2024-04-25T01:55:12.495 INFO:tasks.workunit.client.0.smithi162.stdout:8/519: dread d0/d44/d91/f58 [0,4194304] 0 2024-04-25T01:55:12.564 INFO:tasks.workunit.client.0.smithi162.stdout:0/596: fsync d0/df/d20/d25/f4d 0 2024-04-25T01:55:12.635 INFO:tasks.workunit.client.0.smithi162.stdout:2/508: rmdir d0/d3/d1b/d1d/d20/d67 39 2024-04-25T01:55:13.097 INFO:tasks.workunit.client.0.smithi162.stdout:0/597: symlink d0/d59/lcd 0 2024-04-25T01:55:13.205 INFO:tasks.workunit.client.0.smithi162.stdout:2/509: read d0/f89 [1133991,125065] 0 2024-04-25T01:55:13.247 INFO:tasks.workunit.client.0.smithi162.stdout:1/552: creat d15/d1f/fb0 x:0 0 0 2024-04-25T01:55:13.299 INFO:tasks.workunit.client.0.smithi162.stdout:6/481: dwrite d1/d13/d28/d30/d8a/f8c [0,4194304] 0 2024-04-25T01:55:13.578 INFO:tasks.workunit.client.0.smithi162.stdout:6/482: chown d1/c5d 19052 1 2024-04-25T01:55:13.643 INFO:tasks.workunit.client.0.smithi162.stdout:5/533: dwrite d15/d19/d24/d2b/d3b/d80/fa2 [0,4194304] 0 2024-04-25T01:55:13.740 INFO:tasks.workunit.client.0.smithi162.stdout:8/520: creat d0/d12/d1b/d74/d8a/da3/faa x:0 0 0 2024-04-25T01:55:13.768 INFO:tasks.workunit.client.0.smithi162.stdout:6/483: chown d1/d13/c58 9519 1 2024-04-25T01:55:13.774 INFO:tasks.workunit.client.0.smithi162.stdout:5/534: chown d15/l18 3 1 2024-04-25T01:55:13.841 INFO:tasks.workunit.client.0.smithi162.stdout:4/553: write dd/d1a/f48 [4284085,12915] 0 2024-04-25T01:55:13.886 INFO:tasks.workunit.client.0.smithi162.stdout:0/598: dread - d0/df/d20/d37/d58/f95 zero size 2024-04-25T01:55:14.673 INFO:tasks.workunit.client.0.smithi162.stdout:8/521: truncate d0/d44/d31/f34 732587 0 2024-04-25T01:55:14.734 INFO:tasks.workunit.client.0.smithi162.stdout:3/551: dwrite d2/d9/d10/d4c/d51/d63/d87/d90/fbb [0,4194304] 0 2024-04-25T01:55:14.887 INFO:tasks.workunit.client.0.smithi162.stdout:0/599: readlink d0/d1/l5e 0 2024-04-25T01:55:14.921 INFO:tasks.workunit.client.0.smithi162.stdout:8/522: read d0/d44/d91/f36 [1993921,1237] 0 2024-04-25T01:55:14.938 INFO:tasks.workunit.client.0.smithi162.stdout:3/552: dread - d2/d29/d5d/f9a zero size 2024-04-25T01:55:14.981 INFO:tasks.workunit.client.0.smithi162.stdout:8/523: dread - d0/d12/d1b/f50 zero size 2024-04-25T01:55:15.454 INFO:tasks.workunit.client.0.smithi162.stdout:4/554: mkdir dd/d1a/d34/db1/dba 0 2024-04-25T01:55:15.705 INFO:tasks.workunit.client.0.smithi162.stdout:7/529: write df/f7b [964722,91431] 0 2024-04-25T01:55:15.901 INFO:tasks.workunit.client.0.smithi162.stdout:3/553: truncate d2/d29/d2e/f3a 4832400 0 2024-04-25T01:55:15.983 INFO:tasks.workunit.client.0.smithi162.stdout:4/555: truncate fc 3149610 0 2024-04-25T01:55:16.080 INFO:tasks.workunit.client.0.smithi162.stdout:0/600: truncate d0/d1/d64/f83 2764729 0 2024-04-25T01:55:16.142 INFO:tasks.workunit.client.0.smithi162.stdout:2/510: link d0/d3/d1b/d1d/d3a/f40 d0/d3/d1b/d1d/d20/fb3 0 2024-04-25T01:55:16.214 INFO:tasks.workunit.client.0.smithi162.stdout:9/476: dwrite d4/f26 [0,4194304] 0 2024-04-25T01:55:16.402 INFO:tasks.workunit.client.0.smithi162.stdout:0/601: chown d0/df/d20/d37/d81/fa8 0 1 2024-04-25T01:55:16.658 INFO:tasks.workunit.client.0.smithi162.stdout:1/553: write d15/d1f/d23/fa6 [367151,2191] 0 2024-04-25T01:55:16.665 INFO:tasks.workunit.client.0.smithi162.stdout:5/535: write d15/d19/f67 [553659,96280] 0 2024-04-25T01:55:16.680 INFO:tasks.workunit.client.0.smithi162.stdout:6/484: write d1/d13/d28/d30/d66/f9b [49652,86412] 0 2024-04-25T01:55:16.982 INFO:tasks.workunit.client.0.smithi162.stdout:3/554: creat d2/d9/d10/d4c/d51/d63/d87/d86/fc2 x:0 0 0 2024-04-25T01:55:17.506 INFO:tasks.workunit.client.0.smithi162.stdout:2/511: truncate d0/d3/d1b/d1d/d20/d42/f43 4242855 0 2024-04-25T01:55:17.734 INFO:tasks.workunit.client.0.smithi162.stdout:5/536: creat d15/d19/d24/d73/d7a/fac x:0 0 0 2024-04-25T01:55:17.927 INFO:tasks.workunit.client.0.smithi162.stdout:8/524: dwrite d0/d12/f24 [4194304,4194304] 0 2024-04-25T01:55:18.008 INFO:tasks.workunit.client.0.smithi162.stdout:5/537: chown d15/d19/d24/d73/d7a 280 1 2024-04-25T01:55:18.009 INFO:tasks.workunit.client.0.smithi162.stdout:1/554: symlink d15/d1f/d35/d4c/d70/lb1 0 2024-04-25T01:55:18.054 INFO:tasks.workunit.client.0.smithi162.stdout:5/538: readlink d15/l1d 0 2024-04-25T01:55:18.280 INFO:tasks.workunit.client.0.smithi162.stdout:3/555: creat d2/d9/d10/d4c/d8d/fc3 x:0 0 0 2024-04-25T01:55:18.371 INFO:tasks.workunit.client.0.smithi162.stdout:9/477: symlink d4/d9/la8 0 2024-04-25T01:55:18.410 INFO:tasks.workunit.client.0.smithi162.stdout:9/478: write d4/f26 [1217066,88804] 0 2024-04-25T01:55:18.975 INFO:tasks.workunit.client.0.smithi162.stdout:0/602: write d0/d1/d6a/f72 [177005,47765] 0 2024-04-25T01:55:18.987 INFO:tasks.workunit.client.0.smithi162.stdout:7/530: dread - df/d2c/d63/d83/d8b/d90/f97 zero size 2024-04-25T01:55:19.026 INFO:tasks.workunit.client.0.smithi162.stdout:4/556: dwrite dd/df/d58/f5a [0,4194304] 0 2024-04-25T01:55:19.212 INFO:tasks.workunit.client.0.smithi162.stdout:0/603: sync 2024-04-25T01:55:19.238 INFO:tasks.workunit.client.0.smithi162.stdout:6/485: creat d1/d13/d28/d53/d6d/f9d x:0 0 0 2024-04-25T01:55:19.526 INFO:tasks.workunit.client.0.smithi162.stdout:8/525: truncate d0/d44/d31/f39 1332404 0 2024-04-25T01:55:19.570 INFO:tasks.workunit.client.0.smithi162.stdout:8/526: read d0/d44/f15 [505972,44413] 0 2024-04-25T01:55:19.895 INFO:tasks.workunit.client.0.smithi162.stdout:3/556: creat d2/d9/d10/d2c/da3/db5/fc4 x:0 0 0 2024-04-25T01:55:19.957 INFO:tasks.workunit.client.0.smithi162.stdout:5/539: dread d15/d19/d24/d2b/d3b/d3c/d3f/f43 [0,4194304] 0 2024-04-25T01:55:20.026 INFO:tasks.workunit.client.0.smithi162.stdout:5/540: dread - d15/d1e/f8a zero size 2024-04-25T01:55:20.394 INFO:tasks.workunit.client.0.smithi162.stdout:2/512: truncate d0/d3/d1b/d1d/d3a/f40 1338493 0 2024-04-25T01:55:20.972 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:55:20.976 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:55:21.206 INFO:tasks.workunit.client.0.smithi162.stdout:4/557: creat dd/df/d77/d87/db6/fbb x:0 0 0 2024-04-25T01:55:21.391 INFO:tasks.workunit.client.0.smithi162.stdout:7/531: mknod df/d2c/d49/d7a/cac 0 2024-04-25T01:55:21.411 INFO:tasks.workunit.client.0.smithi162.stdout:0/604: unlink d0/df/d20/d25/d55/d77/f90 0 2024-04-25T01:55:21.721 INFO:tasks.workunit.client.0.smithi162.stdout:8/527: creat d0/d12/d3a/fab x:0 0 0 2024-04-25T01:55:21.744 INFO:tasks.workunit.client.0.smithi162.stdout:8/528: dread - d0/f6b zero size 2024-04-25T01:55:22.096 INFO:tasks.workunit.client.0.smithi162.stdout:5/541: mknod d15/d19/d24/d4d/d7c/cad 0 2024-04-25T01:55:22.118 INFO:tasks.workunit.client.0.smithi162.stdout:1/555: dwrite f14 [0,4194304] 0 2024-04-25T01:55:22.231 INFO:tasks.workunit.client.0.smithi162.stdout:2/513: mknod d0/d3/d1b/d1d/d3a/cb4 0 2024-04-25T01:55:22.263 INFO:tasks.workunit.client.0.smithi162.stdout:1/556: chown d15/d1f/d35/d4c/d70/d73/ca8 368715 1 2024-04-25T01:55:22.559 INFO:tasks.workunit.client.0.smithi162.stdout:4/558: mknod dd/df/d77/d87/cbc 0 2024-04-25T01:55:22.566 INFO:tasks.workunit.client.0.smithi162.stdout:1/557: sync 2024-04-25T01:55:22.578 INFO:tasks.workunit.client.0.smithi162.stdout:0/605: unlink d0/d1/f3d 0 2024-04-25T01:55:22.813 INFO:tasks.workunit.client.0.smithi162.stdout:8/529: stat d0/d12/d1b/d74/d8a/f93 0 2024-04-25T01:55:23.857 INFO:tasks.workunit.client.0.smithi162.stdout:7/532: creat df/d2c/d63/d83/d8b/da2/fad x:0 0 0 2024-04-25T01:55:24.264 INFO:tasks.workunit.client.0.smithi162.stdout:0/606: fdatasync d0/d1/f3c 0 2024-04-25T01:55:24.782 INFO:tasks.workunit.client.0.smithi162.stdout:5/542: unlink d15/d19/d24/f56 0 2024-04-25T01:55:24.849 INFO:tasks.workunit.client.0.smithi162.stdout:6/486: write d1/d13/f50 [2059481,39053] 0 2024-04-25T01:55:25.172 INFO:tasks.workunit.client.0.smithi162.stdout:6/487: dread d1/f2a [0,4194304] 0 2024-04-25T01:55:25.734 INFO:tasks.workunit.client.0.smithi162.stdout:9/479: dwrite d4/d9/d15/d1b/d2f/f62 [0,4194304] 0 2024-04-25T01:55:26.182 INFO:tasks.workunit.client.0.smithi162.stdout:3/557: getdents d2/d9/d10 0 2024-04-25T01:55:26.280 INFO:tasks.workunit.client.0.smithi162.stdout:2/514: creat d0/d3/d1b/d1d/d20/d5e/d61/fb5 x:0 0 0 2024-04-25T01:55:26.310 INFO:tasks.workunit.client.0.smithi162.stdout:7/533: mkdir df/d2c/d63/d83/d8b/dae 0 2024-04-25T01:55:26.769 INFO:tasks.workunit.client.0.smithi162.stdout:6/488: rename d1/l8e to d1/d13/d28/d53/l9e 0 2024-04-25T01:55:27.166 INFO:tasks.workunit.client.0.smithi162.stdout:1/558: creat d15/d1f/d23/fb2 x:0 0 0 2024-04-25T01:55:27.188 INFO:tasks.workunit.client.0.smithi162.stdout:8/530: link d0/f75 d0/d12/d2b/d87/fac 0 2024-04-25T01:55:27.254 INFO:tasks.workunit.client.0.smithi162.stdout:3/558: symlink d2/d9/d10/d2c/da3/dba/lc5 0 2024-04-25T01:55:27.526 INFO:tasks.workunit.client.0.smithi162.stdout:6/489: creat d1/d13/d28/d30/d63/f9f x:0 0 0 2024-04-25T01:55:27.554 INFO:tasks.workunit.client.0.smithi162.stdout:6/490: stat d1/f3f 0 2024-04-25T01:55:27.969 INFO:tasks.workunit.client.0.smithi162.stdout:4/559: dwrite dd/df/f12 [4194304,4194304] 0 2024-04-25T01:55:28.182 INFO:tasks.workunit.client.0.smithi162.stdout:9/480: mkdir d4/d9/da9 0 2024-04-25T01:55:28.286 INFO:tasks.workunit.client.0.smithi162.stdout:8/531: unlink d0/f90 0 2024-04-25T01:55:28.452 INFO:tasks.workunit.client.0.smithi162.stdout:3/559: rename d2/d29/l9e to d2/d9/d10/lc6 0 2024-04-25T01:55:28.651 INFO:tasks.workunit.client.0.smithi162.stdout:5/543: link d15/d19/d24/d2b/d3b/f89 d15/d19/d24/d4d/d7c/fae 0 2024-04-25T01:55:28.892 INFO:tasks.workunit.client.0.smithi162.stdout:0/607: write d0/d1/d4e/d76/db0/fbd [1806902,56120] 0 2024-04-25T01:55:29.290 INFO:tasks.workunit.client.0.smithi162.stdout:4/560: fdatasync dd/d1a/d4e/f80 0 2024-04-25T01:55:29.794 INFO:tasks.workunit.client.0.smithi162.stdout:1/559: creat d15/d1f/d35/d4c/d70/d9f/fb3 x:0 0 0 2024-04-25T01:55:30.136 INFO:tasks.workunit.client.0.smithi162.stdout:5/544: mkdir d15/d19/d24/d2b/d3b/d58/daf 0 2024-04-25T01:55:30.380 INFO:tasks.workunit.client.0.smithi162.stdout:6/491: fdatasync d1/d13/f1f 0 2024-04-25T01:55:30.940 INFO:tasks.workunit.client.0.smithi162.stdout:2/515: dwrite d0/d3/d5/d36/f37 [0,4194304] 0 2024-04-25T01:55:31.075 INFO:tasks.workunit.client.0.smithi162.stdout:9/481: mknod d4/d9/caa 0 2024-04-25T01:55:31.122 INFO:tasks.workunit.client.0.smithi162.stdout:2/516: dread - d0/d3/d1b/d1d/d20/d5e/fad zero size 2024-04-25T01:55:31.366 INFO:tasks.workunit.client.0.smithi162.stdout:7/534: getdents df/d2e/d4c/d58 0 2024-04-25T01:55:31.945 INFO:tasks.workunit.client.0.smithi162.stdout:4/561: rename dd/d1a/d4e/fb3 to dd/df/d2e/d4b/fbd 0 2024-04-25T01:55:32.398 INFO:tasks.workunit.client.0.smithi162.stdout:9/482: truncate d4/d9/d15/d8a/fa1 1715671 0 2024-04-25T01:55:32.540 INFO:tasks.workunit.client.0.smithi162.stdout:7/535: read df/d2c/d63/f84 [489986,18151] 0 2024-04-25T01:55:32.556 INFO:tasks.workunit.client.0.smithi162.stdout:7/536: stat df/d2e 0 2024-04-25T01:55:32.747 INFO:tasks.workunit.client.0.smithi162.stdout:5/545: fdatasync d15/d19/d24/f2d 0 2024-04-25T01:55:33.352 INFO:tasks.workunit.client.0.smithi162.stdout:7/537: truncate df/d2e/d4c/d58/d82/faa 334818 0 2024-04-25T01:55:33.595 INFO:tasks.workunit.client.0.smithi162.stdout:8/532: dwrite d0/d12/d3a/f76 [0,4194304] 0 2024-04-25T01:55:33.784 INFO:tasks.workunit.client.0.smithi162.stdout:3/560: creat d2/d9/d10/d2c/da3/db5/fc7 x:0 0 0 2024-04-25T01:55:33.978 INFO:tasks.workunit.client.0.smithi162.stdout:3/561: sync 2024-04-25T01:55:34.026 INFO:tasks.workunit.client.0.smithi162.stdout:0/608: dwrite d0/df/d20/d25/d55/f5c [0,4194304] 0 2024-04-25T01:55:34.183 INFO:tasks.workunit.client.0.smithi162.stdout:0/609: chown d0/df/d20/d25/c38 71 1 2024-04-25T01:55:34.237 INFO:tasks.workunit.client.0.smithi162.stdout:6/492: getdents d1/d13/d28/d30/d3a/d57 0 2024-04-25T01:55:34.254 INFO:tasks.workunit.client.0.smithi162.stdout:0/610: chown d0/df/d20/d37/da1/cb1 194207 1 2024-04-25T01:55:34.475 INFO:tasks.workunit.client.0.smithi162.stdout:7/538: mkdir df/d2e/d4c/daf 0 2024-04-25T01:55:34.745 INFO:tasks.workunit.client.0.smithi162.stdout:3/562: chown d2/d9/d10/d4c/d51/cb9 7 1 2024-04-25T01:55:34.921 INFO:tasks.workunit.client.0.smithi162.stdout:6/493: read d1/d13/d28/d30/d3a/f44 [308138,2750] 0 2024-04-25T01:55:35.074 INFO:tasks.workunit.client.0.smithi162.stdout:1/560: dwrite d15/d1f/d23/d30/d4a/f58 [0,4194304] 0 2024-04-25T01:55:35.178 INFO:tasks.workunit.client.0.smithi162.stdout:7/539: truncate df/f1b 1790055 0 2024-04-25T01:55:35.565 INFO:tasks.workunit.client.0.smithi162.stdout:7/540: dread df/d2c/f3e [0,4194304] 0 2024-04-25T01:55:35.612 INFO:tasks.workunit.client.0.smithi162.stdout:7/541: chown df/d2c/d63/d83/d8b/da2/fad 3 1 2024-04-25T01:55:35.867 INFO:tasks.workunit.client.0.smithi162.stdout:2/517: write d0/d3/d1b/d1d/d20/f54 [1182096,20315] 0 2024-04-25T01:55:36.078 INFO:tasks.workunit.client.0.smithi162.stdout:2/518: sync 2024-04-25T01:55:36.166 INFO:tasks.workunit.client.0.smithi162.stdout:1/561: creat d15/d69/d4f/dad/fb4 x:0 0 0 2024-04-25T01:55:36.286 INFO:tasks.workunit.client.0.smithi162.stdout:8/533: getdents d0/d12/d2b 0 2024-04-25T01:55:36.518 INFO:tasks.workunit.client.0.smithi162.stdout:7/542: creat df/d2e/d4c/daf/fb0 x:0 0 0 2024-04-25T01:55:36.627 INFO:tasks.workunit.client.0.smithi162.stdout:4/562: dwrite dd/df/f14 [0,4194304] 0 2024-04-25T01:55:36.828 INFO:tasks.workunit.client.0.smithi162.stdout:3/563: getdents d2/d9/d19/d3f 0 2024-04-25T01:55:37.115 INFO:tasks.workunit.client.0.smithi162.stdout:7/543: dread df/f15 [4194304,4194304] 0 2024-04-25T01:55:37.172 INFO:tasks.workunit.client.0.smithi162.stdout:3/564: chown d2/da5/fbc 10847 1 2024-04-25T01:55:37.282 INFO:tasks.workunit.client.0.smithi162.stdout:9/483: dwrite d4/d8/d13/f90 [0,4194304] 0 2024-04-25T01:55:37.461 INFO:tasks.workunit.client.0.smithi162.stdout:2/519: rename d0/d3/d1b/d1d/d20/d5e/d61/d66/l55 to d0/d3/d7a/d88/lb6 0 2024-04-25T01:55:37.476 INFO:tasks.workunit.client.0.smithi162.stdout:7/544: chown df/d2e/d4c/d58/f87 112 1 2024-04-25T01:55:37.810 INFO:tasks.workunit.client.0.smithi162.stdout:8/534: link d0/d12/f23 d0/d12/d1b/d74/d8a/fad 0 2024-04-25T01:55:37.855 INFO:tasks.workunit.client.0.smithi162.stdout:3/565: read d2/d9/d19/fa1 [794381,97106] 0 2024-04-25T01:55:37.895 INFO:tasks.workunit.client.0.smithi162.stdout:8/535: chown d0/d44/d31/d33/f54 47 1 2024-04-25T01:55:38.016 INFO:tasks.workunit.client.0.smithi162.stdout:9/484: symlink d4/d9/d15/d1b/d69/lab 0 2024-04-25T01:55:38.028 INFO:tasks.workunit.client.0.smithi162.stdout:7/545: fdatasync df/d2c/d49/f7e 0 2024-04-25T01:55:38.051 INFO:tasks.workunit.client.0.smithi162.stdout:0/611: write d0/d1/d64/f8c [888389,15220] 0 2024-04-25T01:55:38.126 INFO:tasks.workunit.client.0.smithi162.stdout:7/546: read f5 [2324138,10587] 0 2024-04-25T01:55:38.199 INFO:tasks.workunit.client.0.smithi162.stdout:5/546: unlink d15/d19/f35 0 2024-04-25T01:55:38.587 INFO:tasks.workunit.client.0.smithi162.stdout:6/494: write d1/d13/d28/f29 [1252713,128900] 0 2024-04-25T01:55:38.723 INFO:tasks.workunit.client.0.smithi162.stdout:4/563: link dd/d1a/d34/d72/laa dd/df/d77/d87/lbe 0 2024-04-25T01:55:39.005 INFO:tasks.workunit.client.0.smithi162.stdout:7/547: fsync df/d2e/d4c/d58/d93/fa7 0 2024-04-25T01:55:39.036 INFO:tasks.workunit.client.0.smithi162.stdout:7/548: chown df/d2c/f3f 7 1 2024-04-25T01:55:39.479 INFO:tasks.workunit.client.0.smithi162.stdout:2/520: rename d0/d3/d1b/d6b/l7b to d0/d3/d1b/d6b/lb7 0 2024-04-25T01:55:39.798 INFO:tasks.workunit.client.0.smithi162.stdout:2/521: dread d0/d3/d1b/d1d/f38 [0,4194304] 0 2024-04-25T01:55:40.012 INFO:tasks.workunit.client.0.smithi162.stdout:1/562: write d15/d1f/d23/f25 [459822,7623] 0 2024-04-25T01:55:40.046 INFO:tasks.workunit.client.0.smithi162.stdout:4/564: chown dd/d1a/d34/l99 0 1 2024-04-25T01:55:40.166 INFO:tasks.workunit.client.0.smithi162.stdout:9/485: mknod d4/d8/d13/cac 0 2024-04-25T01:55:40.235 INFO:tasks.workunit.client.0.smithi162.stdout:7/549: symlink df/d2c/d63/lb1 0 2024-04-25T01:55:40.372 INFO:tasks.workunit.client.0.smithi162.stdout:3/566: creat d2/d9/d10/d2c/da3/fc8 x:0 0 0 2024-04-25T01:55:40.889 INFO:tasks.workunit.client.0.smithi162.stdout:8/536: creat d0/d1a/fae x:0 0 0 2024-04-25T01:55:41.109 INFO:tasks.workunit.client.0.smithi162.stdout:2/522: mkdir d0/d3/d1b/d1d/d20/d5e/db8 0 2024-04-25T01:55:41.163 INFO:tasks.workunit.client.0.smithi162.stdout:2/523: readlink d0/d3/d1b/d1d/d20/d5e/d61/d66/l5d 0 2024-04-25T01:55:41.193 INFO:tasks.workunit.client.0.smithi162.stdout:2/524: chown d0/d3/d1b/d6b/d92/d9a 125 1 2024-04-25T01:55:41.689 INFO:tasks.workunit.client.0.smithi162.stdout:7/550: mkdir df/d2e/d4c/d8a/db2 0 2024-04-25T01:55:41.705 INFO:tasks.workunit.client.0.smithi162.stdout:7/551: stat df/f96 0 2024-04-25T01:55:42.120 INFO:tasks.workunit.client.0.smithi162.stdout:1/563: fdatasync d15/d1f/d23/d30/f53 0 2024-04-25T01:55:42.282 INFO:tasks.workunit.client.0.smithi162.stdout:8/537: dread d0/f75 [0,4194304] 0 2024-04-25T01:55:42.373 INFO:tasks.workunit.client.0.smithi162.stdout:0/612: getdents d0/d1/dab 0 2024-04-25T01:55:42.469 INFO:tasks.workunit.client.0.smithi162.stdout:0/613: readlink d0/df/d20/d25/l42 0 2024-04-25T01:55:42.496 INFO:tasks.workunit.client.0.smithi162.stdout:2/525: dread d0/d3/d1b/d1d/d20/d5e/d61/d66/f24 [0,4194304] 0 2024-04-25T01:55:42.575 INFO:tasks.workunit.client.0.smithi162.stdout:5/547: write d15/d19/f59 [564597,35076] 0 2024-04-25T01:55:42.755 INFO:tasks.workunit.client.0.smithi162.stdout:7/552: creat df/d2e/d4c/daf/fb3 x:0 0 0 2024-04-25T01:55:42.923 INFO:tasks.workunit.client.0.smithi162.stdout:3/567: mknod d2/d9/d10/cc9 0 2024-04-25T01:55:43.002 INFO:tasks.workunit.client.0.smithi162.stdout:6/495: getdents d1/d13/d28/d45/d59 0 2024-04-25T01:55:43.030 INFO:tasks.workunit.client.0.smithi162.stdout:6/496: chown d1/d13/d28/d30 32780 1 2024-04-25T01:55:43.157 INFO:tasks.workunit.client.0.smithi162.stdout:6/497: dread d1/f10 [0,4194304] 0 2024-04-25T01:55:43.216 INFO:tasks.workunit.client.0.smithi162.stdout:4/565: creat dd/df/d2e/fbf x:0 0 0 2024-04-25T01:55:43.260 INFO:tasks.workunit.client.0.smithi162.stdout:1/564: truncate d15/d1f/d35/f44 803466 0 2024-04-25T01:55:43.401 INFO:tasks.workunit.client.0.smithi162.stdout:8/538: creat d0/d44/d31/d65/faf x:0 0 0 2024-04-25T01:55:43.812 INFO:tasks.workunit.client.0.smithi162.stdout:0/614: dread - d0/df/d20/fae zero size 2024-04-25T01:55:44.181 INFO:tasks.workunit.client.0.smithi162.stdout:5/548: dread d15/d19/d24/d4d/d7c/fae [0,4194304] 0 2024-04-25T01:55:44.244 INFO:tasks.workunit.client.0.smithi162.stdout:5/549: stat d15/d19/d24/d4d/d7c/d85 0 2024-04-25T01:55:44.281 INFO:tasks.workunit.client.0.smithi162.stdout:5/550: chown d15/d19/d24/d2b/d3b/f91 2754 1 2024-04-25T01:55:44.890 INFO:tasks.workunit.client.0.smithi162.stdout:6/498: dread d1/f3f [0,4194304] 0 2024-04-25T01:55:45.026 INFO:tasks.workunit.client.0.smithi162.stdout:4/566: fsync dd/df/f12 0 2024-04-25T01:55:45.086 INFO:tasks.workunit.client.0.smithi162.stdout:8/539: symlink d0/d12/d3a/lb0 0 2024-04-25T01:55:45.433 INFO:tasks.workunit.client.0.smithi162.stdout:9/486: dwrite d4/d7c/f8f [0,4194304] 0 2024-04-25T01:55:45.545 INFO:tasks.workunit.client.0.smithi162.stdout:5/551: mknod d15/d19/d24/d73/cb0 0 2024-04-25T01:55:45.709 INFO:tasks.workunit.client.0.smithi162.stdout:8/540: dread d0/d44/d31/d65/f88 [0,4194304] 0 2024-04-25T01:55:45.843 INFO:tasks.workunit.client.0.smithi162.stdout:4/567: creat dd/df/d77/fc0 x:0 0 0 2024-04-25T01:55:46.093 INFO:tasks.workunit.client.0.smithi162.stdout:8/541: dread d0/d12/f17 [4194304,4194304] 0 2024-04-25T01:55:46.122 INFO:tasks.workunit.client.0.smithi162.stdout:8/542: chown d0/d44/c21 32531 1 2024-04-25T01:55:46.807 INFO:tasks.workunit.client.0.smithi162.stdout:6/499: creat d1/d13/d28/d45/d59/d93/fa0 x:0 0 0 2024-04-25T01:55:47.061 INFO:tasks.workunit.client.0.smithi162.stdout:9/487: mkdir d4/d9/d15/d4e/dad 0 2024-04-25T01:55:47.096 INFO:tasks.workunit.client.0.smithi162.stdout:9/488: chown d4/d8/d13/f5b 0 1 2024-04-25T01:55:47.219 INFO:tasks.workunit.client.0.smithi162.stdout:4/568: creat dd/d1a/d4e/fc1 x:0 0 0 2024-04-25T01:55:47.321 INFO:tasks.workunit.client.0.smithi162.stdout:8/543: unlink d0/d12/d2b/c52 0 2024-04-25T01:55:47.518 INFO:tasks.workunit.client.0.smithi162.stdout:2/526: dwrite d0/d3/d1b/d1d/d20/d5e/d61/da4/f73 [0,4194304] 0 2024-04-25T01:55:47.611 INFO:tasks.workunit.client.0.smithi162.stdout:8/544: sync 2024-04-25T01:55:47.616 INFO:tasks.workunit.client.0.smithi162.stdout:7/553: rename df/d2c/d63/f79 to df/d2c/fb4 0 2024-04-25T01:55:47.639 INFO:tasks.workunit.client.0.smithi162.stdout:6/500: mkdir d1/d73/da1 0 2024-04-25T01:55:47.752 INFO:tasks.workunit.client.0.smithi162.stdout:5/552: symlink d15/d19/d24/d4d/d9d/lb1 0 2024-04-25T01:55:47.811 INFO:tasks.workunit.client.0.smithi162.stdout:5/553: read - d15/d19/d24/d2b/d3b/d3c/d3f/f6f zero size 2024-04-25T01:55:48.077 INFO:tasks.workunit.client.0.smithi162.stdout:4/569: truncate dd/d1a/f8f 1588947 0 2024-04-25T01:55:48.102 INFO:tasks.workunit.client.0.smithi162.stdout:3/568: getdents d2/d9/d10/d4c/d51/d63/d87/d90 0 2024-04-25T01:55:48.173 INFO:tasks.workunit.client.0.smithi162.stdout:4/570: chown dd/d1a/d4e/fc1 13775046 1 2024-04-25T01:55:48.333 INFO:tasks.workunit.client.0.smithi162.stdout:6/501: creat d1/d46/d7a/fa2 x:0 0 0 2024-04-25T01:55:48.406 INFO:tasks.workunit.client.0.smithi162.stdout:7/554: mkdir df/d2c/d49/d7a/db5 0 2024-04-25T01:55:48.511 INFO:tasks.workunit.client.0.smithi162.stdout:1/565: dwrite d15/d1f/d35/d4c/f88 [0,4194304] 0 2024-04-25T01:55:48.722 INFO:tasks.workunit.client.0.smithi162.stdout:3/569: symlink d2/d9/d10/d4c/d8d/lca 0 2024-04-25T01:55:48.799 INFO:tasks.workunit.client.0.smithi162.stdout:4/571: creat dd/d1a/d34/d57/fc2 x:0 0 0 2024-04-25T01:55:48.801 INFO:tasks.workunit.client.0.smithi162.stdout:1/566: chown d15/f1d 786132379 1 2024-04-25T01:55:48.874 INFO:tasks.workunit.client.0.smithi162.stdout:6/502: creat d1/d46/d7a/d85/fa3 x:0 0 0 2024-04-25T01:55:48.909 INFO:tasks.workunit.client.0.smithi162.stdout:2/527: mknod d0/d3/d1b/d1d/d20/d5e/d61/d62/cb9 0 2024-04-25T01:55:49.016 INFO:tasks.workunit.client.0.smithi162.stdout:7/555: creat df/d2e/d4c/daf/fb6 x:0 0 0 2024-04-25T01:55:49.122 INFO:tasks.workunit.client.0.smithi162.stdout:5/554: dread d15/d19/d24/d2b/d3b/d80/fa2 [0,4194304] 0 2024-04-25T01:55:49.228 INFO:tasks.workunit.client.0.smithi162.stdout:0/615: dwrite d0/d1/d4b/f85 [4194304,4194304] 0 2024-04-25T01:55:49.514 INFO:tasks.workunit.client.0.smithi162.stdout:2/528: dread d0/d3/d5/d36/f37 [0,4194304] 0 2024-04-25T01:55:49.544 INFO:tasks.workunit.client.0.smithi162.stdout:6/503: fdatasync d1/d13/d28/d30/f7c 0 2024-04-25T01:55:49.735 INFO:tasks.workunit.client.0.smithi162.stdout:7/556: fdatasync df/d2c/d49/d5d/f60 0 2024-04-25T01:55:50.248 INFO:tasks.workunit.client.0.smithi162.stdout:0/616: mkdir d0/df/d20/d25/dce 0 2024-04-25T01:55:50.721 INFO:tasks.workunit.client.0.smithi162.stdout:2/529: fdatasync d0/d3/d1b/d1d/d20/d5e/d61/f9d 0 2024-04-25T01:55:50.898 INFO:tasks.workunit.client.0.smithi162.stdout:6/504: truncate d1/f25 4390941 0 2024-04-25T01:55:51.038 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:55:51.041 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:55:51.146 INFO:tasks.workunit.client.0.smithi162.stdout:7/557: creat df/d2c/d63/d83/d8b/d90/fb7 x:0 0 0 2024-04-25T01:55:51.263 INFO:tasks.workunit.client.0.smithi162.stdout:3/570: creat d2/d9/d10/fcb x:0 0 0 2024-04-25T01:55:51.447 INFO:tasks.workunit.client.0.smithi162.stdout:0/617: unlink d0/d1/f53 0 2024-04-25T01:55:51.846 INFO:tasks.workunit.client.0.smithi162.stdout:2/530: truncate d0/d3/d1b/d6b/fa5 498037 0 2024-04-25T01:55:52.268 INFO:tasks.workunit.client.0.smithi162.stdout:0/618: mknod d0/d1/dab/ccf 0 2024-04-25T01:55:52.347 INFO:tasks.workunit.client.0.smithi162.stdout:9/489: dwrite d4/d9/d15/d4e/d59/f9c [0,4194304] 0 2024-04-25T01:55:52.543 INFO:tasks.workunit.client.0.smithi162.stdout:6/505: creat d1/d13/d28/d30/d66/d89/fa4 x:0 0 0 2024-04-25T01:55:52.684 INFO:tasks.workunit.client.0.smithi162.stdout:2/531: mkdir d0/d3/d1b/d1d/d3a/d63/dba 0 2024-04-25T01:55:53.464 INFO:tasks.workunit.client.0.smithi162.stdout:0/619: creat d0/df/d20/d37/d81/dad/fd0 x:0 0 0 2024-04-25T01:55:53.476 INFO:tasks.workunit.client.0.smithi162.stdout:6/506: creat d1/d13/d28/d45/fa5 x:0 0 0 2024-04-25T01:55:54.350 INFO:tasks.workunit.client.0.smithi162.stdout:2/532: mkdir d0/d3/d5/dbb 0 2024-04-25T01:55:54.866 INFO:tasks.workunit.client.0.smithi162.stdout:8/545: rmdir d0/d1a 39 2024-04-25T01:55:54.885 INFO:tasks.workunit.client.0.smithi162.stdout:6/507: creat d1/d73/d9a/fa6 x:0 0 0 2024-04-25T01:55:54.991 INFO:tasks.workunit.client.0.smithi162.stdout:2/533: mknod d0/d3/d5/d36/d93/cbc 0 2024-04-25T01:55:55.096 INFO:tasks.workunit.client.0.smithi162.stdout:1/567: symlink d15/d1f/d23/lb5 0 2024-04-25T01:55:55.261 INFO:tasks.workunit.client.0.smithi162.stdout:5/555: dwrite d15/d19/d24/d40/f5f [0,4194304] 0 2024-04-25T01:55:55.739 INFO:tasks.workunit.client.0.smithi162.stdout:4/572: dwrite dd/df/d2e/d4b/fbd [4194304,4194304] 0 2024-04-25T01:55:55.884 INFO:tasks.workunit.client.0.smithi162.stdout:0/620: truncate d0/df/d20/d25/f4d 1871322 0 2024-04-25T01:55:56.137 INFO:tasks.workunit.client.0.smithi162.stdout:2/534: mkdir d0/d3/d5/d36/d93/dbd 0 2024-04-25T01:55:56.168 INFO:tasks.workunit.client.0.smithi162.stdout:5/556: symlink d15/d19/d24/d73/d7a/d7e/lb2 0 2024-04-25T01:55:56.320 INFO:tasks.workunit.client.0.smithi162.stdout:4/573: dread dd/df/d2e/d59/f91 [0,4194304] 0 2024-04-25T01:55:56.699 INFO:tasks.workunit.client.0.smithi162.stdout:0/621: creat d0/df/fd1 x:0 0 0 2024-04-25T01:55:57.224 INFO:tasks.workunit.client.0.smithi162.stdout:7/558: write df/f96 [2686762,648] 0 2024-04-25T01:55:57.436 INFO:tasks.workunit.client.0.smithi162.stdout:7/559: sync 2024-04-25T01:55:57.471 INFO:tasks.workunit.client.0.smithi162.stdout:0/622: mknod d0/d59/d7e/cd2 0 2024-04-25T01:55:57.550 INFO:tasks.workunit.client.0.smithi162.stdout:4/574: dread dd/d1a/f22 [0,4194304] 0 2024-04-25T01:55:58.152 INFO:tasks.workunit.client.0.smithi162.stdout:7/560: creat df/d2e/fb8 x:0 0 0 2024-04-25T01:55:58.525 INFO:tasks.workunit.client.0.smithi162.stdout:9/490: write d4/d25/f6e [680442,49146] 0 2024-04-25T01:55:58.626 INFO:tasks.workunit.client.0.smithi162.stdout:3/571: dwrite d2/d9/d10/d4c/d51/d63/d87/d86/fa4 [0,4194304] 0 2024-04-25T01:55:58.875 INFO:tasks.workunit.client.0.smithi162.stdout:1/568: link d15/d69/f62 d15/d1f/d35/d4c/d70/d9f/fb6 0 2024-04-25T01:56:00.489 INFO:tasks.workunit.client.0.smithi162.stdout:9/491: mknod d4/d8/d13/cae 0 2024-04-25T01:56:00.877 INFO:tasks.workunit.client.0.smithi162.stdout:6/508: creat d1/d13/d28/fa7 x:0 0 0 2024-04-25T01:56:01.333 INFO:tasks.workunit.client.0.smithi162.stdout:8/546: dwrite d0/f9f [0,4194304] 0 2024-04-25T01:56:01.462 INFO:tasks.workunit.client.0.smithi162.stdout:8/547: chown d0/d44/f15 20251 1 2024-04-25T01:56:01.595 INFO:tasks.workunit.client.0.smithi162.stdout:9/492: mknod d4/d9/caf 0 2024-04-25T01:56:01.620 INFO:tasks.workunit.client.0.smithi162.stdout:2/535: write d0/d3/d5/d36/f37 [2503467,130688] 0 2024-04-25T01:56:01.848 INFO:tasks.workunit.client.0.smithi162.stdout:9/493: chown d4/ca4 2 1 2024-04-25T01:56:01.850 INFO:tasks.workunit.client.0.smithi162.stdout:6/509: dread d1/d13/d28/d30/d3a/f4b [0,4194304] 0 2024-04-25T01:56:02.451 INFO:tasks.workunit.client.0.smithi162.stdout:9/494: read d4/d8/f10 [5892989,11404] 0 2024-04-25T01:56:02.491 INFO:tasks.workunit.client.0.smithi162.stdout:9/495: stat d4/d9/d15/d71/l9b 0 2024-04-25T01:56:02.603 INFO:tasks.workunit.client.0.smithi162.stdout:2/536: mkdir d0/d3/d1b/d1d/d20/d5e/d61/d66/d84/dbe 0 2024-04-25T01:56:02.720 INFO:tasks.workunit.client.0.smithi162.stdout:5/557: write d15/d19/d24/d2b/d3b/d58/f9a [900953,62916] 0 2024-04-25T01:56:03.287 INFO:tasks.workunit.client.0.smithi162.stdout:5/558: truncate d15/d19/d24/d2b/d3b/d3c/d3f/f6f 894829 0 2024-04-25T01:56:03.304 INFO:tasks.workunit.client.0.smithi162.stdout:3/572: write d2/d9/d10/d4c/d51/d63/d87/db6/f8f [931583,128916] 0 2024-04-25T01:56:03.343 INFO:tasks.workunit.client.0.smithi162.stdout:9/496: symlink d4/d8/lb0 0 2024-04-25T01:56:03.578 INFO:tasks.workunit.client.0.smithi162.stdout:3/573: dread d2/d9/d10/d4c/d51/d63/d87/db6/f8f [0,4194304] 0 2024-04-25T01:56:03.583 INFO:tasks.workunit.client.0.smithi162.stdout:5/559: mknod d15/d19/d24/d73/cb3 0 2024-04-25T01:56:04.267 INFO:tasks.workunit.client.0.smithi162.stdout:5/560: dread d15/d19/d24/d2b/d3b/d3c/f70 [0,4194304] 0 2024-04-25T01:56:04.518 INFO:tasks.workunit.client.0.smithi162.stdout:7/561: rename df/d2c/la0 to df/d2e/d4c/d8a/db2/lb9 0 2024-04-25T01:56:05.107 INFO:tasks.workunit.client.0.smithi162.stdout:8/548: write d0/f16 [1732240,1160] 0 2024-04-25T01:56:05.397 INFO:tasks.workunit.client.0.smithi162.stdout:7/562: dread df/d2e/d4c/d8a/f62 [0,4194304] 0 2024-04-25T01:56:05.659 INFO:tasks.workunit.client.0.smithi162.stdout:6/510: dwrite d1/f3f [4194304,4194304] 0 2024-04-25T01:56:06.037 INFO:tasks.workunit.client.0.smithi162.stdout:7/563: truncate df/f32 411388 0 2024-04-25T01:56:06.145 INFO:tasks.workunit.client.0.smithi162.stdout:6/511: fsync d1/d13/d28/d30/d8a/f8c 0 2024-04-25T01:56:06.155 INFO:tasks.workunit.client.0.smithi162.stdout:2/537: dwrite d0/d3/d1b/d1d/d20/d5e/d61/d66/d84/da2/fb0 [0,4194304] 0 2024-04-25T01:56:06.424 INFO:tasks.workunit.client.0.smithi162.stdout:2/538: sync 2024-04-25T01:56:06.529 INFO:tasks.workunit.client.0.smithi162.stdout:3/574: write d2/d29/d2e/f31 [497827,55502] 0 2024-04-25T01:56:06.655 INFO:tasks.workunit.client.0.smithi162.stdout:9/497: dwrite d4/d9/d15/d1b/d2f/f3a [0,4194304] 0 2024-04-25T01:56:06.874 INFO:tasks.workunit.client.0.smithi162.stdout:9/498: readlink d4/d8/d13/l64 0 2024-04-25T01:56:06.946 INFO:tasks.workunit.client.0.smithi162.stdout:6/512: dread d1/f68 [0,4194304] 0 2024-04-25T01:56:06.966 INFO:tasks.workunit.client.0.smithi162.stdout:8/549: mkdir d0/db1 0 2024-04-25T01:56:07.115 INFO:tasks.workunit.client.0.smithi162.stdout:6/513: readlink d1/d13/l2c 0 2024-04-25T01:56:07.187 INFO:tasks.workunit.client.0.smithi162.stdout:8/550: write d0/f16 [1615527,128589] 0 2024-04-25T01:56:07.418 INFO:tasks.workunit.client.0.smithi162.stdout:5/561: dwrite d15/d19/d24/d2b/f53 [0,4194304] 0 2024-04-25T01:56:07.569 INFO:tasks.workunit.client.0.smithi162.stdout:4/575: creat dd/fc3 x:0 0 0 2024-04-25T01:56:07.570 INFO:tasks.workunit.client.0.smithi162.stdout:7/564: mknod df/d2c/d49/d7a/db5/cba 0 2024-04-25T01:56:07.792 INFO:tasks.workunit.client.0.smithi162.stdout:2/539: read - d0/d3/d1b/d6b/d92/d9a/fa3 zero size 2024-04-25T01:56:07.811 INFO:tasks.workunit.client.0.smithi162.stdout:9/499: dread - d4/d9/d15/d4e/fa2 zero size 2024-04-25T01:56:08.007 INFO:tasks.workunit.client.0.smithi162.stdout:6/514: dread d1/d13/d28/d30/d3a/d57/f65 [0,4194304] 0 2024-04-25T01:56:08.469 INFO:tasks.workunit.client.0.smithi162.stdout:3/575: dread - d2/d9/d10/d2c/da3/db5/fc7 zero size 2024-04-25T01:56:08.502 INFO:tasks.workunit.client.0.smithi162.stdout:6/515: creat d1/fa8 x:0 0 0 2024-04-25T01:56:08.798 INFO:tasks.workunit.client.0.smithi162.stdout:2/540: dwrite d0/d3/d5/d36/f37 [0,4194304] 0 2024-04-25T01:56:08.909 INFO:tasks.workunit.client.0.smithi162.stdout:7/565: symlink df/d2c/lbb 0 2024-04-25T01:56:08.960 INFO:tasks.workunit.client.0.smithi162.stdout:2/541: dread - d0/d3/d1b/d6b/f8e zero size 2024-04-25T01:56:08.981 INFO:tasks.workunit.client.0.smithi162.stdout:1/569: rename c12 to d15/d1f/d35/d4c/d8e/cb7 0 2024-04-25T01:56:09.036 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:06:58.470 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:56:09.145 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:06:58.579 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:56:09.200 INFO:tasks.workunit.client.0.smithi162.stdout:6/516: mknod d1/d13/d28/d45/d59/ca9 0 2024-04-25T01:56:09.229 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:06:58.663 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:56:09.257 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:06:58.609 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:56:09.258 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:06:58.610 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:56:09.265 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:06:58.617 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:56:09.271 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:06:58.623 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:56:09.320 INFO:tasks.workunit.client.0.smithi162.stdout:4/576: creat dd/fc4 x:0 0 0 2024-04-25T01:56:09.342 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:06:58.694 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:56:09.348 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:06:58.700 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:56:09.356 INFO:tasks.workunit.client.0.smithi162.stdout:4/577: chown dd/df/d2e/d4b/d79/f85 733998 1 2024-04-25T01:56:09.522 INFO:tasks.workunit.client.0.smithi162.stdout:0/623: rename d0/df/d20/d37/f93 to d0/df/d20/d25/d55/d77/fd3 0 2024-04-25T01:56:09.605 INFO:tasks.workunit.client.0.smithi162.stdout:1/570: mkdir d15/d1f/d35/d4c/d70/d73/db8 0 2024-04-25T01:56:09.849 INFO:tasks.workunit.client.0.smithi162.stdout:5/562: getdents d15/d19/d24/d2b/d3b/d80 0 2024-04-25T01:56:10.276 INFO:tasks.workunit.client.0.smithi162.stdout:7/566: symlink df/d2c/lbc 0 2024-04-25T01:56:10.549 INFO:tasks.workunit.client.0.smithi162.stdout:8/551: rename d0/d12/d3a/f6a to d0/d12/d2b/d87/fb2 0 2024-04-25T01:56:10.758 INFO:tasks.workunit.client.0.smithi162.stdout:1/571: truncate d15/d1f/d23/d30/f53 636794 0 2024-04-25T01:56:10.782 INFO:tasks.workunit.client.0.smithi162.stdout:9/500: dwrite d4/d9/d15/d1b/d2f/d30/f70 [0,4194304] 0 2024-04-25T01:56:11.094 INFO:tasks.workunit.client.0.smithi162.stdout:5/563: read f3 [4518130,85714] 0 2024-04-25T01:56:11.124 INFO:tasks.workunit.client.0.smithi162.stdout:3/576: write d2/d29/d2e/f7a [5470024,56036] 0 2024-04-25T01:56:11.148 INFO:tasks.workunit.client.0.smithi162.stdout:5/564: readlink d15/l60 0 2024-04-25T01:56:11.237 INFO:tasks.workunit.client.0.smithi162.stdout:7/567: mknod df/d2e/d4c/d58/d82/cbd 0 2024-04-25T01:56:11.597 INFO:tasks.workunit.client.0.smithi162.stdout:0/624: fdatasync d0/df/f9a 0 2024-04-25T01:56:11.982 INFO:tasks.workunit.client.0.smithi162.stdout:6/517: write d1/d13/d28/d30/d3a/d57/f65 [2627518,687] 0 2024-04-25T01:56:12.089 INFO:tasks.workunit.client.0.smithi162.stdout:9/501: read d4/f6c [4134305,17875] 0 2024-04-25T01:56:12.126 INFO:tasks.workunit.client.0.smithi162.stdout:9/502: stat d4/d9/d15/d1b/d69/c86 0 2024-04-25T01:56:12.305 INFO:tasks.workunit.client.0.smithi162.stdout:8/552: rename d0/d12/d3a/f42 to d0/d12/d1b/d74/d8a/da3/fb3 0 2024-04-25T01:56:12.770 INFO:tasks.workunit.client.0.smithi162.stdout:7/568: chown df/d2c/f3b 418276 1 2024-04-25T01:56:13.095 INFO:tasks.workunit.client.0.smithi162.stdout:0/625: mkdir d0/d1/d4e/dd4 0 2024-04-25T01:56:13.105 INFO:tasks.workunit.client.0.smithi162.stdout:2/542: link d0/d3/d1b/d1d/d20/d5e/d61/da4/fa6 d0/d3/d5/fbf 0 2024-04-25T01:56:13.153 INFO:tasks.workunit.client.0.smithi162.stdout:4/578: dwrite dd/df/d77/d87/db6/fbb [0,4194304] 0 2024-04-25T01:56:13.379 INFO:tasks.workunit.client.0.smithi162.stdout:2/543: readlink d0/d3/d1b/d1d/d20/d5e/d61/d66/l5d 0 2024-04-25T01:56:13.548 INFO:tasks.workunit.client.0.smithi162.stdout:1/572: truncate d15/d1f/f33 37676 0 2024-04-25T01:56:13.592 INFO:tasks.workunit.client.0.smithi162.stdout:6/518: dread - d1/d13/f23 zero size 2024-04-25T01:56:13.899 INFO:tasks.workunit.client.0.smithi162.stdout:9/503: symlink d4/d9/d15/d8a/lb1 0 2024-04-25T01:56:14.520 INFO:tasks.workunit.client.0.smithi162.stdout:7/569: creat df/d2c/d49/d5d/fbe x:0 0 0 2024-04-25T01:56:14.750 INFO:tasks.workunit.client.0.smithi162.stdout:8/553: dread d0/d44/f1c [0,4194304] 0 2024-04-25T01:56:14.856 INFO:tasks.workunit.client.0.smithi162.stdout:3/577: write d2/d29/f46 [425198,35377] 0 2024-04-25T01:56:15.175 INFO:tasks.workunit.client.0.smithi162.stdout:0/626: mknod d0/d1/d6a/cd5 0 2024-04-25T01:56:15.670 INFO:tasks.workunit.client.0.smithi162.stdout:5/565: dwrite d15/d19/d24/d2b/f52 [0,4194304] 0 2024-04-25T01:56:15.882 INFO:tasks.workunit.client.0.smithi162.stdout:2/544: dread d0/f5c [0,4194304] 0 2024-04-25T01:56:15.964 INFO:tasks.workunit.client.0.smithi162.stdout:7/570: unlink f2 0 2024-04-25T01:56:17.332 INFO:tasks.workunit.client.0.smithi162.stdout:6/519: write d1/d13/f1f [504342,10198] 0 2024-04-25T01:56:17.372 INFO:tasks.workunit.client.0.smithi162.stdout:4/579: dwrite dd/df/d77/fc0 [0,4194304] 0 2024-04-25T01:56:17.619 INFO:tasks.workunit.client.0.smithi162.stdout:1/573: link f14 d15/fb9 0 2024-04-25T01:56:17.773 INFO:tasks.workunit.client.0.smithi162.stdout:0/627: rmdir d0/df/d20/d37/d81/dad/dc8 0 2024-04-25T01:56:18.062 INFO:tasks.workunit.client.0.smithi162.stdout:9/504: dwrite d4/d9/d15/f23 [4194304,4194304] 0 2024-04-25T01:56:18.255 INFO:tasks.workunit.client.0.smithi162.stdout:5/566: creat d15/d19/d24/d2b/d3b/fb4 x:0 0 0 2024-04-25T01:56:18.348 INFO:tasks.workunit.client.0.smithi162.stdout:3/578: dwrite d2/d9/d10/d4c/f7c [0,4194304] 0 2024-04-25T01:56:18.377 INFO:tasks.workunit.client.0.smithi162.stdout:6/520: symlink d1/d46/d7a/d85/laa 0 2024-04-25T01:56:18.507 INFO:tasks.workunit.client.0.smithi162.stdout:9/505: stat d4/d9/d15/d1b/c68 0 2024-04-25T01:56:18.611 INFO:tasks.workunit.client.0.smithi162.stdout:1/574: symlink d15/d1f/d35/d4c/d70/d9f/lba 0 2024-04-25T01:56:18.720 INFO:tasks.workunit.client.0.smithi162.stdout:4/580: dread dd/df/d2e/d59/f9f [0,4194304] 0 2024-04-25T01:56:19.283 INFO:tasks.workunit.client.0.smithi162.stdout:0/628: truncate d0/df/d20/d37/d81/fa8 33531 0 2024-04-25T01:56:19.421 INFO:tasks.workunit.client.0.smithi162.stdout:8/554: mknod d0/cb4 0 2024-04-25T01:56:19.566 INFO:tasks.workunit.client.0.smithi162.stdout:9/506: truncate d4/d8/d13/f27 1576355 0 2024-04-25T01:56:19.678 INFO:tasks.workunit.client.0.smithi162.stdout:3/579: creat d2/d9/d10/d4c/d51/d63/d87/d86/fcc x:0 0 0 2024-04-25T01:56:20.110 INFO:tasks.workunit.client.0.smithi162.stdout:0/629: creat d0/d59/d7e/fd6 x:0 0 0 2024-04-25T01:56:20.715 INFO:tasks.workunit.client.0.smithi162.stdout:1/575: mkdir d15/d1f/d35/d4c/d70/d73/db8/dbb 0 2024-04-25T01:56:20.791 INFO:tasks.workunit.client.0.smithi162.stdout:2/545: write d0/d3/d1b/d6b/f8e [389706,24519] 0 2024-04-25T01:56:20.918 INFO:tasks.workunit.client.0.smithi162.stdout:2/546: readlink d0/l4b 0 2024-04-25T01:56:20.933 INFO:tasks.workunit.client.0.smithi162.stdout:7/571: dwrite df/f23 [0,4194304] 0 2024-04-25T01:56:21.110 INFO:tasks.workunit.client.0.smithi162.stdout:7/572: chown df/d2e/l3a 24 1 2024-04-25T01:56:21.160 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:56:21.163 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:56:21.532 INFO:tasks.workunit.client.0.smithi162.stdout:0/630: chown d0/df/d20/d37/d81/fa8 921 1 2024-04-25T01:56:21.783 INFO:tasks.workunit.client.0.smithi162.stdout:2/547: unlink d0/d3/d1b/d1d/d20/d5e/d61/d62/c77 0 2024-04-25T01:56:21.797 INFO:tasks.workunit.client.0.smithi162.stdout:7/573: mkdir df/d2c/d49/d7a/dbf 0 2024-04-25T01:56:22.244 INFO:tasks.workunit.client.0.smithi162.stdout:0/631: creat d0/df/d20/d37/d81/fd7 x:0 0 0 2024-04-25T01:56:23.009 INFO:tasks.workunit.client.0.smithi162.stdout:5/567: rename d15/d19/d24/d2b/c39 to d15/d19/d24/d2b/d3b/d3c/cb5 0 2024-04-25T01:56:23.309 INFO:tasks.workunit.client.0.smithi162.stdout:4/581: dwrite dd/df/d2e/fb5 [0,4194304] 0 2024-04-25T01:56:23.438 INFO:tasks.workunit.client.0.smithi162.stdout:4/582: chown dd/df/d2e/l4f 2959 1 2024-04-25T01:56:23.728 INFO:tasks.workunit.client.0.smithi162.stdout:6/521: rename d1/d13/d28/d45/d59/d93 to d1/d13/d28/d30/d8a/dab 0 2024-04-25T01:56:23.868 INFO:tasks.workunit.client.0.smithi162.stdout:9/507: write d4/d9/d15/d8a/fa1 [322612,90854] 0 2024-04-25T01:56:24.116 INFO:tasks.workunit.client.0.smithi162.stdout:5/568: dread d15/fa3 [0,4194304] 0 2024-04-25T01:56:24.281 INFO:tasks.workunit.client.0.smithi162.stdout:1/576: write d15/d1f/d23/f56 [1369818,62109] 0 2024-04-25T01:56:24.291 INFO:tasks.workunit.client.0.smithi162.stdout:3/580: dwrite d2/d29/d5d/f9a [0,4194304] 0 2024-04-25T01:56:24.462 INFO:tasks.workunit.client.0.smithi162.stdout:8/555: rename d0/d12/d1b/c5b to d0/d12/d3a/da5/cb5 0 2024-04-25T01:56:24.472 INFO:tasks.workunit.client.0.smithi162.stdout:6/522: stat d1/d13/l22 0 2024-04-25T01:56:24.896 INFO:tasks.workunit.client.0.smithi162.stdout:7/574: write df/d2e/f40 [3439598,59905] 0 2024-04-25T01:56:25.107 INFO:tasks.workunit.client.0.smithi162.stdout:2/548: dwrite d0/f89 [0,4194304] 0 2024-04-25T01:56:25.213 INFO:tasks.workunit.client.0.smithi162.stdout:9/508: rename d4/l73 to d4/d8/d85/lb2 0 2024-04-25T01:56:25.493 INFO:tasks.workunit.client.0.smithi162.stdout:6/523: dread d1/d13/f50 [0,4194304] 0 2024-04-25T01:56:25.695 INFO:tasks.workunit.client.0.smithi162.stdout:7/575: creat df/d2e/fc0 x:0 0 0 2024-04-25T01:56:25.902 INFO:tasks.workunit.client.0.smithi162.stdout:0/632: dwrite d0/d1/d4e/f86 [0,4194304] 0 2024-04-25T01:56:26.054 INFO:tasks.workunit.client.0.smithi162.stdout:8/556: creat d0/d12/d1b/d8d/fb6 x:0 0 0 2024-04-25T01:56:26.264 INFO:tasks.workunit.client.0.smithi162.stdout:3/581: mkdir d2/d9/d10/d4c/d51/d63/d87/d90/db3/dcd 0 2024-04-25T01:56:26.335 INFO:tasks.workunit.client.0.smithi162.stdout:7/576: dread df/d2e/d4c/d58/f87 [0,4194304] 0 2024-04-25T01:56:26.353 INFO:tasks.workunit.client.0.smithi162.stdout:9/509: truncate d4/f74 861147 0 2024-04-25T01:56:26.554 INFO:tasks.workunit.client.0.smithi162.stdout:2/549: rename d0/d3/d1b/d1d/d20 to d0/d3/d1b/d6b/dc0 0 2024-04-25T01:56:26.587 INFO:tasks.workunit.client.0.smithi162.stdout:6/524: fsync d1/fe 0 2024-04-25T01:56:27.036 INFO:tasks.workunit.client.0.smithi162.stdout:4/583: write dd/d1a/d4e/d93/fa5 [5117503,94570] 0 2024-04-25T01:56:27.092 INFO:tasks.workunit.client.0.smithi162.stdout:0/633: dread - d0/d59/d7e/fd6 zero size 2024-04-25T01:56:27.407 INFO:tasks.workunit.client.0.smithi162.stdout:3/582: symlink d2/d9/d10/d4c/d51/d63/d87/lce 0 2024-04-25T01:56:27.452 INFO:tasks.workunit.client.0.smithi162.stdout:7/577: truncate df/f21 8475604 0 2024-04-25T01:56:27.741 INFO:tasks.workunit.client.0.smithi162.stdout:6/525: fdatasync d1/f24 0 2024-04-25T01:56:27.871 INFO:tasks.workunit.client.0.smithi162.stdout:2/550: mkdir d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dc1 0 2024-04-25T01:56:27.883 INFO:tasks.workunit.client.0.smithi162.stdout:2/551: chown d0 59138 1 2024-04-25T01:56:28.119 INFO:tasks.workunit.client.0.smithi162.stdout:5/569: write d15/d1e/f6c [4100716,91151] 0 2024-04-25T01:56:28.202 INFO:tasks.workunit.client.0.smithi162.stdout:1/577: unlink d15/c41 0 2024-04-25T01:56:28.484 INFO:tasks.workunit.client.0.smithi162.stdout:4/584: creat dd/df/d2e/d59/fc5 x:0 0 0 2024-04-25T01:56:28.817 INFO:tasks.workunit.client.0.smithi162.stdout:3/583: dread - d2/d9/d10/d4c/d8d/fc3 zero size 2024-04-25T01:56:29.070 INFO:tasks.workunit.client.0.smithi162.stdout:9/510: creat d4/d9/d15/d1b/da7/fb3 x:0 0 0 2024-04-25T01:56:29.095 INFO:tasks.workunit.client.0.smithi162.stdout:9/511: stat d4/d8/d13/f89 0 2024-04-25T01:56:29.334 INFO:tasks.workunit.client.0.smithi162.stdout:6/526: truncate d1/d13/d28/d30/d3a/d57/f65 4893964 0 2024-04-25T01:56:29.558 INFO:tasks.workunit.client.0.smithi162.stdout:1/578: fdatasync d15/f3f 0 2024-04-25T01:56:29.859 INFO:tasks.workunit.client.0.smithi162.stdout:4/585: creat dd/d1a/d34/d57/fc6 x:0 0 0 2024-04-25T01:56:30.055 INFO:tasks.workunit.client.0.smithi162.stdout:4/586: sync 2024-04-25T01:56:30.101 INFO:tasks.workunit.client.0.smithi162.stdout:4/587: rename dd/df to dd/df/d77/d87/db6/db8/dc7 22 2024-04-25T01:56:30.132 INFO:tasks.workunit.client.0.smithi162.stdout:3/584: truncate d2/d9/d99/f2f 651832 0 2024-04-25T01:56:30.355 INFO:tasks.workunit.client.0.smithi162.stdout:6/527: fdatasync d1/d13/d28/f2f 0 2024-04-25T01:56:30.924 INFO:tasks.workunit.client.0.smithi162.stdout:1/579: symlink d15/d1f/d35/d4c/d70/d73/lbc 0 2024-04-25T01:56:31.148 INFO:tasks.workunit.client.0.smithi162.stdout:8/557: link d0/d44/d31/f39 d0/d44/d91/fb7 0 2024-04-25T01:56:31.764 INFO:tasks.workunit.client.0.smithi162.stdout:3/585: mkdir d2/d29/d5d/dcf 0 2024-04-25T01:56:32.316 INFO:tasks.workunit.client.0.smithi162.stdout:2/552: link d0/d3/d1b/d1d/d3a/c4d d0/d3/d1b/d6b/dc0/d5e/d61/d66/cc2 0 2024-04-25T01:56:32.324 INFO:tasks.workunit.client.0.smithi162.stdout:5/570: link d15/d19/d24/d73/d7a/c8f d15/d19/d24/d4d/d9d/cb6 0 2024-04-25T01:56:32.968 INFO:tasks.workunit.client.0.smithi162.stdout:7/578: write df/d2e/f78 [260167,43902] 0 2024-04-25T01:56:33.200 INFO:tasks.workunit.client.0.smithi162.stdout:8/558: creat d0/d44/d91/fb8 x:0 0 0 2024-04-25T01:56:33.574 INFO:tasks.workunit.client.0.smithi162.stdout:9/512: rmdir d4/d9/d15/d4e/dad 0 2024-04-25T01:56:33.729 INFO:tasks.workunit.client.0.smithi162.stdout:5/571: stat d15/d19/d24/f77 0 2024-04-25T01:56:33.747 INFO:tasks.workunit.client.0.smithi162.stdout:5/572: stat d15/d19/d24 0 2024-04-25T01:56:33.954 INFO:tasks.workunit.client.0.smithi162.stdout:5/573: sync 2024-04-25T01:56:34.180 INFO:tasks.workunit.client.0.smithi162.stdout:0/634: dwrite d0/d1/d64/f83 [0,4194304] 0 2024-04-25T01:56:34.305 INFO:tasks.workunit.client.0.smithi162.stdout:0/635: chown d0/d1/d64/f8c 2770 1 2024-04-25T01:56:34.555 INFO:tasks.workunit.client.0.smithi162.stdout:7/579: mkdir df/d2c/d49/d7a/db5/dc1 0 2024-04-25T01:56:34.599 INFO:tasks.workunit.client.0.smithi162.stdout:2/553: fdatasync d0/d3/d1b/d1d/d3a/d63/fb1 0 2024-04-25T01:56:34.608 INFO:tasks.workunit.client.0.smithi162.stdout:8/559: dread - d0/d12/d2b/d87/fa0 zero size 2024-04-25T01:56:34.697 INFO:tasks.workunit.client.0.smithi162.stdout:8/560: readlink d0/d44/d91/l72 0 2024-04-25T01:56:34.711 INFO:tasks.workunit.client.0.smithi162.stdout:2/554: chown d0/d3/d1b/d6b/d92/d9a 0 1 2024-04-25T01:56:34.757 INFO:tasks.workunit.client.0.smithi162.stdout:8/561: chown d0/d44/d31/d65/f71 2 1 2024-04-25T01:56:34.935 INFO:tasks.workunit.client.0.smithi162.stdout:4/588: write dd/f3a [1748272,79311] 0 2024-04-25T01:56:35.236 INFO:tasks.workunit.client.0.smithi162.stdout:9/513: creat d4/d9/d15/d4e/d9f/fb4 x:0 0 0 2024-04-25T01:56:35.359 INFO:tasks.workunit.client.0.smithi162.stdout:1/580: rename c10 to d15/d69/d4f/dad/cbd 0 2024-04-25T01:56:35.662 INFO:tasks.workunit.client.0.smithi162.stdout:6/528: dwrite d1/d13/d28/f29 [0,4194304] 0 2024-04-25T01:56:35.833 INFO:tasks.workunit.client.0.smithi162.stdout:2/555: mkdir d0/d3/d1b/d6b/dc0/d5e/d61/da4/dc3 0 2024-04-25T01:56:36.432 INFO:tasks.workunit.client.0.smithi162.stdout:9/514: mknod d4/d7c/cb5 0 2024-04-25T01:56:36.450 INFO:tasks.workunit.client.0.smithi162.stdout:3/586: rename d2/d9/d10/d4c/d8d/fc3 to d2/d9/d10/d2c/da3/db5/fd0 0 2024-04-25T01:56:36.654 INFO:tasks.workunit.client.0.smithi162.stdout:1/581: mkdir d15/d1f/d23/d30/d4a/d7f/d97/dbe 0 2024-04-25T01:56:36.969 INFO:tasks.workunit.client.0.smithi162.stdout:6/529: dread d1/d13/d28/d53/f72 [0,4194304] 0 2024-04-25T01:56:36.988 INFO:tasks.workunit.client.0.smithi162.stdout:2/556: truncate d0/d3/d1b/d6b/dc0/f54 871474 0 2024-04-25T01:56:37.167 INFO:tasks.workunit.client.0.smithi162.stdout:4/589: creat dd/df/d77/d87/db6/db8/fc8 x:0 0 0 2024-04-25T01:56:37.545 INFO:tasks.workunit.client.0.smithi162.stdout:8/562: rename d0/d44/d31/d33/f53 to d0/d12/d2b/d87/fb9 0 2024-04-25T01:56:37.568 INFO:tasks.workunit.client.0.smithi162.stdout:8/563: chown d0/d44/l89 411707 1 2024-04-25T01:56:37.911 INFO:tasks.workunit.client.0.smithi162.stdout:7/580: link df/d2e/fc0 df/d2e/d4c/d8a/fc2 0 2024-04-25T01:56:38.397 INFO:tasks.workunit.client.0.smithi162.stdout:5/574: write d15/d19/f20 [64772,50786] 0 2024-04-25T01:56:38.853 INFO:tasks.workunit.client.0.smithi162.stdout:0/636: write d0/df/d20/fae [79345,43378] 0 2024-04-25T01:56:39.552 INFO:tasks.workunit.client.0.smithi162.stdout:1/582: rename d15/d1f/d35/d4c/f88 to d15/d69/d4f/fbf 0 2024-04-25T01:56:39.658 INFO:tasks.workunit.client.0.smithi162.stdout:7/581: truncate df/f22 315630 0 2024-04-25T01:56:39.814 INFO:tasks.workunit.client.0.smithi162.stdout:0/637: truncate d0/d1/dab/fbe 662283 0 2024-04-25T01:56:40.347 INFO:tasks.workunit.client.0.smithi162.stdout:5/575: symlink d15/d19/d24/d2b/d3b/d3c/lb7 0 2024-04-25T01:56:40.591 INFO:tasks.workunit.client.0.smithi162.stdout:5/576: sync 2024-04-25T01:56:40.623 INFO:tasks.workunit.client.0.smithi162.stdout:1/583: creat d15/d1f/d35/d4c/d70/fc0 x:0 0 0 2024-04-25T01:56:40.808 INFO:tasks.workunit.client.0.smithi162.stdout:7/582: creat df/d2c/d49/d7a/fc3 x:0 0 0 2024-04-25T01:56:40.973 INFO:tasks.workunit.client.0.smithi162.stdout:0/638: unlink d0/df/d20/d25/d55/d6f/d7d/ca0 0 2024-04-25T01:56:40.995 INFO:tasks.workunit.client.0.smithi162.stdout:0/639: stat d0/d1/d4e/fac 0 2024-04-25T01:56:41.057 INFO:tasks.workunit.client.0.smithi162.stdout:0/640: read - d0/df/d20/d25/d55/d77/fb8 zero size 2024-04-25T01:56:41.656 INFO:tasks.workunit.client.0.smithi162.stdout:1/584: symlink d15/d69/d4f/lc1 0 2024-04-25T01:56:41.664 INFO:tasks.workunit.client.0.smithi162.stdout:7/583: creat df/d2e/d4c/d58/d82/fc4 x:0 0 0 2024-04-25T01:56:42.007 INFO:tasks.workunit.client.0.smithi162.stdout:3/587: write d2/d29/f2a [142588,54092] 0 2024-04-25T01:56:42.130 INFO:tasks.workunit.client.0.smithi162.stdout:0/641: rmdir d0/d1/d6a/da9 39 2024-04-25T01:56:42.235 INFO:tasks.workunit.client.0.smithi162.stdout:5/577: rename d15/d19/d24/f8c to d15/d19/d24/d4d/fb8 0 2024-04-25T01:56:42.321 INFO:tasks.workunit.client.0.smithi162.stdout:1/585: fsync d15/d1f/d23/f56 0 2024-04-25T01:56:42.689 INFO:tasks.workunit.client.0.smithi162.stdout:6/530: dwrite d1/d13/d28/d30/d8a/f8c [0,4194304] 0 2024-04-25T01:56:42.790 INFO:tasks.workunit.client.0.smithi162.stdout:0/642: rename d0/df/d20/ca5 to d0/d1/d4b/cd8 0 2024-04-25T01:56:42.975 INFO:tasks.workunit.client.0.smithi162.stdout:1/586: creat d15/d1f/d35/d4c/d70/d73/fc2 x:0 0 0 2024-04-25T01:56:43.154 INFO:tasks.workunit.client.0.smithi162.stdout:5/578: dread d15/d19/d24/d2b/d3b/f46 [0,4194304] 0 2024-04-25T01:56:43.164 INFO:tasks.workunit.client.0.smithi162.stdout:7/584: mknod df/d2c/d49/d7a/dbf/cc5 0 2024-04-25T01:56:43.285 INFO:tasks.workunit.client.0.smithi162.stdout:4/590: dwrite dd/d1a/d34/d57/f71 [0,4194304] 0 2024-04-25T01:56:43.490 INFO:tasks.workunit.client.0.smithi162.stdout:9/515: dwrite d4/d9/d15/f5c [0,4194304] 0 2024-04-25T01:56:43.763 INFO:tasks.workunit.client.0.smithi162.stdout:1/587: read d15/d1f/d23/d30/f53 [201694,44499] 0 2024-04-25T01:56:43.948 INFO:tasks.workunit.client.0.smithi162.stdout:5/579: dread f3 [0,4194304] 0 2024-04-25T01:56:44.008 INFO:tasks.workunit.client.0.smithi162.stdout:8/564: write d0/d44/d31/f39 [667966,98011] 0 2024-04-25T01:56:44.551 INFO:tasks.workunit.client.0.smithi162.stdout:3/588: write d2/d9/d10/d4c/f53 [2174882,12771] 0 2024-04-25T01:56:44.707 INFO:tasks.workunit.client.0.smithi162.stdout:6/531: rename d1/d13/d28/d30/d3a/l60 to d1/d13/d28/d30/d3a/lac 0 2024-04-25T01:56:44.803 INFO:tasks.workunit.client.0.smithi162.stdout:2/557: creat d0/d3/d1b/d6b/dc0/fc4 x:0 0 0 2024-04-25T01:56:46.313 INFO:tasks.workunit.client.0.smithi162.stdout:3/589: creat d2/d9/d10/d2c/da3/dba/fd1 x:0 0 0 2024-04-25T01:56:46.699 INFO:tasks.workunit.client.0.smithi162.stdout:0/643: write d0/fd [920142,37104] 0 2024-04-25T01:56:46.700 INFO:tasks.workunit.client.0.smithi162.stdout:9/516: symlink d4/d9/lb6 0 2024-04-25T01:56:46.782 INFO:tasks.workunit.client.0.smithi162.stdout:1/588: fdatasync f14 0 2024-04-25T01:56:46.842 INFO:tasks.workunit.client.0.smithi162.stdout:4/591: write dd/df/d2e/d59/f76 [1400458,118955] 0 2024-04-25T01:56:46.907 INFO:tasks.workunit.client.0.smithi162.stdout:8/565: truncate d0/d12/d1b/d74/d8a/fad 1946622 0 2024-04-25T01:56:48.222 INFO:tasks.workunit.client.0.smithi162.stdout:9/517: rename d4/d9/d15/d1b/l4a to d4/d8/d13/d38/lb7 0 2024-04-25T01:56:48.350 INFO:tasks.workunit.client.0.smithi162.stdout:7/585: write df/d2e/d4c/d58/d82/faa [462251,45991] 0 2024-04-25T01:56:48.441 INFO:tasks.workunit.client.0.smithi162.stdout:8/566: dread d0/d12/d1b/f9b [0,4194304] 0 2024-04-25T01:56:48.467 INFO:tasks.workunit.client.0.smithi162.stdout:8/567: readlink d0/d12/d1b/l41 0 2024-04-25T01:56:48.942 INFO:tasks.workunit.client.0.smithi162.stdout:2/558: creat d0/d3/d7a/fc5 x:0 0 0 2024-04-25T01:56:49.042 INFO:tasks.workunit.client.0.smithi162.stdout:5/580: getdents d15/d19/d24/d2b 0 2024-04-25T01:56:49.266 INFO:tasks.workunit.client.0.smithi162.stdout:1/589: symlink d15/d1f/d35/d5c/lc3 0 2024-04-25T01:56:49.373 INFO:tasks.workunit.client.0.smithi162.stdout:6/532: write d1/d13/d28/d45/f4f [316595,3011] 0 2024-04-25T01:56:49.639 INFO:tasks.workunit.client.0.smithi162.stdout:9/518: dread - d4/d9/d15/d8a/fa5 zero size 2024-04-25T01:56:49.740 INFO:tasks.workunit.client.0.smithi162.stdout:3/590: dwrite d2/d9/d19/f73 [4194304,4194304] 0 2024-04-25T01:56:49.877 INFO:tasks.workunit.client.0.smithi162.stdout:8/568: dread - d0/d44/d91/fb8 zero size 2024-04-25T01:56:49.977 INFO:tasks.workunit.client.0.smithi162.stdout:2/559: symlink d0/d3/d1b/d6b/dc0/d5e/d61/da4/lc6 0 2024-04-25T01:56:50.086 INFO:tasks.workunit.client.0.smithi162.stdout:0/644: link d0/d1/d64/la3 d0/d59/d7e/d9f/ld9 0 2024-04-25T01:56:50.310 INFO:tasks.workunit.client.0.smithi162.stdout:5/581: dread d15/f65 [0,4194304] 0 2024-04-25T01:56:50.454 INFO:tasks.workunit.client.0.smithi162.stdout:1/590: read - d15/d1f/d23/d30/d4a/d7f/d97/fa2 zero size 2024-04-25T01:56:50.716 INFO:tasks.workunit.client.0.smithi162.stdout:4/592: dwrite dd/d1a/d34/d57/fc6 [0,4194304] 0 2024-04-25T01:56:50.851 INFO:tasks.workunit.client.0.smithi162.stdout:3/591: mkdir d2/d9/d99/dd2 0 2024-04-25T01:56:50.967 INFO:tasks.workunit.client.0.smithi162.stdout:4/593: read dd/d1a/d34/d57/f7a [35349,108653] 0 2024-04-25T01:56:51.141 INFO:tasks.workunit.client.0.smithi162.stdout:8/569: mknod d0/d12/d1b/d8d/cba 0 2024-04-25T01:56:51.225 INFO:tasks.workunit.client.0.smithi162.stdout:2/560: creat d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/da2/fc7 x:0 0 0 2024-04-25T01:56:51.298 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:56:51.301 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:56:51.345 INFO:tasks.workunit.client.0.smithi162.stdout:3/592: dread d2/d9/d10/d2c/da3/dba/f81 [0,4194304] 0 2024-04-25T01:56:51.944 INFO:tasks.workunit.client.0.smithi162.stdout:5/582: fdatasync d15/d19/d24/d2b/fab 0 2024-04-25T01:56:52.048 INFO:tasks.workunit.client.0.smithi162.stdout:1/591: creat d15/d69/d4f/fc4 x:0 0 0 2024-04-25T01:56:52.726 INFO:tasks.workunit.client.0.smithi162.stdout:4/594: chown dd/d1a/l45 18993385 1 2024-04-25T01:56:52.760 INFO:tasks.workunit.client.0.smithi162.stdout:8/570: symlink d0/d12/d1b/lbb 0 2024-04-25T01:56:53.286 INFO:tasks.workunit.client.0.smithi162.stdout:0/645: unlink d0/df/d20/d25/d55/d77/f99 0 2024-04-25T01:56:53.347 INFO:tasks.workunit.client.0.smithi162.stdout:0/646: read d0/d1/d4b/f4f [1796161,101572] 0 2024-04-25T01:56:53.789 INFO:tasks.workunit.client.0.smithi162.stdout:1/592: truncate d15/f1a 1752649 0 2024-04-25T01:56:53.889 INFO:tasks.workunit.client.0.smithi162.stdout:5/583: dread d15/d19/d24/d4d/f5a [0,4194304] 0 2024-04-25T01:56:53.890 INFO:tasks.workunit.client.0.smithi162.stdout:9/519: creat d4/d9/fb8 x:0 0 0 2024-04-25T01:56:54.130 INFO:tasks.workunit.client.0.smithi162.stdout:7/586: link df/c44 df/d2c/d49/d7a/db5/cc6 0 2024-04-25T01:56:54.164 INFO:tasks.workunit.client.0.smithi162.stdout:7/587: chown df/d2e/d4c/daf/fb6 3 1 2024-04-25T01:56:54.413 INFO:tasks.workunit.client.0.smithi162.stdout:2/561: unlink d0/d3/d1b/d1d/d3a/f40 0 2024-04-25T01:56:54.856 INFO:tasks.workunit.client.0.smithi162.stdout:6/533: getdents d1/d13/d28/d30/d8a 0 2024-04-25T01:56:55.973 INFO:tasks.workunit.client.0.smithi162.stdout:1/593: unlink d15/d1f/d35/c55 0 2024-04-25T01:56:55.998 INFO:tasks.workunit.client.0.smithi162.stdout:1/594: chown d15/fa4 560268 1 2024-04-25T01:56:56.018 INFO:tasks.workunit.client.0.smithi162.stdout:1/595: stat d15/d69/d4f/fc4 0 2024-04-25T01:56:56.253 INFO:tasks.workunit.client.0.smithi162.stdout:5/584: mknod d15/cb9 0 2024-04-25T01:56:56.274 INFO:tasks.workunit.client.0.smithi162.stdout:6/534: creat d1/d13/d28/d45/fad x:0 0 0 2024-04-25T01:56:56.328 INFO:tasks.workunit.client.0.smithi162.stdout:6/535: chown d1/d46/l49 364788 1 2024-04-25T01:56:56.362 INFO:tasks.workunit.client.0.smithi162.stdout:5/585: chown d15/d19/d24/d2b/d3b/d3c/f70 44677 1 2024-04-25T01:56:56.416 INFO:tasks.workunit.client.0.smithi162.stdout:9/520: truncate d4/d25/f45 964076 0 2024-04-25T01:56:57.063 INFO:tasks.workunit.client.0.smithi162.stdout:1/596: dread d15/d1f/d35/d4c/d70/d73/f77 [0,4194304] 0 2024-04-25T01:56:57.128 INFO:tasks.workunit.client.0.smithi162.stdout:6/536: fsync d1/d13/d28/f2f 0 2024-04-25T01:56:57.211 INFO:tasks.workunit.client.0.smithi162.stdout:9/521: truncate d4/f39 439181 0 2024-04-25T01:56:57.436 INFO:tasks.workunit.client.0.smithi162.stdout:5/586: truncate d15/d19/d24/d40/f41 4229803 0 2024-04-25T01:56:57.513 INFO:tasks.workunit.client.0.smithi162.stdout:0/647: write d0/df/f9a [293075,87077] 0 2024-04-25T01:56:57.757 INFO:tasks.workunit.client.0.smithi162.stdout:3/593: rename d2/l4e to d2/d29/d5d/ld3 0 2024-04-25T01:56:57.826 INFO:tasks.workunit.client.0.smithi162.stdout:4/595: dwrite dd/df/d58/f83 [0,4194304] 0 2024-04-25T01:56:57.832 INFO:tasks.workunit.client.0.smithi162.stdout:6/537: dread d1/d13/d28/d30/d3a/f3c [0,4194304] 0 2024-04-25T01:56:57.980 INFO:tasks.workunit.client.0.smithi162.stdout:7/588: getdents df/d2c/d49/d7a 0 2024-04-25T01:56:58.038 INFO:tasks.workunit.client.0.smithi162.stdout:0/648: chown d0/df/d20/d37/d81/d92 136904 1 2024-04-25T01:56:58.196 INFO:tasks.workunit.client.0.smithi162.stdout:9/522: creat d4/d9/d15/d1b/da7/fb9 x:0 0 0 2024-04-25T01:56:58.289 INFO:tasks.workunit.client.0.smithi162.stdout:1/597: rename d15/d1f/d35/d5c/c8c to d15/d1f/d35/d4c/cc5 0 2024-04-25T01:56:58.601 INFO:tasks.workunit.client.0.smithi162.stdout:2/562: write d0/f5a [4292142,59284] 0 2024-04-25T01:56:58.797 INFO:tasks.workunit.client.0.smithi162.stdout:7/589: mknod df/d2c/d49/d7a/cc7 0 2024-04-25T01:56:58.963 INFO:tasks.workunit.client.0.smithi162.stdout:8/571: dwrite d0/d12/d1b/d74/d8a/da3/fb3 [0,4194304] 0 2024-04-25T01:56:59.493 INFO:tasks.workunit.client.0.smithi162.stdout:0/649: mknod d0/cda 0 2024-04-25T01:57:00.341 INFO:tasks.workunit.client.0.smithi162.stdout:7/590: dread df/d2e/d4c/f54 [0,4194304] 0 2024-04-25T01:57:00.533 INFO:tasks.workunit.client.0.smithi162.stdout:1/598: fsync d15/d1f/f33 0 2024-04-25T01:57:00.794 INFO:tasks.workunit.client.0.smithi162.stdout:0/650: creat d0/df/d20/d25/d55/fdb x:0 0 0 2024-04-25T01:57:01.192 INFO:tasks.workunit.client.0.smithi162.stdout:2/563: symlink d0/d3/d5/lc8 0 2024-04-25T01:57:01.208 INFO:tasks.workunit.client.0.smithi162.stdout:5/587: link d15/d19/d24/d2b/d3b/d3c/fa1 d15/d19/d24/d4d/d7c/d85/fba 0 2024-04-25T01:57:01.498 INFO:tasks.workunit.client.0.smithi162.stdout:7/591: stat df/c41 0 2024-04-25T01:57:01.678 INFO:tasks.workunit.client.0.smithi162.stdout:4/596: write dd/df/f49 [871450,109555] 0 2024-04-25T01:57:02.157 INFO:tasks.workunit.client.0.smithi162.stdout:5/588: mkdir d15/d19/d24/d4d/d7c/dbb 0 2024-04-25T01:57:02.461 INFO:tasks.workunit.client.0.smithi162.stdout:3/594: dwrite d2/d9/d10/d4c/d51/d63/d87/d86/f9b [0,4194304] 0 2024-04-25T01:57:02.617 INFO:tasks.workunit.client.0.smithi162.stdout:4/597: symlink dd/d1a/d34/lc9 0 2024-04-25T01:57:02.674 INFO:tasks.workunit.client.0.smithi162.stdout:9/523: write d4/f6c [1026074,107192] 0 2024-04-25T01:57:03.026 INFO:tasks.workunit.client.0.smithi162.stdout:3/595: symlink d2/d9/d10/d4c/d51/ld4 0 2024-04-25T01:57:03.068 INFO:tasks.workunit.client.0.smithi162.stdout:6/538: write d1/d13/d28/d30/d3a/f3e [2956675,31880] 0 2024-04-25T01:57:03.119 INFO:tasks.workunit.client.0.smithi162.stdout:3/596: dread - d2/d9/d10/d2c/da3/db5/fc7 zero size 2024-04-25T01:57:03.275 INFO:tasks.workunit.client.0.smithi162.stdout:2/564: creat d0/d3/d1b/d6b/dc0/d5e/fc9 x:0 0 0 2024-04-25T01:57:03.390 INFO:tasks.workunit.client.0.smithi162.stdout:9/524: creat d4/d8/d13/d38/fba x:0 0 0 2024-04-25T01:57:03.631 INFO:tasks.workunit.client.0.smithi162.stdout:5/589: symlink d15/d19/d24/d2b/d3b/d3c/lbc 0 2024-04-25T01:57:03.971 INFO:tasks.workunit.client.0.smithi162.stdout:6/539: dread d1/d13/d28/d45/f4f [0,4194304] 0 2024-04-25T01:57:04.014 INFO:tasks.workunit.client.0.smithi162.stdout:8/572: dwrite d0/d12/d1b/d74/d8a/fa7 [0,4194304] 0 2024-04-25T01:57:04.147 INFO:tasks.workunit.client.0.smithi162.stdout:2/565: fsync d0/d3/d7a/d88/f9f 0 2024-04-25T01:57:04.251 INFO:tasks.workunit.client.0.smithi162.stdout:9/525: creat d4/d8/d85/fbb x:0 0 0 2024-04-25T01:57:04.346 INFO:tasks.workunit.client.0.smithi162.stdout:3/597: dread d2/d9/d10/d4c/d51/f7e [0,4194304] 0 2024-04-25T01:57:04.406 INFO:tasks.workunit.client.0.smithi162.stdout:3/598: chown d2/d29/d2e/f5e 0 1 2024-04-25T01:57:04.585 INFO:tasks.workunit.client.0.smithi162.stdout:4/598: link dd/df/d2e/d4b/l74 dd/df/d2e/d59/lca 0 2024-04-25T01:57:05.157 INFO:tasks.workunit.client.0.smithi162.stdout:8/573: truncate d0/f18 6099751 0 2024-04-25T01:57:05.188 INFO:tasks.workunit.client.0.smithi162.stdout:8/574: chown d0/d12/d2b/c30 1125 1 2024-04-25T01:57:05.212 INFO:tasks.workunit.client.0.smithi162.stdout:0/651: write d0/d1/d6a/f8f [583960,29804] 0 2024-04-25T01:57:05.340 INFO:tasks.workunit.client.0.smithi162.stdout:6/540: rename d1/d13/c62 to d1/d13/d28/d53/cae 0 2024-04-25T01:57:05.378 INFO:tasks.workunit.client.0.smithi162.stdout:6/541: stat d1/d13/d28/d30/d3a/f3e 0 2024-04-25T01:57:05.835 INFO:tasks.workunit.client.0.smithi162.stdout:9/526: dread d4/d8/d13/f5b [0,4194304] 0 2024-04-25T01:57:06.215 INFO:tasks.workunit.client.0.smithi162.stdout:0/652: mkdir d0/d1/dab/ddc 0 2024-04-25T01:57:06.229 INFO:tasks.workunit.client.0.smithi162.stdout:7/592: dwrite df/d2c/f5b [0,4194304] 0 2024-04-25T01:57:06.616 INFO:tasks.workunit.client.0.smithi162.stdout:6/542: creat d1/d13/d28/d45/d59/d80/faf x:0 0 0 2024-04-25T01:57:06.645 INFO:tasks.workunit.client.0.smithi162.stdout:1/599: creat d15/d1f/d35/d4c/d70/d9f/fc6 x:0 0 0 2024-04-25T01:57:07.483 INFO:tasks.workunit.client.0.smithi162.stdout:9/527: unlink d4/d9/d15/d1b/d69/c95 0 2024-04-25T01:57:08.061 INFO:tasks.workunit.client.0.smithi162.stdout:6/543: truncate d1/d13/d28/fa7 24602 0 2024-04-25T01:57:08.232 INFO:tasks.workunit.client.0.smithi162.stdout:1/600: dread d15/d69/d4f/fbf [0,4194304] 0 2024-04-25T01:57:08.277 INFO:tasks.workunit.client.0.smithi162.stdout:8/575: creat d0/d44/d31/fbc x:0 0 0 2024-04-25T01:57:08.349 INFO:tasks.workunit.client.0.smithi162.stdout:8/576: truncate d0/d44/d31/fbc 564147 0 2024-04-25T01:57:09.418 INFO:tasks.workunit.client.0.smithi162.stdout:2/566: dwrite d0/f89 [0,4194304] 0 2024-04-25T01:57:09.550 INFO:tasks.workunit.client.0.smithi162.stdout:0/653: mknod d0/df/d20/d25/d51/cdd 0 2024-04-25T01:57:09.797 INFO:tasks.workunit.client.0.smithi162.stdout:3/599: rename d2/l6e to d2/d9/d94/ld5 0 2024-04-25T01:57:09.817 INFO:tasks.workunit.client.0.smithi162.stdout:3/600: readlink d2/d29/l41 0 2024-04-25T01:57:10.586 INFO:tasks.workunit.client.0.smithi162.stdout:5/590: creat d15/d19/d24/fbd x:0 0 0 2024-04-25T01:57:10.667 INFO:tasks.workunit.client.0.smithi162.stdout:4/599: write dd/d1a/d34/f8e [907383,33709] 0 2024-04-25T01:57:10.900 INFO:tasks.workunit.client.0.smithi162.stdout:9/528: getdents d4/d8 0 2024-04-25T01:57:11.140 INFO:tasks.workunit.client.0.smithi162.stdout:8/577: creat d0/d12/fbd x:0 0 0 2024-04-25T01:57:11.149 INFO:tasks.workunit.client.0.smithi162.stdout:7/593: write df/d2e/d4c/d58/f87 [4629435,9829] 0 2024-04-25T01:57:11.360 INFO:tasks.workunit.client.0.smithi162.stdout:4/600: creat dd/df/d2e/d4b/d79/fcb x:0 0 0 2024-04-25T01:57:11.974 INFO:tasks.workunit.client.0.smithi162.stdout:8/578: fdatasync d0/d44/d31/f39 0 2024-04-25T01:57:12.384 INFO:tasks.workunit.client.0.smithi162.stdout:4/601: fdatasync dd/f3a 0 2024-04-25T01:57:12.934 INFO:tasks.workunit.client.0.smithi162.stdout:2/567: link d0/d3/d1b/d6b/dc0/f54 d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/fca 0 2024-04-25T01:57:13.081 INFO:tasks.workunit.client.0.smithi162.stdout:6/544: dwrite d1/d13/f1f [0,4194304] 0 2024-04-25T01:57:13.258 INFO:tasks.workunit.client.0.smithi162.stdout:8/579: mkdir d0/d12/d2b/d87/dbe 0 2024-04-25T01:57:13.435 INFO:tasks.workunit.client.0.smithi162.stdout:6/545: chown d1/d13/d28/d30/d8a/c9c 1 1 2024-04-25T01:57:13.540 INFO:tasks.workunit.client.0.smithi162.stdout:1/601: dwrite d15/fa4 [0,4194304] 0 2024-04-25T01:57:13.986 INFO:tasks.workunit.client.0.smithi162.stdout:8/580: unlink d0/l98 0 2024-04-25T01:57:14.167 INFO:tasks.workunit.client.0.smithi162.stdout:6/546: symlink d1/d46/d7a/lb0 0 2024-04-25T01:57:14.341 INFO:tasks.workunit.client.0.smithi162.stdout:0/654: dwrite d0/df/d20/fae [0,4194304] 0 2024-04-25T01:57:14.471 INFO:tasks.workunit.client.0.smithi162.stdout:9/529: link d4/c7e d4/d9/cbc 0 2024-04-25T01:57:14.559 INFO:tasks.workunit.client.0.smithi162.stdout:0/655: sync 2024-04-25T01:57:14.781 INFO:tasks.workunit.client.0.smithi162.stdout:8/581: rename d0/d12/d1b/f9b to d0/d12/d2b/d87/fbf 0 2024-04-25T01:57:14.936 INFO:tasks.workunit.client.0.smithi162.stdout:5/591: dwrite d15/d1e/f22 [0,4194304] 0 2024-04-25T01:57:15.062 INFO:tasks.workunit.client.0.smithi162.stdout:6/547: mknod d1/d13/d28/d30/d3a/cb1 0 2024-04-25T01:57:15.254 INFO:tasks.workunit.client.0.smithi162.stdout:0/656: read - d0/df/d20/d25/d55/d77/fd3 zero size 2024-04-25T01:57:15.342 INFO:tasks.workunit.client.0.smithi162.stdout:8/582: creat d0/d44/d31/d33/fc0 x:0 0 0 2024-04-25T01:57:15.496 INFO:tasks.workunit.client.0.smithi162.stdout:6/548: dread d1/fe [0,4194304] 0 2024-04-25T01:57:15.822 INFO:tasks.workunit.client.0.smithi162.stdout:0/657: rmdir d0/d1/d4b 39 2024-04-25T01:57:16.296 INFO:tasks.workunit.client.0.smithi162.stdout:5/592: dread d15/d19/d24/d2b/d3b/d3c/d3f/f51 [0,4194304] 0 2024-04-25T01:57:16.481 INFO:tasks.workunit.client.0.smithi162.stdout:1/602: getdents d15/d1f/d35/d4c/d8e 0 2024-04-25T01:57:16.502 INFO:tasks.workunit.client.0.smithi162.stdout:7/594: dwrite df/d2e/d4c/d58/d82/faa [0,4194304] 0 2024-04-25T01:57:16.659 INFO:tasks.workunit.client.0.smithi162.stdout:1/603: sync 2024-04-25T01:57:16.707 INFO:tasks.workunit.client.0.smithi162.stdout:3/601: symlink d2/d9/ld6 0 2024-04-25T01:57:16.736 INFO:tasks.workunit.client.0.smithi162.stdout:0/658: dread d0/df/f66 [0,4194304] 0 2024-04-25T01:57:17.007 INFO:tasks.workunit.client.0.smithi162.stdout:7/595: symlink df/d2e/d4c/d58/d93/lc8 0 2024-04-25T01:57:17.074 INFO:tasks.workunit.client.0.smithi162.stdout:5/593: dread d15/d19/d24/d4d/d7c/d85/f8b [0,4194304] 0 2024-04-25T01:57:17.182 INFO:tasks.workunit.client.0.smithi162.stdout:0/659: symlink d0/d59/d7e/d9f/lde 0 2024-04-25T01:57:17.373 INFO:tasks.workunit.client.0.smithi162.stdout:3/602: truncate d2/d9/d19/f73 4273475 0 2024-04-25T01:57:17.438 INFO:tasks.workunit.client.0.smithi162.stdout:2/568: dwrite d0/f5c [0,4194304] 0 2024-04-25T01:57:17.441 INFO:tasks.workunit.client.0.smithi162.stdout:0/660: chown d0/d59/d7e/d9f/cbf 616 1 2024-04-25T01:57:17.601 INFO:tasks.workunit.client.0.smithi162.stdout:3/603: chown d2/d9/d10/d4c/d8d/f92 3186663 1 2024-04-25T01:57:17.831 INFO:tasks.workunit.client.0.smithi162.stdout:7/596: symlink df/d2c/d49/d7a/dbf/lc9 0 2024-04-25T01:57:18.054 INFO:tasks.workunit.client.0.smithi162.stdout:5/594: rename d15/d1e/f6c to d15/d19/d24/d4d/d9d/fbe 0 2024-04-25T01:57:18.262 INFO:tasks.workunit.client.0.smithi162.stdout:3/604: symlink d2/d9/d94/ld7 0 2024-04-25T01:57:18.612 INFO:tasks.workunit.client.0.smithi162.stdout:5/595: mkdir d15/d19/d24/d40/dbf 0 2024-04-25T01:57:18.803 INFO:tasks.workunit.client.0.smithi162.stdout:0/661: read d0/d1/d4b/f61 [899514,99443] 0 2024-04-25T01:57:18.851 INFO:tasks.workunit.client.0.smithi162.stdout:0/662: dread - d0/df/d20/d25/d55/d77/fd3 zero size 2024-04-25T01:57:19.267 INFO:tasks.workunit.client.0.smithi162.stdout:9/530: dwrite d4/f39 [0,4194304] 0 2024-04-25T01:57:19.439 INFO:tasks.workunit.client.0.smithi162.stdout:6/549: write d1/d13/d28/d30/d63/f6f [2064272,108046] 0 2024-04-25T01:57:19.622 INFO:tasks.workunit.client.0.smithi162.stdout:8/583: dwrite d0/d44/d31/d33/f54 [0,4194304] 0 2024-04-25T01:57:19.738 INFO:tasks.workunit.client.0.smithi162.stdout:2/569: link d0/d3/d1b/d6b/dc0/d5e/d61/d66/f9b d0/d3/d5/d36/d93/fcb 0 2024-04-25T01:57:20.083 INFO:tasks.workunit.client.0.smithi162.stdout:1/604: write d15/d1f/d23/f51 [1979339,85724] 0 2024-04-25T01:57:20.443 INFO:tasks.workunit.client.0.smithi162.stdout:7/597: getdents df/d2c 0 2024-04-25T01:57:21.120 INFO:tasks.workunit.client.0.smithi162.stdout:1/605: fdatasync d15/d1f/d35/d4c/d70/d73/f9b 0 2024-04-25T01:57:21.174 INFO:tasks.workunit.client.0.smithi162.stdout:7/598: truncate df/fa4 267047 0 2024-04-25T01:57:21.431 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:57:21.435 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:57:21.592 INFO:tasks.workunit.client.0.smithi162.stdout:4/602: rmdir dd/df/d2e/d59 39 2024-04-25T01:57:21.761 INFO:tasks.workunit.client.0.smithi162.stdout:1/606: unlink d15/d69/d4f/fbf 0 2024-04-25T01:57:21.989 INFO:tasks.workunit.client.0.smithi162.stdout:7/599: dread df/f32 [0,4194304] 0 2024-04-25T01:57:22.111 INFO:tasks.workunit.client.0.smithi162.stdout:0/663: getdents d0/df/d20/d25/d55/d77 0 2024-04-25T01:57:22.416 INFO:tasks.workunit.client.0.smithi162.stdout:1/607: creat d15/d1f/d23/d30/d4a/d7f/d97/fc7 x:0 0 0 2024-04-25T01:57:22.664 INFO:tasks.workunit.client.0.smithi162.stdout:5/596: dwrite d15/d1e/f8a [0,4194304] 0 2024-04-25T01:57:22.773 INFO:tasks.workunit.client.0.smithi162.stdout:2/570: truncate d0/d3/d1b/d6b/dc0/d5e/d61/d66/f9b 670109 0 2024-04-25T01:57:23.079 INFO:tasks.workunit.client.0.smithi162.stdout:0/664: fdatasync d0/df/fd1 0 2024-04-25T01:57:23.324 INFO:tasks.workunit.client.0.smithi162.stdout:3/605: dwrite d2/d9/d10/f95 [4194304,4194304] 0 2024-04-25T01:57:23.331 INFO:tasks.workunit.client.0.smithi162.stdout:5/597: creat d15/d19/d24/d40/fc0 x:0 0 0 2024-04-25T01:57:23.628 INFO:tasks.workunit.client.0.smithi162.stdout:7/600: dwrite df/d2e/d4c/d58/d82/faa [0,4194304] 0 2024-04-25T01:57:23.802 INFO:tasks.workunit.client.0.smithi162.stdout:2/571: dread d0/d3/d1b/d6b/dc0/fb3 [0,4194304] 0 2024-04-25T01:57:23.819 INFO:tasks.workunit.client.0.smithi162.stdout:0/665: rmdir d0 39 2024-04-25T01:57:23.878 INFO:tasks.workunit.client.0.smithi162.stdout:9/531: write d4/d8/d13/f90 [5199181,63251] 0 2024-04-25T01:57:24.014 INFO:tasks.workunit.client.0.smithi162.stdout:6/550: write d1/d13/d28/d30/d66/f9b [289965,118947] 0 2024-04-25T01:57:24.321 INFO:tasks.workunit.client.0.smithi162.stdout:7/601: fsync df/d2c/f3b 0 2024-04-25T01:57:24.678 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:08:14.111 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:57:24.683 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:08:14.116 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:57:24.755 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:08:14.188 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:57:24.773 INFO:tasks.workunit.client.0.smithi162.stdout:8/584: dwrite d0/d44/f7d [0,4194304] 0 2024-04-25T01:57:24.788 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:08:14.139 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:57:24.796 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:08:14.147 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:57:24.803 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:08:14.154 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:57:24.809 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:08:14.160 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:57:24.856 INFO:tasks.workunit.client.0.smithi162.stdout:3/606: unlink d2/d9/d10/l15 0 2024-04-25T01:57:24.876 INFO:tasks.workunit.client.0.smithi162.stdout:3/607: readlink d2/d9/d99/l1b 0 2024-04-25T01:57:24.892 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:08:14.243 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:57:24.896 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:08:14.247 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:57:25.076 INFO:tasks.workunit.client.0.smithi162.stdout:0/666: mkdir d0/df/d20/d37/ddf 0 2024-04-25T01:57:25.362 INFO:tasks.workunit.client.0.smithi162.stdout:8/585: symlink d0/d44/d64/lc1 0 2024-04-25T01:57:25.597 INFO:tasks.workunit.client.0.smithi162.stdout:3/608: unlink d2/d9/d19/d3f/c88 0 2024-04-25T01:57:26.155 INFO:tasks.workunit.client.0.smithi162.stdout:0/667: mknod d0/df/d20/d25/d55/d6f/d7d/ce0 0 2024-04-25T01:57:26.217 INFO:tasks.workunit.client.0.smithi162.stdout:2/572: link d0/d3/d5/d36/d93/cbc d0/d3/d1b/d6b/dc0/d5e/d61/d62/ccc 0 2024-04-25T01:57:26.416 INFO:tasks.workunit.client.0.smithi162.stdout:7/602: rmdir df/d2c/d63/d83/d8b/dae 0 2024-04-25T01:57:26.511 INFO:tasks.workunit.client.0.smithi162.stdout:4/603: unlink fb 0 2024-04-25T01:57:26.723 INFO:tasks.workunit.client.0.smithi162.stdout:0/668: creat d0/df/d20/d37/d81/d92/fe1 x:0 0 0 2024-04-25T01:57:26.900 INFO:tasks.workunit.client.0.smithi162.stdout:8/586: creat d0/d86/fc2 x:0 0 0 2024-04-25T01:57:27.090 INFO:tasks.workunit.client.0.smithi162.stdout:7/603: dread - df/d2e/fb8 zero size 2024-04-25T01:57:27.269 INFO:tasks.workunit.client.0.smithi162.stdout:0/669: mknod d0/d7b/ce2 0 2024-04-25T01:57:27.439 INFO:tasks.workunit.client.0.smithi162.stdout:1/608: dwrite d15/d1f/d35/d4c/f6f [0,4194304] 0 2024-04-25T01:57:27.575 INFO:tasks.workunit.client.0.smithi162.stdout:8/587: creat d0/d12/d2b/fc3 x:0 0 0 2024-04-25T01:57:27.628 INFO:tasks.workunit.client.0.smithi162.stdout:1/609: sync 2024-04-25T01:57:27.747 INFO:tasks.workunit.client.0.smithi162.stdout:7/604: unlink df/d2c/c42 0 2024-04-25T01:57:27.988 INFO:tasks.workunit.client.0.smithi162.stdout:7/605: dread df/f28 [0,4194304] 0 2024-04-25T01:57:28.010 INFO:tasks.workunit.client.0.smithi162.stdout:7/606: chown df/l27 356462 1 2024-04-25T01:57:28.259 INFO:tasks.workunit.client.0.smithi162.stdout:5/598: write d15/d19/d24/d73/f97 [81137,653] 0 2024-04-25T01:57:28.264 INFO:tasks.workunit.client.0.smithi162.stdout:0/670: mknod d0/d1/d4e/d76/ce3 0 2024-04-25T01:57:28.359 INFO:tasks.workunit.client.0.smithi162.stdout:3/609: getdents d2/d9/d10/d4c/d51/d63/d87/d90/db3 0 2024-04-25T01:57:28.428 INFO:tasks.workunit.client.0.smithi162.stdout:1/610: mknod d15/d1f/d35/d4c/d70/d9f/cc8 0 2024-04-25T01:57:28.651 INFO:tasks.workunit.client.0.smithi162.stdout:7/607: rmdir df/d2e/d4c/d8a/db2 39 2024-04-25T01:57:28.904 INFO:tasks.workunit.client.0.smithi162.stdout:9/532: dwrite d4/d8/d13/d38/f5e [0,4194304] 0 2024-04-25T01:57:29.154 INFO:tasks.workunit.client.0.smithi162.stdout:0/671: fsync d0/df/f1b 0 2024-04-25T01:57:29.603 INFO:tasks.workunit.client.0.smithi162.stdout:4/604: getdents dd/df/d77/d87/db6/db8 0 2024-04-25T01:57:29.753 INFO:tasks.workunit.client.0.smithi162.stdout:9/533: rmdir d4/d9/d15/d1b/d69 39 2024-04-25T01:57:29.784 INFO:tasks.workunit.client.0.smithi162.stdout:9/534: chown d4/d8/d85/c43 4055666 1 2024-04-25T01:57:30.778 INFO:tasks.workunit.client.0.smithi162.stdout:3/610: symlink d2/d9/d10/ld8 0 2024-04-25T01:57:30.819 INFO:tasks.workunit.client.0.smithi162.stdout:3/611: chown d2/d9/d10/d2c/f5c 1 1 2024-04-25T01:57:30.925 INFO:tasks.workunit.client.0.smithi162.stdout:1/611: truncate d15/d69/f62 2052660 0 2024-04-25T01:57:30.933 INFO:tasks.workunit.client.0.smithi162.stdout:3/612: sync 2024-04-25T01:57:30.947 INFO:tasks.workunit.client.0.smithi162.stdout:2/573: write d0/d3/d1b/f5f [624011,50077] 0 2024-04-25T01:57:31.038 INFO:tasks.workunit.client.0.smithi162.stdout:2/574: fsync d0/d3/d1b/f5f 0 2024-04-25T01:57:31.079 INFO:tasks.workunit.client.0.smithi162.stdout:4/605: fsync dd/d1a/d34/d57/f71 0 2024-04-25T01:57:31.409 INFO:tasks.workunit.client.0.smithi162.stdout:0/672: mknod d0/df/d20/d25/d51/ce4 0 2024-04-25T01:57:31.604 INFO:tasks.workunit.client.0.smithi162.stdout:9/535: rmdir d4/d25 39 2024-04-25T01:57:31.970 INFO:tasks.workunit.client.0.smithi162.stdout:1/612: creat d15/d1f/d35/d4c/d70/d73/db8/fc9 x:0 0 0 2024-04-25T01:57:31.978 INFO:tasks.workunit.client.0.smithi162.stdout:4/606: creat dd/d1a/fcc x:0 0 0 2024-04-25T01:57:32.140 INFO:tasks.workunit.client.0.smithi162.stdout:3/613: rename d2/d9/d10/cc9 to d2/d9/d10/d4c/d51/d63/cd9 0 2024-04-25T01:57:32.810 INFO:tasks.workunit.client.0.smithi162.stdout:6/551: symlink d1/d13/d28/d30/lb2 0 2024-04-25T01:57:32.849 INFO:tasks.workunit.client.0.smithi162.stdout:6/552: chown d1/d13/d28/d30/d63 4 1 2024-04-25T01:57:32.875 INFO:tasks.workunit.client.0.smithi162.stdout:9/536: read - d4/d9/fb8 zero size 2024-04-25T01:57:32.928 INFO:tasks.workunit.client.0.smithi162.stdout:9/537: chown d4/l5f 544131448 1 2024-04-25T01:57:33.029 INFO:tasks.workunit.client.0.smithi162.stdout:6/553: dread d1/d13/d28/d30/d66/f67 [0,4194304] 0 2024-04-25T01:57:33.325 INFO:tasks.workunit.client.0.smithi162.stdout:3/614: truncate d2/d9/d10/d2c/da3/fc8 989891 0 2024-04-25T01:57:33.602 INFO:tasks.workunit.client.0.smithi162.stdout:8/588: write d0/d12/f23 [1924451,68862] 0 2024-04-25T01:57:33.782 INFO:tasks.workunit.client.0.smithi162.stdout:0/673: symlink d0/df/d20/d25/le5 0 2024-04-25T01:57:34.120 INFO:tasks.workunit.client.0.smithi162.stdout:9/538: creat d4/d8/d13/d38/fbd x:0 0 0 2024-04-25T01:57:34.131 INFO:tasks.workunit.client.0.smithi162.stdout:6/554: dread - d1/fa8 zero size 2024-04-25T01:57:34.187 INFO:tasks.workunit.client.0.smithi162.stdout:1/613: mknod d15/d1f/d23/d30/cca 0 2024-04-25T01:57:34.214 INFO:tasks.workunit.client.0.smithi162.stdout:6/555: chown d1/d46/d7a/fa2 56064443 1 2024-04-25T01:57:34.301 INFO:tasks.workunit.client.0.smithi162.stdout:7/608: mknod df/d2c/d49/d5d/cca 0 2024-04-25T01:57:34.339 INFO:tasks.workunit.client.0.smithi162.stdout:7/609: dread - df/d2e/d4c/d8a/f8f zero size 2024-04-25T01:57:34.932 INFO:tasks.workunit.client.0.smithi162.stdout:8/589: dread d0/d12/d2b/d87/fbf [0,4194304] 0 2024-04-25T01:57:34.957 INFO:tasks.workunit.client.0.smithi162.stdout:8/590: stat d0/d44/d31/f6c 0 2024-04-25T01:57:35.126 INFO:tasks.workunit.client.0.smithi162.stdout:0/674: fdatasync d0/d1/d6a/f72 0 2024-04-25T01:57:35.245 INFO:tasks.workunit.client.0.smithi162.stdout:1/614: read d15/d1f/d23/f25 [4022664,110683] 0 2024-04-25T01:57:35.916 INFO:tasks.workunit.client.0.smithi162.stdout:8/591: dread - d0/d44/fa9 zero size 2024-04-25T01:57:36.246 INFO:tasks.workunit.client.0.smithi162.stdout:6/556: fsync d1/d13/f42 0 2024-04-25T01:57:36.419 INFO:tasks.workunit.client.0.smithi162.stdout:2/575: write d0/d3/d1b/d6b/dc0/d5e/fc9 [860294,47112] 0 2024-04-25T01:57:36.615 INFO:tasks.workunit.client.0.smithi162.stdout:8/592: chown d0/d12/d1b/d74/ca4 187 1 2024-04-25T01:57:36.745 INFO:tasks.workunit.client.0.smithi162.stdout:5/599: creat d15/d19/d24/fc1 x:0 0 0 2024-04-25T01:57:37.085 INFO:tasks.workunit.client.0.smithi162.stdout:6/557: mknod d1/cb3 0 2024-04-25T01:57:37.274 INFO:tasks.workunit.client.0.smithi162.stdout:3/615: getdents d2/d9/d48 0 2024-04-25T01:57:37.436 INFO:tasks.workunit.client.0.smithi162.stdout:2/576: truncate d0/d3/d1b/d6b/fa0 223824 0 2024-04-25T01:57:37.495 INFO:tasks.workunit.client.0.smithi162.stdout:4/607: dwrite dd/d1a/d34/f8e [0,4194304] 0 2024-04-25T01:57:37.765 INFO:tasks.workunit.client.0.smithi162.stdout:9/539: link d4/d8/d13/l5a d4/d9/d15/d4e/d59/lbe 0 2024-04-25T01:57:37.939 INFO:tasks.workunit.client.0.smithi162.stdout:6/558: dread d1/f21 [0,4194304] 0 2024-04-25T01:57:38.546 INFO:tasks.workunit.client.0.smithi162.stdout:2/577: dread d0/d3/d1b/d1d/f38 [0,4194304] 0 2024-04-25T01:57:39.024 INFO:tasks.workunit.client.0.smithi162.stdout:8/593: link d0/d12/d1b/lbb d0/d44/d31/lc4 0 2024-04-25T01:57:39.282 INFO:tasks.workunit.client.0.smithi162.stdout:6/559: getdents d1/d13/d28/d30/d8a 0 2024-04-25T01:57:39.676 INFO:tasks.workunit.client.0.smithi162.stdout:8/594: dread d0/d12/f4e [0,4194304] 0 2024-04-25T01:57:40.692 INFO:tasks.workunit.client.0.smithi162.stdout:2/578: link d0/d3/d5/d36/c6a d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/ccd 0 2024-04-25T01:57:40.962 INFO:tasks.workunit.client.0.smithi162.stdout:7/610: dwrite df/f22 [0,4194304] 0 2024-04-25T01:57:41.083 INFO:tasks.workunit.client.0.smithi162.stdout:4/608: mknod dd/d1a/d34/ccd 0 2024-04-25T01:57:41.087 INFO:tasks.workunit.client.0.smithi162.stdout:5/600: dwrite d15/d19/d24/d73/f82 [0,4194304] 0 2024-04-25T01:57:41.126 INFO:tasks.workunit.client.0.smithi162.stdout:9/540: write d4/d9/d15/d8a/fa1 [607864,112613] 0 2024-04-25T01:57:41.199 INFO:tasks.workunit.client.0.smithi162.stdout:0/675: rename d0/df/d20/d37/d58/f95 to d0/fe6 0 2024-04-25T01:57:41.274 INFO:tasks.workunit.client.0.smithi162.stdout:4/609: sync 2024-04-25T01:57:41.558 INFO:tasks.workunit.client.0.smithi162.stdout:6/560: dwrite d1/d13/f23 [0,4194304] 0 2024-04-25T01:57:41.794 INFO:tasks.workunit.client.0.smithi162.stdout:7/611: creat df/d2c/d49/d5d/fcb x:0 0 0 2024-04-25T01:57:41.992 INFO:tasks.workunit.client.0.smithi162.stdout:5/601: truncate d15/fa3 3339079 0 2024-04-25T01:57:42.305 INFO:tasks.workunit.client.0.smithi162.stdout:9/541: mkdir d4/d8/d13/dbf 0 2024-04-25T01:57:42.641 INFO:tasks.workunit.client.0.smithi162.stdout:6/561: creat d1/d13/d28/d30/d63/fb4 x:0 0 0 2024-04-25T01:57:42.645 INFO:tasks.workunit.client.0.smithi162.stdout:7/612: truncate df/d2e/f6c 764704 0 2024-04-25T01:57:42.653 INFO:tasks.workunit.client.0.smithi162.stdout:2/579: write d0/f89 [2387273,83553] 0 2024-04-25T01:57:42.891 INFO:tasks.workunit.client.0.smithi162.stdout:1/615: rename d15/d69/l72 to d15/d1f/d23/lcb 0 2024-04-25T01:57:43.402 INFO:tasks.workunit.client.0.smithi162.stdout:0/676: creat d0/fe7 x:0 0 0 2024-04-25T01:57:43.704 INFO:tasks.workunit.client.0.smithi162.stdout:4/610: creat dd/df/d2e/fce x:0 0 0 2024-04-25T01:57:43.721 INFO:tasks.workunit.client.0.smithi162.stdout:7/613: dread - df/f76 zero size 2024-04-25T01:57:43.888 INFO:tasks.workunit.client.0.smithi162.stdout:6/562: creat d1/d13/d28/d30/d8a/dab/fb5 x:0 0 0 2024-04-25T01:57:44.166 INFO:tasks.workunit.client.0.smithi162.stdout:5/602: write d15/d19/f20 [2897667,130866] 0 2024-04-25T01:57:44.355 INFO:tasks.workunit.client.0.smithi162.stdout:1/616: symlink d15/d69/lcc 0 2024-04-25T01:57:44.737 INFO:tasks.workunit.client.0.smithi162.stdout:9/542: dwrite d4/d9/d15/d1b/d2f/d30/f56 [0,4194304] 0 2024-04-25T01:57:44.881 INFO:tasks.workunit.client.0.smithi162.stdout:4/611: fsync dd/df/f97 0 2024-04-25T01:57:45.147 INFO:tasks.workunit.client.0.smithi162.stdout:6/563: mknod d1/d13/d28/d45/d59/d80/cb6 0 2024-04-25T01:57:45.399 INFO:tasks.workunit.client.0.smithi162.stdout:1/617: chown d15/d1f/d23/d30/l86 181012253 1 2024-04-25T01:57:45.525 INFO:tasks.workunit.client.0.smithi162.stdout:0/677: getdents d0/d1/d4e/dd4 0 2024-04-25T01:57:45.728 INFO:tasks.workunit.client.0.smithi162.stdout:9/543: unlink d4/d9/d15/d1b/d2f/f3a 0 2024-04-25T01:57:46.356 INFO:tasks.workunit.client.0.smithi162.stdout:6/564: fsync d1/d13/d28/d30/d66/d89/fa4 0 2024-04-25T01:57:46.702 INFO:tasks.workunit.client.0.smithi162.stdout:6/565: dread d1/f48 [0,4194304] 0 2024-04-25T01:57:46.751 INFO:tasks.workunit.client.0.smithi162.stdout:3/616: rename d2/d9/d10/d2c/da3/dba/l4a to d2/lda 0 2024-04-25T01:57:46.905 INFO:tasks.workunit.client.0.smithi162.stdout:3/617: stat d2/ca 0 2024-04-25T01:57:47.049 INFO:tasks.workunit.client.0.smithi162.stdout:1/618: mkdir d15/d1f/d35/d4c/dcd 0 2024-04-25T01:57:47.265 INFO:tasks.workunit.client.0.smithi162.stdout:5/603: write d15/d19/d24/fa9 [802892,50917] 0 2024-04-25T01:57:47.428 INFO:tasks.workunit.client.0.smithi162.stdout:7/614: dwrite df/d2e/d4c/d58/d93/fa7 [0,4194304] 0 2024-04-25T01:57:47.565 INFO:tasks.workunit.client.0.smithi162.stdout:0/678: dread d0/df/d20/d37/f57 [0,4194304] 0 2024-04-25T01:57:47.987 INFO:tasks.workunit.client.0.smithi162.stdout:3/618: mknod d2/d9/d10/d2c/cdb 0 2024-04-25T01:57:48.008 INFO:tasks.workunit.client.0.smithi162.stdout:4/612: link f5 dd/fcf 0 2024-04-25T01:57:48.037 INFO:tasks.workunit.client.0.smithi162.stdout:5/604: fdatasync d15/d19/d24/d2b/d3b/fb4 0 2024-04-25T01:57:48.090 INFO:tasks.workunit.client.0.smithi162.stdout:4/613: readlink dd/df/d58/l89 0 2024-04-25T01:57:48.191 INFO:tasks.workunit.client.0.smithi162.stdout:5/605: dread d15/d1e/f2a [0,4194304] 0 2024-04-25T01:57:48.207 INFO:tasks.workunit.client.0.smithi162.stdout:0/679: dread - d0/df/d20/d25/d55/d77/fb8 zero size 2024-04-25T01:57:48.214 INFO:tasks.workunit.client.0.smithi162.stdout:3/619: sync 2024-04-25T01:57:48.682 INFO:tasks.workunit.client.0.smithi162.stdout:8/595: rename d0/d12/c8b to d0/d44/d64/cc5 0 2024-04-25T01:57:49.101 INFO:tasks.workunit.client.0.smithi162.stdout:1/619: mknod d15/d1f/d35/d4c/d70/d73/cce 0 2024-04-25T01:57:49.367 INFO:tasks.workunit.client.0.smithi162.stdout:5/606: symlink d15/d19/d24/d73/lc2 0 2024-04-25T01:57:50.311 INFO:tasks.workunit.client.0.smithi162.stdout:6/566: link d1/d13/d28/d30/d66/f67 d1/d13/d28/d30/d3a/fb7 0 2024-04-25T01:57:50.410 INFO:tasks.workunit.client.0.smithi162.stdout:6/567: readlink d1/d46/d7a/d85/l91 0 2024-04-25T01:57:50.537 INFO:tasks.workunit.client.0.smithi162.stdout:5/607: truncate d15/f3a 4776433 0 2024-04-25T01:57:51.108 INFO:tasks.workunit.client.0.smithi162.stdout:7/615: link df/d2e/d4c/d58/f88 df/d2e/fcc 0 2024-04-25T01:57:51.143 INFO:tasks.workunit.client.0.smithi162.stdout:7/616: dread - df/d2c/d49/d7a/fc3 zero size 2024-04-25T01:57:51.215 INFO:tasks.workunit.client.0.smithi162.stdout:2/580: rename d0/d3/d5/d36/d93/l3e to d0/d3/d1b/d6b/dc0/d42/lce 0 2024-04-25T01:57:51.526 INFO:tasks.workunit.client.0.smithi162.stdout:6/568: truncate d1/d13/f23 2165823 0 2024-04-25T01:57:51.542 INFO:tasks.workunit.client.0.smithi162.stdout:5/608: truncate d15/d1e/f2a 147632 0 2024-04-25T01:57:51.550 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:57:51.553 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:57:51.592 INFO:tasks.workunit.client.0.smithi162.stdout:6/569: chown d1/d13/d28/f2f 63574241 1 2024-04-25T01:57:51.617 INFO:tasks.workunit.client.0.smithi162.stdout:6/570: stat d1/d73/d9a/fa6 0 2024-04-25T01:57:51.774 INFO:tasks.workunit.client.0.smithi162.stdout:7/617: truncate df/f9a 837126 0 2024-04-25T01:57:51.968 INFO:tasks.workunit.client.0.smithi162.stdout:8/596: symlink d0/lc6 0 2024-04-25T01:57:52.009 INFO:tasks.workunit.client.0.smithi162.stdout:0/680: dwrite d0/df/d20/d37/f6c [0,4194304] 0 2024-04-25T01:57:52.516 INFO:tasks.workunit.client.0.smithi162.stdout:5/609: creat d15/d19/d24/d4d/d9d/fc3 x:0 0 0 2024-04-25T01:57:52.898 INFO:tasks.workunit.client.0.smithi162.stdout:2/581: mknod d0/d3/d1b/d1d/d3a/d63/dba/ccf 0 2024-04-25T01:57:52.987 INFO:tasks.workunit.client.0.smithi162.stdout:1/620: write d15/d1f/d23/d30/d4a/d7f/d97/fc7 [830511,57399] 0 2024-04-25T01:57:53.027 INFO:tasks.workunit.client.0.smithi162.stdout:8/597: rmdir d0/d44/d64 39 2024-04-25T01:57:53.222 INFO:tasks.workunit.client.0.smithi162.stdout:0/681: creat d0/d1/dab/fe8 x:0 0 0 2024-04-25T01:57:53.245 INFO:tasks.workunit.client.0.smithi162.stdout:0/682: chown d0/l3 892 1 2024-04-25T01:57:53.415 INFO:tasks.workunit.client.0.smithi162.stdout:9/544: rename d4/d9/d15/d1b/da7 to d4/dc0 0 2024-04-25T01:57:54.157 INFO:tasks.workunit.client.0.smithi162.stdout:2/582: mknod d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/cd0 0 2024-04-25T01:57:54.176 INFO:tasks.workunit.client.0.smithi162.stdout:1/621: mknod d15/d69/d4f/ccf 0 2024-04-25T01:57:54.270 INFO:tasks.workunit.client.0.smithi162.stdout:8/598: mkdir d0/d12/d2b/dc7 0 2024-04-25T01:57:54.486 INFO:tasks.workunit.client.0.smithi162.stdout:0/683: fdatasync d0/d1/d4b/f61 0 2024-04-25T01:57:54.677 INFO:tasks.workunit.client.0.smithi162.stdout:4/614: rename dd/f98 to dd/d1a/d4e/d93/fd0 0 2024-04-25T01:57:54.871 INFO:tasks.workunit.client.0.smithi162.stdout:9/545: dread d4/d9/d15/d1b/d2f/d30/f56 [0,4194304] 0 2024-04-25T01:57:55.161 INFO:tasks.workunit.client.0.smithi162.stdout:2/583: mknod d0/d3/d1b/d6b/dc0/d5e/d61/da4/cd1 0 2024-04-25T01:57:55.222 INFO:tasks.workunit.client.0.smithi162.stdout:7/618: write df/d2c/d49/d5d/f60 [946846,37749] 0 2024-04-25T01:57:55.278 INFO:tasks.workunit.client.0.smithi162.stdout:6/571: dwrite d1/d13/d28/d30/f7c [0,4194304] 0 2024-04-25T01:57:55.576 INFO:tasks.workunit.client.0.smithi162.stdout:3/620: rename d2/d9/d10/d2c/da3/db5/fc4 to d2/d29/d2e/fdc 0 2024-04-25T01:57:56.527 INFO:tasks.workunit.client.0.smithi162.stdout:7/619: fdatasync df/f76 0 2024-04-25T01:57:56.561 INFO:tasks.workunit.client.0.smithi162.stdout:7/620: chown df/d2e/l89 352858 1 2024-04-25T01:57:56.883 INFO:tasks.workunit.client.0.smithi162.stdout:2/584: fsync d0/d3/d5/fbf 0 2024-04-25T01:57:56.949 INFO:tasks.workunit.client.0.smithi162.stdout:9/546: dread d4/d25/f93 [0,4194304] 0 2024-04-25T01:57:57.517 INFO:tasks.workunit.client.0.smithi162.stdout:0/684: write d0/df/d20/d25/d55/f5c [544408,100745] 0 2024-04-25T01:57:57.716 INFO:tasks.workunit.client.0.smithi162.stdout:0/685: sync 2024-04-25T01:57:57.755 INFO:tasks.workunit.client.0.smithi162.stdout:1/622: dwrite d15/d1f/d35/d5c/f74 [0,4194304] 0 2024-04-25T01:57:57.856 INFO:tasks.workunit.client.0.smithi162.stdout:0/686: sync 2024-04-25T01:57:57.964 INFO:tasks.workunit.client.0.smithi162.stdout:1/623: chown d15/c20 78 1 2024-04-25T01:57:58.121 INFO:tasks.workunit.client.0.smithi162.stdout:5/610: chown d15/f3a 334462789 1 2024-04-25T01:57:58.243 INFO:tasks.workunit.client.0.smithi162.stdout:4/615: dwrite dd/d1a/d34/d57/fc6 [0,4194304] 0 2024-04-25T01:57:58.485 INFO:tasks.workunit.client.0.smithi162.stdout:2/585: dread d0/d3/d1b/d6b/f8e [0,4194304] 0 2024-04-25T01:57:58.512 INFO:tasks.workunit.client.0.smithi162.stdout:4/616: chown dd/df/d2e/d4b/d79/f85 7149301 1 2024-04-25T01:57:58.817 INFO:tasks.workunit.client.0.smithi162.stdout:3/621: write d2/d29/d2e/f5e [500692,102011] 0 2024-04-25T01:57:58.932 INFO:tasks.workunit.client.0.smithi162.stdout:8/599: link d0/d12/d1b/lbb d0/d12/d1b/d74/lc8 0 2024-04-25T01:57:58.945 INFO:tasks.workunit.client.0.smithi162.stdout:6/572: dwrite d1/d13/d28/d30/d8a/f8c [4194304,4194304] 0 2024-04-25T01:57:59.084 INFO:tasks.workunit.client.0.smithi162.stdout:1/624: rename d15/d1f/d23/fa6 to d15/d1f/d23/d30/d4a/fd0 0 2024-04-25T01:57:59.198 INFO:tasks.workunit.client.0.smithi162.stdout:8/600: chown d0/d12/d1b/d74/d8a/da3/fb3 118960 1 2024-04-25T01:57:59.295 INFO:tasks.workunit.client.0.smithi162.stdout:2/586: creat d0/d3/d1b/d6b/dc0/d42/fd2 x:0 0 0 2024-04-25T01:57:59.695 INFO:tasks.workunit.client.0.smithi162.stdout:7/621: write df/d2e/f6c [331855,106415] 0 2024-04-25T01:57:59.964 INFO:tasks.workunit.client.0.smithi162.stdout:4/617: rename dd/df/d2e/f35 to dd/d1a/d4e/d93/fd1 0 2024-04-25T01:58:00.169 INFO:tasks.workunit.client.0.smithi162.stdout:1/625: dread d15/d1f/d35/f44 [0,4194304] 0 2024-04-25T01:58:00.638 INFO:tasks.workunit.client.0.smithi162.stdout:2/587: truncate d0/d3/d1b/d6b/d92/d9a/fa3 984958 0 2024-04-25T01:58:00.953 INFO:tasks.workunit.client.0.smithi162.stdout:9/547: dwrite d4/d9/f87 [0,4194304] 0 2024-04-25T01:58:01.070 INFO:tasks.workunit.client.0.smithi162.stdout:9/548: chown d4/d8/f2d 31732828 1 2024-04-25T01:58:01.135 INFO:tasks.workunit.client.0.smithi162.stdout:5/611: creat d15/d19/d24/d2b/d3b/d3c/fc4 x:0 0 0 2024-04-25T01:58:01.159 INFO:tasks.workunit.client.0.smithi162.stdout:6/573: creat d1/d13/d28/d7b/fb8 x:0 0 0 2024-04-25T01:58:01.394 INFO:tasks.workunit.client.0.smithi162.stdout:1/626: creat d15/d1f/d23/d30/d4a/d7f/fd1 x:0 0 0 2024-04-25T01:58:01.550 INFO:tasks.workunit.client.0.smithi162.stdout:0/687: getdents d0/df/d20/d25/d55/d6f 0 2024-04-25T01:58:02.156 INFO:tasks.workunit.client.0.smithi162.stdout:9/549: rename d4/d9/d15/d4e to d4/d9/d15/d1b/d2f/d30/dc1 0 2024-04-25T01:58:02.209 INFO:tasks.workunit.client.0.smithi162.stdout:9/550: chown d4/d7c/cb5 4509 1 2024-04-25T01:58:02.752 INFO:tasks.workunit.client.0.smithi162.stdout:3/622: dwrite d2/d9/d10/d4c/d51/d63/d87/db6/f8f [0,4194304] 0 2024-04-25T01:58:02.771 INFO:tasks.workunit.client.0.smithi162.stdout:6/574: rename d1/f39 to d1/d13/d28/d30/d3a/fb9 0 2024-04-25T01:58:02.900 INFO:tasks.workunit.client.0.smithi162.stdout:8/601: write d0/d44/d31/d33/f47 [2326864,59561] 0 2024-04-25T01:58:02.928 INFO:tasks.workunit.client.0.smithi162.stdout:5/612: getdents d15/d19/d24/d4d/d7c/dbb 0 2024-04-25T01:58:03.007 INFO:tasks.workunit.client.0.smithi162.stdout:6/575: stat d1/d13/d28/d45/d59/d80 0 2024-04-25T01:58:03.038 INFO:tasks.workunit.client.0.smithi162.stdout:9/551: creat d4/d9/d15/d1b/d2f/d30/dc1/fc2 x:0 0 0 2024-04-25T01:58:03.137 INFO:tasks.workunit.client.0.smithi162.stdout:1/627: mknod d15/d1f/cd2 0 2024-04-25T01:58:03.263 INFO:tasks.workunit.client.0.smithi162.stdout:2/588: creat d0/d3/d1b/fd3 x:0 0 0 2024-04-25T01:58:04.098 INFO:tasks.workunit.client.0.smithi162.stdout:3/623: dread d2/d9/d10/f11 [0,4194304] 0 2024-04-25T01:58:04.687 INFO:tasks.workunit.client.0.smithi162.stdout:5/613: creat d15/d19/d24/d40/fc5 x:0 0 0 2024-04-25T01:58:04.758 INFO:tasks.workunit.client.0.smithi162.stdout:4/618: dwrite dd/df/d77/d87/db6/fbb [0,4194304] 0 2024-04-25T01:58:04.780 INFO:tasks.workunit.client.0.smithi162.stdout:8/602: mknod d0/d12/d3a/da5/cc9 0 2024-04-25T01:58:04.997 INFO:tasks.workunit.client.0.smithi162.stdout:5/614: stat d15/d19/d24/d73/lc2 0 2024-04-25T01:58:05.064 INFO:tasks.workunit.client.0.smithi162.stdout:8/603: stat d0/d12/d3a/da5/cc9 0 2024-04-25T01:58:05.094 INFO:tasks.workunit.client.0.smithi162.stdout:0/688: dwrite d0/fd [0,4194304] 0 2024-04-25T01:58:05.204 INFO:tasks.workunit.client.0.smithi162.stdout:9/552: symlink d4/d8/lc3 0 2024-04-25T01:58:05.291 INFO:tasks.workunit.client.0.smithi162.stdout:6/576: mknod d1/d13/d28/d30/d3a/d57/cba 0 2024-04-25T01:58:05.363 INFO:tasks.workunit.client.0.smithi162.stdout:1/628: unlink d15/d1f/d35/d4c/d70/d73/f9b 0 2024-04-25T01:58:05.397 INFO:tasks.workunit.client.0.smithi162.stdout:2/589: chown d0/d3/d1b/d6b/fa5 20457 1 2024-04-25T01:58:05.444 INFO:tasks.workunit.client.0.smithi162.stdout:7/622: getdents df/d2e/d4c/d8a/db2 0 2024-04-25T01:58:05.530 INFO:tasks.workunit.client.0.smithi162.stdout:1/629: sync 2024-04-25T01:58:05.570 INFO:tasks.workunit.client.0.smithi162.stdout:1/630: chown d15/d1f/d35/d4c/d70/d73/cce 5 1 2024-04-25T01:58:05.681 INFO:tasks.workunit.client.0.smithi162.stdout:3/624: mkdir d2/d9/d10/d4c/d51/ddd 0 2024-04-25T01:58:06.476 INFO:tasks.workunit.client.0.smithi162.stdout:0/689: fsync d0/df/d20/f40 0 2024-04-25T01:58:06.518 INFO:tasks.workunit.client.0.smithi162.stdout:0/690: readlink d0/d1/d4e/d76/l84 0 2024-04-25T01:58:06.550 INFO:tasks.workunit.client.0.smithi162.stdout:0/691: stat d0/df/d20/d37/da1/ccb 0 2024-04-25T01:58:06.581 INFO:tasks.workunit.client.0.smithi162.stdout:9/553: rmdir d4/d9/d15 39 2024-04-25T01:58:06.930 INFO:tasks.workunit.client.0.smithi162.stdout:2/590: creat d0/d3/d1b/d6b/d92/fd4 x:0 0 0 2024-04-25T01:58:07.407 INFO:tasks.workunit.client.0.smithi162.stdout:3/625: fdatasync d2/d9/d99/f75 0 2024-04-25T01:58:07.460 INFO:tasks.workunit.client.0.smithi162.stdout:4/619: truncate dd/fa1 564849 0 2024-04-25T01:58:07.740 INFO:tasks.workunit.client.0.smithi162.stdout:5/615: fdatasync d15/d19/d24/d2b/f3d 0 2024-04-25T01:58:08.112 INFO:tasks.workunit.client.0.smithi162.stdout:6/577: truncate d1/d13/d28/fa7 928195 0 2024-04-25T01:58:08.750 INFO:tasks.workunit.client.0.smithi162.stdout:7/623: fsync df/d2c/f5b 0 2024-04-25T01:58:08.916 INFO:tasks.workunit.client.0.smithi162.stdout:1/631: unlink d15/d69/f62 0 2024-04-25T01:58:09.351 INFO:tasks.workunit.client.0.smithi162.stdout:4/620: creat dd/df/d77/fd2 x:0 0 0 2024-04-25T01:58:09.533 INFO:tasks.workunit.client.0.smithi162.stdout:0/692: mknod d0/d1/d6a/da9/ce9 0 2024-04-25T01:58:09.560 INFO:tasks.workunit.client.0.smithi162.stdout:9/554: chown d4/d8/l31 0 1 2024-04-25T01:58:09.722 INFO:tasks.workunit.client.0.smithi162.stdout:0/693: sync 2024-04-25T01:58:10.014 INFO:tasks.workunit.client.0.smithi162.stdout:6/578: mkdir d1/d13/d28/d7b/dbb 0 2024-04-25T01:58:10.314 INFO:tasks.workunit.client.0.smithi162.stdout:1/632: creat d15/d1f/d35/d5c/fd3 x:0 0 0 2024-04-25T01:58:10.529 INFO:tasks.workunit.client.0.smithi162.stdout:3/626: symlink d2/d9/lde 0 2024-04-25T01:58:10.762 INFO:tasks.workunit.client.0.smithi162.stdout:4/621: creat dd/d1a/d34/d9d/fd3 x:0 0 0 2024-04-25T01:58:10.961 INFO:tasks.workunit.client.0.smithi162.stdout:2/591: dwrite d0/d3/d5/d36/d93/f76 [0,4194304] 0 2024-04-25T01:58:11.111 INFO:tasks.workunit.client.0.smithi162.stdout:9/555: chown d4/d9/d15/d1b 104243504 1 2024-04-25T01:58:11.142 INFO:tasks.workunit.client.0.smithi162.stdout:9/556: stat d4/d9/fa 0 2024-04-25T01:58:11.177 INFO:tasks.workunit.client.0.smithi162.stdout:8/604: link d0/d44/f7d d0/d44/d31/fca 0 2024-04-25T01:58:11.317 INFO:tasks.workunit.client.0.smithi162.stdout:0/694: unlink d0/df/f9a 0 2024-04-25T01:58:11.532 INFO:tasks.workunit.client.0.smithi162.stdout:6/579: unlink d1/d13/d28/d53/d6d/f9d 0 2024-04-25T01:58:12.285 INFO:tasks.workunit.client.0.smithi162.stdout:7/624: unlink df/c1d 0 2024-04-25T01:58:12.736 INFO:tasks.workunit.client.0.smithi162.stdout:9/557: fdatasync d4/f52 0 2024-04-25T01:58:13.020 INFO:tasks.workunit.client.0.smithi162.stdout:5/616: dwrite d15/d19/d24/d2b/d3b/d3c/d3f/f43 [0,4194304] 0 2024-04-25T01:58:13.696 INFO:tasks.workunit.client.0.smithi162.stdout:4/622: mkdir dd/df/d2e/dd4 0 2024-04-25T01:58:13.943 INFO:tasks.workunit.client.0.smithi162.stdout:3/627: mkdir d2/ddf 0 2024-04-25T01:58:13.966 INFO:tasks.workunit.client.0.smithi162.stdout:2/592: creat d0/d3/d1b/d6b/dc0/d67/fd5 x:0 0 0 2024-04-25T01:58:14.416 INFO:tasks.workunit.client.0.smithi162.stdout:9/558: symlink d4/d9/d15/d1b/d2f/d30/dc1/d59/lc4 0 2024-04-25T01:58:14.979 INFO:tasks.workunit.client.0.smithi162.stdout:2/593: mknod d0/d3/d5/d36/d93/cd6 0 2024-04-25T01:58:15.164 INFO:tasks.workunit.client.0.smithi162.stdout:9/559: truncate d4/d9/f87 51466 0 2024-04-25T01:58:15.179 INFO:tasks.workunit.client.0.smithi162.stdout:4/623: dread dd/f16 [0,4194304] 0 2024-04-25T01:58:15.618 INFO:tasks.workunit.client.0.smithi162.stdout:2/594: mknod d0/d3/d1b/d6b/dc0/d5e/cd7 0 2024-04-25T01:58:15.626 INFO:tasks.workunit.client.0.smithi162.stdout:9/560: mknod d4/d9/d15/d8a/cc5 0 2024-04-25T01:58:15.982 INFO:tasks.workunit.client.0.smithi162.stdout:8/605: write d0/d44/f15 [6723925,129024] 0 2024-04-25T01:58:16.014 INFO:tasks.workunit.client.0.smithi162.stdout:0/695: write d0/fe7 [1033601,106065] 0 2024-04-25T01:58:16.028 INFO:tasks.workunit.client.0.smithi162.stdout:7/625: write f1 [3389610,122221] 0 2024-04-25T01:58:16.206 INFO:tasks.workunit.client.0.smithi162.stdout:5/617: creat d15/d19/d24/d2b/d3b/d58/fc6 x:0 0 0 2024-04-25T01:58:16.214 INFO:tasks.workunit.client.0.smithi162.stdout:0/696: chown d0/df/d20/d25/d55/d77/fb8 271656921 1 2024-04-25T01:58:16.554 INFO:tasks.workunit.client.0.smithi162.stdout:2/595: mknod d0/d3/d5/d36/cd8 0 2024-04-25T01:58:16.627 INFO:tasks.workunit.client.0.smithi162.stdout:6/580: write d1/d13/d28/d30/d3a/f3d [5081384,92515] 0 2024-04-25T01:58:16.771 INFO:tasks.workunit.client.0.smithi162.stdout:6/581: dread d1/d13/d28/d30/d3a/f44 [0,4194304] 0 2024-04-25T01:58:16.999 INFO:tasks.workunit.client.0.smithi162.stdout:7/626: rename df/d2c/d49/d5d/fcb to df/d2e/fcd 0 2024-04-25T01:58:17.327 INFO:tasks.workunit.client.0.smithi162.stdout:3/628: getdents d2/d9/d10/d2c/da3/db5 0 2024-04-25T01:58:17.399 INFO:tasks.workunit.client.0.smithi162.stdout:0/697: read d0/df/d20/d25/d55/fb3 [3325493,82887] 0 2024-04-25T01:58:17.821 INFO:tasks.workunit.client.0.smithi162.stdout:6/582: fdatasync d1/d13/f1f 0 2024-04-25T01:58:18.030 INFO:tasks.workunit.client.0.smithi162.stdout:5/618: rename d15/d19/d24/d73/cb3 to d15/d19/d24/d2b/d3b/d3c/d3f/cc7 0 2024-04-25T01:58:18.471 INFO:tasks.workunit.client.0.smithi162.stdout:4/624: write dd/df/f12 [595395,94801] 0 2024-04-25T01:58:19.610 INFO:tasks.workunit.client.0.smithi162.stdout:9/561: getdents d4 0 2024-04-25T01:58:19.637 INFO:tasks.workunit.client.0.smithi162.stdout:7/627: dread - df/d2c/d63/d83/d8b/f9f zero size 2024-04-25T01:58:19.908 INFO:tasks.workunit.client.0.smithi162.stdout:8/606: dwrite d0/fa1 [0,4194304] 0 2024-04-25T01:58:20.033 INFO:tasks.workunit.client.0.smithi162.stdout:0/698: getdents d0/df/d20/d25/d55/d6f 0 2024-04-25T01:58:20.179 INFO:tasks.workunit.client.0.smithi162.stdout:7/628: creat df/d2c/d49/d7a/fce x:0 0 0 2024-04-25T01:58:20.520 INFO:tasks.workunit.client.0.smithi162.stdout:9/562: symlink d4/d9/d15/d1b/d2f/d30/lc6 0 2024-04-25T01:58:20.625 INFO:tasks.workunit.client.0.smithi162.stdout:1/633: creat d15/d1f/d35/fd4 x:0 0 0 2024-04-25T01:58:20.633 INFO:tasks.workunit.client.0.smithi162.stdout:6/583: write d1/d46/d7a/d85/fa3 [251325,91630] 0 2024-04-25T01:58:20.798 INFO:tasks.workunit.client.0.smithi162.stdout:5/619: write d15/d19/d24/d2b/d3b/f89 [1658782,62428] 0 2024-04-25T01:58:21.080 INFO:tasks.workunit.client.0.smithi162.stdout:0/699: rename d0/d1/d4e/d76/l84 to d0/df/d20/d37/d81/d92/lea 0 2024-04-25T01:58:21.156 INFO:tasks.workunit.client.0.smithi162.stdout:2/596: dwrite d0/d3/d1b/d1d/d3a/f3b [0,4194304] 0 2024-04-25T01:58:21.299 INFO:tasks.workunit.client.0.smithi162.stdout:6/584: dread d1/d13/d28/d45/f61 [0,4194304] 0 2024-04-25T01:58:21.342 INFO:tasks.workunit.client.0.smithi162.stdout:8/607: creat d0/d12/d2b/d87/dbe/fcb x:0 0 0 2024-04-25T01:58:21.416 INFO:tasks.workunit.client.0.smithi162.stdout:3/629: dwrite d2/d9/d10/d2c/da3/db5/fd0 [0,4194304] 0 2024-04-25T01:58:21.546 INFO:tasks.workunit.client.0.smithi162.stdout:0/700: sync 2024-04-25T01:58:21.654 INFO:tasks.workunit.client.0.smithi162.stdout:3/630: chown d2/d29/d5d/c6c 3 1 2024-04-25T01:58:21.672 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:58:21.675 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:58:21.722 INFO:tasks.workunit.client.0.smithi162.stdout:7/629: symlink df/d2c/d63/d83/d8b/lcf 0 2024-04-25T01:58:21.739 INFO:tasks.workunit.client.0.smithi162.stdout:5/620: read - d15/d19/d24/fbd zero size 2024-04-25T01:58:22.045 INFO:tasks.workunit.client.0.smithi162.stdout:9/563: dread d4/d9/d15/f5c [0,4194304] 0 2024-04-25T01:58:22.244 INFO:tasks.workunit.client.0.smithi162.stdout:4/625: dwrite dd/d1a/d4e/d93/fd0 [0,4194304] 0 2024-04-25T01:58:22.562 INFO:tasks.workunit.client.0.smithi162.stdout:6/585: rmdir d1/d13/d28/d30/d3a 39 2024-04-25T01:58:22.576 INFO:tasks.workunit.client.0.smithi162.stdout:2/597: fsync d0/d3/d1b/d6b/dc0/d5e/f96 0 2024-04-25T01:58:22.626 INFO:tasks.workunit.client.0.smithi162.stdout:6/586: chown d1/f51 27586 1 2024-04-25T01:58:22.898 INFO:tasks.workunit.client.0.smithi162.stdout:5/621: fdatasync d15/d19/f34 0 2024-04-25T01:58:23.015 INFO:tasks.workunit.client.0.smithi162.stdout:7/630: mkdir df/d2c/d63/d83/d8b/da2/dd0 0 2024-04-25T01:58:23.247 INFO:tasks.workunit.client.0.smithi162.stdout:7/631: sync 2024-04-25T01:58:23.292 INFO:tasks.workunit.client.0.smithi162.stdout:1/634: creat d15/d1f/d23/fd5 x:0 0 0 2024-04-25T01:58:23.298 INFO:tasks.workunit.client.0.smithi162.stdout:3/631: dread - d2/d9/d10/d4c/d51/d63/d87/d86/fcc zero size 2024-04-25T01:58:23.300 INFO:tasks.workunit.client.0.smithi162.stdout:7/632: chown ce 591435043 1 2024-04-25T01:58:23.831 INFO:tasks.workunit.client.0.smithi162.stdout:2/598: rmdir d0/d3/d1b/d1d/d3a/d63/dba 39 2024-04-25T01:58:23.949 INFO:tasks.workunit.client.0.smithi162.stdout:6/587: read d1/d13/d28/d30/d3a/f3c [1425479,60562] 0 2024-04-25T01:58:24.250 INFO:tasks.workunit.client.0.smithi162.stdout:5/622: fsync d15/d19/d24/d2b/d3b/f91 0 2024-04-25T01:58:24.258 INFO:tasks.workunit.client.0.smithi162.stdout:7/633: readlink df/d2c/lbb 0 2024-04-25T01:58:24.666 INFO:tasks.workunit.client.0.smithi162.stdout:1/635: creat d15/d1f/d35/d5c/fd6 x:0 0 0 2024-04-25T01:58:24.676 INFO:tasks.workunit.client.0.smithi162.stdout:8/608: write d0/d12/d1b/d74/f77 [689789,59104] 0 2024-04-25T01:58:24.825 INFO:tasks.workunit.client.0.smithi162.stdout:0/701: write d0/df/d20/d37/d81/d92/fa4 [680797,61643] 0 2024-04-25T01:58:25.130 INFO:tasks.workunit.client.0.smithi162.stdout:6/588: dread - d1/d13/d28/d45/d59/d80/faf zero size 2024-04-25T01:58:25.771 INFO:tasks.workunit.client.0.smithi162.stdout:3/632: unlink d2/d29/d2e/f3a 0 2024-04-25T01:58:26.084 INFO:tasks.workunit.client.0.smithi162.stdout:4/626: write dd/df/f52 [4627887,62958] 0 2024-04-25T01:58:26.146 INFO:tasks.workunit.client.0.smithi162.stdout:9/564: link d4/d9/d15/d1b/d2f/f62 d4/d9/d15/d1b/d2f/d30/dc1/d59/fc7 0 2024-04-25T01:58:27.249 INFO:tasks.workunit.client.0.smithi162.stdout:3/633: fsync d2/d29/f3c 0 2024-04-25T01:58:27.321 INFO:tasks.workunit.client.0.smithi162.stdout:2/599: write d0/d3/d1b/d6b/dc0/d5e/d61/fb5 [880999,54425] 0 2024-04-25T01:58:27.444 INFO:tasks.workunit.client.0.smithi162.stdout:4/627: unlink dd/df/d2e/d4b/d79/l88 0 2024-04-25T01:58:28.327 INFO:tasks.workunit.client.0.smithi162.stdout:1/636: write f4 [3366225,128109] 0 2024-04-25T01:58:28.758 INFO:tasks.workunit.client.0.smithi162.stdout:8/609: dwrite d0/d44/d31/d65/f7b [0,4194304] 0 2024-04-25T01:58:28.760 INFO:tasks.workunit.client.0.smithi162.stdout:5/623: mkdir d15/d19/d24/d2b/d3b/d58/daf/dc8 0 2024-04-25T01:58:28.916 INFO:tasks.workunit.client.0.smithi162.stdout:4/628: rename dd/d1a/d4e/f80 to dd/d1a/d34/d9d/fd5 0 2024-04-25T01:58:29.051 INFO:tasks.workunit.client.0.smithi162.stdout:9/565: fsync d4/d8/d13/f53 0 2024-04-25T01:58:29.071 INFO:tasks.workunit.client.0.smithi162.stdout:4/629: sync 2024-04-25T01:58:29.224 INFO:tasks.workunit.client.0.smithi162.stdout:0/702: dwrite d0/df/d20/d25/d55/d77/fb8 [0,4194304] 0 2024-04-25T01:58:29.349 INFO:tasks.workunit.client.0.smithi162.stdout:0/703: chown d0/d59/d7e/cd2 720840 1 2024-04-25T01:58:29.383 INFO:tasks.workunit.client.0.smithi162.stdout:1/637: read - d15/d1f/d35/d4c/d70/d73/db8/fc9 zero size 2024-04-25T01:58:29.470 INFO:tasks.workunit.client.0.smithi162.stdout:1/638: sync 2024-04-25T01:58:29.821 INFO:tasks.workunit.client.0.smithi162.stdout:7/634: link df/d2c/lbc df/d2e/d4c/d58/d82/ld1 0 2024-04-25T01:58:29.921 INFO:tasks.workunit.client.0.smithi162.stdout:6/589: write d1/f88 [49183,40004] 0 2024-04-25T01:58:29.957 INFO:tasks.workunit.client.0.smithi162.stdout:5/624: chown l14 196593252 1 2024-04-25T01:58:30.679 INFO:tasks.workunit.client.0.smithi162.stdout:0/704: creat d0/df/d20/d37/d58/feb x:0 0 0 2024-04-25T01:58:30.885 INFO:tasks.workunit.client.0.smithi162.stdout:7/635: dread df/f9a [0,4194304] 0 2024-04-25T01:58:31.090 INFO:tasks.workunit.client.0.smithi162.stdout:8/610: mkdir d0/d12/dcc 0 2024-04-25T01:58:31.843 INFO:tasks.workunit.client.0.smithi162.stdout:1/639: symlink d15/d1f/d35/d5c/d83/ld7 0 2024-04-25T01:58:31.861 INFO:tasks.workunit.client.0.smithi162.stdout:0/705: chown d0/c8 70631719 1 2024-04-25T01:58:31.935 INFO:tasks.workunit.client.0.smithi162.stdout:3/634: write d2/d9/d19/f36 [2484456,26504] 0 2024-04-25T01:58:32.743 INFO:tasks.workunit.client.0.smithi162.stdout:9/566: creat d4/d9/fc8 x:0 0 0 2024-04-25T01:58:32.744 INFO:tasks.workunit.client.0.smithi162.stdout:1/640: creat d15/d1f/d35/d5c/d83/fd8 x:0 0 0 2024-04-25T01:58:32.810 INFO:tasks.workunit.client.0.smithi162.stdout:1/641: dread - d15/d1f/d23/d30/d4a/d7f/d97/fa2 zero size 2024-04-25T01:58:32.996 INFO:tasks.workunit.client.0.smithi162.stdout:0/706: mkdir d0/d1/d4e/d76/dec 0 2024-04-25T01:58:33.245 INFO:tasks.workunit.client.0.smithi162.stdout:8/611: stat d0/d1a/l7 0 2024-04-25T01:58:33.317 INFO:tasks.workunit.client.0.smithi162.stdout:4/630: link dd/la2 dd/d1a/d34/d9d/ld6 0 2024-04-25T01:58:33.578 INFO:tasks.workunit.client.0.smithi162.stdout:2/600: dwrite d0/d3/d1b/d6b/dc0/d42/f43 [0,4194304] 0 2024-04-25T01:58:33.909 INFO:tasks.workunit.client.0.smithi162.stdout:6/590: write d1/f10 [1790554,105490] 0 2024-04-25T01:58:33.954 INFO:tasks.workunit.client.0.smithi162.stdout:8/612: dread - d0/d12/d3a/fab zero size 2024-04-25T01:58:33.972 INFO:tasks.workunit.client.0.smithi162.stdout:5/625: write d15/d19/d24/d2b/d3b/fb4 [247213,4031] 0 2024-04-25T01:58:34.384 INFO:tasks.workunit.client.0.smithi162.stdout:0/707: fdatasync d0/df/d20/d25/f4d 0 2024-04-25T01:58:34.690 INFO:tasks.workunit.client.0.smithi162.stdout:3/635: mkdir d2/d9/d10/d4c/d51/d63/d87/de0 0 2024-04-25T01:58:35.236 INFO:tasks.workunit.client.0.smithi162.stdout:4/631: unlink dd/d1a/d34/c5d 0 2024-04-25T01:58:35.482 INFO:tasks.workunit.client.0.smithi162.stdout:5/626: unlink d15/d19/d24/d2b/d3b/c49 0 2024-04-25T01:58:35.493 INFO:tasks.workunit.client.0.smithi162.stdout:9/567: truncate d4/d8/d85/f7a 123859 0 2024-04-25T01:58:35.531 INFO:tasks.workunit.client.0.smithi162.stdout:9/568: stat d4/d25/c92 0 2024-04-25T01:58:36.139 INFO:tasks.workunit.client.0.smithi162.stdout:2/601: symlink d0/d3/d1b/d6b/ld9 0 2024-04-25T01:58:36.730 INFO:tasks.workunit.client.0.smithi162.stdout:5/627: creat d15/d19/d24/d2b/d3b/d80/fc9 x:0 0 0 2024-04-25T01:58:36.966 INFO:tasks.workunit.client.0.smithi162.stdout:7/636: dwrite df/d2c/fb4 [0,4194304] 0 2024-04-25T01:58:36.986 INFO:tasks.workunit.client.0.smithi162.stdout:1/642: write d15/d1f/d23/fb2 [832262,43883] 0 2024-04-25T01:58:37.252 INFO:tasks.workunit.client.0.smithi162.stdout:1/643: sync 2024-04-25T01:58:37.295 INFO:tasks.workunit.client.0.smithi162.stdout:7/637: sync 2024-04-25T01:58:37.521 INFO:tasks.workunit.client.0.smithi162.stdout:2/602: symlink d0/d3/d1b/d1d/d3a/d63/lda 0 2024-04-25T01:58:37.544 INFO:tasks.workunit.client.0.smithi162.stdout:2/603: chown d0/f89 17266211 1 2024-04-25T01:58:37.679 INFO:tasks.workunit.client.0.smithi162.stdout:9/569: creat d4/d9/fc9 x:0 0 0 2024-04-25T01:58:37.715 INFO:tasks.workunit.client.0.smithi162.stdout:9/570: chown d4/d9/d15/d1b/c68 262020 1 2024-04-25T01:58:37.825 INFO:tasks.workunit.client.0.smithi162.stdout:1/644: mknod d15/d1f/d35/d4c/d70/cd9 0 2024-04-25T01:58:38.179 INFO:tasks.workunit.client.0.smithi162.stdout:8/613: write d0/d1a/f32 [1277000,116621] 0 2024-04-25T01:58:38.184 INFO:tasks.workunit.client.0.smithi162.stdout:6/591: dwrite d1/d13/d28/d30/d3a/f6c [0,4194304] 0 2024-04-25T01:58:38.351 INFO:tasks.workunit.client.0.smithi162.stdout:9/571: read d4/d9/d15/f23 [766966,37871] 0 2024-04-25T01:58:38.781 INFO:tasks.workunit.client.0.smithi162.stdout:1/645: unlink d15/f3f 0 2024-04-25T01:58:39.017 INFO:tasks.workunit.client.0.smithi162.stdout:2/604: unlink d0/d3/d1b/d6b/dc0/d5e/d61/da4/f8b 0 2024-04-25T01:58:39.157 INFO:tasks.workunit.client.0.smithi162.stdout:8/614: mknod d0/d86/ccd 0 2024-04-25T01:58:39.219 INFO:tasks.workunit.client.0.smithi162.stdout:9/572: fdatasync d4/f74 0 2024-04-25T01:58:40.178 INFO:tasks.workunit.client.0.smithi162.stdout:3/636: dwrite d2/d9/d10/d2c/da3/db5/fd0 [0,4194304] 0 2024-04-25T01:58:40.309 INFO:tasks.workunit.client.0.smithi162.stdout:4/632: dwrite dd/df/f12 [4194304,4194304] 0 2024-04-25T01:58:40.406 INFO:tasks.workunit.client.0.smithi162.stdout:9/573: mkdir d4/d8/d85/dca 0 2024-04-25T01:58:40.609 INFO:tasks.workunit.client.0.smithi162.stdout:0/708: write d0/d1/d6a/f75 [1462582,122621] 0 2024-04-25T01:58:40.873 INFO:tasks.workunit.client.0.smithi162.stdout:5/628: write d15/d19/d24/d4d/d7c/fae [4051119,108463] 0 2024-04-25T01:58:41.002 INFO:tasks.workunit.client.0.smithi162.stdout:2/605: symlink d0/d3/d1b/d1d/d3a/d63/dba/ldb 0 2024-04-25T01:58:41.485 INFO:tasks.workunit.client.0.smithi162.stdout:4/633: symlink dd/df/d77/d87/db6/db8/ld7 0 2024-04-25T01:58:41.582 INFO:tasks.workunit.client.0.smithi162.stdout:0/709: mkdir d0/df/d20/d37/d81/dad/ded 0 2024-04-25T01:58:41.721 INFO:tasks.workunit.client.0.smithi162.stdout:5/629: dread - d15/d19/d24/d73/d7a/fac zero size 2024-04-25T01:58:41.781 INFO:tasks.workunit.client.0.smithi162.stdout:5/630: read d15/d19/d24/f77 [7600775,116215] 0 2024-04-25T01:58:41.963 INFO:tasks.workunit.client.0.smithi162.stdout:9/574: truncate d4/d8/d85/f7b 755417 0 2024-04-25T01:58:42.188 INFO:tasks.workunit.client.0.smithi162.stdout:3/637: mkdir d2/d9/d10/d4c/d51/ddd/de1 0 2024-04-25T01:58:42.353 INFO:tasks.workunit.client.0.smithi162.stdout:4/634: rename dd/df/d77/d87/db6/fbb to dd/d1a/d34/db1/fd8 0 2024-04-25T01:58:42.440 INFO:tasks.workunit.client.0.smithi162.stdout:0/710: creat d0/df/d20/d37/d58/fee x:0 0 0 2024-04-25T01:58:42.503 INFO:tasks.workunit.client.0.smithi162.stdout:2/606: mkdir d0/d3/d5/ddc 0 2024-04-25T01:58:42.849 INFO:tasks.workunit.client.0.smithi162.stdout:7/638: dwrite df/d2e/fc0 [0,4194304] 0 2024-04-25T01:58:43.029 INFO:tasks.workunit.client.0.smithi162.stdout:9/575: creat d4/dc0/fcb x:0 0 0 2024-04-25T01:58:43.138 INFO:tasks.workunit.client.0.smithi162.stdout:4/635: unlink dd/df/f86 0 2024-04-25T01:58:43.260 INFO:tasks.workunit.client.0.smithi162.stdout:4/636: read dd/d1a/f22 [3961154,39959] 0 2024-04-25T01:58:43.296 INFO:tasks.workunit.client.0.smithi162.stdout:7/639: dread df/d2e/fc0 [0,4194304] 0 2024-04-25T01:58:43.629 INFO:tasks.workunit.client.0.smithi162.stdout:3/638: rename d2/d9/d10/d2c/da3/dba/d9f/c8a to d2/d9/d10/d4c/d51/ddd/de1/ce2 0 2024-04-25T01:58:43.841 INFO:tasks.workunit.client.0.smithi162.stdout:2/607: dread d0/d3/d1b/d6b/dc0/d5e/d61/da4/f7f [0,4194304] 0 2024-04-25T01:58:43.950 INFO:tasks.workunit.client.0.smithi162.stdout:9/576: creat d4/d9/d15/d8a/fcc x:0 0 0 2024-04-25T01:58:44.036 INFO:tasks.workunit.client.0.smithi162.stdout:9/577: chown d4/d9/d15/d1b/d2f/d30/l3e 332 1 2024-04-25T01:58:44.176 INFO:tasks.workunit.client.0.smithi162.stdout:6/592: write d1/d13/d28/d30/d3a/d57/f65 [3569084,92003] 0 2024-04-25T01:58:44.211 INFO:tasks.workunit.client.0.smithi162.stdout:7/640: creat df/d2c/d49/d7a/dbf/fd2 x:0 0 0 2024-04-25T01:58:44.240 INFO:tasks.workunit.client.0.smithi162.stdout:1/646: write d15/d1f/d23/f48 [117738,96299] 0 2024-04-25T01:58:44.388 INFO:tasks.workunit.client.0.smithi162.stdout:1/647: read d15/d1f/f33 [31597,121172] 0 2024-04-25T01:58:44.494 INFO:tasks.workunit.client.0.smithi162.stdout:3/639: chown d2/d9/f2d 1713089232 1 2024-04-25T01:58:44.554 INFO:tasks.workunit.client.0.smithi162.stdout:3/640: read - d2/d9/d10/d4c/d51/d63/d87/d86/fcc zero size 2024-04-25T01:58:45.326 INFO:tasks.workunit.client.0.smithi162.stdout:8/615: dwrite d0/d44/d31/fca [0,4194304] 0 2024-04-25T01:58:45.742 INFO:tasks.workunit.client.0.smithi162.stdout:0/711: rename d0/df/d20/d25/d51/caf to d0/df/d20/d25/d55/cef 0 2024-04-25T01:58:45.791 INFO:tasks.workunit.client.0.smithi162.stdout:3/641: mkdir d2/d9/d10/d4c/d51/d63/d87/d90/db3/de3 0 2024-04-25T01:58:45.815 INFO:tasks.workunit.client.0.smithi162.stdout:2/608: unlink d0/d3/d1b/d1d/d3a/c4d 0 2024-04-25T01:58:45.996 INFO:tasks.workunit.client.0.smithi162.stdout:8/616: creat d0/d12/d1b/d74/d8a/da3/fce x:0 0 0 2024-04-25T01:58:46.351 INFO:tasks.workunit.client.0.smithi162.stdout:7/641: rename df/d2c/d63/d83/d8b/da2 to df/d2e/d4c/d58/dd3 0 2024-04-25T01:58:46.465 INFO:tasks.workunit.client.0.smithi162.stdout:1/648: truncate d15/d69/f3e 2142030 0 2024-04-25T01:58:46.527 INFO:tasks.workunit.client.0.smithi162.stdout:3/642: mkdir d2/d9/d10/d4c/d51/ddd/de1/de4 0 2024-04-25T01:58:46.559 INFO:tasks.workunit.client.0.smithi162.stdout:3/643: chown d2/d9/d10/d2c/l35 135 1 2024-04-25T01:58:46.679 INFO:tasks.workunit.client.0.smithi162.stdout:8/617: chown d0/d44/d64/c81 273 1 2024-04-25T01:58:46.713 INFO:tasks.workunit.client.0.smithi162.stdout:8/618: chown d0/d12/d1b/l41 113020206 1 2024-04-25T01:58:47.738 INFO:tasks.workunit.client.0.smithi162.stdout:2/609: rename d0/d3/d5/d36/d93/cd6 to d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/da2/cdd 0 2024-04-25T01:58:47.747 INFO:tasks.workunit.client.0.smithi162.stdout:7/642: truncate df/d2e/d4c/d8a/f62 4705938 0 2024-04-25T01:58:47.890 INFO:tasks.workunit.client.0.smithi162.stdout:1/649: fdatasync f14 0 2024-04-25T01:58:48.150 INFO:tasks.workunit.client.0.smithi162.stdout:5/631: mkdir d15/d19/d24/dca 0 2024-04-25T01:58:48.428 INFO:tasks.workunit.client.0.smithi162.stdout:7/643: symlink df/d2e/d4c/d58/dd3/ld4 0 2024-04-25T01:58:48.463 INFO:tasks.workunit.client.0.smithi162.stdout:7/644: read - df/d2c/d49/d7a/fc3 zero size 2024-04-25T01:58:48.595 INFO:tasks.workunit.client.0.smithi162.stdout:2/610: truncate d0/d3/d7a/d88/f9f 723453 0 2024-04-25T01:58:48.604 INFO:tasks.workunit.client.0.smithi162.stdout:4/637: write dd/f16 [1752550,35768] 0 2024-04-25T01:58:48.700 INFO:tasks.workunit.client.0.smithi162.stdout:2/611: chown d0/d3/d1b/d6b/d9e/lac 1038662 1 2024-04-25T01:58:48.946 INFO:tasks.workunit.client.0.smithi162.stdout:0/712: symlink d0/lf0 0 2024-04-25T01:58:49.270 INFO:tasks.workunit.client.0.smithi162.stdout:8/619: mknod d0/d12/dcc/ccf 0 2024-04-25T01:58:49.417 INFO:tasks.workunit.client.0.smithi162.stdout:8/620: dread d0/d1a/f28 [0,4194304] 0 2024-04-25T01:58:49.529 INFO:tasks.workunit.client.0.smithi162.stdout:4/638: truncate dd/d1a/f22 4278617 0 2024-04-25T01:58:50.090 INFO:tasks.workunit.client.0.smithi162.stdout:0/713: rename d0/d1/d4b/f4f to d0/df/d20/d37/ddf/ff1 0 2024-04-25T01:58:50.104 INFO:tasks.workunit.client.0.smithi162.stdout:9/578: dwrite d4/f21 [4194304,4194304] 0 2024-04-25T01:58:50.316 INFO:tasks.workunit.client.0.smithi162.stdout:5/632: symlink d15/d19/d24/d4d/d7c/dbb/lcb 0 2024-04-25T01:58:50.567 INFO:tasks.workunit.client.0.smithi162.stdout:6/593: dwrite d1/d13/d28/d30/d3a/f3c [0,4194304] 0 2024-04-25T01:58:50.827 INFO:tasks.workunit.client.0.smithi162.stdout:6/594: dread d1/f21 [0,4194304] 0 2024-04-25T01:58:50.875 INFO:tasks.workunit.client.0.smithi162.stdout:2/612: creat d0/d3/d1b/d6b/dc0/d67/d9c/fde x:0 0 0 2024-04-25T01:58:51.720 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:58:51.724 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:58:52.421 INFO:tasks.workunit.client.0.smithi162.stdout:1/650: getdents d15/d1f/d35/d5c 0 2024-04-25T01:58:52.791 INFO:tasks.workunit.client.0.smithi162.stdout:9/579: symlink d4/d25/da3/lcd 0 2024-04-25T01:58:53.067 INFO:tasks.workunit.client.0.smithi162.stdout:6/595: fsync d1/d13/d28/fa7 0 2024-04-25T01:58:53.666 INFO:tasks.workunit.client.0.smithi162.stdout:5/633: link d15/l30 d15/d19/d24/d40/dbf/lcc 0 2024-04-25T01:58:53.727 INFO:tasks.workunit.client.0.smithi162.stdout:5/634: chown d15/d19/d24/d2b/d3b/d80/c87 129228339 1 2024-04-25T01:58:54.107 INFO:tasks.workunit.client.0.smithi162.stdout:5/635: mknod d15/d1e/ccd 0 2024-04-25T01:58:54.321 INFO:tasks.workunit.client.0.smithi162.stdout:1/651: getdents d15/d1f/d35/d4c/d8e 0 2024-04-25T01:58:54.503 INFO:tasks.workunit.client.0.smithi162.stdout:9/580: creat d4/d9/d15/d1b/d2f/fce x:0 0 0 2024-04-25T01:58:54.643 INFO:tasks.workunit.client.0.smithi162.stdout:7/645: dwrite df/d2c/d63/f69 [0,4194304] 0 2024-04-25T01:58:54.803 INFO:tasks.workunit.client.0.smithi162.stdout:3/644: write d2/d9/d99/f2f [78821,63024] 0 2024-04-25T01:58:55.013 INFO:tasks.workunit.client.0.smithi162.stdout:1/652: dread - d15/d1f/d23/d30/f9c zero size 2024-04-25T01:58:55.096 INFO:tasks.workunit.client.0.smithi162.stdout:3/645: sync 2024-04-25T01:58:55.286 INFO:tasks.workunit.client.0.smithi162.stdout:7/646: mknod df/d2c/d49/cd5 0 2024-04-25T01:58:55.478 INFO:tasks.workunit.client.0.smithi162.stdout:8/621: write d0/d12/d1b/d74/d8a/da3/faa [357348,110634] 0 2024-04-25T01:58:55.607 INFO:tasks.workunit.client.0.smithi162.stdout:9/581: creat d4/d8/d13/dbf/fcf x:0 0 0 2024-04-25T01:58:55.839 INFO:tasks.workunit.client.0.smithi162.stdout:7/647: mknod df/d2e/d4c/daf/cd6 0 2024-04-25T01:58:55.895 INFO:tasks.workunit.client.0.smithi162.stdout:1/653: dread d15/d1f/d23/f64 [0,4194304] 0 2024-04-25T01:58:55.950 INFO:tasks.workunit.client.0.smithi162.stdout:7/648: stat df/f95 0 2024-04-25T01:58:56.133 INFO:tasks.workunit.client.0.smithi162.stdout:4/639: dwrite dd/d1a/d34/f51 [0,4194304] 0 2024-04-25T01:58:56.219 INFO:tasks.workunit.client.0.smithi162.stdout:7/649: rename df to df/d2e/d4c/d8a/db2/dd7 22 2024-04-25T01:58:56.644 INFO:tasks.workunit.client.0.smithi162.stdout:0/714: dwrite d0/d1/d64/f8c [0,4194304] 0 2024-04-25T01:58:56.797 INFO:tasks.workunit.client.0.smithi162.stdout:9/582: chown d4/d9/d15/d1b/d69/lab 28137 1 2024-04-25T01:58:56.956 INFO:tasks.workunit.client.0.smithi162.stdout:1/654: fsync d15/d1f/f87 0 2024-04-25T01:58:57.000 INFO:tasks.workunit.client.0.smithi162.stdout:1/655: chown d15/d1f/d35/d5c/l91 21964 1 2024-04-25T01:58:57.341 INFO:tasks.workunit.client.0.smithi162.stdout:7/650: mkdir df/d2e/d4c/d58/dd3/dd8 0 2024-04-25T01:58:57.668 INFO:tasks.workunit.client.0.smithi162.stdout:3/646: write d2/f62 [1731697,51596] 0 2024-04-25T01:58:57.842 INFO:tasks.workunit.client.0.smithi162.stdout:6/596: dwrite d1/d13/d28/d30/f69 [0,4194304] 0 2024-04-25T01:58:57.852 INFO:tasks.workunit.client.0.smithi162.stdout:1/656: dread d15/d1f/d23/f25 [0,4194304] 0 2024-04-25T01:58:57.906 INFO:tasks.workunit.client.0.smithi162.stdout:4/640: dread dd/d1a/d34/f8e [0,4194304] 0 2024-04-25T01:58:58.281 INFO:tasks.workunit.client.0.smithi162.stdout:9/583: truncate d4/d9/d15/d1b/d2f/d30/dc1/d9f/fb4 196553 0 2024-04-25T01:58:58.422 INFO:tasks.workunit.client.0.smithi162.stdout:6/597: readlink d1/d13/d28/d7b/l81 0 2024-04-25T01:58:58.582 INFO:tasks.workunit.client.0.smithi162.stdout:7/651: creat df/d2e/d4c/daf/fd9 x:0 0 0 2024-04-25T01:58:58.670 INFO:tasks.workunit.client.0.smithi162.stdout:8/622: dwrite d0/d12/d2b/f7c [0,4194304] 0 2024-04-25T01:58:58.765 INFO:tasks.workunit.client.0.smithi162.stdout:5/636: dwrite d15/d19/d24/d4d/fb8 [0,4194304] 0 2024-04-25T01:58:58.968 INFO:tasks.workunit.client.0.smithi162.stdout:2/613: mknod d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/da2/cdf 0 2024-04-25T01:58:58.977 INFO:tasks.workunit.client.0.smithi162.stdout:6/598: chown d1/l1d 3214099 1 2024-04-25T01:58:59.064 INFO:tasks.workunit.client.0.smithi162.stdout:0/715: dread d0/df/f39 [0,4194304] 0 2024-04-25T01:58:59.093 INFO:tasks.workunit.client.0.smithi162.stdout:6/599: stat d1/l31 0 2024-04-25T01:58:59.622 INFO:tasks.workunit.client.0.smithi162.stdout:7/652: readlink df/d2e/d4c/d58/d82/ld1 0 2024-04-25T01:58:59.645 INFO:tasks.workunit.client.0.smithi162.stdout:7/653: chown df/l27 2115125974 1 2024-04-25T01:59:00.049 INFO:tasks.workunit.client.0.smithi162.stdout:3/647: dwrite d2/d9/d10/d4c/f53 [0,4194304] 0 2024-04-25T01:59:00.469 INFO:tasks.workunit.client.0.smithi162.stdout:1/657: write d15/d1f/d23/f56 [1626823,113846] 0 2024-04-25T01:59:00.554 INFO:tasks.workunit.client.0.smithi162.stdout:0/716: mkdir d0/df/d20/d25/d55/df2 0 2024-04-25T01:59:00.563 INFO:tasks.workunit.client.0.smithi162.stdout:6/600: dread d1/d13/d28/d30/f4e [0,4194304] 0 2024-04-25T01:59:00.638 INFO:tasks.workunit.client.0.smithi162.stdout:4/641: write dd/df/d2e/f95 [863101,81653] 0 2024-04-25T01:59:00.690 INFO:tasks.workunit.client.0.smithi162.stdout:4/642: chown dd/d1a/d34/l38 26800 1 2024-04-25T01:59:00.871 INFO:tasks.workunit.client.0.smithi162.stdout:7/654: truncate df/d2c/d63/f84 924583 0 2024-04-25T01:59:00.923 INFO:tasks.workunit.client.0.smithi162.stdout:8/623: write d0/d12/f2e [1134529,83194] 0 2024-04-25T01:59:00.981 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:09:50.414 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:59:00.989 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:09:50.422 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:59:01.003 INFO:tasks.workunit.client.0.smithi162.stdout:3/648: unlink d2/d9/d99/f38 0 2024-04-25T01:59:01.027 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:09:50.377 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:59:01.037 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:09:50.387 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:59:01.047 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:09:50.397 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:59:01.071 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:09:50.421 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:59:01.139 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:09:50.571 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T01:59:01.164 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:09:50.514 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T01:59:01.199 INFO:tasks.workunit.client.0.smithi162.stdout:7/655: dread df/d2e/d4c/f54 [0,4194304] 0 2024-04-25T01:59:01.215 INFO:tasks.workunit.client.0.smithi162.stdout:3/649: chown d2/d9/d10/d4c/d51/d63/d87/lce 57374 1 2024-04-25T01:59:01.239 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:09:50.589 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T01:59:01.461 INFO:tasks.workunit.client.0.smithi162.stdout:3/650: dread d2/f62 [0,4194304] 0 2024-04-25T01:59:01.511 INFO:tasks.workunit.client.0.smithi162.stdout:1/658: mknod d15/d69/d4f/cda 0 2024-04-25T01:59:01.572 INFO:tasks.workunit.client.0.smithi162.stdout:1/659: dread - d15/d1f/d23/d30/f9c zero size 2024-04-25T01:59:01.599 INFO:tasks.workunit.client.0.smithi162.stdout:5/637: write d15/d19/d24/d2b/f2c [783739,70842] 0 2024-04-25T01:59:01.684 INFO:tasks.workunit.client.0.smithi162.stdout:9/584: rename d4/d25/f93 to d4/d8/fd0 0 2024-04-25T01:59:01.713 INFO:tasks.workunit.client.0.smithi162.stdout:1/660: dread d15/d69/f37 [0,4194304] 0 2024-04-25T01:59:02.157 INFO:tasks.workunit.client.0.smithi162.stdout:7/656: creat df/d2e/d4c/d8a/db2/fda x:0 0 0 2024-04-25T01:59:02.955 INFO:tasks.workunit.client.0.smithi162.stdout:9/585: stat d4/d8/f5d 0 2024-04-25T01:59:03.113 INFO:tasks.workunit.client.0.smithi162.stdout:2/614: rename d0/d3/d5/ddc to d0/d3/d5/d36/d93/de0 0 2024-04-25T01:59:03.942 INFO:tasks.workunit.client.0.smithi162.stdout:0/717: mkdir d0/df/d20/d25/dce/df3 0 2024-04-25T01:59:03.948 INFO:tasks.workunit.client.0.smithi162.stdout:6/601: dwrite d1/d46/d7a/f90 [0,4194304] 0 2024-04-25T01:59:04.090 INFO:tasks.workunit.client.0.smithi162.stdout:3/651: mknod d2/d9/d10/d4c/d51/d63/d87/d90/db3/de3/ce5 0 2024-04-25T01:59:04.115 INFO:tasks.workunit.client.0.smithi162.stdout:8/624: dwrite d0/d44/fa9 [0,4194304] 0 2024-04-25T01:59:04.314 INFO:tasks.workunit.client.0.smithi162.stdout:6/602: dread d1/d13/d28/d45/f4f [0,4194304] 0 2024-04-25T01:59:04.334 INFO:tasks.workunit.client.0.smithi162.stdout:9/586: mkdir d4/d9/d15/d1b/d2f/d30/dc1/d9f/dd1 0 2024-04-25T01:59:04.464 INFO:tasks.workunit.client.0.smithi162.stdout:2/615: creat d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/fe1 x:0 0 0 2024-04-25T01:59:04.701 INFO:tasks.workunit.client.0.smithi162.stdout:5/638: dwrite d15/f17 [0,4194304] 0 2024-04-25T01:59:04.894 INFO:tasks.workunit.client.0.smithi162.stdout:7/657: write df/f95 [96813,25907] 0 2024-04-25T01:59:05.054 INFO:tasks.workunit.client.0.smithi162.stdout:0/718: mkdir d0/df/d20/d37/d58/df4 0 2024-04-25T01:59:05.160 INFO:tasks.workunit.client.0.smithi162.stdout:1/661: dwrite d15/d1f/d35/d4c/d70/f81 [0,4194304] 0 2024-04-25T01:59:05.395 INFO:tasks.workunit.client.0.smithi162.stdout:9/587: fsync d4/dc0/fb9 0 2024-04-25T01:59:05.689 INFO:tasks.workunit.client.0.smithi162.stdout:6/603: dwrite d1/d13/d28/d30/f69 [0,4194304] 0 2024-04-25T01:59:05.951 INFO:tasks.workunit.client.0.smithi162.stdout:2/616: mkdir d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/da2/de2 0 2024-04-25T01:59:06.288 INFO:tasks.workunit.client.0.smithi162.stdout:5/639: fsync d15/d19/d24/d2b/d3b/d58/f9a 0 2024-04-25T01:59:06.418 INFO:tasks.workunit.client.0.smithi162.stdout:4/643: write dd/df/d2e/d59/f76 [2172693,86646] 0 2024-04-25T01:59:06.791 INFO:tasks.workunit.client.0.smithi162.stdout:1/662: creat d15/d1f/d35/d4c/d8e/fdb x:0 0 0 2024-04-25T01:59:07.127 INFO:tasks.workunit.client.0.smithi162.stdout:9/588: fdatasync d4/f6c 0 2024-04-25T01:59:07.389 INFO:tasks.workunit.client.0.smithi162.stdout:8/625: dwrite d0/d12/d1b/d74/d8a/f93 [0,4194304] 0 2024-04-25T01:59:07.592 INFO:tasks.workunit.client.0.smithi162.stdout:6/604: truncate d1/d13/d28/d30/d63/f9f 881626 0 2024-04-25T01:59:07.946 INFO:tasks.workunit.client.0.smithi162.stdout:4/644: rmdir dd/df/d58 39 2024-04-25T01:59:08.793 INFO:tasks.workunit.client.0.smithi162.stdout:8/626: mkdir d0/d86/dd0 0 2024-04-25T01:59:09.288 INFO:tasks.workunit.client.0.smithi162.stdout:3/652: getdents d2/d9/d10/d2c/da3/dba 0 2024-04-25T01:59:09.692 INFO:tasks.workunit.client.0.smithi162.stdout:8/627: mknod d0/d86/dd0/cd1 0 2024-04-25T01:59:09.828 INFO:tasks.workunit.client.0.smithi162.stdout:4/645: mkdir dd/df/d2e/d59/dd9 0 2024-04-25T01:59:10.071 INFO:tasks.workunit.client.0.smithi162.stdout:7/658: dwrite df/d2e/d4c/d8a/f80 [0,4194304] 0 2024-04-25T01:59:10.074 INFO:tasks.workunit.client.0.smithi162.stdout:0/719: dwrite d0/df/d20/d25/d55/f5c [0,4194304] 0 2024-04-25T01:59:10.089 INFO:tasks.workunit.client.0.smithi162.stdout:3/653: truncate d2/d9/d10/d4c/d51/d63/d87/d90/fbb 3012928 0 2024-04-25T01:59:10.297 INFO:tasks.workunit.client.0.smithi162.stdout:4/646: chown dd/df/d2e/d59/dd9 2 1 2024-04-25T01:59:10.297 INFO:tasks.workunit.client.0.smithi162.stdout:9/589: link d4/d9/c4b d4/d9/d15/d1b/d2f/cd2 0 2024-04-25T01:59:10.324 INFO:tasks.workunit.client.0.smithi162.stdout:5/640: getdents d15/d19/d24/d73/d7a 0 2024-04-25T01:59:10.398 INFO:tasks.workunit.client.0.smithi162.stdout:9/590: stat d4/dc0/fb3 0 2024-04-25T01:59:10.695 INFO:tasks.workunit.client.0.smithi162.stdout:8/628: fsync d0/d44/d31/d65/f88 0 2024-04-25T01:59:11.352 INFO:tasks.workunit.client.0.smithi162.stdout:7/659: creat df/d2e/d4c/d58/fdb x:0 0 0 2024-04-25T01:59:11.357 INFO:tasks.workunit.client.0.smithi162.stdout:0/720: dread - d0/d1/d4e/fac zero size 2024-04-25T01:59:11.445 INFO:tasks.workunit.client.0.smithi162.stdout:0/721: readlink d0/df/d20/d37/l44 0 2024-04-25T01:59:11.832 INFO:tasks.workunit.client.0.smithi162.stdout:8/629: unlink d0/d44/l60 0 2024-04-25T01:59:11.837 INFO:tasks.workunit.client.0.smithi162.stdout:1/663: write fe [2682829,94378] 0 2024-04-25T01:59:12.257 INFO:tasks.workunit.client.0.smithi162.stdout:4/647: truncate f5 1379498 0 2024-04-25T01:59:12.268 INFO:tasks.workunit.client.0.smithi162.stdout:3/654: truncate d2/d9/d99/f3d 788985 0 2024-04-25T01:59:12.309 INFO:tasks.workunit.client.0.smithi162.stdout:9/591: mknod d4/d8/d13/cd3 0 2024-04-25T01:59:12.309 INFO:tasks.workunit.client.0.smithi162.stdout:5/641: creat d15/d19/d24/d2b/d3b/d58/daf/dc8/fce x:0 0 0 2024-04-25T01:59:12.331 INFO:tasks.workunit.client.0.smithi162.stdout:7/660: mkdir df/d2c/d63/d83/ddc 0 2024-04-25T01:59:12.384 INFO:tasks.workunit.client.0.smithi162.stdout:0/722: creat d0/df/d20/d25/dce/ff5 x:0 0 0 2024-04-25T01:59:12.574 INFO:tasks.workunit.client.0.smithi162.stdout:8/630: read d0/d12/d1b/d74/d8a/fad [1907428,107710] 0 2024-04-25T01:59:12.655 INFO:tasks.workunit.client.0.smithi162.stdout:2/617: write d0/d3/d1b/d6b/fa0 [584990,127574] 0 2024-04-25T01:59:12.757 INFO:tasks.workunit.client.0.smithi162.stdout:1/664: rename d15/d1f/f87 to d15/d1f/d23/d30/d4a/d7f/d97/dbe/fdc 0 2024-04-25T01:59:12.771 INFO:tasks.workunit.client.0.smithi162.stdout:6/605: write d1/d13/d28/d30/d3a/f4b [3124253,2998] 0 2024-04-25T01:59:12.924 INFO:tasks.workunit.client.0.smithi162.stdout:6/606: dread d1/d13/d28/d45/f61 [0,4194304] 0 2024-04-25T01:59:12.959 INFO:tasks.workunit.client.0.smithi162.stdout:6/607: readlink d1/d13/l22 0 2024-04-25T01:59:13.209 INFO:tasks.workunit.client.0.smithi162.stdout:4/648: read dd/df/d2e/d59/f9f [234907,36570] 0 2024-04-25T01:59:13.229 INFO:tasks.workunit.client.0.smithi162.stdout:7/661: dread df/d2c/f36 [0,4194304] 0 2024-04-25T01:59:13.442 INFO:tasks.workunit.client.0.smithi162.stdout:5/642: mknod d15/d19/d24/d4d/d7c/dbb/ccf 0 2024-04-25T01:59:13.863 INFO:tasks.workunit.client.0.smithi162.stdout:8/631: symlink d0/d12/d1b/d8d/ld2 0 2024-04-25T01:59:14.495 INFO:tasks.workunit.client.0.smithi162.stdout:4/649: unlink dd/df/d77/cab 0 2024-04-25T01:59:14.821 INFO:tasks.workunit.client.0.smithi162.stdout:7/662: symlink df/d2c/d49/d7a/ldd 0 2024-04-25T01:59:14.984 INFO:tasks.workunit.client.0.smithi162.stdout:5/643: read d15/d19/d24/d40/f41 [3575779,45370] 0 2024-04-25T01:59:15.220 INFO:tasks.workunit.client.0.smithi162.stdout:2/618: unlink d0/d3/d1b/d6b/dc0/f86 0 2024-04-25T01:59:15.270 INFO:tasks.workunit.client.0.smithi162.stdout:2/619: chown d0/d3/d1b/d6b/dc0/d42/f43 1003248165 1 2024-04-25T01:59:16.111 INFO:tasks.workunit.client.0.smithi162.stdout:0/723: link d0/d1/c11 d0/df/d20/d25/d55/cf6 0 2024-04-25T01:59:16.263 INFO:tasks.workunit.client.0.smithi162.stdout:0/724: dread - d0/df/fd1 zero size 2024-04-25T01:59:16.294 INFO:tasks.workunit.client.0.smithi162.stdout:5/644: dread d15/d1e/f8a [0,4194304] 0 2024-04-25T01:59:16.635 INFO:tasks.workunit.client.0.smithi162.stdout:0/725: mkdir d0/d1/d4e/df7 0 2024-04-25T01:59:16.642 INFO:tasks.workunit.client.0.smithi162.stdout:8/632: link d0/d12/d1b/d74/d8a/da3/faa d0/d12/d3a/fd3 0 2024-04-25T01:59:16.729 INFO:tasks.workunit.client.0.smithi162.stdout:0/726: chown d0/df/d20/d25/dce/ff5 27 1 2024-04-25T01:59:16.750 INFO:tasks.workunit.client.0.smithi162.stdout:0/727: readlink d0/d59/d7e/d9f/lc1 0 2024-04-25T01:59:17.166 INFO:tasks.workunit.client.0.smithi162.stdout:3/655: write d2/d9/d10/d4c/f70 [326644,110453] 0 2024-04-25T01:59:17.246 INFO:tasks.workunit.client.0.smithi162.stdout:8/633: symlink d0/d12/d1b/d8d/ld4 0 2024-04-25T01:59:17.487 INFO:tasks.workunit.client.0.smithi162.stdout:0/728: mkdir d0/d1/d4e/df8 0 2024-04-25T01:59:17.531 INFO:tasks.workunit.client.0.smithi162.stdout:8/634: sync 2024-04-25T01:59:17.577 INFO:tasks.workunit.client.0.smithi162.stdout:7/663: unlink df/d2c/f3e 0 2024-04-25T01:59:18.311 INFO:tasks.workunit.client.0.smithi162.stdout:3/656: chown d2/d9/d19 895 1 2024-04-25T01:59:18.486 INFO:tasks.workunit.client.0.smithi162.stdout:7/664: fdatasync df/f15 0 2024-04-25T01:59:18.688 INFO:tasks.workunit.client.0.smithi162.stdout:6/608: dwrite d1/d13/f50 [0,4194304] 0 2024-04-25T01:59:19.229 INFO:tasks.workunit.client.0.smithi162.stdout:9/592: dwrite d4/d8/d85/f7a [0,4194304] 0 2024-04-25T01:59:19.848 INFO:tasks.workunit.client.0.smithi162.stdout:7/665: symlink df/d2e/d4c/daf/lde 0 2024-04-25T01:59:20.127 INFO:tasks.workunit.client.0.smithi162.stdout:4/650: dwrite dd/df/d2e/f2f [0,4194304] 0 2024-04-25T01:59:20.375 INFO:tasks.workunit.client.0.smithi162.stdout:7/666: truncate df/f76 673215 0 2024-04-25T01:59:20.424 INFO:tasks.workunit.client.0.smithi162.stdout:9/593: rmdir d4/d7c 39 2024-04-25T01:59:20.533 INFO:tasks.workunit.client.0.smithi162.stdout:2/620: dwrite d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/fe1 [0,4194304] 0 2024-04-25T01:59:20.668 INFO:tasks.workunit.client.0.smithi162.stdout:7/667: readlink df/d2e/d4c/d58/l74 0 2024-04-25T01:59:20.872 INFO:tasks.workunit.client.0.smithi162.stdout:5/645: write d15/d19/d24/d4d/d7c/d85/fba [28827,50636] 0 2024-04-25T01:59:21.168 INFO:tasks.workunit.client.0.smithi162.stdout:1/665: write d15/d1f/d23/d30/d4a/d7f/d97/dbe/fdc [138490,50844] 0 2024-04-25T01:59:21.373 INFO:tasks.workunit.client.0.smithi162.stdout:1/666: sync 2024-04-25T01:59:21.392 INFO:tasks.workunit.client.0.smithi162.stdout:1/667: chown d15/d1f/c2e 160273 1 2024-04-25T01:59:21.840 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:59:21.843 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:59:21.964 INFO:tasks.workunit.client.0.smithi162.stdout:1/668: read d15/d1f/d23/d30/d4a/d7f/d97/fc7 [163435,123712] 0 2024-04-25T01:59:21.988 INFO:tasks.workunit.client.0.smithi162.stdout:1/669: chown f14 54252 1 2024-04-25T01:59:22.135 INFO:tasks.workunit.client.0.smithi162.stdout:9/594: truncate d4/d8/d13/f90 4350663 0 2024-04-25T01:59:22.327 INFO:tasks.workunit.client.0.smithi162.stdout:8/635: dwrite d0/d12/d2b/d87/fb2 [0,4194304] 0 2024-04-25T01:59:22.505 INFO:tasks.workunit.client.0.smithi162.stdout:0/729: write d0/df/d20/d25/f49 [529097,81302] 0 2024-04-25T01:59:22.523 INFO:tasks.workunit.client.0.smithi162.stdout:3/657: write d2/d9/d10/f95 [8623859,95212] 0 2024-04-25T01:59:22.767 INFO:tasks.workunit.client.0.smithi162.stdout:8/636: readlink d0/d1a/l5e 0 2024-04-25T01:59:22.793 INFO:tasks.workunit.client.0.smithi162.stdout:9/595: chown d4/d25/f6e 122 1 2024-04-25T01:59:22.927 INFO:tasks.workunit.client.0.smithi162.stdout:8/637: sync 2024-04-25T01:59:23.005 INFO:tasks.workunit.client.0.smithi162.stdout:6/609: dwrite d1/d13/d28/fa7 [0,4194304] 0 2024-04-25T01:59:23.180 INFO:tasks.workunit.client.0.smithi162.stdout:5/646: symlink d15/d19/d24/ld0 0 2024-04-25T01:59:23.257 INFO:tasks.workunit.client.0.smithi162.stdout:5/647: sync 2024-04-25T01:59:23.816 INFO:tasks.workunit.client.0.smithi162.stdout:5/648: mkdir d15/d19/d24/d73/dd1 0 2024-04-25T01:59:24.448 INFO:tasks.workunit.client.0.smithi162.stdout:4/651: dwrite dd/d1a/f20 [0,4194304] 0 2024-04-25T01:59:24.559 INFO:tasks.workunit.client.0.smithi162.stdout:7/668: write df/d2c/f3c [255870,3501] 0 2024-04-25T01:59:24.665 INFO:tasks.workunit.client.0.smithi162.stdout:3/658: link d2/d9/d94/ld7 d2/d9/d10/d2c/da3/dba/le6 0 2024-04-25T01:59:24.711 INFO:tasks.workunit.client.0.smithi162.stdout:1/670: write d15/fa5 [1030165,108526] 0 2024-04-25T01:59:24.739 INFO:tasks.workunit.client.0.smithi162.stdout:6/610: dread d1/d13/d28/d30/d63/f6f [0,4194304] 0 2024-04-25T01:59:24.774 INFO:tasks.workunit.client.0.smithi162.stdout:9/596: dread d4/d9/d15/d1b/d2f/f62 [0,4194304] 0 2024-04-25T01:59:25.050 INFO:tasks.workunit.client.0.smithi162.stdout:2/621: dwrite d0/d3/d1b/f4f [0,4194304] 0 2024-04-25T01:59:25.072 INFO:tasks.workunit.client.0.smithi162.stdout:7/669: stat df/d2c/d49/cd5 0 2024-04-25T01:59:25.248 INFO:tasks.workunit.client.0.smithi162.stdout:4/652: creat dd/d1a/d34/d9d/fda x:0 0 0 2024-04-25T01:59:25.597 INFO:tasks.workunit.client.0.smithi162.stdout:8/638: dwrite d0/f75 [0,4194304] 0 2024-04-25T01:59:25.636 INFO:tasks.workunit.client.0.smithi162.stdout:0/730: dwrite d0/df/d20/d25/f4c [0,4194304] 0 2024-04-25T01:59:25.881 INFO:tasks.workunit.client.0.smithi162.stdout:3/659: fsync d2/d9/d10/d2c/da3/db5/fc0 0 2024-04-25T01:59:26.028 INFO:tasks.workunit.client.0.smithi162.stdout:5/649: dwrite d15/d19/d24/d2b/f2c [0,4194304] 0 2024-04-25T01:59:26.196 INFO:tasks.workunit.client.0.smithi162.stdout:6/611: dwrite d1/f10 [0,4194304] 0 2024-04-25T01:59:26.346 INFO:tasks.workunit.client.0.smithi162.stdout:9/597: creat d4/d9/d15/d1b/d2f/d30/dc1/d9f/fd4 x:0 0 0 2024-04-25T01:59:26.484 INFO:tasks.workunit.client.0.smithi162.stdout:8/639: rmdir d0/d12/d2b/d87/dbe 39 2024-04-25T01:59:26.538 INFO:tasks.workunit.client.0.smithi162.stdout:9/598: stat d4/d8/d85/dca 0 2024-04-25T01:59:27.329 INFO:tasks.workunit.client.0.smithi162.stdout:1/671: write d15/d1f/d35/d4c/d8e/fdb [1039816,38653] 0 2024-04-25T01:59:27.357 INFO:tasks.workunit.client.0.smithi162.stdout:1/672: stat d15/f79 0 2024-04-25T01:59:27.375 INFO:tasks.workunit.client.0.smithi162.stdout:1/673: chown d15/l16 32172 1 2024-04-25T01:59:27.397 INFO:tasks.workunit.client.0.smithi162.stdout:3/660: fdatasync d2/d9/d10/d4c/f70 0 2024-04-25T01:59:27.474 INFO:tasks.workunit.client.0.smithi162.stdout:4/653: write dd/f2c [1953106,83373] 0 2024-04-25T01:59:27.585 INFO:tasks.workunit.client.0.smithi162.stdout:7/670: write df/d2e/d4c/daf/fd9 [507749,31889] 0 2024-04-25T01:59:27.641 INFO:tasks.workunit.client.0.smithi162.stdout:4/654: chown dd/df/f49 185230 1 2024-04-25T01:59:27.664 INFO:tasks.workunit.client.0.smithi162.stdout:3/661: dread - d2/d9/d10/d2c/da3/db5/fc7 zero size 2024-04-25T01:59:28.189 INFO:tasks.workunit.client.0.smithi162.stdout:8/640: dread d0/d12/d1b/d74/d8a/fa7 [0,4194304] 0 2024-04-25T01:59:28.433 INFO:tasks.workunit.client.0.smithi162.stdout:8/641: sync 2024-04-25T01:59:28.501 INFO:tasks.workunit.client.0.smithi162.stdout:4/655: fdatasync dd/df/f12 0 2024-04-25T01:59:28.621 INFO:tasks.workunit.client.0.smithi162.stdout:1/674: truncate d15/d1f/d23/d30/d4a/d7f/d97/fc7 566262 0 2024-04-25T01:59:28.874 INFO:tasks.workunit.client.0.smithi162.stdout:3/662: fsync d2/d9/d10/d2c/da3/dba/fd1 0 2024-04-25T01:59:29.094 INFO:tasks.workunit.client.0.smithi162.stdout:9/599: creat d4/d7c/fd5 x:0 0 0 2024-04-25T01:59:29.205 INFO:tasks.workunit.client.0.smithi162.stdout:0/731: getdents d0/d1/dab 0 2024-04-25T01:59:29.660 INFO:tasks.workunit.client.0.smithi162.stdout:8/642: rmdir d0/d44/d64 39 2024-04-25T01:59:29.704 INFO:tasks.workunit.client.0.smithi162.stdout:5/650: dwrite d15/d19/d24/d40/fc5 [0,4194304] 0 2024-04-25T01:59:30.104 INFO:tasks.workunit.client.0.smithi162.stdout:6/612: dwrite d1/d13/d28/d30/d3a/f6c [0,4194304] 0 2024-04-25T01:59:30.314 INFO:tasks.workunit.client.0.smithi162.stdout:1/675: creat d15/d1f/d23/d30/d4a/d7f/fdd x:0 0 0 2024-04-25T01:59:30.383 INFO:tasks.workunit.client.0.smithi162.stdout:2/622: dwrite d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/fca [0,4194304] 0 2024-04-25T01:59:30.505 INFO:tasks.workunit.client.0.smithi162.stdout:3/663: unlink d2/d29/d2e/f5e 0 2024-04-25T01:59:30.648 INFO:tasks.workunit.client.0.smithi162.stdout:4/656: write dd/df/d77/fc0 [1375083,60119] 0 2024-04-25T01:59:30.653 INFO:tasks.workunit.client.0.smithi162.stdout:9/600: fdatasync d4/d9/f87 0 2024-04-25T01:59:30.794 INFO:tasks.workunit.client.0.smithi162.stdout:7/671: dwrite df/d2e/d4c/f9e [0,4194304] 0 2024-04-25T01:59:30.913 INFO:tasks.workunit.client.0.smithi162.stdout:2/623: readlink d0/d3/d1b/d1d/d3a/d63/dba/ldb 0 2024-04-25T01:59:30.981 INFO:tasks.workunit.client.0.smithi162.stdout:4/657: dread dd/d1a/d34/d57/f7a [0,4194304] 0 2024-04-25T01:59:31.126 INFO:tasks.workunit.client.0.smithi162.stdout:0/732: rename d0/df/d20/d37/d58/feb to d0/d1/d64/ff9 0 2024-04-25T01:59:31.174 INFO:tasks.workunit.client.0.smithi162.stdout:4/658: sync 2024-04-25T01:59:31.214 INFO:tasks.workunit.client.0.smithi162.stdout:9/601: dread d4/d9/fa [0,4194304] 0 2024-04-25T01:59:31.273 INFO:tasks.workunit.client.0.smithi162.stdout:4/659: sync 2024-04-25T01:59:31.320 INFO:tasks.workunit.client.0.smithi162.stdout:8/643: creat d0/d44/d31/d33/fd5 x:0 0 0 2024-04-25T01:59:32.486 INFO:tasks.workunit.client.0.smithi162.stdout:6/613: dread - d1/d13/d28/d45/fa5 zero size 2024-04-25T01:59:32.986 INFO:tasks.workunit.client.0.smithi162.stdout:1/676: mkdir d15/d1f/d23/d30/d4a/d7f/d97/dbe/dde 0 2024-04-25T01:59:33.009 INFO:tasks.workunit.client.0.smithi162.stdout:1/677: chown d15/d1f/d35/d5c 1 1 2024-04-25T01:59:33.037 INFO:tasks.workunit.client.0.smithi162.stdout:1/678: stat d15/d1f/d35/d4c/d8e/cb7 0 2024-04-25T01:59:33.059 INFO:tasks.workunit.client.0.smithi162.stdout:1/679: chown d15/d1f/l45 5 1 2024-04-25T01:59:33.203 INFO:tasks.workunit.client.0.smithi162.stdout:9/602: dread - d4/d9/fc8 zero size 2024-04-25T01:59:33.231 INFO:tasks.workunit.client.0.smithi162.stdout:9/603: chown d4/d9/d15/d8a 39 1 2024-04-25T01:59:33.395 INFO:tasks.workunit.client.0.smithi162.stdout:0/733: creat d0/df/d20/d37/d81/d92/ffa x:0 0 0 2024-04-25T01:59:33.556 INFO:tasks.workunit.client.0.smithi162.stdout:5/651: write d15/d19/d24/fa9 [1789205,23374] 0 2024-04-25T01:59:33.573 INFO:tasks.workunit.client.0.smithi162.stdout:8/644: creat d0/d12/d1b/d74/d8a/da3/fd6 x:0 0 0 2024-04-25T01:59:34.412 INFO:tasks.workunit.client.0.smithi162.stdout:6/614: truncate d1/d13/d28/d45/f4f 396670 0 2024-04-25T01:59:34.804 INFO:tasks.workunit.client.0.smithi162.stdout:3/664: mkdir d2/ddf/de7 0 2024-04-25T01:59:34.852 INFO:tasks.workunit.client.0.smithi162.stdout:3/665: read d2/d9/d19/d3f/f79 [385984,102197] 0 2024-04-25T01:59:34.887 INFO:tasks.workunit.client.0.smithi162.stdout:3/666: chown d2/d29/d5d/c6c 0 1 2024-04-25T01:59:35.116 INFO:tasks.workunit.client.0.smithi162.stdout:2/624: mkdir d0/d3/d1b/d6b/dc0/de3 0 2024-04-25T01:59:35.414 INFO:tasks.workunit.client.0.smithi162.stdout:4/660: symlink dd/d1a/d34/db1/dba/ldb 0 2024-04-25T01:59:35.746 INFO:tasks.workunit.client.0.smithi162.stdout:5/652: mknod d15/d19/d24/d4d/d7c/d85/cd2 0 2024-04-25T01:59:36.007 INFO:tasks.workunit.client.0.smithi162.stdout:6/615: mkdir d1/d13/d28/d30/d3a/dbc 0 2024-04-25T01:59:36.135 INFO:tasks.workunit.client.0.smithi162.stdout:6/616: dread d1/f21 [0,4194304] 0 2024-04-25T01:59:36.205 INFO:tasks.workunit.client.0.smithi162.stdout:3/667: mknod d2/d9/d10/d2c/ce8 0 2024-04-25T01:59:36.453 INFO:tasks.workunit.client.0.smithi162.stdout:2/625: mkdir d0/d3/d1b/d6b/d92/d9a/de4 0 2024-04-25T01:59:37.535 INFO:tasks.workunit.client.0.smithi162.stdout:5/653: dread d15/d19/d24/f25 [0,4194304] 0 2024-04-25T01:59:37.685 INFO:tasks.workunit.client.0.smithi162.stdout:0/734: rename d0/d1/d64/f83 to d0/df/d20/ffb 0 2024-04-25T01:59:38.021 INFO:tasks.workunit.client.0.smithi162.stdout:7/672: write df/d2c/f3f [2121397,52928] 0 2024-04-25T01:59:38.325 INFO:tasks.workunit.client.0.smithi162.stdout:1/680: dwrite d15/f1c [0,4194304] 0 2024-04-25T01:59:38.509 INFO:tasks.workunit.client.0.smithi162.stdout:9/604: getdents d4/d9/d15/d1b 0 2024-04-25T01:59:38.695 INFO:tasks.workunit.client.0.smithi162.stdout:5/654: creat d15/d19/d24/d4d/d7c/fd3 x:0 0 0 2024-04-25T01:59:38.776 INFO:tasks.workunit.client.0.smithi162.stdout:0/735: dread d0/df/d20/d37/d81/fa8 [0,4194304] 0 2024-04-25T01:59:38.812 INFO:tasks.workunit.client.0.smithi162.stdout:5/655: chown d15/d19/d24/d73/cb0 1 1 2024-04-25T01:59:38.895 INFO:tasks.workunit.client.0.smithi162.stdout:8/645: write d0/d44/d31/d33/f47 [1278755,24334] 0 2024-04-25T01:59:39.057 INFO:tasks.workunit.client.0.smithi162.stdout:7/673: dread df/d2e/fc0 [0,4194304] 0 2024-04-25T01:59:39.186 INFO:tasks.workunit.client.0.smithi162.stdout:9/605: truncate d4/d8/d13/f5b 3852234 0 2024-04-25T01:59:39.720 INFO:tasks.workunit.client.0.smithi162.stdout:0/736: mkdir d0/df/d20/d37/dfc 0 2024-04-25T01:59:40.006 INFO:tasks.workunit.client.0.smithi162.stdout:1/681: fsync d15/d1f/fac 0 2024-04-25T01:59:40.047 INFO:tasks.workunit.client.0.smithi162.stdout:4/661: write dd/df/f6c [600667,26016] 0 2024-04-25T01:59:40.158 INFO:tasks.workunit.client.0.smithi162.stdout:7/674: stat df/d2c/l6f 0 2024-04-25T01:59:40.288 INFO:tasks.workunit.client.0.smithi162.stdout:9/606: mkdir d4/d8/d85/dd6 0 2024-04-25T01:59:40.348 INFO:tasks.workunit.client.0.smithi162.stdout:5/656: symlink d15/d19/d24/d2b/d3b/ld4 0 2024-04-25T01:59:40.653 INFO:tasks.workunit.client.0.smithi162.stdout:1/682: fsync f4 0 2024-04-25T01:59:40.882 INFO:tasks.workunit.client.0.smithi162.stdout:3/668: dwrite d2/d9/d19/d3f/fa9 [0,4194304] 0 2024-04-25T01:59:41.112 INFO:tasks.workunit.client.0.smithi162.stdout:7/675: truncate df/f96 4048548 0 2024-04-25T01:59:41.140 INFO:tasks.workunit.client.0.smithi162.stdout:7/676: chown df/d2c/d49/d7a/dbf 26858576 1 2024-04-25T01:59:41.463 INFO:tasks.workunit.client.0.smithi162.stdout:5/657: creat d15/d19/d24/d73/d7a/d7e/fd5 x:0 0 0 2024-04-25T01:59:41.647 INFO:tasks.workunit.client.0.smithi162.stdout:2/626: dwrite d0/d3/d7a/d88/f9f [0,4194304] 0 2024-04-25T01:59:42.403 INFO:tasks.workunit.client.0.smithi162.stdout:2/627: mkdir d0/d3/d1b/d6b/de5 0 2024-04-25T01:59:42.465 INFO:tasks.workunit.client.0.smithi162.stdout:5/658: dread d15/d1e/f22 [0,4194304] 0 2024-04-25T01:59:42.759 INFO:tasks.workunit.client.0.smithi162.stdout:8/646: write d0/d44/d91/fb7 [1689281,120857] 0 2024-04-25T01:59:42.898 INFO:tasks.workunit.client.0.smithi162.stdout:5/659: symlink d15/d19/d24/d4d/d7c/dbb/ld6 0 2024-04-25T01:59:43.043 INFO:tasks.workunit.client.0.smithi162.stdout:2/628: symlink d0/d3/d5/d36/d93/dbd/le6 0 2024-04-25T01:59:43.142 INFO:tasks.workunit.client.0.smithi162.stdout:5/660: stat d15/d19/d24/d4d/d7c/dbb/ccf 0 2024-04-25T01:59:43.150 INFO:tasks.workunit.client.0.smithi162.stdout:0/737: dwrite d0/df/f96 [0,4194304] 0 2024-04-25T01:59:43.306 INFO:tasks.workunit.client.0.smithi162.stdout:6/617: unlink d1/l78 0 2024-04-25T01:59:43.529 INFO:tasks.workunit.client.0.smithi162.stdout:5/661: dread d15/d19/d24/f25 [0,4194304] 0 2024-04-25T01:59:43.618 INFO:tasks.workunit.client.0.smithi162.stdout:0/738: chown d0/df/d20/d37/ddf/ff1 14 1 2024-04-25T01:59:43.680 INFO:tasks.workunit.client.0.smithi162.stdout:6/618: creat d1/fbd x:0 0 0 2024-04-25T01:59:43.885 INFO:tasks.workunit.client.0.smithi162.stdout:8/647: link d0/d12/l22 d0/d12/d2b/ld7 0 2024-04-25T01:59:44.050 INFO:tasks.workunit.client.0.smithi162.stdout:5/662: fsync d15/d19/d24/d73/f82 0 2024-04-25T01:59:44.225 INFO:tasks.workunit.client.0.smithi162.stdout:4/662: dwrite dd/d1a/f20 [4194304,4194304] 0 2024-04-25T01:59:44.362 INFO:tasks.workunit.client.0.smithi162.stdout:6/619: fsync d1/d13/d28/f2f 0 2024-04-25T01:59:44.463 INFO:tasks.workunit.client.0.smithi162.stdout:2/629: creat d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/da2/de2/fe7 x:0 0 0 2024-04-25T01:59:45.140 INFO:tasks.workunit.client.0.smithi162.stdout:5/663: fdatasync d15/d19/d24/d2b/d3b/d3c/f70 0 2024-04-25T01:59:45.215 INFO:tasks.workunit.client.0.smithi162.stdout:3/669: write d2/d9/d10/d2c/da3/dba/f81 [2742731,64599] 0 2024-04-25T01:59:45.348 INFO:tasks.workunit.client.0.smithi162.stdout:6/620: fsync d1/d13/d28/d30/d3a/f4b 0 2024-04-25T01:59:45.401 INFO:tasks.workunit.client.0.smithi162.stdout:6/621: read - d1/d13/d28/d30/d66/d89/fa4 zero size 2024-04-25T01:59:45.787 INFO:tasks.workunit.client.0.smithi162.stdout:4/663: creat dd/df/d58/fdc x:0 0 0 2024-04-25T01:59:46.253 INFO:tasks.workunit.client.0.smithi162.stdout:7/677: dwrite df/d2e/d4c/f9e [4194304,4194304] 0 2024-04-25T01:59:46.427 INFO:tasks.workunit.client.0.smithi162.stdout:5/664: unlink d15/d19/d24/d40/dbf/lcc 0 2024-04-25T01:59:46.549 INFO:tasks.workunit.client.0.smithi162.stdout:2/630: dread d0/d3/d5/d36/f65 [0,4194304] 0 2024-04-25T01:59:46.616 INFO:tasks.workunit.client.0.smithi162.stdout:9/607: dwrite d4/d8/d85/f7b [0,4194304] 0 2024-04-25T01:59:46.839 INFO:tasks.workunit.client.0.smithi162.stdout:5/665: stat d15/d19/d24/d2b/d3b/d80/c87 0 2024-04-25T01:59:46.917 INFO:tasks.workunit.client.0.smithi162.stdout:4/664: dread f5 [0,4194304] 0 2024-04-25T01:59:47.089 INFO:tasks.workunit.client.0.smithi162.stdout:7/678: creat df/d2e/d4c/d58/d82/fdf x:0 0 0 2024-04-25T01:59:47.774 INFO:tasks.workunit.client.0.smithi162.stdout:9/608: rename d4/d7c/fd5 to d4/d9/d15/d1b/d2f/d30/fd7 0 2024-04-25T01:59:47.942 INFO:tasks.workunit.client.0.smithi162.stdout:4/665: mkdir dd/d1a/d34/db1/dba/ddd 0 2024-04-25T01:59:48.272 INFO:tasks.workunit.client.0.smithi162.stdout:0/739: dwrite d0/d7b/f9b [0,4194304] 0 2024-04-25T01:59:48.408 INFO:tasks.workunit.client.0.smithi162.stdout:3/670: write d2/d9/d10/d4c/fae [1032881,97726] 0 2024-04-25T01:59:48.656 INFO:tasks.workunit.client.0.smithi162.stdout:0/740: chown d0/df/d20/l35 3874989 1 2024-04-25T01:59:48.726 INFO:tasks.workunit.client.0.smithi162.stdout:8/648: dwrite d0/d12/d3a/fab [0,4194304] 0 2024-04-25T01:59:48.755 INFO:tasks.workunit.client.0.smithi162.stdout:7/679: fsync df/d2e/d4c/d58/f88 0 2024-04-25T01:59:49.055 INFO:tasks.workunit.client.0.smithi162.stdout:4/666: rename dd/df/f14 to dd/d1a/fde 0 2024-04-25T01:59:49.168 INFO:tasks.workunit.client.0.smithi162.stdout:7/680: rename df to df/d2c/d49/d7a/de0 22 2024-04-25T01:59:49.253 INFO:tasks.workunit.client.0.smithi162.stdout:0/741: dread d0/d1/f7 [0,4194304] 0 2024-04-25T01:59:49.279 INFO:tasks.workunit.client.0.smithi162.stdout:4/667: chown dd/d1a/d34/d57/l8c 4290 1 2024-04-25T01:59:49.538 INFO:tasks.workunit.client.0.smithi162.stdout:8/649: mknod d0/d12/d2b/cd8 0 2024-04-25T01:59:49.773 INFO:tasks.workunit.client.0.smithi162.stdout:6/622: write d1/d13/d28/d30/d66/f67 [1811950,36429] 0 2024-04-25T01:59:49.776 INFO:tasks.workunit.client.0.smithi162.stdout:1/683: symlink d15/ldf 0 2024-04-25T01:59:49.831 INFO:tasks.workunit.client.0.smithi162.stdout:5/666: write d15/d19/d24/d2b/f2c [3886529,96524] 0 2024-04-25T01:59:49.841 INFO:tasks.workunit.client.0.smithi162.stdout:2/631: write d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/fca [177219,67502] 0 2024-04-25T01:59:49.989 INFO:tasks.workunit.client.0.smithi162.stdout:5/667: dread - d15/d19/d24/d2b/d3b/f91 zero size 2024-04-25T01:59:50.132 INFO:tasks.workunit.client.0.smithi162.stdout:3/671: unlink d2/d9/d10/f11 0 2024-04-25T01:59:50.354 INFO:tasks.workunit.client.0.smithi162.stdout:0/742: rename d0/df/d20/fae to d0/df/d20/d37/d81/dad/ffd 0 2024-04-25T01:59:50.735 INFO:tasks.workunit.client.0.smithi162.stdout:9/609: getdents d4/d9/d15/d1b/d2f/d30 0 2024-04-25T01:59:50.761 INFO:tasks.workunit.client.0.smithi162.stdout:6/623: mkdir d1/d13/d28/d45/d59/dbe 0 2024-04-25T01:59:51.291 INFO:tasks.workunit.client.0.smithi162.stdout:2/632: mkdir d0/d3/d1b/d6b/dc0/d67/d9c/de8 0 2024-04-25T01:59:51.406 INFO:tasks.workunit.client.0.smithi162.stdout:5/668: unlink d15/d19/d24/d2b/caa 0 2024-04-25T01:59:51.431 INFO:tasks.workunit.client.0.smithi162.stdout:5/669: chown d15/d19/l66 1 1 2024-04-25T01:59:51.774 INFO:tasks.workunit.client.0.smithi162.stdout:0/743: truncate d0/d1/dab/fbe 1504712 0 2024-04-25T01:59:51.919 INFO:tasks.workunit.client.0.smithi162.stdout:8/650: symlink d0/d44/d64/ld9 0 2024-04-25T01:59:52.038 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:59:52.041 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T01:59:52.618 INFO:tasks.workunit.client.0.smithi162.stdout:7/681: dwrite df/f33 [0,4194304] 0 2024-04-25T01:59:52.731 INFO:tasks.workunit.client.0.smithi162.stdout:7/682: chown df/d2e/d4c/d8a/f71 198 1 2024-04-25T01:59:52.857 INFO:tasks.workunit.client.0.smithi162.stdout:2/633: readlink d0/d3/d5/l70 0 2024-04-25T01:59:52.962 INFO:tasks.workunit.client.0.smithi162.stdout:5/670: symlink d15/d19/d24/d40/dbf/ld7 0 2024-04-25T01:59:52.977 INFO:tasks.workunit.client.0.smithi162.stdout:3/672: fsync d2/d9/d99/f3d 0 2024-04-25T01:59:53.334 INFO:tasks.workunit.client.0.smithi162.stdout:8/651: mknod d0/d12/d1b/d74/d8a/cda 0 2024-04-25T01:59:53.861 INFO:tasks.workunit.client.0.smithi162.stdout:4/668: write dd/d1a/f8f [1927011,85031] 0 2024-04-25T01:59:53.917 INFO:tasks.workunit.client.0.smithi162.stdout:7/683: mknod df/d2c/d49/ce1 0 2024-04-25T01:59:53.931 INFO:tasks.workunit.client.0.smithi162.stdout:4/669: chown dd/df/d77/d87/db6 17913315 1 2024-04-25T01:59:54.734 INFO:tasks.workunit.client.0.smithi162.stdout:8/652: symlink d0/d44/d31/d65/ldb 0 2024-04-25T01:59:54.834 INFO:tasks.workunit.client.0.smithi162.stdout:1/684: dwrite d15/d1f/d23/d30/d4a/fd0 [0,4194304] 0 2024-04-25T01:59:54.980 INFO:tasks.workunit.client.0.smithi162.stdout:9/610: creat d4/d9/d15/fd8 x:0 0 0 2024-04-25T01:59:55.153 INFO:tasks.workunit.client.0.smithi162.stdout:4/670: truncate dd/df/d2e/f2f 3851585 0 2024-04-25T01:59:55.617 INFO:tasks.workunit.client.0.smithi162.stdout:6/624: rename d1/c11 to d1/d13/d28/d45/d59/cbf 0 2024-04-25T01:59:55.806 INFO:tasks.workunit.client.0.smithi162.stdout:3/673: mkdir d2/d9/d10/de9 0 2024-04-25T01:59:56.140 INFO:tasks.workunit.client.0.smithi162.stdout:0/744: dread d0/d1/dab/fbe [0,4194304] 0 2024-04-25T01:59:56.663 INFO:tasks.workunit.client.0.smithi162.stdout:1/685: fdatasync d15/d1f/f6c 0 2024-04-25T01:59:56.836 INFO:tasks.workunit.client.0.smithi162.stdout:9/611: symlink d4/d8/d13/dbf/ld9 0 2024-04-25T01:59:56.891 INFO:tasks.workunit.client.0.smithi162.stdout:9/612: chown d4/d9/d15/d1b/d2f/d30/dc1/d59/fc7 0 1 2024-04-25T01:59:57.353 INFO:tasks.workunit.client.0.smithi162.stdout:4/671: dread dd/d1a/f26 [0,4194304] 0 2024-04-25T01:59:57.452 INFO:tasks.workunit.client.0.smithi162.stdout:3/674: rename d2/d9/d10/d2c/c43 to d2/d9/d10/d2c/da0/cea 0 2024-04-25T01:59:57.491 INFO:tasks.workunit.client.0.smithi162.stdout:5/671: link d15/l18 d15/d19/ld8 0 2024-04-25T01:59:57.614 INFO:tasks.workunit.client.0.smithi162.stdout:0/745: mkdir d0/d59/d7e/dfe 0 2024-04-25T01:59:57.658 INFO:tasks.workunit.client.0.smithi162.stdout:3/675: sync 2024-04-25T01:59:57.958 INFO:tasks.workunit.client.0.smithi162.stdout:1/686: rmdir d15/d1f/d35/d4c/d8e 39 2024-04-25T01:59:58.458 INFO:tasks.workunit.client.0.smithi162.stdout:2/634: getdents d0/d3/d1b/d6b/d92/d9a 0 2024-04-25T01:59:58.553 INFO:tasks.workunit.client.0.smithi162.stdout:4/672: symlink dd/d1a/d34/d57/ldf 0 2024-04-25T01:59:59.190 INFO:tasks.workunit.client.0.smithi162.stdout:3/676: symlink d2/da5/leb 0 2024-04-25T01:59:59.266 INFO:tasks.workunit.client.0.smithi162.stdout:7/684: getdents df/d2e/d4c/d8a/db2 0 2024-04-25T01:59:59.331 INFO:tasks.workunit.client.0.smithi162.stdout:1/687: truncate d15/fa5 1689420 0 2024-04-25T01:59:59.561 INFO:tasks.workunit.client.0.smithi162.stdout:6/625: link d1/d13/d28/fa7 d1/d13/d28/d30/d63/fc0 0 2024-04-25T01:59:59.600 INFO:tasks.workunit.client.0.smithi162.stdout:8/653: write d0/f11 [1285307,81781] 0 2024-04-25T02:00:00.148 INFO:tasks.workunit.client.0.smithi162.stdout:6/626: mknod d1/d13/d28/d30/d66/cc1 0 2024-04-25T02:00:00.328 INFO:tasks.workunit.client.0.smithi162.stdout:5/672: link d15/d19/d24/d2b/f52 d15/d19/d24/dca/fd9 0 2024-04-25T02:00:00.404 INFO:tasks.workunit.client.0.smithi162.stdout:1/688: dread d15/f1d [0,4194304] 0 2024-04-25T02:00:00.436 INFO:tasks.workunit.client.0.smithi162.stdout:5/673: chown d15/d19/d24/d2b/f53 0 1 2024-04-25T02:00:00.526 INFO:tasks.workunit.client.0.smithi162.stdout:7/685: truncate df/d2e/f48 108183 0 2024-04-25T02:00:00.588 INFO:tasks.workunit.client.0.smithi162.stdout:1/689: sync 2024-04-25T02:00:00.609 INFO:tasks.workunit.client.0.smithi162.stdout:1/690: chown d15/d1f/l24 256 1 2024-04-25T02:00:01.376 INFO:tasks.workunit.client.0.smithi162.stdout:5/674: dread d15/d19/d24/d2b/d3b/d3c/d3f/f6f [0,4194304] 0 2024-04-25T02:00:01.413 INFO:tasks.workunit.client.0.smithi162.stdout:9/613: dwrite d4/d8/d85/fbb [0,4194304] 0 2024-04-25T02:00:02.337 INFO:tasks.workunit.client.0.smithi162.stdout:9/614: symlink d4/d9/d15/d1b/d2f/d30/dc1/d9f/lda 0 2024-04-25T02:00:02.374 INFO:tasks.workunit.client.0.smithi162.stdout:9/615: chown d4/d8/d13/dbf/fcf 6867 1 2024-04-25T02:00:02.484 INFO:tasks.workunit.client.0.smithi162.stdout:8/654: getdents d0/d44/d31/d33 0 2024-04-25T02:00:02.498 INFO:tasks.workunit.client.0.smithi162.stdout:8/655: readlink d0/lc6 0 2024-04-25T02:00:02.688 INFO:tasks.workunit.client.0.smithi162.stdout:9/616: chown d4/d8/f10 1 1 2024-04-25T02:00:03.301 INFO:tasks.workunit.client.0.smithi162.stdout:6/627: write d1/d46/d7a/f90 [45926,40221] 0 2024-04-25T02:00:03.334 INFO:tasks.workunit.client.0.smithi162.stdout:3/677: dwrite d2/d9/fbd [0,4194304] 0 2024-04-25T02:00:03.472 INFO:tasks.workunit.client.0.smithi162.stdout:0/746: rename d0/l26 to d0/df/d20/d37/ddf/lff 0 2024-04-25T02:00:03.530 INFO:tasks.workunit.client.0.smithi162.stdout:3/678: sync 2024-04-25T02:00:03.588 INFO:tasks.workunit.client.0.smithi162.stdout:7/686: write df/d2e/d4c/daf/fb3 [933331,79860] 0 2024-04-25T02:00:03.771 INFO:tasks.workunit.client.0.smithi162.stdout:9/617: creat d4/fdb x:0 0 0 2024-04-25T02:00:03.831 INFO:tasks.workunit.client.0.smithi162.stdout:1/691: write d15/d1f/fb0 [372940,51303] 0 2024-04-25T02:00:03.852 INFO:tasks.workunit.client.0.smithi162.stdout:9/618: chown d4/d9/d15/d1b/d2f/d30 422567657 1 2024-04-25T02:00:03.949 INFO:tasks.workunit.client.0.smithi162.stdout:9/619: read d4/d9/d15/d1b/d2f/d30/f70 [4112018,110870] 0 2024-04-25T02:00:04.032 INFO:tasks.workunit.client.0.smithi162.stdout:2/635: rename d0/d3/d1b/d1d/c25 to d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dc1/ce9 0 2024-04-25T02:00:04.378 INFO:tasks.workunit.client.0.smithi162.stdout:3/679: mkdir d2/d9/d10/d4c/d51/ddd/de1/dec 0 2024-04-25T02:00:04.519 INFO:tasks.workunit.client.0.smithi162.stdout:1/692: chown d15/d1f/d23/d30/d4a/ca3 772 1 2024-04-25T02:00:04.550 INFO:tasks.workunit.client.0.smithi162.stdout:1/693: chown d15/d1f/d23/ca1 5228987 1 2024-04-25T02:00:04.872 INFO:tasks.workunit.client.0.smithi162.stdout:0/747: rename d0/df/d20/d37/d81/dad to d0/d59/d7e/d100 0 2024-04-25T02:00:04.895 INFO:tasks.workunit.client.0.smithi162.stdout:0/748: chown d0/d1/d4b 980 1 2024-04-25T02:00:05.069 INFO:tasks.workunit.client.0.smithi162.stdout:7/687: creat df/d2c/d63/d83/d8b/d90/fe2 x:0 0 0 2024-04-25T02:00:05.225 INFO:tasks.workunit.client.0.smithi162.stdout:5/675: dwrite d15/d19/d24/d2b/f3d [0,4194304] 0 2024-04-25T02:00:05.393 INFO:tasks.workunit.client.0.smithi162.stdout:1/694: creat d15/d1f/d23/d30/d4a/d7f/fe0 x:0 0 0 2024-04-25T02:00:05.435 INFO:tasks.workunit.client.0.smithi162.stdout:1/695: chown d15/d1f/d23/ca1 0 1 2024-04-25T02:00:05.691 INFO:tasks.workunit.client.0.smithi162.stdout:7/688: rmdir df/d2e/d4c/d8a/db2 39 2024-04-25T02:00:05.695 INFO:tasks.workunit.client.0.smithi162.stdout:0/749: stat d0/df/d20/d25/l42 0 2024-04-25T02:00:06.066 INFO:tasks.workunit.client.0.smithi162.stdout:5/676: mknod d15/d19/d24/d2b/d3b/d58/daf/cda 0 2024-04-25T02:00:06.371 INFO:tasks.workunit.client.0.smithi162.stdout:0/750: fsync d0/d1/d64/f8c 0 2024-04-25T02:00:06.642 INFO:tasks.workunit.client.0.smithi162.stdout:8/656: write d0/d12/d1b/d74/d8a/d8f/fa6 [677165,8741] 0 2024-04-25T02:00:06.966 INFO:tasks.workunit.client.0.smithi162.stdout:6/628: dwrite d1/d13/f42 [0,4194304] 0 2024-04-25T02:00:07.108 INFO:tasks.workunit.client.0.smithi162.stdout:7/689: symlink df/d2c/d63/d83/d8b/le3 0 2024-04-25T02:00:07.137 INFO:tasks.workunit.client.0.smithi162.stdout:4/673: write dd/df/d2e/f2f [3879068,112137] 0 2024-04-25T02:00:07.356 INFO:tasks.workunit.client.0.smithi162.stdout:8/657: creat d0/d44/d31/d65/fdc x:0 0 0 2024-04-25T02:00:07.501 INFO:tasks.workunit.client.0.smithi162.stdout:1/696: creat d15/d1f/d35/d4c/fe1 x:0 0 0 2024-04-25T02:00:07.554 INFO:tasks.workunit.client.0.smithi162.stdout:5/677: symlink d15/d19/d24/d2b/d3b/ldb 0 2024-04-25T02:00:07.716 INFO:tasks.workunit.client.0.smithi162.stdout:0/751: creat d0/d1/d4e/dd4/f101 x:0 0 0 2024-04-25T02:00:07.908 INFO:tasks.workunit.client.0.smithi162.stdout:6/629: creat d1/d13/d28/d30/d66/fc2 x:0 0 0 2024-04-25T02:00:07.963 INFO:tasks.workunit.client.0.smithi162.stdout:9/620: dwrite d4/d8/d13/f2a [0,4194304] 0 2024-04-25T02:00:08.086 INFO:tasks.workunit.client.0.smithi162.stdout:3/680: write d2/d9/d10/d4c/d51/d63/d87/d86/fcc [886689,120317] 0 2024-04-25T02:00:08.093 INFO:tasks.workunit.client.0.smithi162.stdout:7/690: dread - df/d2e/d4c/d58/d82/fdf zero size 2024-04-25T02:00:08.227 INFO:tasks.workunit.client.0.smithi162.stdout:7/691: chown df/d2e/l34 74535950 1 2024-04-25T02:00:08.482 INFO:tasks.workunit.client.0.smithi162.stdout:5/678: symlink d15/d19/d24/d73/d7a/d7e/ldc 0 2024-04-25T02:00:08.634 INFO:tasks.workunit.client.0.smithi162.stdout:0/752: mknod d0/df/d20/d25/d55/d6f/d7d/c102 0 2024-04-25T02:00:08.674 INFO:tasks.workunit.client.0.smithi162.stdout:0/753: stat d0/df/d20/d25/d55/d77 0 2024-04-25T02:00:08.789 INFO:tasks.workunit.client.0.smithi162.stdout:2/636: write d0/d3/d1b/d6b/dc0/fc4 [406222,99372] 0 2024-04-25T02:00:08.845 INFO:tasks.workunit.client.0.smithi162.stdout:2/637: chown d0/d3/d1b/d6b/dc0/d67/fd5 3338 1 2024-04-25T02:00:09.011 INFO:tasks.workunit.client.0.smithi162.stdout:6/630: mkdir d1/d13/d28/d30/d8a/dc3 0 2024-04-25T02:00:09.409 INFO:tasks.workunit.client.0.smithi162.stdout:7/692: rename df/d2e/d4c/d58/d82/cbd to df/d2c/d49/d7a/db5/ce4 0 2024-04-25T02:00:09.783 INFO:tasks.workunit.client.0.smithi162.stdout:5/679: mkdir d15/d19/d24/d73/ddd 0 2024-04-25T02:00:10.201 INFO:tasks.workunit.client.0.smithi162.stdout:2/638: unlink d0/d3/d1b/d6b/dc0/fc4 0 2024-04-25T02:00:10.229 INFO:tasks.workunit.client.0.smithi162.stdout:9/621: mkdir d4/d9/d15/d1b/d2f/d30/dc1/d9f/dd1/ddc 0 2024-04-25T02:00:10.875 INFO:tasks.workunit.client.0.smithi162.stdout:7/693: rename df/d2c/d63/d83/d8b/lcf to df/d2e/d4c/daf/le5 0 2024-04-25T02:00:10.988 INFO:tasks.workunit.client.0.smithi162.stdout:5/680: mkdir d15/d19/d24/d4d/d7c/d85/dde 0 2024-04-25T02:00:11.143 INFO:tasks.workunit.client.0.smithi162.stdout:1/697: write d15/d1f/fac [42487,12207] 0 2024-04-25T02:00:11.363 INFO:tasks.workunit.client.0.smithi162.stdout:4/674: link dd/df/d2e/d4b/c4d dd/df/d2e/ce0 0 2024-04-25T02:00:12.110 INFO:tasks.workunit.client.0.smithi162.stdout:8/658: dwrite d0/fa2 [0,4194304] 0 2024-04-25T02:00:12.262 INFO:tasks.workunit.client.0.smithi162.stdout:3/681: write d2/d9/d10/d4c/d51/d63/d87/d86/fc2 [670431,90986] 0 2024-04-25T02:00:12.311 INFO:tasks.workunit.client.0.smithi162.stdout:7/694: truncate df/d2c/d49/d5d/f60 1419858 0 2024-04-25T02:00:12.896 INFO:tasks.workunit.client.0.smithi162.stdout:5/681: dread d15/d19/d24/d2b/f52 [0,4194304] 0 2024-04-25T02:00:13.028 INFO:tasks.workunit.client.0.smithi162.stdout:9/622: symlink d4/d9/d15/d1b/d2f/d30/dc1/d9f/dd1/ddc/ldd 0 2024-04-25T02:00:13.068 INFO:tasks.workunit.client.0.smithi162.stdout:5/682: dread d15/d19/d24/f25 [0,4194304] 0 2024-04-25T02:00:13.395 INFO:tasks.workunit.client.0.smithi162.stdout:3/682: fdatasync d2/d9/d19/d3f/fa9 0 2024-04-25T02:00:13.437 INFO:tasks.workunit.client.0.smithi162.stdout:7/695: truncate df/d2e/d4c/d8a/fc2 3395131 0 2024-04-25T02:00:13.958 INFO:tasks.workunit.client.0.smithi162.stdout:6/631: dwrite d1/d13/d28/d45/f61 [0,4194304] 0 2024-04-25T02:00:14.171 INFO:tasks.workunit.client.0.smithi162.stdout:6/632: chown d1/d13/d28/d7b/l81 14833738 1 2024-04-25T02:00:14.353 INFO:tasks.workunit.client.0.smithi162.stdout:6/633: sync 2024-04-25T02:00:14.353 INFO:tasks.workunit.client.0.smithi162.stdout:9/623: dread d4/d9/f47 [0,4194304] 0 2024-04-25T02:00:14.404 INFO:tasks.workunit.client.0.smithi162.stdout:5/683: mkdir d15/d19/d24/d2b/d3b/d80/ddf 0 2024-04-25T02:00:14.753 INFO:tasks.workunit.client.0.smithi162.stdout:0/754: dwrite d0/df/d20/f45 [0,4194304] 0 2024-04-25T02:00:14.900 INFO:tasks.workunit.client.0.smithi162.stdout:7/696: read df/f43 [921276,2138] 0 2024-04-25T02:00:14.934 INFO:tasks.workunit.client.0.smithi162.stdout:0/755: dread - d0/d1/d4e/fac zero size 2024-04-25T02:00:15.564 INFO:tasks.workunit.client.0.smithi162.stdout:2/639: getdents d0/d3/d7a/d88 0 2024-04-25T02:00:16.027 INFO:tasks.workunit.client.0.smithi162.stdout:5/684: readlink d15/d1e/l75 0 2024-04-25T02:00:16.408 INFO:tasks.workunit.client.0.smithi162.stdout:3/683: symlink d2/d9/d19/led 0 2024-04-25T02:00:16.576 INFO:tasks.workunit.client.0.smithi162.stdout:0/756: unlink d0/df/c91 0 2024-04-25T02:00:17.887 INFO:tasks.workunit.client.0.smithi162.stdout:4/675: dwrite dd/d1a/d4e/d93/fd1 [0,4194304] 0 2024-04-25T02:00:18.052 INFO:tasks.workunit.client.0.smithi162.stdout:1/698: link d15/d1f/d35/d4c/d70/d9f/fb6 d15/d1f/d35/d4c/d70/d73/db8/fe2 0 2024-04-25T02:00:18.193 INFO:tasks.workunit.client.0.smithi162.stdout:5/685: symlink d15/d19/d24/d2b/d3b/d3c/le0 0 2024-04-25T02:00:18.376 INFO:tasks.workunit.client.0.smithi162.stdout:8/659: dwrite d0/d12/d3a/fd3 [0,4194304] 0 2024-04-25T02:00:18.872 INFO:tasks.workunit.client.0.smithi162.stdout:1/699: chown d15/fa5 21663386 1 2024-04-25T02:00:19.206 INFO:tasks.workunit.client.0.smithi162.stdout:5/686: dread d15/d19/d24/d2b/d3b/d3c/fa1 [0,4194304] 0 2024-04-25T02:00:19.545 INFO:tasks.workunit.client.0.smithi162.stdout:3/684: getdents d2/d9/d19/d3f 0 2024-04-25T02:00:19.724 INFO:tasks.workunit.client.0.smithi162.stdout:6/634: write d1/f21 [2073653,111342] 0 2024-04-25T02:00:19.967 INFO:tasks.workunit.client.0.smithi162.stdout:3/685: creat d2/d9/d10/d2c/fee x:0 0 0 2024-04-25T02:00:20.244 INFO:tasks.workunit.client.0.smithi162.stdout:8/660: link d0/d12/d3a/lb0 d0/d12/d1b/d74/d8a/da3/ldd 0 2024-04-25T02:00:20.369 INFO:tasks.workunit.client.0.smithi162.stdout:4/676: getdents dd/df/d77/d87/db6/db8 0 2024-04-25T02:00:20.371 INFO:tasks.workunit.client.0.smithi162.stdout:6/635: dread d1/d13/d28/d30/d63/fc0 [0,4194304] 0 2024-04-25T02:00:20.465 INFO:tasks.workunit.client.0.smithi162.stdout:8/661: chown d0/d12/d1b/d74/d8a/fa7 98084 1 2024-04-25T02:00:20.674 INFO:tasks.workunit.client.0.smithi162.stdout:4/677: read dd/d1a/d34/d57/f71 [1628238,59924] 0 2024-04-25T02:00:20.780 INFO:tasks.workunit.client.0.smithi162.stdout:2/640: dwrite d0/f89 [0,4194304] 0 2024-04-25T02:00:20.926 INFO:tasks.workunit.client.0.smithi162.stdout:7/697: write df/f4d [3247062,110052] 0 2024-04-25T02:00:20.958 INFO:tasks.workunit.client.0.smithi162.stdout:0/757: write d0/df/d20/d25/d55/d77/fb8 [4933034,125276] 0 2024-04-25T02:00:21.111 INFO:tasks.workunit.client.0.smithi162.stdout:9/624: symlink d4/lde 0 2024-04-25T02:00:21.195 INFO:tasks.workunit.client.0.smithi162.stdout:1/700: rmdir d15 39 2024-04-25T02:00:21.222 INFO:tasks.workunit.client.0.smithi162.stdout:3/686: write d2/d9/f49 [787895,43232] 0 2024-04-25T02:00:21.462 INFO:tasks.workunit.client.0.smithi162.stdout:5/687: dwrite d15/d19/d24/fbd [0,4194304] 0 2024-04-25T02:00:21.586 INFO:tasks.workunit.client.0.smithi162.stdout:4/678: fsync dd/d1a/d34/d57/fc2 0 2024-04-25T02:00:21.592 INFO:tasks.workunit.client.0.smithi162.stdout:2/641: mknod d0/d3/d5/d36/d93/de0/cea 0 2024-04-25T02:00:21.612 INFO:tasks.workunit.client.0.smithi162.stdout:7/698: symlink df/d2e/d4c/d58/le6 0 2024-04-25T02:00:21.672 INFO:tasks.workunit.client.0.smithi162.stdout:0/758: symlink d0/df/d20/d37/d58/l103 0 2024-04-25T02:00:21.770 INFO:tasks.workunit.client.0.smithi162.stdout:7/699: sync 2024-04-25T02:00:22.194 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:00:22.197 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:00:22.241 INFO:tasks.workunit.client.0.smithi162.stdout:8/662: symlink d0/d12/d1b/d74/lde 0 2024-04-25T02:00:22.334 INFO:tasks.workunit.client.0.smithi162.stdout:6/636: dwrite d1/d13/d28/d30/d3a/f4b [4194304,4194304] 0 2024-04-25T02:00:22.344 INFO:tasks.workunit.client.0.smithi162.stdout:7/700: dwrite f6 [0,4194304] 0 2024-04-25T02:00:22.621 INFO:tasks.workunit.client.0.smithi162.stdout:3/687: mknod d2/d9/d10/d4c/d51/d63/d87/cef 0 2024-04-25T02:00:22.621 INFO:tasks.workunit.client.0.smithi162.stdout:8/663: dread - d0/d12/d1b/f50 zero size 2024-04-25T02:00:22.639 INFO:tasks.workunit.client.0.smithi162.stdout:2/642: rmdir d0/d3 39 2024-04-25T02:00:23.024 INFO:tasks.workunit.client.0.smithi162.stdout:4/679: truncate dd/d1a/d4e/fc1 455535 0 2024-04-25T02:00:23.080 INFO:tasks.workunit.client.0.smithi162.stdout:5/688: dwrite d15/d19/d24/d2b/fa0 [0,4194304] 0 2024-04-25T02:00:23.407 INFO:tasks.workunit.client.0.smithi162.stdout:1/701: truncate d15/d1f/d23/f57 262734 0 2024-04-25T02:00:23.433 INFO:tasks.workunit.client.0.smithi162.stdout:1/702: dread - d15/fab zero size 2024-04-25T02:00:23.907 INFO:tasks.workunit.client.0.smithi162.stdout:6/637: mkdir d1/d13/d28/d7b/dc4 0 2024-04-25T02:00:24.051 INFO:tasks.workunit.client.0.smithi162.stdout:7/701: symlink df/d2e/d4c/d58/le7 0 2024-04-25T02:00:24.090 INFO:tasks.workunit.client.0.smithi162.stdout:7/702: read - df/d2c/d49/d7a/f7d zero size 2024-04-25T02:00:24.391 INFO:tasks.workunit.client.0.smithi162.stdout:0/759: symlink d0/d1/d6a/l104 0 2024-04-25T02:00:24.765 INFO:tasks.workunit.client.0.smithi162.stdout:5/689: mkdir d15/d19/d24/d2b/d3b/d80/de1 0 2024-04-25T02:00:25.322 INFO:tasks.workunit.client.0.smithi162.stdout:6/638: mkdir d1/d13/d28/d53/d71/dc5 0 2024-04-25T02:00:25.514 INFO:tasks.workunit.client.0.smithi162.stdout:8/664: dwrite d0/f2d [0,4194304] 0 2024-04-25T02:00:25.670 INFO:tasks.workunit.client.0.smithi162.stdout:2/643: write d0/f8d [3703570,43188] 0 2024-04-25T02:00:25.975 INFO:tasks.workunit.client.0.smithi162.stdout:9/625: getdents d4/d9 0 2024-04-25T02:00:26.277 INFO:tasks.workunit.client.0.smithi162.stdout:5/690: mkdir d15/d19/d24/d4d/d7c/de2 0 2024-04-25T02:00:26.294 INFO:tasks.workunit.client.0.smithi162.stdout:5/691: chown f3 61436069 1 2024-04-25T02:00:27.220 INFO:tasks.workunit.client.0.smithi162.stdout:7/703: write df/d2c/d49/d7a/fce [218011,11698] 0 2024-04-25T02:00:27.400 INFO:tasks.workunit.client.0.smithi162.stdout:0/760: write d0/df/d20/f40 [3482902,129527] 0 2024-04-25T02:00:27.704 INFO:tasks.workunit.client.0.smithi162.stdout:4/680: rmdir dd/d1a/d34/db1/dba/ddd 0 2024-04-25T02:00:27.745 INFO:tasks.workunit.client.0.smithi162.stdout:4/681: chown dd/df/d2e/c31 218166 1 2024-04-25T02:00:27.866 INFO:tasks.workunit.client.0.smithi162.stdout:1/703: rename d15/d1f/f6c to d15/d1f/d35/d4c/d70/d9f/fe3 0 2024-04-25T02:00:28.080 INFO:tasks.workunit.client.0.smithi162.stdout:1/704: sync 2024-04-25T02:00:28.227 INFO:tasks.workunit.client.0.smithi162.stdout:1/705: sync 2024-04-25T02:00:28.275 INFO:tasks.workunit.client.0.smithi162.stdout:5/692: fdatasync d15/d19/d24/d2b/f3d 0 2024-04-25T02:00:28.372 INFO:tasks.workunit.client.0.smithi162.stdout:3/688: link d2/d9/d10/d2c/da3/db5/caa d2/d9/d10/d4c/d51/ddd/de1/cf0 0 2024-04-25T02:00:29.034 INFO:tasks.workunit.client.0.smithi162.stdout:7/704: rmdir df/d2e/d4c 39 2024-04-25T02:00:29.113 INFO:tasks.workunit.client.0.smithi162.stdout:2/644: dread d0/d3/f47 [0,4194304] 0 2024-04-25T02:00:29.280 INFO:tasks.workunit.client.0.smithi162.stdout:4/682: mknod dd/df/d58/ce1 0 2024-04-25T02:00:29.665 INFO:tasks.workunit.client.0.smithi162.stdout:6/639: rename d1/d13/d28/d30/d66/f76 to d1/d13/d28/d7b/fc6 0 2024-04-25T02:00:30.092 INFO:tasks.workunit.client.0.smithi162.stdout:5/693: mkdir d15/d19/d24/d40/dbf/de3 0 2024-04-25T02:00:30.133 INFO:tasks.workunit.client.0.smithi162.stdout:5/694: chown d15/d19/d24/d73/d7a/c94 65159933 1 2024-04-25T02:00:30.288 INFO:tasks.workunit.client.0.smithi162.stdout:5/695: dread d15/d1e/f22 [0,4194304] 0 2024-04-25T02:00:30.394 INFO:tasks.workunit.client.0.smithi162.stdout:8/665: link d0/d12/d2b/d87/fa0 d0/d12/d1b/d8d/fdf 0 2024-04-25T02:00:30.813 INFO:tasks.workunit.client.0.smithi162.stdout:9/626: creat d4/d9/d15/fdf x:0 0 0 2024-04-25T02:00:31.143 INFO:tasks.workunit.client.0.smithi162.stdout:1/706: fsync d15/d1f/d35/d4c/d70/d9f/fe3 0 2024-04-25T02:00:31.364 INFO:tasks.workunit.client.0.smithi162.stdout:5/696: dread - d15/d19/d24/d2b/d3b/d58/daf/dc8/fce zero size 2024-04-25T02:00:31.539 INFO:tasks.workunit.client.0.smithi162.stdout:8/666: unlink d0/d44/d31/d33/fd5 0 2024-04-25T02:00:31.708 INFO:tasks.workunit.client.0.smithi162.stdout:7/705: mkdir df/d2e/d4c/de8 0 2024-04-25T02:00:31.948 INFO:tasks.workunit.client.0.smithi162.stdout:9/627: creat d4/d9/d15/d1b/d69/fe0 x:0 0 0 2024-04-25T02:00:32.274 INFO:tasks.workunit.client.0.smithi162.stdout:9/628: dread d4/d9/d15/d1b/d2f/d30/f56 [0,4194304] 0 2024-04-25T02:00:32.968 INFO:tasks.workunit.client.0.smithi162.stdout:3/689: rmdir d2/d9/d10/d4c/d51/ddd/de1/dec 0 2024-04-25T02:00:33.223 INFO:tasks.workunit.client.0.smithi162.stdout:0/761: getdents d0/df/d20/d37/ddf 0 2024-04-25T02:00:33.533 INFO:tasks.workunit.client.0.smithi162.stdout:7/706: readlink df/d2c/l9d 0 2024-04-25T02:00:33.563 INFO:tasks.workunit.client.0.smithi162.stdout:2/645: dwrite d0/f5a [4194304,4194304] 0 2024-04-25T02:00:33.782 INFO:tasks.workunit.client.0.smithi162.stdout:6/640: rename d1/c83 to d1/d13/cc7 0 2024-04-25T02:00:33.807 INFO:tasks.workunit.client.0.smithi162.stdout:6/641: stat d1/d46/d7a/d85/l91 0 2024-04-25T02:00:34.098 INFO:tasks.workunit.client.0.smithi162.stdout:3/690: symlink d2/d9/d10/d4c/d51/d63/d87/d86/lf1 0 2024-04-25T02:00:34.102 INFO:tasks.workunit.client.0.smithi162.stdout:4/683: write dd/df/d2e/d59/f6f [812783,47648] 0 2024-04-25T02:00:34.598 INFO:tasks.workunit.client.0.smithi162.stdout:8/667: symlink d0/d12/d2b/dc7/le0 0 2024-04-25T02:00:34.663 INFO:tasks.workunit.client.0.smithi162.stdout:0/762: truncate d0/df/d20/fbc 458009 0 2024-04-25T02:00:34.751 INFO:tasks.workunit.client.0.smithi162.stdout:8/668: dread d0/d44/d31/d65/f71 [0,4194304] 0 2024-04-25T02:00:34.997 INFO:tasks.workunit.client.0.smithi162.stdout:2/646: creat d0/d3/d5/d69/feb x:0 0 0 2024-04-25T02:00:35.323 INFO:tasks.workunit.client.0.smithi162.stdout:3/691: dread d2/d29/f80 [0,4194304] 0 2024-04-25T02:00:35.441 INFO:tasks.workunit.client.0.smithi162.stdout:4/684: rename dd/df/d77/d87/db6/db8/fc8 to dd/df/d2e/d59/dd9/fe2 0 2024-04-25T02:00:35.662 INFO:tasks.workunit.client.0.smithi162.stdout:5/697: dwrite d15/d19/d24/f2d [0,4194304] 0 2024-04-25T02:00:35.783 INFO:tasks.workunit.client.0.smithi162.stdout:0/763: dread - d0/d1/d6a/da9/fca zero size 2024-04-25T02:00:35.849 INFO:tasks.workunit.client.0.smithi162.stdout:0/764: chown d0/d59/d7e/d9f/lc1 8 1 2024-04-25T02:00:35.874 INFO:tasks.workunit.client.0.smithi162.stdout:0/765: chown d0/df/d20/d37/d58/df4 561153 1 2024-04-25T02:00:35.895 INFO:tasks.workunit.client.0.smithi162.stdout:0/766: chown d0/df/f1b 291 1 2024-04-25T02:00:35.964 INFO:tasks.workunit.client.0.smithi162.stdout:9/629: creat d4/d9/d15/fe1 x:0 0 0 2024-04-25T02:00:36.146 INFO:tasks.workunit.client.0.smithi162.stdout:9/630: readlink d4/d9/l2b 0 2024-04-25T02:00:36.326 INFO:tasks.workunit.client.0.smithi162.stdout:2/647: chown d0/d3/d1b/d6b/dc0/d5e/d61/d66/cc2 0 1 2024-04-25T02:00:36.363 INFO:tasks.workunit.client.0.smithi162.stdout:1/707: dwrite d15/d1f/d35/d4c/d70/d9f/fb3 [0,4194304] 0 2024-04-25T02:00:36.368 INFO:tasks.workunit.client.0.smithi162.stdout:9/631: dread - d4/d8/d13/f89 zero size 2024-04-25T02:00:36.496 INFO:tasks.workunit.client.0.smithi162.stdout:6/642: unlink d1/d13/f23 0 2024-04-25T02:00:36.604 INFO:tasks.workunit.client.0.smithi162.stdout:4/685: fdatasync dd/d1a/fcc 0 2024-04-25T02:00:36.627 INFO:tasks.workunit.client.0.smithi162.stdout:9/632: sync 2024-04-25T02:00:36.948 INFO:tasks.workunit.client.0.smithi162.stdout:9/633: dread d4/d9/d15/d1b/d2f/f62 [0,4194304] 0 2024-04-25T02:00:37.348 INFO:tasks.workunit.client.0.smithi162.stdout:7/707: creat df/d2c/d63/d83/d8b/fe9 x:0 0 0 2024-04-25T02:00:37.830 INFO:tasks.workunit.client.0.smithi162.stdout:1/708: fsync d15/f34 0 2024-04-25T02:00:37.900 INFO:tasks.workunit.client.0.smithi162.stdout:6/643: truncate d1/f24 2183370 0 2024-04-25T02:00:38.252 INFO:tasks.workunit.client.0.smithi162.stdout:8/669: write d0/d12/f2e [1323126,117598] 0 2024-04-25T02:00:38.424 INFO:tasks.workunit.client.0.smithi162.stdout:9/634: truncate d4/d8/d13/f55 4470515 0 2024-04-25T02:00:38.845 INFO:tasks.workunit.client.0.smithi162.stdout:0/767: write d0/df/d20/d25/f49 [1267686,105704] 0 2024-04-25T02:00:38.899 INFO:tasks.workunit.client.0.smithi162.stdout:5/698: dwrite d15/d19/d24/fa9 [0,4194304] 0 2024-04-25T02:00:39.036 INFO:tasks.workunit.client.0.smithi162.stdout:0/768: chown d0/d59/d7e/d100/fd0 753351493 1 2024-04-25T02:00:39.130 INFO:tasks.workunit.client.0.smithi162.stdout:2/648: mknod d0/d3/d1b/d6b/d92/d9a/de4/cec 0 2024-04-25T02:00:39.175 INFO:tasks.workunit.client.0.smithi162.stdout:8/670: rename d0/d44/d91/fb8 to d0/d12/d1b/fe1 0 2024-04-25T02:00:39.765 INFO:tasks.workunit.client.0.smithi162.stdout:0/769: dread d0/d7b/f9b [0,4194304] 0 2024-04-25T02:00:39.792 INFO:tasks.workunit.client.0.smithi162.stdout:7/708: creat df/d2c/d63/d83/ddc/fea x:0 0 0 2024-04-25T02:00:40.125 INFO:tasks.workunit.client.0.smithi162.stdout:3/692: dwrite d2/f8e [0,4194304] 0 2024-04-25T02:00:40.327 INFO:tasks.workunit.client.0.smithi162.stdout:8/671: creat d0/d12/d2b/dc7/fe2 x:0 0 0 2024-04-25T02:00:40.508 INFO:tasks.workunit.client.0.smithi162.stdout:5/699: mkdir d15/d19/d24/d2b/d3b/de4 0 2024-04-25T02:00:40.671 INFO:tasks.workunit.client.0.smithi162.stdout:2/649: dread d0/f5c [0,4194304] 0 2024-04-25T02:00:40.684 INFO:tasks.workunit.client.0.smithi162.stdout:5/700: stat d15/d19/d24/d2b/d3b/f91 0 2024-04-25T02:00:40.759 INFO:tasks.workunit.client.0.smithi162.stdout:4/686: write dd/f33 [1045538,95075] 0 2024-04-25T02:00:40.773 INFO:tasks.workunit.client.0.smithi162.stdout:0/770: dread - d0/df/d20/d37/d58/fee zero size 2024-04-25T02:00:40.848 INFO:tasks.workunit.client.0.smithi162.stdout:4/687: chown dd/df/f10 1338 1 2024-04-25T02:00:41.521 INFO:tasks.workunit.client.0.smithi162.stdout:7/709: symlink df/d2e/d4c/d58/dd3/dd8/leb 0 2024-04-25T02:00:41.908 INFO:tasks.workunit.client.0.smithi162.stdout:0/771: mkdir d0/d1/d64/d105 0 2024-04-25T02:00:42.022 INFO:tasks.workunit.client.0.smithi162.stdout:4/688: truncate dd/d1a/d34/d9d/fda 1016058 0 2024-04-25T02:00:42.069 INFO:tasks.workunit.client.0.smithi162.stdout:0/772: sync 2024-04-25T02:00:42.410 INFO:tasks.workunit.client.0.smithi162.stdout:8/672: creat d0/d12/d2b/d87/dbe/fe3 x:0 0 0 2024-04-25T02:00:42.561 INFO:tasks.workunit.client.0.smithi162.stdout:7/710: creat df/d2e/d4c/d58/dd3/dd8/fec x:0 0 0 2024-04-25T02:00:42.569 INFO:tasks.workunit.client.0.smithi162.stdout:9/635: write d4/d9/d15/d8a/fa1 [161659,2275] 0 2024-04-25T02:00:42.707 INFO:tasks.workunit.client.0.smithi162.stdout:1/709: dwrite d15/d69/f75 [0,4194304] 0 2024-04-25T02:00:42.762 INFO:tasks.workunit.client.0.smithi162.stdout:6/644: dwrite d1/f68 [4194304,4194304] 0 2024-04-25T02:00:43.010 INFO:tasks.workunit.client.0.smithi162.stdout:0/773: symlink d0/d59/d7e/d100/l106 0 2024-04-25T02:00:43.027 INFO:tasks.workunit.client.0.smithi162.stdout:7/711: dread - df/d2e/fb8 zero size 2024-04-25T02:00:43.110 INFO:tasks.workunit.client.0.smithi162.stdout:0/774: sync 2024-04-25T02:00:43.344 INFO:tasks.workunit.client.0.smithi162.stdout:4/689: rename dd/df/d77/fc0 to dd/df/d77/d87/fe3 0 2024-04-25T02:00:43.447 INFO:tasks.workunit.client.0.smithi162.stdout:4/690: chown dd/d1a/d4e/d93/cb9 6001 1 2024-04-25T02:00:43.467 INFO:tasks.workunit.client.0.smithi162.stdout:4/691: chown dd/d1a/l45 43511618 1 2024-04-25T02:00:43.496 INFO:tasks.workunit.client.0.smithi162.stdout:4/692: stat dd/df/d58/f5a 0 2024-04-25T02:00:43.742 INFO:tasks.workunit.client.0.smithi162.stdout:7/712: symlink df/d2c/d63/d83/d8b/d90/led 0 2024-04-25T02:00:43.746 INFO:tasks.workunit.client.0.smithi162.stdout:8/673: creat d0/d12/d1b/d74/d8a/da3/fe4 x:0 0 0 2024-04-25T02:00:43.774 INFO:tasks.workunit.client.0.smithi162.stdout:6/645: chown d1/d5c/f5f 22 1 2024-04-25T02:00:44.008 INFO:tasks.workunit.client.0.smithi162.stdout:0/775: rename d0/d1/d64/f8c to d0/d1/d4e/f107 0 2024-04-25T02:00:44.138 INFO:tasks.workunit.client.0.smithi162.stdout:5/701: getdents d15/d19/d24/d73/d7a/d7e 0 2024-04-25T02:00:44.160 INFO:tasks.workunit.client.0.smithi162.stdout:5/702: chown d15/d19/d24 124098 1 2024-04-25T02:00:44.234 INFO:tasks.workunit.client.0.smithi162.stdout:3/693: write d2/d29/f46 [991935,16364] 0 2024-04-25T02:00:44.234 INFO:tasks.workunit.client.0.smithi162.stdout:4/693: symlink dd/df/d77/d87/le4 0 2024-04-25T02:00:44.319 INFO:tasks.workunit.client.0.smithi162.stdout:9/636: mknod d4/d9/da9/ce2 0 2024-04-25T02:00:44.361 INFO:tasks.workunit.client.0.smithi162.stdout:3/694: chown d2/d9/d10/d4c/d8d/cac 208550 1 2024-04-25T02:00:44.506 INFO:tasks.workunit.client.0.smithi162.stdout:8/674: fdatasync d0/d44/d31/fca 0 2024-04-25T02:00:44.547 INFO:tasks.workunit.client.0.smithi162.stdout:8/675: dread - d0/d44/d31/d33/fc0 zero size 2024-04-25T02:00:44.892 INFO:tasks.workunit.client.0.smithi162.stdout:0/776: unlink d0/df/d20/d25/d55/d6f/l98 0 2024-04-25T02:00:44.948 INFO:tasks.workunit.client.0.smithi162.stdout:2/650: write d0/d3/d1b/d6b/f8e [132394,109285] 0 2024-04-25T02:00:45.186 INFO:tasks.workunit.client.0.smithi162.stdout:4/694: creat dd/d1a/d34/d57/fe5 x:0 0 0 2024-04-25T02:00:45.411 INFO:tasks.workunit.client.0.smithi162.stdout:5/703: dread d15/d19/f1b [0,4194304] 0 2024-04-25T02:00:45.625 INFO:tasks.workunit.client.0.smithi162.stdout:3/695: read d2/d9/d19/f73 [3675239,7203] 0 2024-04-25T02:00:45.646 INFO:tasks.workunit.client.0.smithi162.stdout:1/710: link d15/f34 d15/d1f/d35/d4c/d70/d73/db8/fe4 0 2024-04-25T02:00:45.960 INFO:tasks.workunit.client.0.smithi162.stdout:6/646: symlink d1/d46/lc8 0 2024-04-25T02:00:46.419 INFO:tasks.workunit.client.0.smithi162.stdout:2/651: symlink d0/d3/d5/d36/d93/de0/led 0 2024-04-25T02:00:46.924 INFO:tasks.workunit.client.0.smithi162.stdout:4/695: creat dd/d1a/d34/d57/fe6 x:0 0 0 2024-04-25T02:00:46.953 INFO:tasks.workunit.client.0.smithi162.stdout:4/696: chown dd/d1a/f8f 2085280 1 2024-04-25T02:00:47.131 INFO:tasks.workunit.client.0.smithi162.stdout:5/704: truncate d15/d19/f59 341527 0 2024-04-25T02:00:47.593 INFO:tasks.workunit.client.0.smithi162.stdout:6/647: mknod d1/d13/d28/d30/d66/d89/cc9 0 2024-04-25T02:00:48.047 INFO:tasks.workunit.client.0.smithi162.stdout:0/777: fsync d0/df/d20/fbc 0 2024-04-25T02:00:48.671 INFO:tasks.workunit.client.0.smithi162.stdout:9/637: rmdir d4/d8/d85/dca 0 2024-04-25T02:00:49.160 INFO:tasks.workunit.client.0.smithi162.stdout:7/713: dwrite df/d2e/d4c/d58/f88 [0,4194304] 0 2024-04-25T02:00:49.344 INFO:tasks.workunit.client.0.smithi162.stdout:2/652: symlink d0/d3/d7a/lee 0 2024-04-25T02:00:50.168 INFO:tasks.workunit.client.0.smithi162.stdout:5/705: mkdir d15/d19/d24/d4d/d7c/d85/dde/de5 0 2024-04-25T02:00:50.281 INFO:tasks.workunit.client.0.smithi162.stdout:9/638: truncate d4/d9/d15/fd8 551259 0 2024-04-25T02:00:51.083 INFO:tasks.workunit.client.0.smithi162.stdout:3/696: dwrite d2/d9/d10/d4c/d51/d63/d87/d86/f9b [4194304,4194304] 0 2024-04-25T02:00:51.214 INFO:tasks.workunit.client.0.smithi162.stdout:5/706: fsync d15/d1e/f8a 0 2024-04-25T02:00:51.339 INFO:tasks.workunit.client.0.smithi162.stdout:1/711: getdents d15/d69/d4f/dad 0 2024-04-25T02:00:51.786 INFO:tasks.workunit.client.0.smithi162.stdout:7/714: symlink df/d2e/d4c/de8/lee 0 2024-04-25T02:00:51.948 INFO:tasks.workunit.client.0.smithi162.stdout:4/697: link dd/d1a/d34/l43 dd/df/d2e/le7 0 2024-04-25T02:00:51.986 INFO:tasks.workunit.client.0.smithi162.stdout:4/698: chown dd/d1a/d34/d57/l5c 15 1 2024-04-25T02:00:52.274 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:00:52.278 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:00:52.449 INFO:tasks.workunit.client.0.smithi162.stdout:5/707: creat d15/d19/d24/d40/fe6 x:0 0 0 2024-04-25T02:00:52.508 INFO:tasks.workunit.client.0.smithi162.stdout:5/708: chown d15/d19/d24/d73/d7a/c94 28 1 2024-04-25T02:00:52.591 INFO:tasks.workunit.client.0.smithi162.stdout:1/712: creat d15/d69/d4f/dad/fe5 x:0 0 0 2024-04-25T02:00:53.347 INFO:tasks.workunit.client.0.smithi162.stdout:0/778: dwrite d0/d1/d4e/d76/db0/fba [4194304,4194304] 0 2024-04-25T02:00:53.488 INFO:tasks.workunit.client.0.smithi162.stdout:1/713: creat d15/d1f/d35/d5c/fe6 x:0 0 0 2024-04-25T02:00:53.984 INFO:tasks.workunit.client.0.smithi162.stdout:6/648: mkdir d1/d13/d28/d30/dca 0 2024-04-25T02:00:54.755 INFO:tasks.workunit.client.0.smithi162.stdout:0/779: creat d0/df/d20/d37/dfc/f108 x:0 0 0 2024-04-25T02:00:54.887 INFO:tasks.workunit.client.0.smithi162.stdout:1/714: mknod d15/d1f/d35/d4c/d8e/ce7 0 2024-04-25T02:00:55.003 INFO:tasks.workunit.client.0.smithi162.stdout:4/699: getdents dd/d1a/d4e 0 2024-04-25T02:00:55.215 INFO:tasks.workunit.client.0.smithi162.stdout:6/649: creat d1/d13/d28/d45/d59/dbe/fcb x:0 0 0 2024-04-25T02:00:55.477 INFO:tasks.workunit.client.0.smithi162.stdout:3/697: write d2/d29/f2a [2980656,110343] 0 2024-04-25T02:00:55.625 INFO:tasks.workunit.client.0.smithi162.stdout:1/715: symlink d15/d1f/le8 0 2024-04-25T02:00:56.163 INFO:tasks.workunit.client.0.smithi162.stdout:3/698: symlink d2/d9/d19/d3f/lf2 0 2024-04-25T02:00:56.218 INFO:tasks.workunit.client.0.smithi162.stdout:7/715: write df/d2c/d63/d83/d8b/fe9 [46008,30646] 0 2024-04-25T02:00:56.301 INFO:tasks.workunit.client.0.smithi162.stdout:1/716: mkdir d15/d1f/d23/d30/d4a/d7f/de9 0 2024-04-25T02:00:56.553 INFO:tasks.workunit.client.0.smithi162.stdout:9/639: dwrite d4/dc0/fb9 [0,4194304] 0 2024-04-25T02:00:56.743 INFO:tasks.workunit.client.0.smithi162.stdout:3/699: rmdir d2/d9/d10/d2c/da0 39 2024-04-25T02:00:57.024 INFO:tasks.workunit.client.0.smithi162.stdout:3/700: sync 2024-04-25T02:00:57.065 INFO:tasks.workunit.client.0.smithi162.stdout:3/701: stat d2/d9/d10/d4c/d51/d63/d87/d86/lf1 0 2024-04-25T02:00:57.072 INFO:tasks.workunit.client.0.smithi162.stdout:9/640: rmdir d4/d9/d15/d8a 39 2024-04-25T02:00:57.168 INFO:tasks.workunit.client.0.smithi162.stdout:9/641: sync 2024-04-25T02:00:57.256 INFO:tasks.workunit.client.0.smithi162.stdout:8/676: rename d0/d12/dcc to d0/d12/d2b/d87/de5 0 2024-04-25T02:00:57.319 INFO:tasks.workunit.client.0.smithi162.stdout:7/716: chown df/d2e/d4c/d8a/db2/lb9 1 1 2024-04-25T02:00:57.385 INFO:tasks.workunit.client.0.smithi162.stdout:7/717: sync 2024-04-25T02:00:57.445 INFO:tasks.workunit.client.0.smithi162.stdout:1/717: mkdir d15/d1f/d35/d4c/d70/d9f/dea 0 2024-04-25T02:00:57.471 INFO:tasks.workunit.client.0.smithi162.stdout:8/677: dread d0/d12/f23 [0,4194304] 0 2024-04-25T02:00:57.497 INFO:tasks.workunit.client.0.smithi162.stdout:3/702: creat d2/d9/d19/d3f/ff3 x:0 0 0 2024-04-25T02:00:57.659 INFO:tasks.workunit.client.0.smithi162.stdout:9/642: chown d4/ca4 3970798 1 2024-04-25T02:00:57.833 INFO:tasks.workunit.client.0.smithi162.stdout:2/653: rename d0/d3/d1b/d6b/dc0/d5e/d61/da4/f7f to d0/d3/d1b/d6b/dc0/d67/d9c/fef 0 2024-04-25T02:00:57.847 INFO:tasks.workunit.client.0.smithi162.stdout:7/718: mkdir df/d2e/d4c/d58/dd3/dd8/def 0 2024-04-25T02:00:57.976 INFO:tasks.workunit.client.0.smithi162.stdout:3/703: stat d2/d9/lde 0 2024-04-25T02:00:58.041 INFO:tasks.workunit.client.0.smithi162.stdout:9/643: dread d4/d8/f5d [0,4194304] 0 2024-04-25T02:00:58.482 INFO:tasks.workunit.client.0.smithi162.stdout:5/709: rename d15/d19/d24/d73 to d15/d19/d24/d4d/d7c/d85/de7 0 2024-04-25T02:00:58.690 INFO:tasks.workunit.client.0.smithi162.stdout:7/719: mkdir df/d2e/d4c/d8a/db2/df0 0 2024-04-25T02:00:58.811 INFO:tasks.workunit.client.0.smithi162.stdout:3/704: dread - d2/d9/d10/d4c/d8d/fb2 zero size 2024-04-25T02:00:59.122 INFO:tasks.workunit.client.0.smithi162.stdout:0/780: dwrite d0/d7b/f9b [0,4194304] 0 2024-04-25T02:00:59.217 INFO:tasks.workunit.client.0.smithi162.stdout:1/718: rename d15/d1f/d35/d4c/d70/d73/ca8 to d15/d69/d4f/dad/ceb 0 2024-04-25T02:00:59.454 INFO:tasks.workunit.client.0.smithi162.stdout:4/700: write dd/df/d77/d87/fe3 [2640053,27890] 0 2024-04-25T02:00:59.955 INFO:tasks.workunit.client.0.smithi162.stdout:6/650: dwrite d1/f24 [0,4194304] 0 2024-04-25T02:01:00.140 INFO:tasks.workunit.client.0.smithi162.stdout:1/719: creat d15/d1f/d35/d4c/d70/fec x:0 0 0 2024-04-25T02:01:00.227 INFO:tasks.workunit.client.0.smithi162.stdout:2/654: creat d0/d3/d5/ff0 x:0 0 0 2024-04-25T02:01:00.229 INFO:tasks.workunit.client.0.smithi162.stdout:7/720: dread df/d2c/f3f [0,4194304] 0 2024-04-25T02:01:00.255 INFO:tasks.workunit.client.0.smithi162.stdout:6/651: chown d1/f27 859 1 2024-04-25T02:01:00.347 INFO:tasks.workunit.client.0.smithi162.stdout:2/655: chown d0/d3/d7a/d88/f9f 148 1 2024-04-25T02:01:00.522 INFO:tasks.workunit.client.0.smithi162.stdout:3/705: creat d2/d9/d99/dd2/ff4 x:0 0 0 2024-04-25T02:01:00.522 INFO:tasks.workunit.client.0.smithi162.stdout:9/644: creat d4/d8/d13/fe3 x:0 0 0 2024-04-25T02:01:00.597 INFO:tasks.workunit.client.0.smithi162.stdout:9/645: chown d4/d9/d15/d1b/la6 44284 1 2024-04-25T02:01:00.929 INFO:tasks.workunit.client.0.smithi162.stdout:4/701: mkdir dd/df/d2e/de8 0 2024-04-25T02:01:01.208 INFO:tasks.workunit.client.0.smithi162.stdout:6/652: dread d1/d13/f42 [0,4194304] 0 2024-04-25T02:01:01.508 INFO:tasks.workunit.client.0.smithi162.stdout:7/721: rename df/d2e/d4c/d8a/db2/fda to df/d2e/d4c/d8a/db2/ff1 0 2024-04-25T02:01:01.533 INFO:tasks.workunit.client.0.smithi162.stdout:7/722: chown df/d2e/lab 12709015 1 2024-04-25T02:01:02.068 INFO:tasks.workunit.client.0.smithi162.stdout:9/646: truncate d4/d8/d13/dbf/fcf 52451 0 2024-04-25T02:01:02.089 INFO:tasks.workunit.client.0.smithi162.stdout:8/678: write d0/d12/f2e [1921632,50287] 0 2024-04-25T02:01:02.179 INFO:tasks.workunit.client.0.smithi162.stdout:0/781: rmdir d0/d1/d4e/df8 0 2024-04-25T02:01:02.530 INFO:tasks.workunit.client.0.smithi162.stdout:7/723: rmdir df/d2c/d63/d83/d8b 39 2024-04-25T02:01:02.925 INFO:tasks.workunit.client.0.smithi162.stdout:5/710: dwrite f11 [0,4194304] 0 2024-04-25T02:01:03.015 INFO:tasks.workunit.client.0.smithi162.stdout:1/720: mknod d15/ced 0 2024-04-25T02:01:03.030 INFO:tasks.workunit.client.0.smithi162.stdout:8/679: symlink d0/d12/d1b/d8d/le6 0 2024-04-25T02:01:03.858 INFO:tasks.workunit.client.0.smithi162.stdout:5/711: dread - d15/d1e/f6b zero size 2024-04-25T02:01:04.286 INFO:tasks.workunit.client.0.smithi162.stdout:7/724: mknod df/d2e/d4c/d8a/cf2 0 2024-04-25T02:01:04.563 INFO:tasks.workunit.client.0.smithi162.stdout:5/712: creat d15/d19/d24/d2b/d3b/d80/fe8 x:0 0 0 2024-04-25T02:01:04.826 INFO:tasks.workunit.client.0.smithi162.stdout:1/721: creat d15/d1f/d35/d4c/d70/d9f/dea/fee x:0 0 0 2024-04-25T02:01:04.882 INFO:tasks.workunit.client.0.smithi162.stdout:4/702: getdents dd/d1a/d34/d9d 0 2024-04-25T02:01:05.107 INFO:tasks.workunit.client.0.smithi162.stdout:7/725: mknod df/d2e/d4c/d58/dd3/cf3 0 2024-04-25T02:01:05.162 INFO:tasks.workunit.client.0.smithi162.stdout:2/656: dwrite d0/d3/d1b/f5f [0,4194304] 0 2024-04-25T02:01:05.521 INFO:tasks.workunit.client.0.smithi162.stdout:2/657: dread d0/f5c [0,4194304] 0 2024-04-25T02:01:05.678 INFO:tasks.workunit.client.0.smithi162.stdout:3/706: dwrite d2/d9/d10/d2c/f78 [0,4194304] 0 2024-04-25T02:01:05.848 INFO:tasks.workunit.client.0.smithi162.stdout:8/680: creat d0/d12/d1b/d74/fe7 x:0 0 0 2024-04-25T02:01:05.905 INFO:tasks.workunit.client.0.smithi162.stdout:1/722: creat d15/d1f/d23/d30/d4a/d7f/d97/fef x:0 0 0 2024-04-25T02:01:05.943 INFO:tasks.workunit.client.0.smithi162.stdout:1/723: chown f14 258 1 2024-04-25T02:01:06.330 INFO:tasks.workunit.client.0.smithi162.stdout:6/653: dwrite d1/f68 [4194304,4194304] 0 2024-04-25T02:01:06.638 INFO:tasks.workunit.client.0.smithi162.stdout:0/782: write d0/d1/d4e/dd4/f101 [902761,127861] 0 2024-04-25T02:01:06.671 INFO:tasks.workunit.client.0.smithi162.stdout:0/783: stat d0/fa2 0 2024-04-25T02:01:07.289 INFO:tasks.workunit.client.0.smithi162.stdout:9/647: write d4/d8/d13/f55 [2965577,123107] 0 2024-04-25T02:01:07.298 INFO:tasks.workunit.client.0.smithi162.stdout:5/713: write d15/d19/d24/d40/f74 [3003281,111798] 0 2024-04-25T02:01:07.368 INFO:tasks.workunit.client.0.smithi162.stdout:4/703: write dd/df/d58/f5a [4074518,46903] 0 2024-04-25T02:01:07.461 INFO:tasks.workunit.client.0.smithi162.stdout:3/707: unlink d2/d9/d10/d2c/fee 0 2024-04-25T02:01:07.483 INFO:tasks.workunit.client.0.smithi162.stdout:7/726: write df/d2e/d4c/d58/d82/f8d [239359,90139] 0 2024-04-25T02:01:07.531 INFO:tasks.workunit.client.0.smithi162.stdout:8/681: mknod d0/d12/d2b/ce8 0 2024-04-25T02:01:07.594 INFO:tasks.workunit.client.0.smithi162.stdout:8/682: stat d0/d44/d64/f78 0 2024-04-25T02:01:07.837 INFO:tasks.workunit.client.0.smithi162.stdout:0/784: creat d0/df/d20/d37/da1/f109 x:0 0 0 2024-04-25T02:01:07.916 INFO:tasks.workunit.client.0.smithi162.stdout:9/648: stat d4/d8/d13/l5a 0 2024-04-25T02:01:08.095 INFO:tasks.workunit.client.0.smithi162.stdout:4/704: mkdir dd/df/d7e/de9 0 2024-04-25T02:01:08.489 INFO:tasks.workunit.client.0.smithi162.stdout:3/708: truncate d2/d29/f2a 3204606 0 2024-04-25T02:01:08.776 INFO:tasks.workunit.client.0.smithi162.stdout:8/683: unlink d0/d44/d31/l9d 0 2024-04-25T02:01:09.001 INFO:tasks.workunit.client.0.smithi162.stdout:2/658: dwrite d0/d3/d1b/d6b/fa0 [0,4194304] 0 2024-04-25T02:01:09.141 INFO:tasks.workunit.client.0.smithi162.stdout:0/785: rename d0/df/d20/l35 to d0/d1/dab/l10a 0 2024-04-25T02:01:09.289 INFO:tasks.workunit.client.0.smithi162.stdout:9/649: mknod d4/d9/da9/ce4 0 2024-04-25T02:01:09.524 INFO:tasks.workunit.client.0.smithi162.stdout:4/705: symlink dd/d1a/d4e/lea 0 2024-04-25T02:01:09.643 INFO:tasks.workunit.client.0.smithi162.stdout:3/709: rmdir d2/d9/d94 39 2024-04-25T02:01:09.757 INFO:tasks.workunit.client.0.smithi162.stdout:7/727: mknod df/d2c/d49/d7a/db5/dc1/cf4 0 2024-04-25T02:01:09.883 INFO:tasks.workunit.client.0.smithi162.stdout:6/654: dwrite d1/f10 [0,4194304] 0 2024-04-25T02:01:10.384 INFO:tasks.workunit.client.0.smithi162.stdout:8/684: symlink d0/d12/d2b/dc7/le9 0 2024-04-25T02:01:10.395 INFO:tasks.workunit.client.0.smithi162.stdout:2/659: unlink d0/d3/d5/d36/cd8 0 2024-04-25T02:01:10.413 INFO:tasks.workunit.client.0.smithi162.stdout:5/714: write d15/d19/d24/d2b/d3b/d3c/f70 [722234,69260] 0 2024-04-25T02:01:10.417 INFO:tasks.workunit.client.0.smithi162.stdout:0/786: truncate d0/d1/f3c 1026969 0 2024-04-25T02:01:10.558 INFO:tasks.workunit.client.0.smithi162.stdout:9/650: mkdir d4/d25/de5 0 2024-04-25T02:01:10.631 INFO:tasks.workunit.client.0.smithi162.stdout:9/651: chown d4/d8/d13/d38/fba 152641 1 2024-04-25T02:01:10.972 INFO:tasks.workunit.client.0.smithi162.stdout:1/724: getdents d15/d1f/d23 0 2024-04-25T02:01:11.392 INFO:tasks.workunit.client.0.smithi162.stdout:4/706: dread dd/d1a/f21 [0,4194304] 0 2024-04-25T02:01:11.707 INFO:tasks.workunit.client.0.smithi162.stdout:2/660: rmdir d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/da2 39 2024-04-25T02:01:11.708 INFO:tasks.workunit.client.0.smithi162.stdout:5/715: creat d15/d19/d24/d4d/d7c/d85/dde/fe9 x:0 0 0 2024-04-25T02:01:11.863 INFO:tasks.workunit.client.0.smithi162.stdout:9/652: chown d4/d8/f2d 53 1 2024-04-25T02:01:12.542 INFO:tasks.workunit.client.0.smithi162.stdout:7/728: symlink df/d2e/lf5 0 2024-04-25T02:01:12.682 INFO:tasks.workunit.client.0.smithi162.stdout:6/655: creat d1/d13/d79/fcc x:0 0 0 2024-04-25T02:01:12.788 INFO:tasks.workunit.client.0.smithi162.stdout:1/725: write d15/d1f/d35/d4c/d70/d9f/dea/fee [326437,5951] 0 2024-04-25T02:01:12.957 INFO:tasks.workunit.client.0.smithi162.stdout:4/707: mkdir dd/df/d58/deb 0 2024-04-25T02:01:13.144 INFO:tasks.workunit.client.0.smithi162.stdout:0/787: unlink d0/df/d20/d25/c38 0 2024-04-25T02:01:13.210 INFO:tasks.workunit.client.0.smithi162.stdout:5/716: symlink d15/d19/d24/d2b/lea 0 2024-04-25T02:01:13.985 INFO:tasks.workunit.client.0.smithi162.stdout:9/653: mknod d4/d7c/ce6 0 2024-04-25T02:01:14.224 INFO:tasks.workunit.client.0.smithi162.stdout:9/654: sync 2024-04-25T02:01:14.339 INFO:tasks.workunit.client.0.smithi162.stdout:7/729: truncate df/d2e/d4c/d8a/f8f 147828 0 2024-04-25T02:01:14.503 INFO:tasks.workunit.client.0.smithi162.stdout:6/656: dread d1/d13/d28/d30/d3a/f4b [4194304,4194304] 0 2024-04-25T02:01:14.529 INFO:tasks.workunit.client.0.smithi162.stdout:8/685: creat d0/d12/fea x:0 0 0 2024-04-25T02:01:14.673 INFO:tasks.workunit.client.0.smithi162.stdout:4/708: creat dd/d1a/d34/d57/fec x:0 0 0 2024-04-25T02:01:14.697 INFO:tasks.workunit.client.0.smithi162.stdout:4/709: chown dd/c2b 37513551 1 2024-04-25T02:01:15.255 INFO:tasks.workunit.client.0.smithi162.stdout:0/788: creat d0/d1/d6a/da9/f10b x:0 0 0 2024-04-25T02:01:16.059 INFO:tasks.workunit.client.0.smithi162.stdout:7/730: creat df/d2c/d63/d83/ddc/ff6 x:0 0 0 2024-04-25T02:01:16.103 INFO:tasks.workunit.client.0.smithi162.stdout:4/710: symlink dd/df/d58/led 0 2024-04-25T02:01:16.202 INFO:tasks.workunit.client.0.smithi162.stdout:4/711: dread - dd/d1a/fcc zero size 2024-04-25T02:01:16.644 INFO:tasks.workunit.client.0.smithi162.stdout:0/789: symlink d0/d1/d64/l10c 0 2024-04-25T02:01:16.742 INFO:tasks.workunit.client.0.smithi162.stdout:5/717: symlink d15/d19/d24/d2b/d3b/d3c/leb 0 2024-04-25T02:01:17.096 INFO:tasks.workunit.client.0.smithi162.stdout:2/661: rename d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/da2/cdd to d0/d3/d1b/d6b/dc0/d67/d9c/cf1 0 2024-04-25T02:01:17.591 INFO:tasks.workunit.client.0.smithi162.stdout:7/731: dread df/d2e/d4c/d58/f88 [0,4194304] 0 2024-04-25T02:01:17.597 INFO:tasks.workunit.client.0.smithi162.stdout:3/710: write d2/d9/d10/d2c/da3/db5/fc7 [500055,30901] 0 2024-04-25T02:01:17.710 INFO:tasks.workunit.client.0.smithi162.stdout:6/657: creat d1/d13/fcd x:0 0 0 2024-04-25T02:01:18.188 INFO:tasks.workunit.client.0.smithi162.stdout:5/718: symlink d15/d19/d24/d40/dbf/de3/lec 0 2024-04-25T02:01:18.342 INFO:tasks.workunit.client.0.smithi162.stdout:3/711: unlink d2/d9/d10/ld8 0 2024-04-25T02:01:18.555 INFO:tasks.workunit.client.0.smithi162.stdout:6/658: dread - d1/d46/d7a/fa2 zero size 2024-04-25T02:01:19.292 INFO:tasks.workunit.client.0.smithi162.stdout:6/659: dread - d1/d46/f97 zero size 2024-04-25T02:01:19.305 INFO:tasks.workunit.client.0.smithi162.stdout:3/712: chown d2/d9/d19/d3f 126977943 1 2024-04-25T02:01:19.337 INFO:tasks.workunit.client.0.smithi162.stdout:6/660: stat d1/d13/c58 0 2024-04-25T02:01:19.603 INFO:tasks.workunit.client.0.smithi162.stdout:8/686: write d0/d12/d1b/d8d/fb6 [418219,102922] 0 2024-04-25T02:01:19.755 INFO:tasks.workunit.client.0.smithi162.stdout:9/655: rename d4/d8/d13/f90 to d4/d9/d15/fe7 0 2024-04-25T02:01:19.797 INFO:tasks.workunit.client.0.smithi162.stdout:8/687: chown d0/d12/d2b/dc7/fe2 409336 1 2024-04-25T02:01:19.901 INFO:tasks.workunit.client.0.smithi162.stdout:1/726: dwrite d15/d1f/d23/d30/f5a [0,4194304] 0 2024-04-25T02:01:20.016 INFO:tasks.workunit.client.0.smithi162.stdout:8/688: chown d0/f2d 47485 1 2024-04-25T02:01:20.106 INFO:tasks.workunit.client.0.smithi162.stdout:1/727: readlink d15/d1f/d23/lb5 0 2024-04-25T02:01:20.502 INFO:tasks.workunit.client.0.smithi162.stdout:9/656: rmdir d4/d9/d15/d1b/d2f/d30/dc1/d9f/dd1 39 2024-04-25T02:01:20.691 INFO:tasks.workunit.client.0.smithi162.stdout:3/713: dread d2/d9/d10/d4c/f53 [0,4194304] 0 2024-04-25T02:01:20.860 INFO:tasks.workunit.client.0.smithi162.stdout:6/661: dwrite d1/d13/d79/fcc [0,4194304] 0 2024-04-25T02:01:21.087 INFO:tasks.workunit.client.0.smithi162.stdout:2/662: dwrite d0/d3/f47 [0,4194304] 0 2024-04-25T02:01:21.221 INFO:tasks.workunit.client.0.smithi162.stdout:1/728: symlink d15/d1f/d35/d5c/lf0 0 2024-04-25T02:01:21.345 INFO:tasks.workunit.client.0.smithi162.stdout:0/790: rename d0/df/d20/d37/d81/fd7 to d0/df/d20/d25/f10d 0 2024-04-25T02:01:21.483 INFO:tasks.workunit.client.0.smithi162.stdout:9/657: stat d4/d9/l7d 0 2024-04-25T02:01:21.676 INFO:tasks.workunit.client.0.smithi162.stdout:6/662: symlink d1/d73/d9a/lce 0 2024-04-25T02:01:21.683 INFO:tasks.workunit.client.0.smithi162.stdout:5/719: write d15/d19/d24/d2b/d3b/d80/fc9 [916308,27402] 0 2024-04-25T02:01:21.782 INFO:tasks.workunit.client.0.smithi162.stdout:6/663: stat d1/d13/d28/d30/d3a/d57/l5a 0 2024-04-25T02:01:22.029 INFO:tasks.workunit.client.0.smithi162.stdout:2/663: mkdir d0/d3/d1b/d6b/d92/d9a/de4/df2 0 2024-04-25T02:01:22.056 INFO:tasks.workunit.client.0.smithi162.stdout:6/664: sync 2024-04-25T02:01:22.078 INFO:tasks.workunit.client.0.smithi162.stdout:2/664: chown d0/d3/d1b/d6b/dc0/d5e 360 1 2024-04-25T02:01:22.174 INFO:tasks.workunit.client.0.smithi162.stdout:7/732: rename df/d2e/d4c/d58/dd3/dd8/fec to df/d2e/d4c/daf/ff7 0 2024-04-25T02:01:22.326 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:01:22.329 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:01:22.498 INFO:tasks.workunit.client.0.smithi162.stdout:3/714: mkdir d2/d9/d10/d2c/da0/df5 0 2024-04-25T02:01:22.706 INFO:tasks.workunit.client.0.smithi162.stdout:5/720: rmdir d15/d19/d24/d2b/d3b/d80 39 2024-04-25T02:01:22.850 INFO:tasks.workunit.client.0.smithi162.stdout:6/665: unlink d1/d46/d7a/l8d 0 2024-04-25T02:01:22.930 INFO:tasks.workunit.client.0.smithi162.stdout:4/712: mknod dd/cee 0 2024-04-25T02:01:23.098 INFO:tasks.workunit.client.0.smithi162.stdout:9/658: dread - d4/d9/d15/d8a/fcc zero size 2024-04-25T02:01:23.787 INFO:tasks.workunit.client.0.smithi162.stdout:8/689: dwrite d0/d12/d2b/d87/dbe/fe3 [0,4194304] 0 2024-04-25T02:01:23.987 INFO:tasks.workunit.client.0.smithi162.stdout:3/715: mkdir d2/ddf/de7/df6 0 2024-04-25T02:01:24.037 INFO:tasks.workunit.client.0.smithi162.stdout:9/659: dread d4/d8/d85/fbb [0,4194304] 0 2024-04-25T02:01:24.641 INFO:tasks.workunit.client.0.smithi162.stdout:6/666: mknod d1/d46/ccf 0 2024-04-25T02:01:24.773 INFO:tasks.workunit.client.0.smithi162.stdout:1/729: dwrite d15/f79 [0,4194304] 0 2024-04-25T02:01:24.907 INFO:tasks.workunit.client.0.smithi162.stdout:8/690: fdatasync d0/d1a/fd 0 2024-04-25T02:01:24.930 INFO:tasks.workunit.client.0.smithi162.stdout:6/667: dread - d1/d13/d28/d45/d59/d80/faf zero size 2024-04-25T02:01:25.083 INFO:tasks.workunit.client.0.smithi162.stdout:0/791: write d0/df/d20/d25/f4d [1130831,719] 0 2024-04-25T02:01:25.818 INFO:tasks.workunit.client.0.smithi162.stdout:6/668: mknod d1/d13/d28/d30/d8a/cd0 0 2024-04-25T02:01:25.943 INFO:tasks.workunit.client.0.smithi162.stdout:9/660: symlink d4/d9/d15/d1b/d2f/d30/dc1/d9f/le8 0 2024-04-25T02:01:25.987 INFO:tasks.workunit.client.0.smithi162.stdout:1/730: dread d15/d1f/d35/d4c/f6f [0,4194304] 0 2024-04-25T02:01:26.142 INFO:tasks.workunit.client.0.smithi162.stdout:6/669: stat d1/d13/d28/d30/d3a/d57/f65 0 2024-04-25T02:01:26.167 INFO:tasks.workunit.client.0.smithi162.stdout:7/733: dwrite df/d2e/f78 [0,4194304] 0 2024-04-25T02:01:26.565 INFO:tasks.workunit.client.0.smithi162.stdout:4/713: dwrite dd/df/f6c [0,4194304] 0 2024-04-25T02:01:26.702 INFO:tasks.workunit.client.0.smithi162.stdout:8/691: creat d0/d12/feb x:0 0 0 2024-04-25T02:01:26.959 INFO:tasks.workunit.client.0.smithi162.stdout:1/731: unlink d15/d1f/d35/d5c/lc3 0 2024-04-25T02:01:27.325 INFO:tasks.workunit.client.0.smithi162.stdout:5/721: dwrite d15/d19/d24/d4d/d9d/fbe [4194304,4194304] 0 2024-04-25T02:01:27.483 INFO:tasks.workunit.client.0.smithi162.stdout:7/734: creat df/d2e/d4c/d58/dd3/dd8/ff8 x:0 0 0 2024-04-25T02:01:27.537 INFO:tasks.workunit.client.0.smithi162.stdout:4/714: truncate dd/df/d2e/fb5 5164935 0 2024-04-25T02:01:27.568 INFO:tasks.workunit.client.0.smithi162.stdout:6/670: dread d1/d13/f15 [0,4194304] 0 2024-04-25T02:01:27.868 INFO:tasks.workunit.client.0.smithi162.stdout:1/732: mknod d15/d1f/d35/d4c/d70/d73/db8/cf1 0 2024-04-25T02:01:27.920 INFO:tasks.workunit.client.0.smithi162.stdout:7/735: fdatasync df/d2e/d4c/d8a/f61 0 2024-04-25T02:01:28.071 INFO:tasks.workunit.client.0.smithi162.stdout:4/715: mkdir dd/d1a/d34/d72/def 0 2024-04-25T02:01:28.252 INFO:tasks.workunit.client.0.smithi162.stdout:3/716: write d2/d9/f2d [782796,79743] 0 2024-04-25T02:01:28.634 INFO:tasks.workunit.client.0.smithi162.stdout:1/733: read d15/d1f/d35/d4c/d70/d73/db8/fe2 [1065678,73331] 0 2024-04-25T02:01:28.640 INFO:tasks.workunit.client.0.smithi162.stdout:0/792: dwrite d0/df/d20/d37/dfc/f108 [0,4194304] 0 2024-04-25T02:01:28.811 INFO:tasks.workunit.client.0.smithi162.stdout:1/734: read d15/f1b [3935444,104678] 0 2024-04-25T02:01:28.832 INFO:tasks.workunit.client.0.smithi162.stdout:0/793: readlink d0/df/d20/d25/d55/d6f/l71 0 2024-04-25T02:01:28.974 INFO:tasks.workunit.client.0.smithi162.stdout:6/671: mknod d1/d13/d28/d30/d3a/dbc/cd1 0 2024-04-25T02:01:28.998 INFO:tasks.workunit.client.0.smithi162.stdout:5/722: creat d15/fed x:0 0 0 2024-04-25T02:01:29.260 INFO:tasks.workunit.client.0.smithi162.stdout:3/717: chown d2/d9/d99/f52 2796 1 2024-04-25T02:01:29.694 INFO:tasks.workunit.client.0.smithi162.stdout:9/661: write d4/d9/d15/d1b/d2f/f62 [237646,18987] 0 2024-04-25T02:01:29.710 INFO:tasks.workunit.client.0.smithi162.stdout:1/735: dread - d15/d1f/d35/d4c/fe1 zero size 2024-04-25T02:01:29.745 INFO:tasks.workunit.client.0.smithi162.stdout:4/716: mknod dd/df/d2e/cf0 0 2024-04-25T02:01:29.815 INFO:tasks.workunit.client.0.smithi162.stdout:0/794: dread d0/df/d20/d37/f5b [0,4194304] 0 2024-04-25T02:01:29.864 INFO:tasks.workunit.client.0.smithi162.stdout:4/717: dread - dd/d1a/fcc zero size 2024-04-25T02:01:29.977 INFO:tasks.workunit.client.0.smithi162.stdout:6/672: chown d1/d13/c2b 1624754628 1 2024-04-25T02:01:29.986 INFO:tasks.workunit.client.0.smithi162.stdout:4/718: stat dd/d1a/d34/d57/ldf 0 2024-04-25T02:01:30.066 INFO:tasks.workunit.client.0.smithi162.stdout:3/718: mknod d2/d9/d10/d4c/d51/d63/d87/db6/cf7 0 2024-04-25T02:01:30.208 INFO:tasks.workunit.client.0.smithi162.stdout:6/673: sync 2024-04-25T02:01:30.320 INFO:tasks.workunit.client.0.smithi162.stdout:7/736: link df/f2d df/d2c/d49/d7a/db5/ff9 0 2024-04-25T02:01:30.349 INFO:tasks.workunit.client.0.smithi162.stdout:7/737: chown df/d2e/d4c/c6b 1 1 2024-04-25T02:01:30.794 INFO:tasks.workunit.client.0.smithi162.stdout:1/736: fsync d15/d1f/d23/d30/d4a/d7f/d97/dbe/fdc 0 2024-04-25T02:01:31.103 INFO:tasks.workunit.client.0.smithi162.stdout:8/692: write d0/d12/d2b/d87/fb9 [4083378,8842] 0 2024-04-25T02:01:31.165 INFO:tasks.workunit.client.0.smithi162.stdout:1/737: dread d15/d1f/d35/d5c/f74 [0,4194304] 0 2024-04-25T02:01:31.210 INFO:tasks.workunit.client.0.smithi162.stdout:6/674: mknod d1/d13/d28/d30/d3a/dbc/cd2 0 2024-04-25T02:01:31.216 INFO:tasks.workunit.client.0.smithi162.stdout:8/693: readlink d0/d12/d1b/l82 0 2024-04-25T02:01:31.691 INFO:tasks.workunit.client.0.smithi162.stdout:2/665: creat d0/ff3 x:0 0 0 2024-04-25T02:01:31.718 INFO:tasks.workunit.client.0.smithi162.stdout:8/694: dread d0/d44/d31/fca [0,4194304] 0 2024-04-25T02:01:31.855 INFO:tasks.workunit.client.0.smithi162.stdout:6/675: rename d1/d13/d28/d30/d66/d89/fa4 to d1/d13/d28/d7b/fd3 0 2024-04-25T02:01:32.353 INFO:tasks.workunit.client.0.smithi162.stdout:1/738: creat d15/d1f/d35/d4c/d70/d73/db8/dbb/ff2 x:0 0 0 2024-04-25T02:01:32.577 INFO:tasks.workunit.client.0.smithi162.stdout:8/695: mknod d0/d12/d2b/d87/dbe/cec 0 2024-04-25T02:01:32.759 INFO:tasks.workunit.client.0.smithi162.stdout:6/676: symlink d1/d13/d28/d53/ld4 0 2024-04-25T02:01:32.853 INFO:tasks.workunit.client.0.smithi162.stdout:1/739: dread - d15/d1f/d35/d5c/d83/fd8 zero size 2024-04-25T02:01:32.892 INFO:tasks.workunit.client.0.smithi162.stdout:1/740: stat d15/d1f/d35/d4c/d70/d9f/fb3 0 2024-04-25T02:01:33.519 INFO:tasks.workunit.client.0.smithi162.stdout:2/666: creat d0/d3/d7a/ff4 x:0 0 0 2024-04-25T02:01:33.699 INFO:tasks.workunit.client.0.smithi162.stdout:5/723: write d15/d19/d24/d2b/d3b/f98 [895545,79503] 0 2024-04-25T02:01:33.772 INFO:tasks.workunit.client.0.smithi162.stdout:8/696: creat d0/db1/fed x:0 0 0 2024-04-25T02:01:33.999 INFO:tasks.workunit.client.0.smithi162.stdout:2/667: mkdir d0/d3/d5/d36/df5 0 2024-04-25T02:01:34.641 INFO:tasks.workunit.client.0.smithi162.stdout:9/662: dwrite d4/d8/d13/fe3 [0,4194304] 0 2024-04-25T02:01:34.820 INFO:tasks.workunit.client.0.smithi162.stdout:0/795: write d0/d1/dab/fbe [193516,70766] 0 2024-04-25T02:01:34.822 INFO:tasks.workunit.client.0.smithi162.stdout:2/668: fsync d0/d3/d7a/d88/f9f 0 2024-04-25T02:01:35.232 INFO:tasks.workunit.client.0.smithi162.stdout:1/741: getdents d15/d1f/d23 0 2024-04-25T02:01:35.251 INFO:tasks.workunit.client.0.smithi162.stdout:4/719: write dd/fa1 [228052,83981] 0 2024-04-25T02:01:35.664 INFO:tasks.workunit.client.0.smithi162.stdout:3/719: dwrite d2/d9/d10/d2c/f78 [0,4194304] 0 2024-04-25T02:01:35.915 INFO:tasks.workunit.client.0.smithi162.stdout:7/738: dwrite f5 [0,4194304] 0 2024-04-25T02:01:36.250 INFO:tasks.workunit.client.0.smithi162.stdout:6/677: dwrite d1/d46/f56 [4194304,4194304] 0 2024-04-25T02:01:36.368 INFO:tasks.workunit.client.0.smithi162.stdout:9/663: fsync d4/d9/d15/d1b/d2f/d30/dc1/f61 0 2024-04-25T02:01:36.449 INFO:tasks.workunit.client.0.smithi162.stdout:0/796: read - d0/df/d20/d25/d55/d6f/d7d/da7/fb2 zero size 2024-04-25T02:01:36.542 INFO:tasks.workunit.client.0.smithi162.stdout:4/720: creat dd/d1a/d34/d9d/ff1 x:0 0 0 2024-04-25T02:01:36.545 INFO:tasks.workunit.client.0.smithi162.stdout:5/724: write d15/d19/d24/fa9 [450398,27433] 0 2024-04-25T02:01:36.954 INFO:tasks.workunit.client.0.smithi162.stdout:8/697: dwrite d0/d44/d31/d33/f47 [4194304,4194304] 0 2024-04-25T02:01:37.033 INFO:tasks.workunit.client.0.smithi162.stdout:3/720: truncate d2/d9/d10/d2c/da3/dba/f81 3078366 0 2024-04-25T02:01:37.266 INFO:tasks.workunit.client.0.smithi162.stdout:4/721: mknod dd/d1a/d34/cf2 0 2024-04-25T02:01:37.965 INFO:tasks.workunit.client.0.smithi162.stdout:9/664: creat d4/d25/de5/fe9 x:0 0 0 2024-04-25T02:01:38.103 INFO:tasks.workunit.client.0.smithi162.stdout:3/721: symlink d2/ddf/lf8 0 2024-04-25T02:01:38.216 INFO:tasks.workunit.client.0.smithi162.stdout:8/698: creat d0/d12/d1b/d8d/fee x:0 0 0 2024-04-25T02:01:38.339 INFO:tasks.workunit.client.0.smithi162.stdout:4/722: rmdir dd/df/d7e 39 2024-04-25T02:01:38.403 INFO:tasks.workunit.client.0.smithi162.stdout:2/669: write d0/d3/f35 [105549,37567] 0 2024-04-25T02:01:39.024 INFO:tasks.workunit.client.0.smithi162.stdout:1/742: write d15/fa5 [222650,92628] 0 2024-04-25T02:01:39.073 INFO:tasks.workunit.client.0.smithi162.stdout:1/743: chown d15/d69/d4f/dad/fe5 0 1 2024-04-25T02:01:39.147 INFO:tasks.workunit.client.0.smithi162.stdout:4/723: symlink dd/d1a/d34/d9d/lf3 0 2024-04-25T02:01:39.199 INFO:tasks.workunit.client.0.smithi162.stdout:4/724: chown dd/d1a/d4e/l7b 86327233 1 2024-04-25T02:01:39.239 INFO:tasks.workunit.client.0.smithi162.stdout:4/725: chown dd/df/d2e/d4b/d79/f85 0 1 2024-04-25T02:01:39.370 INFO:tasks.workunit.client.0.smithi162.stdout:7/739: write f1 [1488415,22218] 0 2024-04-25T02:01:39.710 INFO:tasks.workunit.client.0.smithi162.stdout:6/678: write d1/d13/d28/d30/d66/fc2 [249366,101945] 0 2024-04-25T02:01:39.864 INFO:tasks.workunit.client.0.smithi162.stdout:0/797: write d0/df/d20/d25/d55/f5a [1027485,30812] 0 2024-04-25T02:01:40.036 INFO:tasks.workunit.client.0.smithi162.stdout:2/670: symlink d0/d3/d7a/lf6 0 2024-04-25T02:01:40.158 INFO:tasks.workunit.client.0.smithi162.stdout:4/726: dread - dd/df/d2e/fad zero size 2024-04-25T02:01:40.763 INFO:tasks.workunit.client.0.smithi162.stdout:1/744: rename d15/d1f/d35/la0 to d15/d1f/d35/d4c/d70/d73/db8/dbb/lf3 0 2024-04-25T02:01:41.277 INFO:tasks.workunit.client.0.smithi162.stdout:5/725: write d15/d19/d24/d2b/d3b/d80/fc9 [128948,33077] 0 2024-04-25T02:01:41.430 INFO:tasks.workunit.client.0.smithi162.stdout:1/745: mkdir d15/d1f/d35/d4c/d70/d73/db8/df4 0 2024-04-25T02:01:41.537 INFO:tasks.workunit.client.0.smithi162.stdout:9/665: write d4/d9/d15/d1b/d2f/d30/dc1/d59/f9c [3500829,73011] 0 2024-04-25T02:01:42.161 INFO:tasks.workunit.client.0.smithi162.stdout:3/722: dwrite d2/d9/d10/d4c/f70 [0,4194304] 0 2024-04-25T02:01:42.174 INFO:tasks.workunit.client.0.smithi162.stdout:4/727: creat dd/df/d2e/de8/ff4 x:0 0 0 2024-04-25T02:01:42.433 INFO:tasks.workunit.client.0.smithi162.stdout:1/746: unlink d15/f79 0 2024-04-25T02:01:42.451 INFO:tasks.workunit.client.0.smithi162.stdout:8/699: dwrite d0/d12/d2b/d87/fbf [0,4194304] 0 2024-04-25T02:01:42.452 INFO:tasks.workunit.client.0.smithi162.stdout:2/671: rmdir d0/d3/d5/dbb 0 2024-04-25T02:01:42.565 INFO:tasks.workunit.client.0.smithi162.stdout:9/666: truncate d4/d9/d15/f88 707592 0 2024-04-25T02:01:42.848 INFO:tasks.workunit.client.0.smithi162.stdout:5/726: dread d15/d19/d24/d40/f5f [0,4194304] 0 2024-04-25T02:01:43.223 INFO:tasks.workunit.client.0.smithi162.stdout:3/723: fdatasync d2/d9/d10/d4c/d51/d63/d87/d86/f9b 0 2024-04-25T02:01:43.287 INFO:tasks.workunit.client.0.smithi162.stdout:4/728: dread dd/df/d2e/f2f [0,4194304] 0 2024-04-25T02:01:43.343 INFO:tasks.workunit.client.0.smithi162.stdout:3/724: stat d2/d9/d10/d4c/lb1 0 2024-04-25T02:01:43.394 INFO:tasks.workunit.client.0.smithi162.stdout:9/667: mknod d4/d25/da3/cea 0 2024-04-25T02:01:43.614 INFO:tasks.workunit.client.0.smithi162.stdout:8/700: fdatasync d0/d12/d1b/d8d/fb6 0 2024-04-25T02:01:43.803 INFO:tasks.workunit.client.0.smithi162.stdout:5/727: creat d15/d19/d24/d2b/d3b/d3c/d3f/fee x:0 0 0 2024-04-25T02:01:43.844 INFO:tasks.workunit.client.0.smithi162.stdout:0/798: dwrite d0/df/d20/d25/f49 [0,4194304] 0 2024-04-25T02:01:43.985 INFO:tasks.workunit.client.0.smithi162.stdout:8/701: write d0/d12/d1b/d8d/fee [458401,35621] 0 2024-04-25T02:01:44.014 INFO:tasks.workunit.client.0.smithi162.stdout:7/740: write df/d2c/f5b [2202489,47425] 0 2024-04-25T02:01:44.178 INFO:tasks.workunit.client.0.smithi162.stdout:1/747: truncate d15/f21 1704639 0 2024-04-25T02:01:44.262 INFO:tasks.workunit.client.0.smithi162.stdout:4/729: fdatasync dd/df/f52 0 2024-04-25T02:01:44.526 INFO:tasks.workunit.client.0.smithi162.stdout:9/668: creat d4/d8/d85/feb x:0 0 0 2024-04-25T02:01:44.694 INFO:tasks.workunit.client.0.smithi162.stdout:3/725: dread d2/d9/fbd [0,4194304] 0 2024-04-25T02:01:45.327 INFO:tasks.workunit.client.0.smithi162.stdout:0/799: symlink d0/df/d20/d25/d55/l10e 0 2024-04-25T02:01:45.375 INFO:tasks.workunit.client.0.smithi162.stdout:0/800: chown d0/df/d20/d37/ddf/ff1 1291 1 2024-04-25T02:01:45.745 INFO:tasks.workunit.client.0.smithi162.stdout:1/748: fdatasync d15/d1f/d35/f44 0 2024-04-25T02:01:45.808 INFO:tasks.workunit.client.0.smithi162.stdout:1/749: chown d15/d1f/d35/d4c/d70/d73/db8/fe2 461 1 2024-04-25T02:01:45.837 INFO:tasks.workunit.client.0.smithi162.stdout:1/750: read - d15/d1f/d35/d5c/d83/fd8 zero size 2024-04-25T02:01:45.866 INFO:tasks.workunit.client.0.smithi162.stdout:1/751: chown d15/d69/d4f/dad/fe5 3734 1 2024-04-25T02:01:45.906 INFO:tasks.workunit.client.0.smithi162.stdout:4/730: readlink dd/df/d7e/la8 0 2024-04-25T02:01:45.933 INFO:tasks.workunit.client.0.smithi162.stdout:1/752: chown d15/d69/d4f/c8a 108343474 1 2024-04-25T02:01:45.947 INFO:tasks.workunit.client.0.smithi162.stdout:9/669: mkdir d4/d9/d15/d1b/d2f/d30/dc1/d59/dec 0 2024-04-25T02:01:46.047 INFO:tasks.workunit.client.0.smithi162.stdout:6/679: symlink d1/d13/d28/ld5 0 2024-04-25T02:01:46.083 INFO:tasks.workunit.client.0.smithi162.stdout:6/680: read - d1/d13/d28/d45/d59/d80/faf zero size 2024-04-25T02:01:46.145 INFO:tasks.workunit.client.0.smithi162.stdout:6/681: chown d1/d13/d28/d45/fa5 14250 1 2024-04-25T02:01:46.270 INFO:tasks.workunit.client.0.smithi162.stdout:2/672: creat d0/d3/d1b/d1d/d3a/d63/ff7 x:0 0 0 2024-04-25T02:01:46.922 INFO:tasks.workunit.client.0.smithi162.stdout:0/801: mknod d0/df/d20/d37/dfc/c10f 0 2024-04-25T02:01:47.354 INFO:tasks.workunit.client.0.smithi162.stdout:4/731: rmdir dd/df/d2e 39 2024-04-25T02:01:47.722 INFO:tasks.workunit.client.0.smithi162.stdout:2/673: creat d0/d3/d1b/d6b/dc0/d67/d9c/ff8 x:0 0 0 2024-04-25T02:01:47.820 INFO:tasks.workunit.client.0.smithi162.stdout:5/728: creat d15/d19/d24/d2b/d3b/d3c/fef x:0 0 0 2024-04-25T02:01:47.921 INFO:tasks.workunit.client.0.smithi162.stdout:0/802: creat d0/d1/d6a/da9/f110 x:0 0 0 2024-04-25T02:01:48.138 INFO:tasks.workunit.client.0.smithi162.stdout:5/729: sync 2024-04-25T02:01:48.309 INFO:tasks.workunit.client.0.smithi162.stdout:3/726: rename d2/d9/d10/c3e to d2/d9/d10/d2c/da3/dba/cf9 0 2024-04-25T02:01:48.377 INFO:tasks.workunit.client.0.smithi162.stdout:4/732: read dd/df/f49 [3382735,26561] 0 2024-04-25T02:01:48.463 INFO:tasks.workunit.client.0.smithi162.stdout:9/670: truncate d4/d9/d15/d1b/f2e 191488 0 2024-04-25T02:01:48.491 INFO:tasks.workunit.client.0.smithi162.stdout:9/671: chown d4/d8/d13/cac 3632092 1 2024-04-25T02:01:48.756 INFO:tasks.workunit.client.0.smithi162.stdout:6/682: mkdir d1/d13/d28/d53/d71/dc5/dd6 0 2024-04-25T02:01:48.788 INFO:tasks.workunit.client.0.smithi162.stdout:6/683: chown d1/d13/d28/d45/d59/dbe 0 1 2024-04-25T02:01:49.693 INFO:tasks.workunit.client.0.smithi162.stdout:1/753: rename d15/d1f/d23/d30/d4a/d7f/de9 to d15/d1f/d35/d4c/d70/d73/df5 0 2024-04-25T02:01:49.931 INFO:tasks.workunit.client.0.smithi162.stdout:8/702: dwrite d0/d44/d31/fca [4194304,4194304] 0 2024-04-25T02:01:50.233 INFO:tasks.workunit.client.0.smithi162.stdout:6/684: symlink d1/d13/d79/ld7 0 2024-04-25T02:01:50.340 INFO:tasks.workunit.client.0.smithi162.stdout:9/672: dread d4/d8/d13/f79 [0,4194304] 0 2024-04-25T02:01:50.360 INFO:tasks.workunit.client.0.smithi162.stdout:7/741: dwrite df/d2c/d63/d83/ddc/fea [0,4194304] 0 2024-04-25T02:01:51.094 INFO:tasks.workunit.client.0.smithi162.stdout:1/754: chown d15/d1f/d23/d30/l9a 86755404 1 2024-04-25T02:01:52.104 INFO:tasks.workunit.client.0.smithi162.stdout:4/733: read - dd/df/d2e/d4b/d79/f9c zero size 2024-04-25T02:01:52.118 INFO:tasks.workunit.client.0.smithi162.stdout:9/673: fdatasync d4/d9/fc8 0 2024-04-25T02:01:52.137 INFO:tasks.workunit.client.0.smithi162.stdout:7/742: creat df/d2e/d4c/d58/ffa x:0 0 0 2024-04-25T02:01:52.229 INFO:tasks.workunit.client.0.smithi162.stdout:4/734: chown dd/d1a/d4e/d93 11993 1 2024-04-25T02:01:52.262 INFO:tasks.workunit.client.0.smithi162.stdout:9/674: sync 2024-04-25T02:01:52.373 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:01:52.376 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:01:52.566 INFO:tasks.workunit.client.0.smithi162.stdout:5/730: write d15/d19/d24/d2b/d3b/d58/f9a [1640312,96327] 0 2024-04-25T02:01:52.569 INFO:tasks.workunit.client.0.smithi162.stdout:3/727: write d2/d9/d10/d4c/d8d/f92 [1618685,54563] 0 2024-04-25T02:01:52.784 INFO:tasks.workunit.client.0.smithi162.stdout:1/755: getdents d15/d1f/d23/d30/d4a/d7f/d97/dbe/dde 0 2024-04-25T02:01:52.807 INFO:tasks.workunit.client.0.smithi162.stdout:1/756: readlink d15/d1f/d23/l4d 0 2024-04-25T02:01:53.105 INFO:tasks.workunit.client.0.smithi162.stdout:6/685: mknod d1/d46/cd8 0 2024-04-25T02:01:53.760 INFO:tasks.workunit.client.0.smithi162.stdout:2/674: dwrite d0/d3/d7a/fb2 [0,4194304] 0 2024-04-25T02:01:53.906 INFO:tasks.workunit.client.0.smithi162.stdout:1/757: chown d15/d1f/d35/d4c/d70/d9f/fc6 1731615 1 2024-04-25T02:01:53.945 INFO:tasks.workunit.client.0.smithi162.stdout:0/803: dwrite d0/df/d20/d37/d58/f8b [0,4194304] 0 2024-04-25T02:01:54.142 INFO:tasks.workunit.client.0.smithi162.stdout:9/675: rename f3 to d4/d8/d85/fed 0 2024-04-25T02:01:54.389 INFO:tasks.workunit.client.0.smithi162.stdout:6/686: mknod d1/d13/d28/d30/d3a/d57/cd9 0 2024-04-25T02:01:54.464 INFO:tasks.workunit.client.0.smithi162.stdout:8/703: write d0/d12/fea [20929,15699] 0 2024-04-25T02:01:54.560 INFO:tasks.workunit.client.0.smithi162.stdout:4/735: link dd/df/d2e/c31 dd/df/d2e/d4b/d79/cf5 0 2024-04-25T02:01:54.851 INFO:tasks.workunit.client.0.smithi162.stdout:0/804: creat d0/df/d20/d25/dce/f111 x:0 0 0 2024-04-25T02:01:55.298 INFO:tasks.workunit.client.0.smithi162.stdout:9/676: unlink d4/d8/d13/cac 0 2024-04-25T02:01:55.344 INFO:tasks.workunit.client.0.smithi162.stdout:6/687: creat d1/d46/d7a/fda x:0 0 0 2024-04-25T02:01:55.628 INFO:tasks.workunit.client.0.smithi162.stdout:0/805: truncate d0/d1/f9e 1199459 0 2024-04-25T02:01:56.063 INFO:tasks.workunit.client.0.smithi162.stdout:6/688: read d1/d46/d7a/d85/fa3 [45134,36665] 0 2024-04-25T02:01:56.466 INFO:tasks.workunit.client.0.smithi162.stdout:4/736: symlink dd/df/d2e/lf6 0 2024-04-25T02:01:56.773 INFO:tasks.workunit.client.0.smithi162.stdout:5/731: rename d15/d19/d24/d4d/d7c/d85/de7/d7a/d7e/fd5 to d15/d19/d24/ff0 0 2024-04-25T02:01:56.807 INFO:tasks.workunit.client.0.smithi162.stdout:5/732: chown d15/d19/d24/dca/fd9 1476299 1 2024-04-25T02:01:56.933 INFO:tasks.workunit.client.0.smithi162.stdout:9/677: mkdir d4/d9/d15/d1b/d2f/d30/dc1/d9f/dd1/dee 0 2024-04-25T02:01:56.955 INFO:tasks.workunit.client.0.smithi162.stdout:3/728: write d2/d9/d10/d4c/d51/d63/d87/d86/fc2 [1090342,127123] 0 2024-04-25T02:01:57.075 INFO:tasks.workunit.client.0.smithi162.stdout:6/689: symlink d1/d13/d28/d45/d59/dbe/ldb 0 2024-04-25T02:01:57.610 INFO:tasks.workunit.client.0.smithi162.stdout:7/743: dwrite df/d2e/d4c/daf/ff7 [0,4194304] 0 2024-04-25T02:01:57.782 INFO:tasks.workunit.client.0.smithi162.stdout:4/737: dread dd/d1a/f8f [0,4194304] 0 2024-04-25T02:01:57.873 INFO:tasks.workunit.client.0.smithi162.stdout:3/729: mknod d2/ddf/cfa 0 2024-04-25T02:01:57.875 INFO:tasks.workunit.client.0.smithi162.stdout:9/678: dread d4/dc0/fb9 [0,4194304] 0 2024-04-25T02:01:57.890 INFO:tasks.workunit.client.0.smithi162.stdout:8/704: getdents d0/db1 0 2024-04-25T02:01:57.915 INFO:tasks.workunit.client.0.smithi162.stdout:9/679: stat d4/d9/da9/ce4 0 2024-04-25T02:01:57.956 INFO:tasks.workunit.client.0.smithi162.stdout:3/730: read d2/d9/d10/d4c/d51/d63/d87/d86/fc2 [1079195,33433] 0 2024-04-25T02:01:58.169 INFO:tasks.workunit.client.0.smithi162.stdout:2/675: dwrite d0/d3/d1b/d1d/f38 [0,4194304] 0 2024-04-25T02:01:58.275 INFO:tasks.workunit.client.0.smithi162.stdout:7/744: creat df/d2e/d4c/ffb x:0 0 0 2024-04-25T02:01:58.350 INFO:tasks.workunit.client.0.smithi162.stdout:2/676: chown d0/d3/d1b/d6b/dc0/d5e/d61/d62 610 1 2024-04-25T02:01:58.598 INFO:tasks.workunit.client.0.smithi162.stdout:4/738: truncate dd/d1a/d34/d57/fc6 4209464 0 2024-04-25T02:01:58.666 INFO:tasks.workunit.client.0.smithi162.stdout:0/806: getdents d0/d59/d7e 0 2024-04-25T02:01:58.787 INFO:tasks.workunit.client.0.smithi162.stdout:1/758: dwrite d15/d1f/d35/d4c/d70/d73/db8/fe2 [0,4194304] 0 2024-04-25T02:01:58.903 INFO:tasks.workunit.client.0.smithi162.stdout:6/690: symlink d1/d46/ldc 0 2024-04-25T02:01:58.913 INFO:tasks.workunit.client.0.smithi162.stdout:9/680: rmdir d4/d9/d15/d1b/d2f/d30/dc1/d9f/dd1/ddc 39 2024-04-25T02:01:59.295 INFO:tasks.workunit.client.0.smithi162.stdout:2/677: dread d0/d3/d1b/d6b/dc0/d5e/d61/d66/f9b [0,4194304] 0 2024-04-25T02:01:59.639 INFO:tasks.workunit.client.0.smithi162.stdout:3/731: mkdir d2/d9/d10/d4c/dfb 0 2024-04-25T02:02:00.609 INFO:tasks.workunit.client.0.smithi162.stdout:6/691: fdatasync d1/d13/d28/d30/d3a/f5b 0 2024-04-25T02:02:00.676 INFO:tasks.workunit.client.0.smithi162.stdout:2/678: mknod d0/d3/d1b/d1d/cf9 0 2024-04-25T02:02:00.872 INFO:tasks.workunit.client.0.smithi162.stdout:8/705: creat d0/fef x:0 0 0 2024-04-25T02:02:00.883 INFO:tasks.workunit.client.0.smithi162.stdout:5/733: write fd [3900075,70850] 0 2024-04-25T02:02:00.948 INFO:tasks.workunit.client.0.smithi162.stdout:8/706: readlink d0/d44/d31/d65/ldb 0 2024-04-25T02:02:00.978 INFO:tasks.workunit.client.0.smithi162.stdout:8/707: stat d0/d12/d1b/d74/lde 0 2024-04-25T02:02:01.180 INFO:tasks.workunit.client.0.smithi162.stdout:4/739: getdents dd/d1a/d34/d72/def 0 2024-04-25T02:02:01.209 INFO:tasks.workunit.client.0.smithi162.stdout:4/740: chown dd/d1a/d34/db1/dba 4938552 1 2024-04-25T02:02:01.908 INFO:tasks.workunit.client.0.smithi162.stdout:7/745: rename f6 to df/d2e/ffc 0 2024-04-25T02:02:02.039 INFO:tasks.workunit.client.0.smithi162.stdout:6/692: truncate d1/d13/d28/d30/d66/fc2 1147770 0 2024-04-25T02:02:02.336 INFO:tasks.workunit.client.0.smithi162.stdout:8/708: rmdir d0/d12/d1b/d74/d8a/da3 39 2024-04-25T02:02:02.445 INFO:tasks.workunit.client.0.smithi162.stdout:3/732: mkdir d2/d9/d10/d4c/dfb/dfc 0 2024-04-25T02:02:02.566 INFO:tasks.workunit.client.0.smithi162.stdout:4/741: creat dd/df/d77/d87/ff7 x:0 0 0 2024-04-25T02:02:02.599 INFO:tasks.workunit.client.0.smithi162.stdout:4/742: readlink dd/d1a/d34/d9d/lf3 0 2024-04-25T02:02:02.719 INFO:tasks.workunit.client.0.smithi162.stdout:7/746: dread - df/d2e/d4c/d8a/db2/ff1 zero size 2024-04-25T02:02:03.019 INFO:tasks.workunit.client.0.smithi162.stdout:2/679: symlink d0/d3/d1b/d6b/dc0/de3/lfa 0 2024-04-25T02:02:03.144 INFO:tasks.workunit.client.0.smithi162.stdout:0/807: write d0/df/d20/d25/d55/d6f/d7d/faa [139234,88978] 0 2024-04-25T02:02:03.186 INFO:tasks.workunit.client.0.smithi162.stdout:8/709: symlink d0/d44/d91/lf0 0 2024-04-25T02:02:03.258 INFO:tasks.workunit.client.0.smithi162.stdout:6/693: dread d1/d13/f50 [0,4194304] 0 2024-04-25T02:02:03.325 INFO:tasks.workunit.client.0.smithi162.stdout:8/710: dread - d0/d12/d3a/f7f zero size 2024-04-25T02:02:03.326 INFO:tasks.workunit.client.0.smithi162.stdout:0/808: chown d0/d1/d4b/f85 195 1 2024-04-25T02:02:03.851 INFO:tasks.workunit.client.0.smithi162.stdout:1/759: write d15/d1f/d35/d5c/f74 [2983544,59898] 0 2024-04-25T02:02:03.940 INFO:tasks.workunit.client.0.smithi162.stdout:2/680: read d0/d3/d1b/d6b/dc0/d5e/d61/fb5 [174627,104321] 0 2024-04-25T02:02:04.023 INFO:tasks.workunit.client.0.smithi162.stdout:0/809: readlink d0/df/d20/d37/d81/d92/lea 0 2024-04-25T02:02:04.108 INFO:tasks.workunit.client.0.smithi162.stdout:8/711: truncate d0/d44/d91/f36 2860947 0 2024-04-25T02:02:04.305 INFO:tasks.workunit.client.0.smithi162.stdout:9/681: dwrite d4/d9/d15/d1b/f9a [0,4194304] 0 2024-04-25T02:02:04.815 INFO:tasks.workunit.client.0.smithi162.stdout:0/810: symlink d0/d1/d4e/d76/db0/l112 0 2024-04-25T02:02:04.941 INFO:tasks.workunit.client.0.smithi162.stdout:8/712: symlink d0/d12/d3a/lf1 0 2024-04-25T02:02:05.316 INFO:tasks.workunit.client.0.smithi162.stdout:2/681: truncate d0/d3/d5/ff0 757166 0 2024-04-25T02:02:06.051 INFO:tasks.workunit.client.0.smithi162.stdout:4/743: getdents dd/d1a/d4e 0 2024-04-25T02:02:06.215 INFO:tasks.workunit.client.0.smithi162.stdout:7/747: getdents df/d2c/d63/d83 0 2024-04-25T02:02:06.302 INFO:tasks.workunit.client.0.smithi162.stdout:2/682: fdatasync d0/f74 0 2024-04-25T02:02:06.374 INFO:tasks.workunit.client.0.smithi162.stdout:8/713: dread d0/d12/f24 [0,4194304] 0 2024-04-25T02:02:06.529 INFO:tasks.workunit.client.0.smithi162.stdout:9/682: creat d4/d9/d15/d1b/d2f/d30/dc1/d59/dec/fef x:0 0 0 2024-04-25T02:02:06.667 INFO:tasks.workunit.client.0.smithi162.stdout:5/734: write d15/d19/d24/dca/fd9 [4114841,57160] 0 2024-04-25T02:02:06.728 INFO:tasks.workunit.client.0.smithi162.stdout:6/694: dread d1/d13/d28/d30/d66/fc2 [0,4194304] 0 2024-04-25T02:02:06.832 INFO:tasks.workunit.client.0.smithi162.stdout:2/683: chown d0/d3/d5/d36/d93/de0/led 583004015 1 2024-04-25T02:02:07.119 INFO:tasks.workunit.client.0.smithi162.stdout:1/760: write d15/d69/d4f/f63 [763732,52599] 0 2024-04-25T02:02:07.411 INFO:tasks.workunit.client.0.smithi162.stdout:3/733: dwrite d2/d29/d2e/f4f [0,4194304] 0 2024-04-25T02:02:07.678 INFO:tasks.workunit.client.0.smithi162.stdout:8/714: fdatasync d0/d12/f4e 0 2024-04-25T02:02:07.850 INFO:tasks.workunit.client.0.smithi162.stdout:0/811: dwrite d0/df/d20/f45 [0,4194304] 0 2024-04-25T02:02:07.968 INFO:tasks.workunit.client.0.smithi162.stdout:7/748: rename df/d2e/d4c/daf/fb3 to df/d2c/d49/ffd 0 2024-04-25T02:02:08.184 INFO:tasks.workunit.client.0.smithi162.stdout:2/684: rmdir d0/d3/d1b/d6b/dc0/d5e/d61/d62 39 2024-04-25T02:02:08.370 INFO:tasks.workunit.client.0.smithi162.stdout:2/685: chown d0/d3/d1b/d6b/dc0/d5e/d61/da4 1626230 1 2024-04-25T02:02:08.439 INFO:tasks.workunit.client.0.smithi162.stdout:4/744: dwrite dd/f33 [0,4194304] 0 2024-04-25T02:02:08.612 INFO:tasks.workunit.client.0.smithi162.stdout:2/686: chown d0/d3/d7a/d88/c99 2609 1 2024-04-25T02:02:08.628 INFO:tasks.workunit.client.0.smithi162.stdout:4/745: chown dd/df/d2e/f2f 9905058 1 2024-04-25T02:02:08.941 INFO:tasks.workunit.client.0.smithi162.stdout:8/715: symlink d0/d12/d2b/lf2 0 2024-04-25T02:02:09.125 INFO:tasks.workunit.client.0.smithi162.stdout:3/734: dread d2/d9/d10/d2c/da3/db5/fc0 [0,4194304] 0 2024-04-25T02:02:09.254 INFO:tasks.workunit.client.0.smithi162.stdout:7/749: unlink df/d2e/d4c/daf/ff7 0 2024-04-25T02:02:09.274 INFO:tasks.workunit.client.0.smithi162.stdout:5/735: creat d15/d19/d24/d4d/d7c/d85/de7/dd1/ff1 x:0 0 0 2024-04-25T02:02:09.322 INFO:tasks.workunit.client.0.smithi162.stdout:1/761: symlink d15/d1f/d35/d4c/d70/d73/db8/df4/lf6 0 2024-04-25T02:02:09.432 INFO:tasks.workunit.client.0.smithi162.stdout:0/812: dread d0/df/d20/d37/d81/d92/fa4 [0,4194304] 0 2024-04-25T02:02:09.784 INFO:tasks.workunit.client.0.smithi162.stdout:4/746: mkdir dd/d1a/d34/d9d/df8 0 2024-04-25T02:02:09.797 INFO:tasks.workunit.client.0.smithi162.stdout:2/687: truncate d0/d3/f16 3525935 0 2024-04-25T02:02:09.852 INFO:tasks.workunit.client.0.smithi162.stdout:4/747: chown dd/f3a 92604 1 2024-04-25T02:02:09.899 INFO:tasks.workunit.client.0.smithi162.stdout:3/735: fsync d2/f65 0 2024-04-25T02:02:10.305 INFO:tasks.workunit.client.0.smithi162.stdout:5/736: mknod d15/d19/d24/d4d/d7c/d85/de7/d7a/d7e/cf2 0 2024-04-25T02:02:10.310 INFO:tasks.workunit.client.0.smithi162.stdout:1/762: fsync d15/f1c 0 2024-04-25T02:02:10.394 INFO:tasks.workunit.client.0.smithi162.stdout:8/716: mknod d0/d1a/cf3 0 2024-04-25T02:02:10.449 INFO:tasks.workunit.client.0.smithi162.stdout:2/688: creat d0/d3/d7a/d88/ffb x:0 0 0 2024-04-25T02:02:10.455 INFO:tasks.workunit.client.0.smithi162.stdout:9/683: write d4/d8/d13/d38/fba [793798,65439] 0 2024-04-25T02:02:10.569 INFO:tasks.workunit.client.0.smithi162.stdout:8/717: chown d0/d12/d2b/cd8 0 1 2024-04-25T02:02:10.686 INFO:tasks.workunit.client.0.smithi162.stdout:6/695: write d1/d13/d28/d30/d8a/f8c [6255342,130408] 0 2024-04-25T02:02:10.846 INFO:tasks.workunit.client.0.smithi162.stdout:3/736: rmdir d2/d9/d19/d3f 39 2024-04-25T02:02:11.366 INFO:tasks.workunit.client.0.smithi162.stdout:1/763: mknod d15/d1f/d35/d4c/d70/d9f/dea/cf7 0 2024-04-25T02:02:11.639 INFO:tasks.workunit.client.0.smithi162.stdout:7/750: mkdir df/d2e/dfe 0 2024-04-25T02:02:11.689 INFO:tasks.workunit.client.0.smithi162.stdout:9/684: rmdir d4/d9/d15/d1b/d2f/d30/dc1/d9f/dd1 39 2024-04-25T02:02:11.932 INFO:tasks.workunit.client.0.smithi162.stdout:0/813: link d0/d59/f80 d0/d1/d64/f113 0 2024-04-25T02:02:12.253 INFO:tasks.workunit.client.0.smithi162.stdout:8/718: mknod d0/d44/d31/cf4 0 2024-04-25T02:02:12.635 INFO:tasks.workunit.client.0.smithi162.stdout:7/751: dread df/d2c/d49/d5d/f60 [0,4194304] 0 2024-04-25T02:02:12.712 INFO:tasks.workunit.client.0.smithi162.stdout:9/685: creat d4/d9/d15/d1b/d69/ff0 x:0 0 0 2024-04-25T02:02:13.407 INFO:tasks.workunit.client.0.smithi162.stdout:0/814: creat d0/d1/dab/f114 x:0 0 0 2024-04-25T02:02:13.542 INFO:tasks.workunit.client.0.smithi162.stdout:1/764: symlink d15/lf8 0 2024-04-25T02:02:13.625 INFO:tasks.workunit.client.0.smithi162.stdout:8/719: read d0/d12/f17 [3857534,39812] 0 2024-04-25T02:02:13.827 INFO:tasks.workunit.client.0.smithi162.stdout:8/720: sync 2024-04-25T02:02:14.237 INFO:tasks.workunit.client.0.smithi162.stdout:4/748: getdents dd/df/d2e/d59/dd9 0 2024-04-25T02:02:14.521 INFO:tasks.workunit.client.0.smithi162.stdout:3/737: rmdir d2/d9/d10/d2c/da3/dba/d9f 0 2024-04-25T02:02:14.744 INFO:tasks.workunit.client.0.smithi162.stdout:2/689: write d0/d3/d7a/f98 [489009,104788] 0 2024-04-25T02:02:15.096 INFO:tasks.workunit.client.0.smithi162.stdout:8/721: creat d0/db1/ff5 x:0 0 0 2024-04-25T02:02:15.377 INFO:tasks.workunit.client.0.smithi162.stdout:0/815: dread d0/df/d20/d25/f4c [0,4194304] 0 2024-04-25T02:02:15.406 INFO:tasks.workunit.client.0.smithi162.stdout:5/737: dwrite d15/d19/d24/d4d/d7c/d85/de7/f92 [0,4194304] 0 2024-04-25T02:02:15.690 INFO:tasks.workunit.client.0.smithi162.stdout:4/749: dread dd/df/d2e/fb5 [4194304,4194304] 0 2024-04-25T02:02:15.713 INFO:tasks.workunit.client.0.smithi162.stdout:6/696: dwrite d1/d13/d28/d30/d3a/f6c [4194304,4194304] 0 2024-04-25T02:02:15.893 INFO:tasks.workunit.client.0.smithi162.stdout:5/738: stat d15/d19/d24/d40/c83 0 2024-04-25T02:02:15.941 INFO:tasks.workunit.client.0.smithi162.stdout:5/739: chown d15/d19/d24/d2b/l32 1004194 1 2024-04-25T02:02:15.966 INFO:tasks.workunit.client.0.smithi162.stdout:5/740: chown d15/d19/d24/d2b/d3b/d3c 3562660 1 2024-04-25T02:02:16.010 INFO:tasks.workunit.client.0.smithi162.stdout:2/690: chown d0/d3/d7a/d88/lb6 1 1 2024-04-25T02:02:16.041 INFO:tasks.workunit.client.0.smithi162.stdout:9/686: mknod d4/d9/d15/d1b/d2f/d30/dc1/d9f/dd1/cf1 0 2024-04-25T02:02:16.395 INFO:tasks.workunit.client.0.smithi162.stdout:8/722: fsync d0/d12/f24 0 2024-04-25T02:02:16.815 INFO:tasks.workunit.client.0.smithi162.stdout:3/738: mkdir d2/d9/d10/d4c/d51/d63/d87/de0/dfd 0 2024-04-25T02:02:16.911 INFO:tasks.workunit.client.0.smithi162.stdout:6/697: dread - d1/d46/d7a/fda zero size 2024-04-25T02:02:17.184 INFO:tasks.workunit.client.0.smithi162.stdout:5/741: mkdir d15/d19/d24/d4d/d7c/d85/dde/df3 0 2024-04-25T02:02:17.239 INFO:tasks.workunit.client.0.smithi162.stdout:7/752: write f5 [1588058,58276] 0 2024-04-25T02:02:17.628 INFO:tasks.workunit.client.0.smithi162.stdout:8/723: rmdir d0/d12/d2b 39 2024-04-25T02:02:17.873 INFO:tasks.workunit.client.0.smithi162.stdout:6/698: creat d1/d73/fdd x:0 0 0 2024-04-25T02:02:17.952 INFO:tasks.workunit.client.0.smithi162.stdout:3/739: dread d2/f8e [0,4194304] 0 2024-04-25T02:02:17.988 INFO:tasks.workunit.client.0.smithi162.stdout:4/750: creat dd/df/d7e/de9/ff9 x:0 0 0 2024-04-25T02:02:18.190 INFO:tasks.workunit.client.0.smithi162.stdout:7/753: symlink df/d2e/d4c/de8/lff 0 2024-04-25T02:02:18.358 INFO:tasks.workunit.client.0.smithi162.stdout:2/691: creat d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/ffc x:0 0 0 2024-04-25T02:02:19.062 INFO:tasks.workunit.client.0.smithi162.stdout:3/740: readlink d2/d9/d19/d3f/lf2 0 2024-04-25T02:02:19.278 INFO:tasks.workunit.client.0.smithi162.stdout:7/754: truncate df/d2c/f3f 646802 0 2024-04-25T02:02:19.382 INFO:tasks.workunit.client.0.smithi162.stdout:8/724: symlink d0/d44/d31/lf6 0 2024-04-25T02:02:19.662 INFO:tasks.workunit.client.0.smithi162.stdout:3/741: fdatasync d2/d9/d10/d4c/d51/d63/d87/db6/f8f 0 2024-04-25T02:02:19.920 INFO:tasks.workunit.client.0.smithi162.stdout:7/755: dread - df/d2e/d4c/d58/dd3/dd8/ff8 zero size 2024-04-25T02:02:20.111 INFO:tasks.workunit.client.0.smithi162.stdout:0/816: write d0/df/f66 [590903,116664] 0 2024-04-25T02:02:20.182 INFO:tasks.workunit.client.0.smithi162.stdout:3/742: unlink d2/d9/d10/d4c/d8d/fb2 0 2024-04-25T02:02:20.423 INFO:tasks.workunit.client.0.smithi162.stdout:7/756: symlink df/d2c/d49/d5d/l100 0 2024-04-25T02:02:20.785 INFO:tasks.workunit.client.0.smithi162.stdout:1/765: creat d15/d1f/d35/ff9 x:0 0 0 2024-04-25T02:02:20.897 INFO:tasks.workunit.client.0.smithi162.stdout:4/751: getdents dd/df/d77 0 2024-04-25T02:02:21.219 INFO:tasks.workunit.client.0.smithi162.stdout:3/743: dread d2/d9/d10/d4c/d51/d63/d87/d86/fa2 [0,4194304] 0 2024-04-25T02:02:21.465 INFO:tasks.workunit.client.0.smithi162.stdout:9/687: write d4/d9/fc9 [753665,91487] 0 2024-04-25T02:02:21.984 INFO:tasks.workunit.client.0.smithi162.stdout:3/744: read - d2/d9/d99/dd2/ff4 zero size 2024-04-25T02:02:22.030 INFO:tasks.workunit.client.0.smithi162.stdout:0/817: link d0/d1/d6a/da9/ce9 d0/df/d20/d25/d55/d77/c115 0 2024-04-25T02:02:22.155 INFO:tasks.workunit.client.0.smithi162.stdout:5/742: write d15/d19/d24/f77 [4866228,52381] 0 2024-04-25T02:02:22.226 INFO:tasks.workunit.client.0.smithi162.stdout:9/688: mknod d4/d25/de5/cf2 0 2024-04-25T02:02:22.467 INFO:tasks.workunit.client.0.smithi162.stdout:8/725: link d0/d12/d2b/dc7/fe2 d0/d12/d1b/d74/d8a/da3/ff7 0 2024-04-25T02:02:22.510 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:02:22.514 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:02:22.546 INFO:tasks.workunit.client.0.smithi162.stdout:0/818: dread d0/df/d20/d37/f57 [0,4194304] 0 2024-04-25T02:02:22.568 INFO:tasks.workunit.client.0.smithi162.stdout:3/745: truncate d2/d9/d10/d4c/f53 5192325 0 2024-04-25T02:02:22.654 INFO:tasks.workunit.client.0.smithi162.stdout:5/743: fdatasync d15/f3a 0 2024-04-25T02:02:22.933 INFO:tasks.workunit.client.0.smithi162.stdout:8/726: creat d0/d86/dd0/ff8 x:0 0 0 2024-04-25T02:02:22.994 INFO:tasks.workunit.client.0.smithi162.stdout:3/746: chown d2/d9/f5f 11565 1 2024-04-25T02:02:23.048 INFO:tasks.workunit.client.0.smithi162.stdout:3/747: stat d2/d9/d99/dd2 0 2024-04-25T02:02:23.103 INFO:tasks.workunit.client.0.smithi162.stdout:0/819: symlink d0/df/d20/d37/l116 0 2024-04-25T02:02:23.128 INFO:tasks.workunit.client.0.smithi162.stdout:0/820: chown d0/d1/d64/d105 117000 1 2024-04-25T02:02:23.653 INFO:tasks.workunit.client.0.smithi162.stdout:5/744: dread d15/d19/d24/d40/fc5 [0,4194304] 0 2024-04-25T02:02:23.869 INFO:tasks.workunit.client.0.smithi162.stdout:3/748: creat d2/da5/ffe x:0 0 0 2024-04-25T02:02:23.886 INFO:tasks.workunit.client.0.smithi162.stdout:6/699: dwrite d1/d13/d28/d45/d59/f6b [0,4194304] 0 2024-04-25T02:02:24.028 INFO:tasks.workunit.client.0.smithi162.stdout:0/821: mkdir d0/df/d117 0 2024-04-25T02:02:24.051 INFO:tasks.workunit.client.0.smithi162.stdout:2/692: write d0/d3/d1b/d6b/dc0/d5e/d61/fb5 [1797315,92544] 0 2024-04-25T02:02:24.137 INFO:tasks.workunit.client.0.smithi162.stdout:5/745: dread - d15/d19/d24/fc1 zero size 2024-04-25T02:02:24.193 INFO:tasks.workunit.client.0.smithi162.stdout:2/693: dread - d0/d3/d5/fbf zero size 2024-04-25T02:02:24.228 INFO:tasks.workunit.client.0.smithi162.stdout:2/694: chown d0/d3/d5/l32 877828 1 2024-04-25T02:02:24.340 INFO:tasks.workunit.client.0.smithi162.stdout:7/757: write df/d2c/d49/f94 [4001528,30597] 0 2024-04-25T02:02:24.783 INFO:tasks.workunit.client.0.smithi162.stdout:4/752: write dd/d1a/f20 [2498478,37616] 0 2024-04-25T02:02:24.788 INFO:tasks.workunit.client.0.smithi162.stdout:1/766: write d15/d1f/f27 [5091859,44963] 0 2024-04-25T02:02:24.921 INFO:tasks.workunit.client.0.smithi162.stdout:0/822: mkdir d0/df/d20/d37/d118 0 2024-04-25T02:02:25.075 INFO:tasks.workunit.client.0.smithi162.stdout:6/700: rename d1/f51 to d1/d13/d28/d30/d8a/dc3/fde 0 2024-04-25T02:02:25.156 INFO:tasks.workunit.client.0.smithi162.stdout:5/746: dread - d15/d19/d24/d4d/d7c/d85/dde/fe9 zero size 2024-04-25T02:02:25.307 INFO:tasks.workunit.client.0.smithi162.stdout:2/695: dread - d0/d3/d1b/fd3 zero size 2024-04-25T02:02:25.462 INFO:tasks.workunit.client.0.smithi162.stdout:9/689: dwrite d4/d9/f47 [0,4194304] 0 2024-04-25T02:02:25.566 INFO:tasks.workunit.client.0.smithi162.stdout:2/696: chown d0/d3/d1b/d6b/fa5 1454 1 2024-04-25T02:02:25.972 INFO:tasks.workunit.client.0.smithi162.stdout:1/767: mknod d15/d1f/d35/d4c/d70/d9f/dea/cfa 0 2024-04-25T02:02:25.991 INFO:tasks.workunit.client.0.smithi162.stdout:8/727: write d0/d12/d1b/d74/d8a/fa7 [4965621,37752] 0 2024-04-25T02:02:26.563 INFO:tasks.workunit.client.0.smithi162.stdout:9/690: read d4/d8/d13/dbf/fcf [48087,14691] 0 2024-04-25T02:02:26.751 INFO:tasks.workunit.client.0.smithi162.stdout:8/728: fsync d0/fef 0 2024-04-25T02:02:26.908 INFO:tasks.workunit.client.0.smithi162.stdout:1/768: dread - d15/d1f/d35/d4c/d70/fec zero size 2024-04-25T02:02:27.323 INFO:tasks.workunit.client.0.smithi162.stdout:3/749: write d2/d9/d10/d4c/f57 [1022978,67052] 0 2024-04-25T02:02:28.087 INFO:tasks.workunit.client.0.smithi162.stdout:4/753: dwrite dd/d1a/d34/d57/fc2 [0,4194304] 0 2024-04-25T02:02:28.209 INFO:tasks.workunit.client.0.smithi162.stdout:8/729: mknod d0/d86/dd0/cf9 0 2024-04-25T02:02:28.266 INFO:tasks.workunit.client.0.smithi162.stdout:8/730: stat d0/d12/f24 0 2024-04-25T02:02:28.409 INFO:tasks.workunit.client.0.smithi162.stdout:5/747: symlink d15/d19/d24/lf4 0 2024-04-25T02:02:28.612 INFO:tasks.workunit.client.0.smithi162.stdout:3/750: dread d2/d9/f49 [0,4194304] 0 2024-04-25T02:02:28.644 INFO:tasks.workunit.client.0.smithi162.stdout:3/751: chown d2/d29/d2e/f7a 1129561 1 2024-04-25T02:02:29.088 INFO:tasks.workunit.client.0.smithi162.stdout:6/701: write d1/f68 [6141971,117126] 0 2024-04-25T02:02:29.183 INFO:tasks.workunit.client.0.smithi162.stdout:8/731: stat d0/d12/d2b/d87/fa0 0 2024-04-25T02:02:29.309 INFO:tasks.workunit.client.0.smithi162.stdout:3/752: fsync d2/d9/d10/d4c/d51/f7e 0 2024-04-25T02:02:29.396 INFO:tasks.workunit.client.0.smithi162.stdout:0/823: dwrite d0/d59/d7e/fd6 [0,4194304] 0 2024-04-25T02:02:29.857 INFO:tasks.workunit.client.0.smithi162.stdout:2/697: dwrite d0/d3/d1b/fd3 [0,4194304] 0 2024-04-25T02:02:30.125 INFO:tasks.workunit.client.0.smithi162.stdout:8/732: creat d0/d12/d2b/ffa x:0 0 0 2024-04-25T02:02:30.517 INFO:tasks.workunit.client.0.smithi162.stdout:0/824: mknod d0/d1/d4b/c119 0 2024-04-25T02:02:30.614 INFO:tasks.workunit.client.0.smithi162.stdout:9/691: write d4/d8/f10 [4223314,31253] 0 2024-04-25T02:02:30.619 INFO:tasks.workunit.client.0.smithi162.stdout:5/748: link f11 d15/d19/d24/d4d/d7c/d85/dde/de5/ff5 0 2024-04-25T02:02:31.189 INFO:tasks.workunit.client.0.smithi162.stdout:1/769: write d15/d1f/d35/f44 [400602,39183] 0 2024-04-25T02:02:31.358 INFO:tasks.workunit.client.0.smithi162.stdout:3/753: getdents d2/d9/d10/de9 0 2024-04-25T02:02:31.594 INFO:tasks.workunit.client.0.smithi162.stdout:9/692: creat d4/d9/da9/ff3 x:0 0 0 2024-04-25T02:02:31.684 INFO:tasks.workunit.client.0.smithi162.stdout:5/749: rename d15/d19/d24/f25 to d15/d19/d24/d4d/d9d/ff6 0 2024-04-25T02:02:31.957 INFO:tasks.workunit.client.0.smithi162.stdout:8/733: mknod d0/d12/d1b/d74/d8a/d8f/cfb 0 2024-04-25T02:02:32.258 INFO:tasks.workunit.client.0.smithi162.stdout:4/754: write dd/d1a/d4e/f56 [48244,95311] 0 2024-04-25T02:02:32.347 INFO:tasks.workunit.client.0.smithi162.stdout:0/825: getdents d0/df/d20/d37/d118 0 2024-04-25T02:02:32.689 INFO:tasks.workunit.client.0.smithi162.stdout:3/754: dread d2/f25 [0,4194304] 0 2024-04-25T02:02:32.710 INFO:tasks.workunit.client.0.smithi162.stdout:9/693: rename d4/dc0/fb9 to d4/d9/d15/d8a/ff4 0 2024-04-25T02:02:32.738 INFO:tasks.workunit.client.0.smithi162.stdout:8/734: mkdir d0/d12/d2b/d87/de5/dfc 0 2024-04-25T02:02:32.739 INFO:tasks.workunit.client.0.smithi162.stdout:7/758: creat df/f101 x:0 0 0 2024-04-25T02:02:33.055 INFO:tasks.workunit.client.0.smithi162.stdout:5/750: fdatasync d15/fa3 0 2024-04-25T02:02:33.627 INFO:tasks.workunit.client.0.smithi162.stdout:3/755: creat d2/d9/d10/d4c/d51/d63/fff x:0 0 0 2024-04-25T02:02:33.754 INFO:tasks.workunit.client.0.smithi162.stdout:4/755: truncate dd/df/d2e/d59/f91 4792180 0 2024-04-25T02:02:33.758 INFO:tasks.workunit.client.0.smithi162.stdout:6/702: write d1/d13/d28/d30/d8a/f8c [1151008,122800] 0 2024-04-25T02:02:33.825 INFO:tasks.workunit.client.0.smithi162.stdout:4/756: readlink dd/d1a/d34/d72/lb4 0 2024-04-25T02:02:33.939 INFO:tasks.workunit.client.0.smithi162.stdout:5/751: rename d15/d19/d24/dca/fd9 to d15/d19/d24/d4d/d7c/d85/dde/de5/ff7 0 2024-04-25T02:02:34.742 INFO:tasks.workunit.client.0.smithi162.stdout:6/703: mknod d1/d13/d28/d30/d8a/cdf 0 2024-04-25T02:02:34.766 INFO:tasks.workunit.client.0.smithi162.stdout:2/698: dwrite d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/ffc [0,4194304] 0 2024-04-25T02:02:35.251 INFO:tasks.workunit.client.0.smithi162.stdout:0/826: rmdir d0/d59/d7e/dfe 0 2024-04-25T02:02:36.022 INFO:tasks.workunit.client.0.smithi162.stdout:6/704: creat d1/d13/d28/d30/d8a/fe0 x:0 0 0 2024-04-25T02:02:36.043 INFO:tasks.workunit.client.0.smithi162.stdout:1/770: write d15/d1f/d23/f64 [4175353,59241] 0 2024-04-25T02:02:36.278 INFO:tasks.workunit.client.0.smithi162.stdout:0/827: symlink d0/df/l11a 0 2024-04-25T02:02:36.319 INFO:tasks.workunit.client.0.smithi162.stdout:0/828: chown d0/d1/d4e/d76/db0/fba 2 1 2024-04-25T02:02:36.616 INFO:tasks.workunit.client.0.smithi162.stdout:9/694: link d4/d9/d15/fd8 d4/d9/d15/d1b/d2f/d30/dc1/d9f/dd1/dee/ff5 0 2024-04-25T02:02:36.924 INFO:tasks.workunit.client.0.smithi162.stdout:6/705: unlink d1/d13/d28/d30/d66/c70 0 2024-04-25T02:02:37.084 INFO:tasks.workunit.client.0.smithi162.stdout:0/829: dread - d0/df/d20/d25/d55/fdb zero size 2024-04-25T02:02:37.133 INFO:tasks.workunit.client.0.smithi162.stdout:0/830: chown d0/df/d20/d25/d55/d6f/cc9 25842 1 2024-04-25T02:02:37.545 INFO:tasks.workunit.client.0.smithi162.stdout:6/706: mkdir d1/d13/d28/d53/d71/dc5/de1 0 2024-04-25T02:02:37.678 INFO:tasks.workunit.client.0.smithi162.stdout:0/831: truncate d0/df/d20/f45 3678660 0 2024-04-25T02:02:38.255 INFO:tasks.workunit.client.0.smithi162.stdout:0/832: mknod d0/d1/d4e/d76/c11b 0 2024-04-25T02:02:38.336 INFO:tasks.workunit.client.0.smithi162.stdout:7/759: write df/f32 [225591,18433] 0 2024-04-25T02:02:38.480 INFO:tasks.workunit.client.0.smithi162.stdout:9/695: getdents d4/d8/d13/dbf 0 2024-04-25T02:02:38.777 INFO:tasks.workunit.client.0.smithi162.stdout:3/756: dwrite d2/d9/d10/d4c/d51/d63/d87/d86/f9b [0,4194304] 0 2024-04-25T02:02:38.896 INFO:tasks.workunit.client.0.smithi162.stdout:7/760: rename df/d2e/d4c/d8a/db2/ff1 to df/d2e/d4c/de8/f102 0 2024-04-25T02:02:38.923 INFO:tasks.workunit.client.0.smithi162.stdout:4/757: write dd/d1a/f48 [1838404,65409] 0 2024-04-25T02:02:39.369 INFO:tasks.workunit.client.0.smithi162.stdout:4/758: mknod dd/df/d2e/d4b/cfa 0 2024-04-25T02:02:39.458 INFO:tasks.workunit.client.0.smithi162.stdout:5/752: dwrite d15/d19/d24/d4d/d7c/d85/de7/f82 [0,4194304] 0 2024-04-25T02:02:39.659 INFO:tasks.workunit.client.0.smithi162.stdout:9/696: fdatasync d4/d9/d15/d1b/d2f/d30/dc1/d9f/fb4 0 2024-04-25T02:02:39.766 INFO:tasks.workunit.client.0.smithi162.stdout:4/759: chown dd/fc4 4 1 2024-04-25T02:02:39.820 INFO:tasks.workunit.client.0.smithi162.stdout:3/757: dread d2/d9/d19/f36 [0,4194304] 0 2024-04-25T02:02:40.001 INFO:tasks.workunit.client.0.smithi162.stdout:8/735: unlink d0/f75 0 2024-04-25T02:02:40.131 INFO:tasks.workunit.client.0.smithi162.stdout:4/760: sync 2024-04-25T02:02:40.495 INFO:tasks.workunit.client.0.smithi162.stdout:1/771: dwrite d15/d1f/d35/d4c/d70/fc0 [0,4194304] 0 2024-04-25T02:02:40.626 INFO:tasks.workunit.client.0.smithi162.stdout:2/699: dwrite d0/d3/d1b/d6b/dc0/d67/fd5 [0,4194304] 0 2024-04-25T02:02:40.628 INFO:tasks.workunit.client.0.smithi162.stdout:7/761: rename df/d2c/c39 to df/d2e/d4c/d58/d93/c103 0 2024-04-25T02:02:40.631 INFO:tasks.workunit.client.0.smithi162.stdout:6/707: write d1/d13/d28/d30/d3a/f3d [120529,119526] 0 2024-04-25T02:02:40.836 INFO:tasks.workunit.client.0.smithi162.stdout:5/753: rmdir d15/d19/d24/d2b/d3b/d3c/d3f 39 2024-04-25T02:02:41.255 INFO:tasks.workunit.client.0.smithi162.stdout:0/833: dwrite d0/df/d20/d37/d58/fee [0,4194304] 0 2024-04-25T02:02:41.712 INFO:tasks.workunit.client.0.smithi162.stdout:8/736: truncate d0/d12/d1b/f43 4570543 0 2024-04-25T02:02:42.116 INFO:tasks.workunit.client.0.smithi162.stdout:7/762: mknod df/d2e/d4c/c104 0 2024-04-25T02:02:42.335 INFO:tasks.workunit.client.0.smithi162.stdout:6/708: mknod d1/d13/d28/d53/ce2 0 2024-04-25T02:02:42.361 INFO:tasks.workunit.client.0.smithi162.stdout:6/709: chown d1/d46/d7a/d85 974733 1 2024-04-25T02:02:42.538 INFO:tasks.workunit.client.0.smithi162.stdout:2/700: mknod d0/d3/d1b/d6b/dc0/d42/cfd 0 2024-04-25T02:02:42.648 INFO:tasks.workunit.client.0.smithi162.stdout:5/754: mkdir d15/d19/d24/d4d/d9d/df8 0 2024-04-25T02:02:42.904 INFO:tasks.workunit.client.0.smithi162.stdout:0/834: rename d0/d1/d4e/d76/db0/fbd to d0/d1/d6a/da9/f11c 0 2024-04-25T02:02:43.478 INFO:tasks.workunit.client.0.smithi162.stdout:8/737: dread - d0/d12/d2b/d87/dbe/fcb zero size 2024-04-25T02:02:44.009 INFO:tasks.workunit.client.0.smithi162.stdout:7/763: dread df/f13 [0,4194304] 0 2024-04-25T02:02:44.041 INFO:tasks.workunit.client.0.smithi162.stdout:5/755: truncate d15/d19/d24/d40/f5f 1543840 0 2024-04-25T02:02:44.224 INFO:tasks.workunit.client.0.smithi162.stdout:6/710: rename d1/d13/d28/d30/f74 to d1/d13/d28/d53/d71/dc5/fe3 0 2024-04-25T02:02:44.251 INFO:tasks.workunit.client.0.smithi162.stdout:9/697: dwrite d4/fdb [0,4194304] 0 2024-04-25T02:02:44.451 INFO:tasks.workunit.client.0.smithi162.stdout:0/835: truncate d0/df/d20/d37/d81/fa8 981572 0 2024-04-25T02:02:44.642 INFO:tasks.workunit.client.0.smithi162.stdout:8/738: creat d0/d86/dd0/ffd x:0 0 0 2024-04-25T02:02:44.736 INFO:tasks.workunit.client.0.smithi162.stdout:2/701: dread d0/d3/d1b/d6b/dc0/d5e/d61/d66/f24 [0,4194304] 0 2024-04-25T02:02:44.862 INFO:tasks.workunit.client.0.smithi162.stdout:1/772: creat d15/d1f/d23/d30/ffb x:0 0 0 2024-04-25T02:02:45.067 INFO:tasks.workunit.client.0.smithi162.stdout:4/761: write dd/df/d2e/f95 [1095958,69343] 0 2024-04-25T02:02:45.398 INFO:tasks.workunit.client.0.smithi162.stdout:5/756: dread d15/d19/d24/d2b/d3b/d80/fc9 [0,4194304] 0 2024-04-25T02:02:45.715 INFO:tasks.workunit.client.0.smithi162.stdout:6/711: symlink d1/d13/d28/d53/d71/le4 0 2024-04-25T02:02:45.739 INFO:tasks.workunit.client.0.smithi162.stdout:9/698: fdatasync d4/d8/d13/dbf/fcf 0 2024-04-25T02:02:45.831 INFO:tasks.workunit.client.0.smithi162.stdout:6/712: chown d1/f10 46568077 1 2024-04-25T02:02:45.865 INFO:tasks.workunit.client.0.smithi162.stdout:9/699: read - d4/d9/d15/d8a/fcc zero size 2024-04-25T02:02:45.913 INFO:tasks.workunit.client.0.smithi162.stdout:3/758: write d2/d9/d10/d4c/d51/d63/d87/d90/fbb [527245,82008] 0 2024-04-25T02:02:46.448 INFO:tasks.workunit.client.0.smithi162.stdout:8/739: dread d0/d44/d31/d65/f7b [0,4194304] 0 2024-04-25T02:02:46.500 INFO:tasks.workunit.client.0.smithi162.stdout:1/773: rmdir d15/d1f/d23/d30/d4a 39 2024-04-25T02:02:46.862 INFO:tasks.workunit.client.0.smithi162.stdout:1/774: dread d15/d1f/d23/f51 [0,4194304] 0 2024-04-25T02:02:47.377 INFO:tasks.workunit.client.0.smithi162.stdout:3/759: creat d2/d9/d10/d4c/d51/d63/f100 x:0 0 0 2024-04-25T02:02:47.456 INFO:tasks.workunit.client.0.smithi162.stdout:8/740: fsync d0/d1a/f3d 0 2024-04-25T02:02:47.527 INFO:tasks.workunit.client.0.smithi162.stdout:5/757: symlink d15/lf9 0 2024-04-25T02:02:47.663 INFO:tasks.workunit.client.0.smithi162.stdout:3/760: sync 2024-04-25T02:02:47.732 INFO:tasks.workunit.client.0.smithi162.stdout:3/761: write d2/d9/d10/d4c/d51/d63/f100 [616743,52945] 0 2024-04-25T02:02:48.191 INFO:tasks.workunit.client.0.smithi162.stdout:2/702: creat d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/ffe x:0 0 0 2024-04-25T02:02:48.527 INFO:tasks.workunit.client.0.smithi162.stdout:5/758: unlink d15/d1e/f6b 0 2024-04-25T02:02:48.567 INFO:tasks.workunit.client.0.smithi162.stdout:5/759: read - d15/d19/d24/d2b/d3b/f91 zero size 2024-04-25T02:02:48.735 INFO:tasks.workunit.client.0.smithi162.stdout:1/775: mknod d15/d1f/d35/d4c/dcd/cfc 0 2024-04-25T02:02:49.076 INFO:tasks.workunit.client.0.smithi162.stdout:0/836: link d0/df/l79 d0/l11d 0 2024-04-25T02:02:49.288 INFO:tasks.workunit.client.0.smithi162.stdout:2/703: fdatasync d0/d3/d5/d36/f37 0 2024-04-25T02:02:49.413 INFO:tasks.workunit.client.0.smithi162.stdout:2/704: sync 2024-04-25T02:02:49.493 INFO:tasks.workunit.client.0.smithi162.stdout:8/741: mkdir d0/dfe 0 2024-04-25T02:02:49.523 INFO:tasks.workunit.client.0.smithi162.stdout:8/742: stat d0/d12/d1b/d8d/ld2 0 2024-04-25T02:02:49.552 INFO:tasks.workunit.client.0.smithi162.stdout:8/743: stat d0/d12/d2b/ce8 0 2024-04-25T02:02:49.636 INFO:tasks.workunit.client.0.smithi162.stdout:7/764: write df/d2c/d49/d7a/f7d [275455,98335] 0 2024-04-25T02:02:49.888 INFO:tasks.workunit.client.0.smithi162.stdout:0/837: mkdir d0/df/d20/d37/dfc/d11e 0 2024-04-25T02:02:50.241 INFO:tasks.workunit.client.0.smithi162.stdout:5/760: creat d15/d19/d24/d2b/d3b/d80/ddf/ffa x:0 0 0 2024-04-25T02:02:50.562 INFO:tasks.workunit.client.0.smithi162.stdout:5/761: dread d15/d19/f1b [0,4194304] 0 2024-04-25T02:02:50.622 INFO:tasks.workunit.client.0.smithi162.stdout:5/762: chown d15/d19/d24/d4d/d7c/d85/de7/f92 1989 1 2024-04-25T02:02:50.934 INFO:tasks.workunit.client.0.smithi162.stdout:0/838: dread d0/df/d20/f45 [0,4194304] 0 2024-04-25T02:02:51.001 INFO:tasks.workunit.client.0.smithi162.stdout:5/763: unlink d15/d19/d24/fa9 0 2024-04-25T02:02:51.175 INFO:tasks.workunit.client.0.smithi162.stdout:1/776: getdents d15/d1f/d35 0 2024-04-25T02:02:51.554 INFO:tasks.workunit.client.0.smithi162.stdout:0/839: symlink d0/d59/d7e/d9f/l11f 0 2024-04-25T02:02:51.873 INFO:tasks.workunit.client.0.smithi162.stdout:0/840: mknod d0/d1/d4e/d76/db0/c120 0 2024-04-25T02:02:51.936 INFO:tasks.workunit.client.0.smithi162.stdout:0/841: chown d0/d59/d7e/d100/ded 384 1 2024-04-25T02:02:51.946 INFO:tasks.workunit.client.0.smithi162.stdout:0/842: readlink d0/l3 0 2024-04-25T02:02:52.025 INFO:tasks.workunit.client.0.smithi162.stdout:1/777: truncate d15/d1f/d23/d30/d4a/fd0 1223160 0 2024-04-25T02:02:52.624 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:02:52.628 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:02:52.728 INFO:tasks.workunit.client.0.smithi162.stdout:0/843: creat d0/d1/d4e/d76/db0/f121 x:0 0 0 2024-04-25T02:02:52.731 INFO:tasks.workunit.client.0.smithi162.stdout:1/778: creat d15/d1f/d35/d5c/d83/ffd x:0 0 0 2024-04-25T02:02:52.785 INFO:tasks.workunit.client.0.smithi162.stdout:9/700: write d4/d8/d13/f27 [1909601,91338] 0 2024-04-25T02:02:53.717 INFO:tasks.workunit.client.0.smithi162.stdout:0/844: mkdir d0/df/d20/d25/d55/d6f/d7d/d122 0 2024-04-25T02:02:54.185 INFO:tasks.workunit.client.0.smithi162.stdout:2/705: dwrite d0/d3/d1b/d6b/dc0/d67/d9c/fde [0,4194304] 0 2024-04-25T02:02:54.189 INFO:tasks.workunit.client.0.smithi162.stdout:3/762: dwrite d2/d29/d2e/f7a [0,4194304] 0 2024-04-25T02:02:54.420 INFO:tasks.workunit.client.0.smithi162.stdout:8/744: dwrite d0/fef [0,4194304] 0 2024-04-25T02:02:54.610 INFO:tasks.workunit.client.0.smithi162.stdout:1/779: creat d15/d1f/d23/d30/d4a/d7f/d97/dbe/dde/ffe x:0 0 0 2024-04-25T02:02:54.713 INFO:tasks.workunit.client.0.smithi162.stdout:0/845: creat d0/df/d20/d25/d55/d6f/d7d/f123 x:0 0 0 2024-04-25T02:02:54.862 INFO:tasks.workunit.client.0.smithi162.stdout:1/780: chown d15/d1f/d23/d30/l9a 30211 1 2024-04-25T02:02:54.894 INFO:tasks.workunit.client.0.smithi162.stdout:5/764: dwrite d15/d19/d24/d40/fc0 [0,4194304] 0 2024-04-25T02:02:55.003 INFO:tasks.workunit.client.0.smithi162.stdout:2/706: fdatasync d0/d3/f1a 0 2024-04-25T02:02:55.271 INFO:tasks.workunit.client.0.smithi162.stdout:2/707: stat d0/d3/d5/d36/d93/c3c 0 2024-04-25T02:02:55.398 INFO:tasks.workunit.client.0.smithi162.stdout:5/765: dread d15/d19/d24/d2b/d3b/f46 [0,4194304] 0 2024-04-25T02:02:55.421 INFO:tasks.workunit.client.0.smithi162.stdout:0/846: dwrite d0/d1/d4e/d76/db0/f121 [0,4194304] 0 2024-04-25T02:02:55.537 INFO:tasks.workunit.client.0.smithi162.stdout:1/781: symlink d15/d1f/d23/d30/d4a/d7f/d97/lff 0 2024-04-25T02:02:55.623 INFO:tasks.workunit.client.0.smithi162.stdout:1/782: chown d15/l6d 0 1 2024-04-25T02:02:55.729 INFO:tasks.workunit.client.0.smithi162.stdout:1/783: read d15/d1f/d23/d30/d4a/d7f/d97/dbe/fdc [99775,108405] 0 2024-04-25T02:02:55.777 INFO:tasks.workunit.client.0.smithi162.stdout:1/784: read - d15/d1f/d35/d5c/d83/fd8 zero size 2024-04-25T02:02:55.861 INFO:tasks.workunit.client.0.smithi162.stdout:8/745: creat d0/d1a/fff x:0 0 0 2024-04-25T02:02:55.977 INFO:tasks.workunit.client.0.smithi162.stdout:0/847: dread - d0/d1/fa6 zero size 2024-04-25T02:02:56.198 INFO:tasks.workunit.client.0.smithi162.stdout:0/848: sync 2024-04-25T02:02:56.243 INFO:tasks.workunit.client.0.smithi162.stdout:4/762: rename dd/f8a to dd/df/d2e/d4b/ffb 0 2024-04-25T02:02:56.276 INFO:tasks.workunit.client.0.smithi162.stdout:4/763: stat dd/f16 0 2024-04-25T02:02:56.546 INFO:tasks.workunit.client.0.smithi162.stdout:2/708: fdatasync d0/d3/d1b/d6b/dc0/d67/d9c/fef 0 2024-04-25T02:02:56.646 INFO:tasks.workunit.client.0.smithi162.stdout:2/709: sync 2024-04-25T02:02:57.046 INFO:tasks.workunit.client.0.smithi162.stdout:9/701: write d4/d8/d13/d38/fba [1431485,4715] 0 2024-04-25T02:02:57.182 INFO:tasks.workunit.client.0.smithi162.stdout:6/713: rename d1/d13/d28/d53/f72 to d1/d13/d28/d30/d8a/fe5 0 2024-04-25T02:02:57.238 INFO:tasks.workunit.client.0.smithi162.stdout:6/714: dread - d1/d13/d28/d30/d3a/d57/f64 zero size 2024-04-25T02:02:57.459 INFO:tasks.workunit.client.0.smithi162.stdout:5/766: creat d15/d19/d24/d2b/d3b/d3c/ffb x:0 0 0 2024-04-25T02:02:57.857 INFO:tasks.workunit.client.0.smithi162.stdout:6/715: chown d1/d13/d28/d53/l75 0 1 2024-04-25T02:02:58.050 INFO:tasks.workunit.client.0.smithi162.stdout:5/767: rmdir d15/d19/d24/d40/dbf 39 2024-04-25T02:02:58.254 INFO:tasks.workunit.client.0.smithi162.stdout:2/710: symlink d0/d3/d1b/lff 0 2024-04-25T02:02:58.920 INFO:tasks.workunit.client.0.smithi162.stdout:7/765: rename df/d2e/d4c/d58/c81 to df/c105 0 2024-04-25T02:02:59.050 INFO:tasks.workunit.client.0.smithi162.stdout:6/716: creat d1/d13/d28/d7b/dbb/fe6 x:0 0 0 2024-04-25T02:02:59.077 INFO:tasks.workunit.client.0.smithi162.stdout:6/717: chown d1/f88 66839 1 2024-04-25T02:02:59.491 INFO:tasks.workunit.client.0.smithi162.stdout:3/763: rename d2/d9/d10/d4c/d8d to d2/ddf/de7/d101 0 2024-04-25T02:02:59.505 INFO:tasks.workunit.client.0.smithi162.stdout:7/766: truncate df/d2e/d4c/d58/dd3/fad 58712 0 2024-04-25T02:02:59.854 INFO:tasks.workunit.client.0.smithi162.stdout:7/767: mknod df/d2e/d4c/d58/c106 0 2024-04-25T02:02:59.923 INFO:tasks.workunit.client.0.smithi162.stdout:2/711: getdents d0/d3/d1b/d6b/d9e 0 2024-04-25T02:03:00.242 INFO:tasks.workunit.client.0.smithi162.stdout:7/768: creat df/d2c/d49/d5d/f107 x:0 0 0 2024-04-25T02:03:00.284 INFO:tasks.workunit.client.0.smithi162.stdout:7/769: chown df/d2e/d4c/d58/d93/fa7 8179716 1 2024-04-25T02:03:00.403 INFO:tasks.workunit.client.0.smithi162.stdout:2/712: truncate d0/d3/d7a/d88/ffb 938930 0 2024-04-25T02:03:00.559 INFO:tasks.workunit.client.0.smithi162.stdout:0/849: write d0/df/d20/d25/d55/f5a [3461678,8858] 0 2024-04-25T02:03:01.394 INFO:tasks.workunit.client.0.smithi162.stdout:1/785: rename d15/d1f/d35/d4c/d70/d73/db8/dbb/lf3 to d15/d1f/d23/d30/l100 0 2024-04-25T02:03:01.411 INFO:tasks.workunit.client.0.smithi162.stdout:7/770: read - df/d2c/d63/d83/ddc/ff6 zero size 2024-04-25T02:03:01.576 INFO:tasks.workunit.client.0.smithi162.stdout:2/713: readlink d0/d3/d1b/d6b/dc0/l44 0 2024-04-25T02:03:01.689 INFO:tasks.workunit.client.0.smithi162.stdout:7/771: chown df/d2e/d4c/d58/d82 211 1 2024-04-25T02:03:01.817 INFO:tasks.workunit.client.0.smithi162.stdout:9/702: dwrite d4/d9/fb8 [0,4194304] 0 2024-04-25T02:03:01.824 INFO:tasks.workunit.client.0.smithi162.stdout:7/772: chown l0 939282266 1 2024-04-25T02:03:01.971 INFO:tasks.workunit.client.0.smithi162.stdout:0/850: read d0/df/d20/d37/dfc/f108 [612004,85871] 0 2024-04-25T02:03:02.434 INFO:tasks.workunit.client.0.smithi162.stdout:1/786: creat d15/d1f/d35/d4c/d8e/f101 x:0 0 0 2024-04-25T02:03:02.443 INFO:tasks.workunit.client.0.smithi162.stdout:5/768: dwrite d15/d19/d24/d4d/d7c/d85/de7/f92 [4194304,4194304] 0 2024-04-25T02:03:02.622 INFO:tasks.workunit.client.0.smithi162.stdout:2/714: fsync d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/fe1 0 2024-04-25T02:03:02.627 INFO:tasks.workunit.client.0.smithi162.stdout:9/703: rmdir d4/d25/da3 39 2024-04-25T02:03:02.693 INFO:tasks.workunit.client.0.smithi162.stdout:5/769: write d15/d19/d24/d4d/d7c/d85/de7/f92 [2978801,78287] 0 2024-04-25T02:03:03.028 INFO:tasks.workunit.client.0.smithi162.stdout:6/718: write d1/d13/d28/d30/d3a/f5b [258130,86146] 0 2024-04-25T02:03:03.085 INFO:tasks.workunit.client.0.smithi162.stdout:3/764: write d2/d9/d10/d2c/da3/db5/fc7 [571395,55293] 0 2024-04-25T02:03:03.320 INFO:tasks.workunit.client.0.smithi162.stdout:0/851: dread d0/df/d20/d37/d58/fee [0,4194304] 0 2024-04-25T02:03:04.132 INFO:tasks.workunit.client.0.smithi162.stdout:8/746: rename d0/d12/d2b/f7c to d0/d12/d1b/d74/d8a/f100 0 2024-04-25T02:03:04.440 INFO:tasks.workunit.client.0.smithi162.stdout:3/765: fsync d2/d9/d99/f52 0 2024-04-25T02:03:04.483 INFO:tasks.workunit.client.0.smithi162.stdout:3/766: readlink d2/d9/d10/d4c/d51/ld4 0 2024-04-25T02:03:04.963 INFO:tasks.workunit.client.0.smithi162.stdout:0/852: creat d0/df/d20/d25/d55/d6f/d7d/f124 x:0 0 0 2024-04-25T02:03:05.322 INFO:tasks.workunit.client.0.smithi162.stdout:4/764: rename dd/df/f12 to dd/df/d2e/d4b/ffc 0 2024-04-25T02:03:05.422 INFO:tasks.workunit.client.0.smithi162.stdout:8/747: mkdir d0/db1/d101 0 2024-04-25T02:03:05.793 INFO:tasks.workunit.client.0.smithi162.stdout:6/719: mknod d1/d13/d28/d53/d71/dc5/de1/ce7 0 2024-04-25T02:03:05.945 INFO:tasks.workunit.client.0.smithi162.stdout:3/767: truncate d2/d9/d10/d4c/d51/d63/d87/d86/fcc 1938025 0 2024-04-25T02:03:06.199 INFO:tasks.workunit.client.0.smithi162.stdout:2/715: creat d0/d3/d1b/d6b/dc0/d5e/d61/f100 x:0 0 0 2024-04-25T02:03:06.258 INFO:tasks.workunit.client.0.smithi162.stdout:9/704: link d4/d8/d13/d38/fbd d4/d9/d15/d1b/d2f/d30/dc1/ff6 0 2024-04-25T02:03:06.394 INFO:tasks.workunit.client.0.smithi162.stdout:7/773: dwrite df/d2e/d4c/d8a/f61 [0,4194304] 0 2024-04-25T02:03:06.521 INFO:tasks.workunit.client.0.smithi162.stdout:1/787: write d15/d1f/d23/d30/d4a/f65 [575674,26946] 0 2024-04-25T02:03:06.653 INFO:tasks.workunit.client.0.smithi162.stdout:7/774: read df/f15 [3239631,121251] 0 2024-04-25T02:03:06.693 INFO:tasks.workunit.client.0.smithi162.stdout:6/720: rmdir d1/d13/d28/d45 39 2024-04-25T02:03:07.116 INFO:tasks.workunit.client.0.smithi162.stdout:5/770: write d15/d1e/f22 [4904712,15558] 0 2024-04-25T02:03:07.398 INFO:tasks.workunit.client.0.smithi162.stdout:9/705: unlink d4/d9/d15/d8a/fa5 0 2024-04-25T02:03:07.542 INFO:tasks.workunit.client.0.smithi162.stdout:2/716: symlink d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/l101 0 2024-04-25T02:03:07.605 INFO:tasks.workunit.client.0.smithi162.stdout:2/717: chown d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/f91 2106 1 2024-04-25T02:03:07.645 INFO:tasks.workunit.client.0.smithi162.stdout:2/718: chown d0/d3/d1b/d6b/dc0/d42/lae 486692527 1 2024-04-25T02:03:08.231 INFO:tasks.workunit.client.0.smithi162.stdout:1/788: truncate d15/d1f/d23/f56 2503516 0 2024-04-25T02:03:08.456 INFO:tasks.workunit.client.0.smithi162.stdout:5/771: rmdir d15/d19/d24/d4d/d9d 39 2024-04-25T02:03:08.782 INFO:tasks.workunit.client.0.smithi162.stdout:2/719: symlink d0/d3/d1b/d6b/dc0/d42/l102 0 2024-04-25T02:03:08.995 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:13:58.426 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:03:09.003 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:13:58.434 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:03:09.020 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:13:58.368 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:03:09.033 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:13:58.381 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:03:09.034 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:13:58.382 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:03:09.053 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:13:58.401 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:03:09.188 INFO:tasks.workunit.client.0.smithi162.stdout:6/721: truncate d1/d13/d28/d45/d59/dbe/fcb 339986 0 2024-04-25T02:03:09.216 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:13:58.564 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:03:09.262 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:13:58.610 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:03:09.295 INFO:tasks.workunit.client.0.smithi162.stdout:3/768: creat d2/d9/d19/f102 x:0 0 0 2024-04-25T02:03:09.334 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:13:58.765 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:03:09.652 INFO:tasks.workunit.client.0.smithi162.stdout:1/789: creat d15/d1f/d23/d30/d4a/d7f/d97/f102 x:0 0 0 2024-04-25T02:03:10.409 INFO:tasks.workunit.client.0.smithi162.stdout:5/772: dread d15/d19/d24/d40/f74 [0,4194304] 0 2024-04-25T02:03:10.463 INFO:tasks.workunit.client.0.smithi162.stdout:9/706: symlink d4/d9/d15/lf7 0 2024-04-25T02:03:10.488 INFO:tasks.workunit.client.0.smithi162.stdout:2/720: mknod d0/d3/d1b/d6b/d92/d9a/de4/c103 0 2024-04-25T02:03:10.655 INFO:tasks.workunit.client.0.smithi162.stdout:8/748: link d0/d44/f7d d0/db1/d101/f102 0 2024-04-25T02:03:10.673 INFO:tasks.workunit.client.0.smithi162.stdout:6/722: symlink d1/le8 0 2024-04-25T02:03:10.728 INFO:tasks.workunit.client.0.smithi162.stdout:5/773: sync 2024-04-25T02:03:10.839 INFO:tasks.workunit.client.0.smithi162.stdout:3/769: chown d2/d9/d10/d4c/d51/ddd/de1/ce2 365 1 2024-04-25T02:03:10.992 INFO:tasks.workunit.client.0.smithi162.stdout:4/765: dwrite dd/df/d58/f5a [0,4194304] 0 2024-04-25T02:03:11.115 INFO:tasks.workunit.client.0.smithi162.stdout:0/853: write d0/d59/f80 [751666,51083] 0 2024-04-25T02:03:11.135 INFO:tasks.workunit.client.0.smithi162.stdout:2/721: creat d0/d3/d1b/d1d/d3a/d63/dba/f104 x:0 0 0 2024-04-25T02:03:11.449 INFO:tasks.workunit.client.0.smithi162.stdout:6/723: creat d1/d13/d28/d53/d71/dc5/fe9 x:0 0 0 2024-04-25T02:03:11.484 INFO:tasks.workunit.client.0.smithi162.stdout:6/724: chown d1/d46/d7a/f90 1 1 2024-04-25T02:03:11.503 INFO:tasks.workunit.client.0.smithi162.stdout:6/725: dread - d1/fa8 zero size 2024-04-25T02:03:11.724 INFO:tasks.workunit.client.0.smithi162.stdout:9/707: symlink d4/d8/d85/dd6/lf8 0 2024-04-25T02:03:11.733 INFO:tasks.workunit.client.0.smithi162.stdout:3/770: unlink d2/d9/d10/d2c/l35 0 2024-04-25T02:03:11.848 INFO:tasks.workunit.client.0.smithi162.stdout:1/790: creat d15/d1f/d35/d4c/f103 x:0 0 0 2024-04-25T02:03:12.162 INFO:tasks.workunit.client.0.smithi162.stdout:1/791: dread d15/d1f/d23/f25 [0,4194304] 0 2024-04-25T02:03:12.288 INFO:tasks.workunit.client.0.smithi162.stdout:8/749: mkdir d0/d12/d1b/d74/d8a/d103 0 2024-04-25T02:03:12.306 INFO:tasks.workunit.client.0.smithi162.stdout:7/775: write df/f95 [874371,71376] 0 2024-04-25T02:03:12.355 INFO:tasks.workunit.client.0.smithi162.stdout:2/722: truncate d0/d3/d7a/ff4 746551 0 2024-04-25T02:03:12.378 INFO:tasks.workunit.client.0.smithi162.stdout:8/750: stat d0/d12/d2b/fc3 0 2024-04-25T02:03:12.546 INFO:tasks.workunit.client.0.smithi162.stdout:4/766: rename dd/df/d77/d87/db6 to dd/d1a/d34/db1/dba/dfd 0 2024-04-25T02:03:12.782 INFO:tasks.workunit.client.0.smithi162.stdout:8/751: dread d0/d12/f4e [0,4194304] 0 2024-04-25T02:03:12.872 INFO:tasks.workunit.client.0.smithi162.stdout:3/771: stat d2/d9/d10/d2c/da3/dba/cf9 0 2024-04-25T02:03:13.212 INFO:tasks.workunit.client.0.smithi162.stdout:3/772: dread d2/d9/d19/d3f/fa9 [0,4194304] 0 2024-04-25T02:03:13.244 INFO:tasks.workunit.client.0.smithi162.stdout:1/792: rmdir d15/d1f/d23 39 2024-04-25T02:03:13.848 INFO:tasks.workunit.client.0.smithi162.stdout:8/752: symlink d0/d12/d1b/l104 0 2024-04-25T02:03:15.008 INFO:tasks.workunit.client.0.smithi162.stdout:9/708: creat d4/d9/d15/d1b/d2f/d30/dc1/d9f/ff9 x:0 0 0 2024-04-25T02:03:15.214 INFO:tasks.workunit.client.0.smithi162.stdout:3/773: fdatasync d2/d9/d10/d2c/da3/fc8 0 2024-04-25T02:03:15.348 INFO:tasks.workunit.client.0.smithi162.stdout:1/793: fsync d15/f1a 0 2024-04-25T02:03:15.716 INFO:tasks.workunit.client.0.smithi162.stdout:2/723: link d0/d3/f35 d0/d3/d1b/d6b/d92/f105 0 2024-04-25T02:03:15.846 INFO:tasks.workunit.client.0.smithi162.stdout:8/753: mkdir d0/d12/d1b/d74/d105 0 2024-04-25T02:03:16.267 INFO:tasks.workunit.client.0.smithi162.stdout:3/774: fsync d2/d9/d99/f52 0 2024-04-25T02:03:16.703 INFO:tasks.workunit.client.0.smithi162.stdout:7/776: link df/d2e/d4c/d58/d93/c103 df/d2e/d4c/daf/c108 0 2024-04-25T02:03:17.303 INFO:tasks.workunit.client.0.smithi162.stdout:8/754: unlink d0/d12/d1b/d8d/fee 0 2024-04-25T02:03:17.325 INFO:tasks.workunit.client.0.smithi162.stdout:9/709: fsync d4/f39 0 2024-04-25T02:03:17.595 INFO:tasks.workunit.client.0.smithi162.stdout:3/775: truncate d2/d9/d19/d3f/f79 1298238 0 2024-04-25T02:03:18.200 INFO:tasks.workunit.client.0.smithi162.stdout:7/777: rmdir df/d2c/d63/d83 39 2024-04-25T02:03:18.297 INFO:tasks.workunit.client.0.smithi162.stdout:2/724: creat d0/d3/d1b/d6b/dc0/d67/d9c/de8/f106 x:0 0 0 2024-04-25T02:03:18.647 INFO:tasks.workunit.client.0.smithi162.stdout:6/726: dwrite d1/d46/d7a/d85/fa3 [0,4194304] 0 2024-04-25T02:03:18.672 INFO:tasks.workunit.client.0.smithi162.stdout:8/755: creat d0/d44/d64/f106 x:0 0 0 2024-04-25T02:03:18.780 INFO:tasks.workunit.client.0.smithi162.stdout:9/710: mknod d4/d25/de5/cfa 0 2024-04-25T02:03:18.781 INFO:tasks.workunit.client.0.smithi162.stdout:5/774: creat d15/d19/ffc x:0 0 0 2024-04-25T02:03:18.820 INFO:tasks.workunit.client.0.smithi162.stdout:0/854: write d0/d59/f68 [899980,94004] 0 2024-04-25T02:03:18.902 INFO:tasks.workunit.client.0.smithi162.stdout:6/727: sync 2024-04-25T02:03:19.064 INFO:tasks.workunit.client.0.smithi162.stdout:7/778: creat df/d2e/d4c/d58/d93/f109 x:0 0 0 2024-04-25T02:03:19.971 INFO:tasks.workunit.client.0.smithi162.stdout:8/756: mkdir d0/d12/d1b/d74/d8a/da3/d107 0 2024-04-25T02:03:20.354 INFO:tasks.workunit.client.0.smithi162.stdout:4/767: dwrite dd/df/d2e/d4b/ffb [0,4194304] 0 2024-04-25T02:03:20.815 INFO:tasks.workunit.client.0.smithi162.stdout:7/779: mkdir df/d2e/d4c/d8a/db2/df0/d10a 0 2024-04-25T02:03:20.935 INFO:tasks.workunit.client.0.smithi162.stdout:7/780: sync 2024-04-25T02:03:21.538 INFO:tasks.workunit.client.0.smithi162.stdout:0/855: getdents d0/d1 0 2024-04-25T02:03:21.977 INFO:tasks.workunit.client.0.smithi162.stdout:0/856: creat d0/df/d20/d25/dce/f125 x:0 0 0 2024-04-25T02:03:21.994 INFO:tasks.workunit.client.0.smithi162.stdout:7/781: dread df/f2d [0,4194304] 0 2024-04-25T02:03:22.130 INFO:tasks.workunit.client.0.smithi162.stdout:1/794: dwrite d15/f1b [0,4194304] 0 2024-04-25T02:03:22.662 INFO:tasks.workunit.client.0.smithi162.stdout:0/857: creat d0/df/d20/d25/dce/f126 x:0 0 0 2024-04-25T02:03:22.738 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:03:22.742 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:03:22.781 INFO:tasks.workunit.client.0.smithi162.stdout:7/782: truncate df/d2e/d4c/d58/dd3/dd8/ff8 187005 0 2024-04-25T02:03:22.809 INFO:tasks.workunit.client.0.smithi162.stdout:7/783: readlink df/d2e/d4c/d8a/db2/lb9 0 2024-04-25T02:03:22.925 INFO:tasks.workunit.client.0.smithi162.stdout:1/795: truncate d15/d1f/d35/d4c/d70/d9f/fb6 1512883 0 2024-04-25T02:03:22.941 INFO:tasks.workunit.client.0.smithi162.stdout:0/858: fsync d0/df/d20/d37/f57 0 2024-04-25T02:03:23.453 INFO:tasks.workunit.client.0.smithi162.stdout:2/725: write d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/ffc [3628565,89384] 0 2024-04-25T02:03:23.458 INFO:tasks.workunit.client.0.smithi162.stdout:1/796: fsync d15/f1d 0 2024-04-25T02:03:23.514 INFO:tasks.workunit.client.0.smithi162.stdout:0/859: truncate d0/d1/d4e/f86 5176639 0 2024-04-25T02:03:23.532 INFO:tasks.workunit.client.0.smithi162.stdout:7/784: creat df/d2c/d63/d83/ddc/f10b x:0 0 0 2024-04-25T02:03:23.861 INFO:tasks.workunit.client.0.smithi162.stdout:5/775: dwrite d15/d19/d24/f77 [4194304,4194304] 0 2024-04-25T02:03:24.016 INFO:tasks.workunit.client.0.smithi162.stdout:3/776: write d2/d9/d10/d4c/f53 [2861888,56504] 0 2024-04-25T02:03:24.529 INFO:tasks.workunit.client.0.smithi162.stdout:3/777: read d2/d29/f3c [191165,109053] 0 2024-04-25T02:03:24.952 INFO:tasks.workunit.client.0.smithi162.stdout:6/728: dwrite d1/f1e [0,4194304] 0 2024-04-25T02:03:24.967 INFO:tasks.workunit.client.0.smithi162.stdout:2/726: fsync d0/d3/d1b/d1d/d3a/d63/fb1 0 2024-04-25T02:03:24.980 INFO:tasks.workunit.client.0.smithi162.stdout:9/711: dwrite d4/d9/d15/d1b/d2f/d30/f9d [0,4194304] 0 2024-04-25T02:03:25.176 INFO:tasks.workunit.client.0.smithi162.stdout:8/757: dwrite d0/d12/feb [0,4194304] 0 2024-04-25T02:03:25.326 INFO:tasks.workunit.client.0.smithi162.stdout:4/768: dwrite dd/df/d2e/d59/f91 [0,4194304] 0 2024-04-25T02:03:25.326 INFO:tasks.workunit.client.0.smithi162.stdout:7/785: creat df/d2e/d4c/d58/f10c x:0 0 0 2024-04-25T02:03:25.559 INFO:tasks.workunit.client.0.smithi162.stdout:5/776: truncate d15/f65 3321233 0 2024-04-25T02:03:25.763 INFO:tasks.workunit.client.0.smithi162.stdout:2/727: chown d0/d3/d1b/d6b/dc0/d5e/d61/d66/f9b 61511 1 2024-04-25T02:03:25.914 INFO:tasks.workunit.client.0.smithi162.stdout:6/729: dread d1/d13/d28/f2f [0,4194304] 0 2024-04-25T02:03:25.966 INFO:tasks.workunit.client.0.smithi162.stdout:2/728: dread - d0/d3/d1b/d6b/dc0/d5e/d61/da4/fa6 zero size 2024-04-25T02:03:26.008 INFO:tasks.workunit.client.0.smithi162.stdout:2/729: dread - d0/d3/d1b/d6b/dc0/d5e/d61/f9d zero size 2024-04-25T02:03:26.328 INFO:tasks.workunit.client.0.smithi162.stdout:2/730: sync 2024-04-25T02:03:26.345 INFO:tasks.workunit.client.0.smithi162.stdout:1/797: dwrite d15/d1f/d35/d5c/fd6 [0,4194304] 0 2024-04-25T02:03:26.493 INFO:tasks.workunit.client.0.smithi162.stdout:2/731: chown d0/d3/d5 163283678 1 2024-04-25T02:03:26.707 INFO:tasks.workunit.client.0.smithi162.stdout:4/769: truncate dd/df/f49 2221358 0 2024-04-25T02:03:26.726 INFO:tasks.workunit.client.0.smithi162.stdout:4/770: readlink dd/df/l75 0 2024-04-25T02:03:27.211 INFO:tasks.workunit.client.0.smithi162.stdout:0/860: rename d0/df/cb4 to d0/d1/c127 0 2024-04-25T02:03:28.068 INFO:tasks.workunit.client.0.smithi162.stdout:2/732: unlink d0/d3/d1b/d6b/dc0/d42/f43 0 2024-04-25T02:03:28.155 INFO:tasks.workunit.client.0.smithi162.stdout:8/758: getdents d0/d12/d1b/d74/d105 0 2024-04-25T02:03:28.174 INFO:tasks.workunit.client.0.smithi162.stdout:8/759: chown d0/lc6 0 1 2024-04-25T02:03:28.213 INFO:tasks.workunit.client.0.smithi162.stdout:7/786: write df/f7b [1728136,17640] 0 2024-04-25T02:03:28.283 INFO:tasks.workunit.client.0.smithi162.stdout:7/787: chown df/d2c/d49/d7a/db5/dc1/cf4 0 1 2024-04-25T02:03:28.344 INFO:tasks.workunit.client.0.smithi162.stdout:4/771: creat dd/d1a/d34/ffe x:0 0 0 2024-04-25T02:03:28.360 INFO:tasks.workunit.client.0.smithi162.stdout:4/772: readlink dd/l1f 0 2024-04-25T02:03:28.484 INFO:tasks.workunit.client.0.smithi162.stdout:3/778: rename d2/d9/d10/d4c/d51/ddd/de1/cf0 to d2/d29/d2e/c103 0 2024-04-25T02:03:28.728 INFO:tasks.workunit.client.0.smithi162.stdout:0/861: unlink d0/d59/d7e/d9f/lde 0 2024-04-25T02:03:29.314 INFO:tasks.workunit.client.0.smithi162.stdout:1/798: rmdir d15/d1f/d23/d30/d4a/d7f/d97/dbe 39 2024-04-25T02:03:29.722 INFO:tasks.workunit.client.0.smithi162.stdout:2/733: rmdir d0/d3/d1b/d6b/dc0 39 2024-04-25T02:03:29.922 INFO:tasks.workunit.client.0.smithi162.stdout:6/730: creat d1/d13/d28/d30/fea x:0 0 0 2024-04-25T02:03:30.038 INFO:tasks.workunit.client.0.smithi162.stdout:9/712: dwrite d4/f52 [0,4194304] 0 2024-04-25T02:03:30.151 INFO:tasks.workunit.client.0.smithi162.stdout:4/773: truncate dd/f16 4737793 0 2024-04-25T02:03:30.160 INFO:tasks.workunit.client.0.smithi162.stdout:5/777: rename d15/d19/d24/d2b/d3b/d3c/d3f/f43 to d15/d19/d24/d2b/ffd 0 2024-04-25T02:03:30.302 INFO:tasks.workunit.client.0.smithi162.stdout:5/778: sync 2024-04-25T02:03:30.980 INFO:tasks.workunit.client.0.smithi162.stdout:8/760: creat d0/db1/d101/f108 x:0 0 0 2024-04-25T02:03:31.001 INFO:tasks.workunit.client.0.smithi162.stdout:7/788: getdents df/d2e/dfe 0 2024-04-25T02:03:31.055 INFO:tasks.workunit.client.0.smithi162.stdout:7/789: stat df/d2e/d4c/d8a/f80 0 2024-04-25T02:03:31.085 INFO:tasks.workunit.client.0.smithi162.stdout:7/790: chown df/d2e/lab 1174891424 1 2024-04-25T02:03:31.340 INFO:tasks.workunit.client.0.smithi162.stdout:2/734: symlink d0/d3/d5/d36/d93/l107 0 2024-04-25T02:03:31.976 INFO:tasks.workunit.client.0.smithi162.stdout:5/779: fsync d15/d19/d24/f2d 0 2024-04-25T02:03:33.214 INFO:tasks.workunit.client.0.smithi162.stdout:8/761: truncate d0/f6b 885378 0 2024-04-25T02:03:33.436 INFO:tasks.workunit.client.0.smithi162.stdout:3/779: dwrite d2/d9/fbd [0,4194304] 0 2024-04-25T02:03:33.588 INFO:tasks.workunit.client.0.smithi162.stdout:9/713: mkdir d4/d25/dfb 0 2024-04-25T02:03:33.674 INFO:tasks.workunit.client.0.smithi162.stdout:3/780: read d2/d29/f3c [1539659,18840] 0 2024-04-25T02:03:33.962 INFO:tasks.workunit.client.0.smithi162.stdout:0/862: mkdir d0/d1/dab/d128 0 2024-04-25T02:03:34.180 INFO:tasks.workunit.client.0.smithi162.stdout:1/799: link d15/d1f/d35/d5c/d83/ld7 d15/d1f/d35/d5c/d83/l104 0 2024-04-25T02:03:34.542 INFO:tasks.workunit.client.0.smithi162.stdout:6/731: dwrite d1/f68 [0,4194304] 0 2024-04-25T02:03:34.664 INFO:tasks.workunit.client.0.smithi162.stdout:7/791: symlink df/d2e/d4c/d8a/db2/df0/d10a/l10d 0 2024-04-25T02:03:34.696 INFO:tasks.workunit.client.0.smithi162.stdout:4/774: write dd/df/d2e/fad [1012977,18458] 0 2024-04-25T02:03:34.786 INFO:tasks.workunit.client.0.smithi162.stdout:6/732: stat d1/d13/d28/d30/d8a/cd0 0 2024-04-25T02:03:34.812 INFO:tasks.workunit.client.0.smithi162.stdout:4/775: stat dd/d1a/d34/d57 0 2024-04-25T02:03:34.858 INFO:tasks.workunit.client.0.smithi162.stdout:3/781: fdatasync d2/d9/d19/fa1 0 2024-04-25T02:03:35.395 INFO:tasks.workunit.client.0.smithi162.stdout:0/863: dread d0/df/d20/d37/d58/f8b [0,4194304] 0 2024-04-25T02:03:35.769 INFO:tasks.workunit.client.0.smithi162.stdout:7/792: mknod df/d2e/d4c/d8a/db2/df0/d10a/c10e 0 2024-04-25T02:03:35.806 INFO:tasks.workunit.client.0.smithi162.stdout:7/793: readlink df/d2e/d4c/d58/d82/l9c 0 2024-04-25T02:03:36.105 INFO:tasks.workunit.client.0.smithi162.stdout:4/776: stat dd/df/d2e/d4b/ffc 0 2024-04-25T02:03:36.132 INFO:tasks.workunit.client.0.smithi162.stdout:4/777: chown dd/d1a/d34/l38 1 1 2024-04-25T02:03:36.272 INFO:tasks.workunit.client.0.smithi162.stdout:6/733: creat d1/d13/d28/d45/d59/feb x:0 0 0 2024-04-25T02:03:36.744 INFO:tasks.workunit.client.0.smithi162.stdout:9/714: creat d4/d9/d15/d1b/d2f/d30/dc1/d9f/dd1/ffc x:0 0 0 2024-04-25T02:03:36.945 INFO:tasks.workunit.client.0.smithi162.stdout:2/735: dwrite d0/d3/d1b/d6b/fa5 [0,4194304] 0 2024-04-25T02:03:37.463 INFO:tasks.workunit.client.0.smithi162.stdout:4/778: dread dd/d1a/d34/db1/fd8 [0,4194304] 0 2024-04-25T02:03:37.492 INFO:tasks.workunit.client.0.smithi162.stdout:8/762: creat d0/d12/d2b/d87/f109 x:0 0 0 2024-04-25T02:03:37.797 INFO:tasks.workunit.client.0.smithi162.stdout:9/715: creat d4/d9/d15/d1b/ffd x:0 0 0 2024-04-25T02:03:38.727 INFO:tasks.workunit.client.0.smithi162.stdout:4/779: creat dd/df/d7e/de9/fff x:0 0 0 2024-04-25T02:03:38.961 INFO:tasks.workunit.client.0.smithi162.stdout:2/736: mkdir d0/d3/d1b/d6b/dc0/d5e/d108 0 2024-04-25T02:03:38.979 INFO:tasks.workunit.client.0.smithi162.stdout:5/780: write d15/f65 [2097891,68288] 0 2024-04-25T02:03:39.077 INFO:tasks.workunit.client.0.smithi162.stdout:3/782: link d2/d9/d48/cb0 d2/d29/d2e/c104 0 2024-04-25T02:03:39.306 INFO:tasks.workunit.client.0.smithi162.stdout:1/800: dwrite d15/d69/f75 [0,4194304] 0 2024-04-25T02:03:39.429 INFO:tasks.workunit.client.0.smithi162.stdout:8/763: mknod d0/d12/d1b/d74/d8a/d103/c10a 0 2024-04-25T02:03:39.530 INFO:tasks.workunit.client.0.smithi162.stdout:8/764: chown d0/d12/d1b/d74/d8a/fad 705386 1 2024-04-25T02:03:40.017 INFO:tasks.workunit.client.0.smithi162.stdout:5/781: read - d15/d19/d24/d2b/d3b/d3c/ffb zero size 2024-04-25T02:03:40.159 INFO:tasks.workunit.client.0.smithi162.stdout:9/716: link d4/lde d4/d9/d15/d8a/lfe 0 2024-04-25T02:03:40.209 INFO:tasks.workunit.client.0.smithi162.stdout:9/717: dread - d4/d9/d15/d1b/d2f/d30/dc1/fa2 zero size 2024-04-25T02:03:40.291 INFO:tasks.workunit.client.0.smithi162.stdout:8/765: mknod d0/d12/d1b/c10b 0 2024-04-25T02:03:40.707 INFO:tasks.workunit.client.0.smithi162.stdout:0/864: dwrite d0/df/d20/d25/d55/d6f/d7d/da7/fb2 [0,4194304] 0 2024-04-25T02:03:40.721 INFO:tasks.workunit.client.0.smithi162.stdout:7/794: write df/d2c/d63/d83/ddc/f10b [845436,117810] 0 2024-04-25T02:03:41.229 INFO:tasks.workunit.client.0.smithi162.stdout:9/718: dread d4/d9/f87 [0,4194304] 0 2024-04-25T02:03:41.282 INFO:tasks.workunit.client.0.smithi162.stdout:9/719: chown d4/d9/d15/d1b/d2f/d30/dc1/d9f/ff9 7 1 2024-04-25T02:03:41.483 INFO:tasks.workunit.client.0.smithi162.stdout:5/782: mknod d15/d19/d24/d2b/d3b/cfe 0 2024-04-25T02:03:41.577 INFO:tasks.workunit.client.0.smithi162.stdout:7/795: dread df/f76 [0,4194304] 0 2024-04-25T02:03:41.613 INFO:tasks.workunit.client.0.smithi162.stdout:6/734: write d1/d13/d28/d30/d63/f9f [778171,105792] 0 2024-04-25T02:03:41.652 INFO:tasks.workunit.client.0.smithi162.stdout:0/865: dread - d0/df/d20/d37/d81/d92/ffa zero size 2024-04-25T02:03:41.775 INFO:tasks.workunit.client.0.smithi162.stdout:8/766: read d0/d12/d2b/d87/fb2 [1609714,13681] 0 2024-04-25T02:03:41.836 INFO:tasks.workunit.client.0.smithi162.stdout:0/866: read d0/df/d20/d37/d58/fee [920267,10179] 0 2024-04-25T02:03:42.103 INFO:tasks.workunit.client.0.smithi162.stdout:9/720: rename d4/d25/de5/fe9 to d4/d9/d15/d1b/d2f/d30/dc1/fff 0 2024-04-25T02:03:42.136 INFO:tasks.workunit.client.0.smithi162.stdout:4/780: write f5 [1834437,129894] 0 2024-04-25T02:03:42.206 INFO:tasks.workunit.client.0.smithi162.stdout:2/737: write d0/d3/d1b/d6b/d92/fd4 [710690,34580] 0 2024-04-25T02:03:42.390 INFO:tasks.workunit.client.0.smithi162.stdout:7/796: creat df/d2c/d63/d83/ddc/f10f x:0 0 0 2024-04-25T02:03:42.623 INFO:tasks.workunit.client.0.smithi162.stdout:8/767: symlink d0/d12/d1b/d74/d8a/da3/l10c 0 2024-04-25T02:03:42.761 INFO:tasks.workunit.client.0.smithi162.stdout:3/783: dwrite d2/d9/d19/fa1 [0,4194304] 0 2024-04-25T02:03:42.882 INFO:tasks.workunit.client.0.smithi162.stdout:1/801: write d15/d1f/d23/d30/d4a/fa9 [619084,63462] 0 2024-04-25T02:03:43.252 INFO:tasks.workunit.client.0.smithi162.stdout:3/784: dread d2/d9/f49 [0,4194304] 0 2024-04-25T02:03:43.336 INFO:tasks.workunit.client.0.smithi162.stdout:9/721: fdatasync d4/fdb 0 2024-04-25T02:03:43.442 INFO:tasks.workunit.client.0.smithi162.stdout:4/781: fsync dd/df/d2e/fb5 0 2024-04-25T02:03:43.550 INFO:tasks.workunit.client.0.smithi162.stdout:9/722: sync 2024-04-25T02:03:43.902 INFO:tasks.workunit.client.0.smithi162.stdout:7/797: creat df/d2e/d4c/d8a/db2/df0/f110 x:0 0 0 2024-04-25T02:03:43.912 INFO:tasks.workunit.client.0.smithi162.stdout:6/735: creat d1/d13/d28/d7b/dc4/fec x:0 0 0 2024-04-25T02:03:44.272 INFO:tasks.workunit.client.0.smithi162.stdout:0/867: symlink d0/df/d20/d37/dfc/d11e/l129 0 2024-04-25T02:03:44.292 INFO:tasks.workunit.client.0.smithi162.stdout:1/802: fdatasync d15/d1f/d35/d4c/d8e/f90 0 2024-04-25T02:03:45.241 INFO:tasks.workunit.client.0.smithi162.stdout:5/783: dwrite d15/d19/d24/d2b/d3b/d3c/fef [0,4194304] 0 2024-04-25T02:03:45.381 INFO:tasks.workunit.client.0.smithi162.stdout:6/736: creat d1/d46/d7a/fed x:0 0 0 2024-04-25T02:03:46.228 INFO:tasks.workunit.client.0.smithi162.stdout:4/782: symlink dd/df/d58/deb/l100 0 2024-04-25T02:03:46.288 INFO:tasks.workunit.client.0.smithi162.stdout:4/783: readlink dd/d1a/d34/db1/dba/dfd/db8/ld7 0 2024-04-25T02:03:46.542 INFO:tasks.workunit.client.0.smithi162.stdout:2/738: dwrite d0/d3/d1b/d1d/d3a/d63/fb1 [0,4194304] 0 2024-04-25T02:03:47.223 INFO:tasks.workunit.client.0.smithi162.stdout:4/784: mknod dd/df/d7e/c101 0 2024-04-25T02:03:47.244 INFO:tasks.workunit.client.0.smithi162.stdout:2/739: dread - d0/d3/d1b/d1d/d3a/d63/dba/f104 zero size 2024-04-25T02:03:47.283 INFO:tasks.workunit.client.0.smithi162.stdout:8/768: write d0/d12/f7e [3933098,33532] 0 2024-04-25T02:03:47.415 INFO:tasks.workunit.client.0.smithi162.stdout:8/769: read d0/d1a/f28 [462468,29082] 0 2024-04-25T02:03:47.553 INFO:tasks.workunit.client.0.smithi162.stdout:1/803: rename d15/d1f/d35/d4c/d70/d73/db8/df4/lf6 to d15/d1f/d35/d4c/d70/d9f/l105 0 2024-04-25T02:03:47.638 INFO:tasks.workunit.client.0.smithi162.stdout:1/804: dread d15/d1f/d23/f48 [0,4194304] 0 2024-04-25T02:03:47.916 INFO:tasks.workunit.client.0.smithi162.stdout:4/785: mknod dd/df/d2e/d4b/d79/c102 0 2024-04-25T02:03:48.031 INFO:tasks.workunit.client.0.smithi162.stdout:3/785: dwrite d2/d9/d10/d4c/d51/d63/d87/d86/fc2 [0,4194304] 0 2024-04-25T02:03:48.163 INFO:tasks.workunit.client.0.smithi162.stdout:2/740: fdatasync d0/d3/d7a/f98 0 2024-04-25T02:03:48.244 INFO:tasks.workunit.client.0.smithi162.stdout:8/770: creat d0/d12/d2b/dc7/f10d x:0 0 0 2024-04-25T02:03:48.626 INFO:tasks.workunit.client.0.smithi162.stdout:9/723: dwrite d4/d9/d15/d1b/d69/fe0 [0,4194304] 0 2024-04-25T02:03:48.805 INFO:tasks.workunit.client.0.smithi162.stdout:3/786: read d2/d29/f2a [2246864,88663] 0 2024-04-25T02:03:48.848 INFO:tasks.workunit.client.0.smithi162.stdout:4/786: read dd/df/d2e/d59/f91 [2737390,55164] 0 2024-04-25T02:03:49.446 INFO:tasks.workunit.client.0.smithi162.stdout:8/771: mkdir d0/d12/d3a/da5/d10e 0 2024-04-25T02:03:49.670 INFO:tasks.workunit.client.0.smithi162.stdout:0/868: dwrite d0/df/d20/f40 [0,4194304] 0 2024-04-25T02:03:49.779 INFO:tasks.workunit.client.0.smithi162.stdout:1/805: read - d15/d1f/d23/d30/d4a/d7f/d97/dbe/dde/ffe zero size 2024-04-25T02:03:49.878 INFO:tasks.workunit.client.0.smithi162.stdout:9/724: unlink d4/d9/f6b 0 2024-04-25T02:03:49.921 INFO:tasks.workunit.client.0.smithi162.stdout:9/725: stat d4/d9/d15/d1b/d2f/d30/dc1/fc2 0 2024-04-25T02:03:49.977 INFO:tasks.workunit.client.0.smithi162.stdout:7/798: mkdir df/d2e/d111 0 2024-04-25T02:03:50.142 INFO:tasks.workunit.client.0.smithi162.stdout:3/787: creat d2/d9/d10/d4c/d51/d63/d87/d90/f105 x:0 0 0 2024-04-25T02:03:50.615 INFO:tasks.workunit.client.0.smithi162.stdout:8/772: mkdir d0/d12/d3a/da5/d10f 0 2024-04-25T02:03:50.861 INFO:tasks.workunit.client.0.smithi162.stdout:1/806: symlink d15/d1f/d23/d30/d4a/d7f/l106 0 2024-04-25T02:03:51.077 INFO:tasks.workunit.client.0.smithi162.stdout:6/737: dwrite d1/f68 [0,4194304] 0 2024-04-25T02:03:51.389 INFO:tasks.workunit.client.0.smithi162.stdout:5/784: dwrite d15/d19/f1b [0,4194304] 0 2024-04-25T02:03:51.551 INFO:tasks.workunit.client.0.smithi162.stdout:8/773: truncate d0/d86/dd0/ffd 583061 0 2024-04-25T02:03:51.564 INFO:tasks.workunit.client.0.smithi162.stdout:8/774: chown d0/d44 21205361 1 2024-04-25T02:03:51.879 INFO:tasks.workunit.client.0.smithi162.stdout:1/807: creat d15/d1f/d23/f107 x:0 0 0 2024-04-25T02:03:51.923 INFO:tasks.workunit.client.0.smithi162.stdout:1/808: chown d15/d1f/d23/f107 46313 1 2024-04-25T02:03:52.338 INFO:tasks.workunit.client.0.smithi162.stdout:6/738: mknod d1/d13/d28/d30/d8a/dab/cee 0 2024-04-25T02:03:52.600 INFO:tasks.workunit.client.0.smithi162.stdout:8/775: symlink d0/d86/dd0/l110 0 2024-04-25T02:03:52.765 INFO:tasks.workunit.client.0.smithi162.stdout:9/726: rename d4/d9/d15/d1b/d2f/d30/dc1/d9f/lda to d4/d9/d15/d1b/d2f/l100 0 2024-04-25T02:03:52.869 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:03:52.872 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:03:53.660 INFO:tasks.workunit.client.0.smithi162.stdout:2/741: write d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/da2/de2/fe7 [889797,59820] 0 2024-04-25T02:03:54.125 INFO:tasks.workunit.client.0.smithi162.stdout:4/787: write dd/d1a/d4e/d93/fd1 [4890704,109138] 0 2024-04-25T02:03:54.337 INFO:tasks.workunit.client.0.smithi162.stdout:2/742: mknod d0/d3/d5/d36/c109 0 2024-04-25T02:03:54.741 INFO:tasks.workunit.client.0.smithi162.stdout:5/785: link d15/d19/d24/d2b/c99 d15/d19/d24/d40/dbf/de3/cff 0 2024-04-25T02:03:54.744 INFO:tasks.workunit.client.0.smithi162.stdout:8/776: creat d0/d44/f111 x:0 0 0 2024-04-25T02:03:55.069 INFO:tasks.workunit.client.0.smithi162.stdout:7/799: write df/d2c/d49/d7a/fc3 [88492,125402] 0 2024-04-25T02:03:55.334 INFO:tasks.workunit.client.0.smithi162.stdout:4/788: mkdir dd/df/d2e/dd4/d103 0 2024-04-25T02:03:55.386 INFO:tasks.workunit.client.0.smithi162.stdout:5/786: mkdir d15/d19/d24/d2b/d3b/d58/daf/d100 0 2024-04-25T02:03:55.686 INFO:tasks.workunit.client.0.smithi162.stdout:3/788: dwrite d2/d29/d2e/f31 [0,4194304] 0 2024-04-25T02:03:55.863 INFO:tasks.workunit.client.0.smithi162.stdout:8/777: fdatasync d0/d12/d2b/d87/fa0 0 2024-04-25T02:03:55.995 INFO:tasks.workunit.client.0.smithi162.stdout:4/789: read - dd/df/d2e/fbf zero size 2024-04-25T02:03:56.137 INFO:tasks.workunit.client.0.smithi162.stdout:0/869: dwrite d0/d1/d4e/d76/db0/fba [4194304,4194304] 0 2024-04-25T02:03:56.419 INFO:tasks.workunit.client.0.smithi162.stdout:5/787: mkdir d15/d19/d24/d4d/d7c/d85/de7/d7a/d7e/d101 0 2024-04-25T02:03:56.955 INFO:tasks.workunit.client.0.smithi162.stdout:6/739: write d1/f2a [2995817,87472] 0 2024-04-25T02:03:57.078 INFO:tasks.workunit.client.0.smithi162.stdout:4/790: creat dd/d1a/d34/db1/dba/dfd/db8/f104 x:0 0 0 2024-04-25T02:03:57.224 INFO:tasks.workunit.client.0.smithi162.stdout:1/809: dwrite d15/d1f/d23/d30/f9c [0,4194304] 0 2024-04-25T02:03:57.357 INFO:tasks.workunit.client.0.smithi162.stdout:9/727: write d4/d9/fc9 [194064,105524] 0 2024-04-25T02:03:57.915 INFO:tasks.workunit.client.0.smithi162.stdout:0/870: getdents d0/d1/d4e/d76/dec 0 2024-04-25T02:03:58.282 INFO:tasks.workunit.client.0.smithi162.stdout:1/810: chown d15/d1f/d35/d4c/d70/d9f/fb6 1780 1 2024-04-25T02:03:58.388 INFO:tasks.workunit.client.0.smithi162.stdout:9/728: mkdir d4/d8/d85/d101 0 2024-04-25T02:03:58.638 INFO:tasks.workunit.client.0.smithi162.stdout:2/743: dwrite d0/d3/d1b/f5f [0,4194304] 0 2024-04-25T02:03:59.024 INFO:tasks.workunit.client.0.smithi162.stdout:2/744: dwrite d0/d3/d1b/f5f [0,4194304] 0 2024-04-25T02:03:59.168 INFO:tasks.workunit.client.0.smithi162.stdout:9/729: dread d4/d9/d15/d1b/d2f/d30/dc1/d9f/dd1/dee/ff5 [0,4194304] 0 2024-04-25T02:03:59.307 INFO:tasks.workunit.client.0.smithi162.stdout:2/745: sync 2024-04-25T02:03:59.461 INFO:tasks.workunit.client.0.smithi162.stdout:6/740: getdents d1/d13/d28/d53/d71 0 2024-04-25T02:03:59.469 INFO:tasks.workunit.client.0.smithi162.stdout:7/800: dwrite df/d2c/d49/d7a/fa5 [0,4194304] 0 2024-04-25T02:03:59.639 INFO:tasks.workunit.client.0.smithi162.stdout:0/871: getdents d0/df/d20/d25 0 2024-04-25T02:04:00.165 INFO:tasks.workunit.client.0.smithi162.stdout:3/789: dwrite d2/d9/d19/fa1 [0,4194304] 0 2024-04-25T02:04:00.286 INFO:tasks.workunit.client.0.smithi162.stdout:8/778: write d0/d44/d31/f6c [276564,114302] 0 2024-04-25T02:04:00.464 INFO:tasks.workunit.client.0.smithi162.stdout:3/790: dread d2/d9/d10/d4c/d51/f7e [0,4194304] 0 2024-04-25T02:04:00.569 INFO:tasks.workunit.client.0.smithi162.stdout:2/746: chown d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/ccd 240 1 2024-04-25T02:04:00.748 INFO:tasks.workunit.client.0.smithi162.stdout:6/741: mkdir d1/d13/d28/d30/d3a/dbc/def 0 2024-04-25T02:04:01.121 INFO:tasks.workunit.client.0.smithi162.stdout:3/791: dread - d2/d29/d2e/fdc zero size 2024-04-25T02:04:01.306 INFO:tasks.workunit.client.0.smithi162.stdout:5/788: dwrite d15/d19/d24/d4d/d7c/fd3 [0,4194304] 0 2024-04-25T02:04:01.587 INFO:tasks.workunit.client.0.smithi162.stdout:6/742: creat d1/d46/d7a/d85/ff0 x:0 0 0 2024-04-25T02:04:01.788 INFO:tasks.workunit.client.0.smithi162.stdout:4/791: dwrite dd/d1a/d34/db1/fd8 [0,4194304] 0 2024-04-25T02:04:01.924 INFO:tasks.workunit.client.0.smithi162.stdout:6/743: chown d1/d13/d28/d30/d63/f9f 77177 1 2024-04-25T02:04:01.952 INFO:tasks.workunit.client.0.smithi162.stdout:4/792: chown dd/df/d2e/fbf 7364 1 2024-04-25T02:04:02.155 INFO:tasks.workunit.client.0.smithi162.stdout:2/747: mknod d0/d3/d1b/d6b/de5/c10a 0 2024-04-25T02:04:02.174 INFO:tasks.workunit.client.0.smithi162.stdout:1/811: write d15/d1f/d35/d4c/d70/d9f/dea/fee [752984,114025] 0 2024-04-25T02:04:02.303 INFO:tasks.workunit.client.0.smithi162.stdout:7/801: link df/f2d df/d2e/d4c/d58/f112 0 2024-04-25T02:04:02.812 INFO:tasks.workunit.client.0.smithi162.stdout:9/730: write d4/d8/f5d [990654,55722] 0 2024-04-25T02:04:02.834 INFO:tasks.workunit.client.0.smithi162.stdout:6/744: dread - d1/d13/d28/d30/d63/fb4 zero size 2024-04-25T02:04:03.022 INFO:tasks.workunit.client.0.smithi162.stdout:5/789: creat d15/d19/d24/d4d/d7c/d85/de7/d7a/d7e/d101/f102 x:0 0 0 2024-04-25T02:04:03.211 INFO:tasks.workunit.client.0.smithi162.stdout:2/748: creat d0/d3/d1b/d6b/d92/f10b x:0 0 0 2024-04-25T02:04:03.517 INFO:tasks.workunit.client.0.smithi162.stdout:7/802: creat df/d2e/d4c/daf/f113 x:0 0 0 2024-04-25T02:04:04.241 INFO:tasks.workunit.client.0.smithi162.stdout:6/745: fsync d1/d13/f42 0 2024-04-25T02:04:04.461 INFO:tasks.workunit.client.0.smithi162.stdout:0/872: write d0/d1/d4b/f61 [2811421,106093] 0 2024-04-25T02:04:04.691 INFO:tasks.workunit.client.0.smithi162.stdout:7/803: rename df/d2c/d49/d7a/fa5 to df/d2e/d4c/de8/f114 0 2024-04-25T02:04:04.765 INFO:tasks.workunit.client.0.smithi162.stdout:4/793: creat dd/df/d2e/f105 x:0 0 0 2024-04-25T02:04:05.394 INFO:tasks.workunit.client.0.smithi162.stdout:8/779: write d0/d44/f7d [3391613,82747] 0 2024-04-25T02:04:05.405 INFO:tasks.workunit.client.0.smithi162.stdout:0/873: dread - d0/d1/dab/f114 zero size 2024-04-25T02:04:05.451 INFO:tasks.workunit.client.0.smithi162.stdout:0/874: chown d0/df 1452714 1 2024-04-25T02:04:05.861 INFO:tasks.workunit.client.0.smithi162.stdout:6/746: mkdir d1/d13/d28/df1 0 2024-04-25T02:04:05.989 INFO:tasks.workunit.client.0.smithi162.stdout:2/749: creat d0/d3/d1b/d6b/dc0/d5e/d61/f10c x:0 0 0 2024-04-25T02:04:06.132 INFO:tasks.workunit.client.0.smithi162.stdout:0/875: rmdir d0/df/d20/d25/d55/d6f/d7d/da7 39 2024-04-25T02:04:06.148 INFO:tasks.workunit.client.0.smithi162.stdout:3/792: dwrite d2/d9/f2d [0,4194304] 0 2024-04-25T02:04:06.374 INFO:tasks.workunit.client.0.smithi162.stdout:4/794: fdatasync dd/d1a/f22 0 2024-04-25T02:04:06.840 INFO:tasks.workunit.client.0.smithi162.stdout:6/747: creat d1/d13/d28/d45/d59/ff2 x:0 0 0 2024-04-25T02:04:06.938 INFO:tasks.workunit.client.0.smithi162.stdout:1/812: write d15/d1f/d23/d30/d4a/d7f/fdd [390298,7869] 0 2024-04-25T02:04:06.972 INFO:tasks.workunit.client.0.smithi162.stdout:7/804: link df/d2c/d63/lb1 df/d2e/d4c/d58/d93/l115 0 2024-04-25T02:04:07.454 INFO:tasks.workunit.client.0.smithi162.stdout:2/750: truncate d0/d3/d1b/d6b/dc0/d5e/d61/fb5 2831391 0 2024-04-25T02:04:07.534 INFO:tasks.workunit.client.0.smithi162.stdout:4/795: symlink dd/df/d58/l106 0 2024-04-25T02:04:07.556 INFO:tasks.workunit.client.0.smithi162.stdout:4/796: stat dd/d1a/c1c 0 2024-04-25T02:04:08.024 INFO:tasks.workunit.client.0.smithi162.stdout:9/731: write d4/d9/d15/d8a/fcc [377768,56037] 0 2024-04-25T02:04:08.083 INFO:tasks.workunit.client.0.smithi162.stdout:6/748: truncate d1/d13/d28/d30/d66/f9b 472583 0 2024-04-25T02:04:08.287 INFO:tasks.workunit.client.0.smithi162.stdout:7/805: symlink df/d2e/d4c/d58/dd3/dd8/l116 0 2024-04-25T02:04:08.320 INFO:tasks.workunit.client.0.smithi162.stdout:7/806: readlink df/d2e/d4c/l99 0 2024-04-25T02:04:08.789 INFO:tasks.workunit.client.0.smithi162.stdout:8/780: getdents d0/d12/d3a/da5 0 2024-04-25T02:04:09.095 INFO:tasks.workunit.client.0.smithi162.stdout:5/790: dwrite d15/d19/d24/d40/f5f [0,4194304] 0 2024-04-25T02:04:09.278 INFO:tasks.workunit.client.0.smithi162.stdout:6/749: truncate d1/d46/d7a/fda 47253 0 2024-04-25T02:04:09.431 INFO:tasks.workunit.client.0.smithi162.stdout:7/807: creat df/d2c/d49/d7a/f117 x:0 0 0 2024-04-25T02:04:09.463 INFO:tasks.workunit.client.0.smithi162.stdout:0/876: link d0/df/d20/d37/d58/f8b d0/df/d20/d37/d81/d92/f12a 0 2024-04-25T02:04:09.779 INFO:tasks.workunit.client.0.smithi162.stdout:4/797: mkdir dd/d1a/d34/d72/def/d107 0 2024-04-25T02:04:10.178 INFO:tasks.workunit.client.0.smithi162.stdout:8/781: dread d0/d44/d31/d33/f47 [0,4194304] 0 2024-04-25T02:04:10.506 INFO:tasks.workunit.client.0.smithi162.stdout:6/750: symlink d1/d13/d28/d53/lf3 0 2024-04-25T02:04:10.866 INFO:tasks.workunit.client.0.smithi162.stdout:5/791: rename d15/d19/d24/d4d/d7c/cad to d15/d19/d24/d2b/d3b/d80/ddf/c103 0 2024-04-25T02:04:11.097 INFO:tasks.workunit.client.0.smithi162.stdout:4/798: chown dd/d1a/d34/d72/laa 19 1 2024-04-25T02:04:11.307 INFO:tasks.workunit.client.0.smithi162.stdout:3/793: dwrite d2/d29/f46 [0,4194304] 0 2024-04-25T02:04:11.730 INFO:tasks.workunit.client.0.smithi162.stdout:6/751: dread - d1/d13/d28/d45/fad zero size 2024-04-25T02:04:12.005 INFO:tasks.workunit.client.0.smithi162.stdout:0/877: mknod d0/df/d20/d25/dce/df3/c12b 0 2024-04-25T02:04:12.558 INFO:tasks.workunit.client.0.smithi162.stdout:2/751: write d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/ffc [1239011,50131] 0 2024-04-25T02:04:12.608 INFO:tasks.workunit.client.0.smithi162.stdout:2/752: readlink d0/d3/d1b/d6b/ld9 0 2024-04-25T02:04:12.620 INFO:tasks.workunit.client.0.smithi162.stdout:3/794: rmdir d2/d9/d10/d4c/d51/d63/d87/d90/db3/de3 39 2024-04-25T02:04:12.877 INFO:tasks.workunit.client.0.smithi162.stdout:7/808: link df/d2e/d4c/daf/fb0 df/d2e/dfe/f118 0 2024-04-25T02:04:12.897 INFO:tasks.workunit.client.0.smithi162.stdout:2/753: sync 2024-04-25T02:04:12.955 INFO:tasks.workunit.client.0.smithi162.stdout:2/754: dread - d0/d3/d1b/d6b/dc0/d5e/d61/da4/fa6 zero size 2024-04-25T02:04:13.661 INFO:tasks.workunit.client.0.smithi162.stdout:7/809: fdatasync df/d2c/d49/d5d/fbe 0 2024-04-25T02:04:13.874 INFO:tasks.workunit.client.0.smithi162.stdout:2/755: mkdir d0/d3/d1b/d1d/d3a/d10d 0 2024-04-25T02:04:13.953 INFO:tasks.workunit.client.0.smithi162.stdout:9/732: write d4/d9/fa0 [586562,43365] 0 2024-04-25T02:04:14.452 INFO:tasks.workunit.client.0.smithi162.stdout:3/795: symlink d2/d9/d19/l106 0 2024-04-25T02:04:14.628 INFO:tasks.workunit.client.0.smithi162.stdout:1/813: unlink d15/d1f/c2b 0 2024-04-25T02:04:14.844 INFO:tasks.workunit.client.0.smithi162.stdout:2/756: mkdir d0/d3/d1b/d6b/dc0/d5e/d10e 0 2024-04-25T02:04:14.900 INFO:tasks.workunit.client.0.smithi162.stdout:2/757: read d0/d3/d1b/d6b/dc0/d5e/d61/d66/f24 [3957100,46174] 0 2024-04-25T02:04:15.244 INFO:tasks.workunit.client.0.smithi162.stdout:8/782: write d0/d44/d31/d65/f9c [116903,100109] 0 2024-04-25T02:04:15.339 INFO:tasks.workunit.client.0.smithi162.stdout:9/733: creat d4/d25/da3/f102 x:0 0 0 2024-04-25T02:04:15.485 INFO:tasks.workunit.client.0.smithi162.stdout:3/796: mknod d2/d9/d10/d4c/dfb/dfc/c107 0 2024-04-25T02:04:15.634 INFO:tasks.workunit.client.0.smithi162.stdout:7/810: creat df/d2e/d4c/d8a/f119 x:0 0 0 2024-04-25T02:04:16.028 INFO:tasks.workunit.client.0.smithi162.stdout:8/783: truncate d0/d1a/fff 924765 0 2024-04-25T02:04:16.212 INFO:tasks.workunit.client.0.smithi162.stdout:9/734: creat d4/d9/d15/d1b/d2f/d30/dc1/f103 x:0 0 0 2024-04-25T02:04:16.494 INFO:tasks.workunit.client.0.smithi162.stdout:3/797: mknod d2/d9/d10/d4c/d51/c108 0 2024-04-25T02:04:16.723 INFO:tasks.workunit.client.0.smithi162.stdout:8/784: fsync d0/fef 0 2024-04-25T02:04:16.916 INFO:tasks.workunit.client.0.smithi162.stdout:7/811: symlink df/d2e/d4c/d8a/l11a 0 2024-04-25T02:04:17.078 INFO:tasks.workunit.client.0.smithi162.stdout:4/799: dwrite dd/d1a/f26 [0,4194304] 0 2024-04-25T02:04:17.318 INFO:tasks.workunit.client.0.smithi162.stdout:5/792: write d15/d19/d24/d4d/d9d/ff6 [3314777,74339] 0 2024-04-25T02:04:17.493 INFO:tasks.workunit.client.0.smithi162.stdout:0/878: write d0/d1/d6a/da9/f110 [570048,125416] 0 2024-04-25T02:04:17.813 INFO:tasks.workunit.client.0.smithi162.stdout:8/785: dread d0/d44/d31/d65/f7b [0,4194304] 0 2024-04-25T02:04:17.945 INFO:tasks.workunit.client.0.smithi162.stdout:6/752: dwrite d1/d13/d28/d45/fad [0,4194304] 0 2024-04-25T02:04:17.945 INFO:tasks.workunit.client.0.smithi162.stdout:0/879: chown d0/d1/d6a/l104 0 1 2024-04-25T02:04:18.115 INFO:tasks.workunit.client.0.smithi162.stdout:1/814: write d15/d1f/d35/d4c/d70/d73/f77 [2074488,70526] 0 2024-04-25T02:04:18.283 INFO:tasks.workunit.client.0.smithi162.stdout:6/753: chown d1/d13/d28/d30/d8a/cd0 27100745 1 2024-04-25T02:04:18.313 INFO:tasks.workunit.client.0.smithi162.stdout:2/758: write d0/d3/d1b/d6b/dc0/d5e/d61/d66/f24 [3556091,1578] 0 2024-04-25T02:04:18.327 INFO:tasks.workunit.client.0.smithi162.stdout:8/786: dread d0/d1a/f28 [0,4194304] 0 2024-04-25T02:04:18.351 INFO:tasks.workunit.client.0.smithi162.stdout:9/735: write d4/d8/d13/f16 [2293082,96308] 0 2024-04-25T02:04:18.430 INFO:tasks.workunit.client.0.smithi162.stdout:9/736: chown d4/d9/fa 72 1 2024-04-25T02:04:18.557 INFO:tasks.workunit.client.0.smithi162.stdout:5/793: creat d15/d19/d24/d4d/d9d/f104 x:0 0 0 2024-04-25T02:04:18.628 INFO:tasks.workunit.client.0.smithi162.stdout:5/794: chown d15/d19/d24/d4d/d7c/d85/de7/dd1/ff1 52 1 2024-04-25T02:04:18.741 INFO:tasks.workunit.client.0.smithi162.stdout:4/800: rename dd/df/d2e/d4b/l62 to dd/d1a/d34/db1/l108 0 2024-04-25T02:04:19.612 INFO:tasks.workunit.client.0.smithi162.stdout:7/812: mknod df/d2e/d4c/d58/dd3/dd8/def/c11b 0 2024-04-25T02:04:19.639 INFO:tasks.workunit.client.0.smithi162.stdout:6/754: dread d1/d46/f56 [4194304,4194304] 0 2024-04-25T02:04:19.901 INFO:tasks.workunit.client.0.smithi162.stdout:8/787: truncate d0/d12/d1b/d74/f77 1575778 0 2024-04-25T02:04:20.212 INFO:tasks.workunit.client.0.smithi162.stdout:3/798: getdents d2/d9/d10/d2c/da3 0 2024-04-25T02:04:20.267 INFO:tasks.workunit.client.0.smithi162.stdout:5/795: read - d15/d19/d24/d40/fe6 zero size 2024-04-25T02:04:20.789 INFO:tasks.workunit.client.0.smithi162.stdout:1/815: dwrite d15/d1f/d35/d4c/d8e/fdb [0,4194304] 0 2024-04-25T02:04:21.142 INFO:tasks.workunit.client.0.smithi162.stdout:6/755: fdatasync d1/d13/d28/d30/f4e 0 2024-04-25T02:04:21.172 INFO:tasks.workunit.client.0.smithi162.stdout:2/759: dwrite d0/d3/d5/d36/d93/f8f [0,4194304] 0 2024-04-25T02:04:21.299 INFO:tasks.workunit.client.0.smithi162.stdout:8/788: rename d0/d44/d31/d33 to d0/d44/d64/d112 0 2024-04-25T02:04:21.340 INFO:tasks.workunit.client.0.smithi162.stdout:3/799: rmdir d2/d9/d10/d4c 39 2024-04-25T02:04:21.365 INFO:tasks.workunit.client.0.smithi162.stdout:9/737: write d4/d9/d15/d1b/ffd [196696,8876] 0 2024-04-25T02:04:21.883 INFO:tasks.workunit.client.0.smithi162.stdout:1/816: symlink d15/d1f/d35/d4c/d70/d73/df5/l108 0 2024-04-25T02:04:21.919 INFO:tasks.workunit.client.0.smithi162.stdout:1/817: chown d15/d1f/d23/d30/f9c 75407 1 2024-04-25T02:04:22.213 INFO:tasks.workunit.client.0.smithi162.stdout:0/880: write d0/d1/fc3 [1009644,37163] 0 2024-04-25T02:04:22.418 INFO:tasks.workunit.client.0.smithi162.stdout:4/801: dwrite dd/d1a/f37 [0,4194304] 0 2024-04-25T02:04:22.848 INFO:tasks.workunit.client.0.smithi162.stdout:2/760: creat d0/d3/d5/d36/d93/de0/f10f x:0 0 0 2024-04-25T02:04:23.057 INFO:tasks.workunit.client.0.smithi162.stdout:9/738: creat d4/d9/d15/d1b/d2f/d30/dc1/d59/dec/f104 x:0 0 0 2024-04-25T02:04:23.143 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:04:23.146 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:04:23.367 INFO:tasks.workunit.client.0.smithi162.stdout:7/813: dwrite df/f12 [4194304,4194304] 0 2024-04-25T02:04:23.713 INFO:tasks.workunit.client.0.smithi162.stdout:4/802: rename dd/df/d58/fdc to dd/d1a/d34/db1/dba/dfd/db8/f109 0 2024-04-25T02:04:23.728 INFO:tasks.workunit.client.0.smithi162.stdout:3/800: mknod d2/d9/d10/d4c/d51/d63/d87/c109 0 2024-04-25T02:04:24.150 INFO:tasks.workunit.client.0.smithi162.stdout:5/796: rmdir d15/d19/d24/d4d/d9d/df8 0 2024-04-25T02:04:24.192 INFO:tasks.workunit.client.0.smithi162.stdout:2/761: dread d0/d3/d7a/fb2 [0,4194304] 0 2024-04-25T02:04:25.473 INFO:tasks.workunit.client.0.smithi162.stdout:8/789: dwrite d0/d12/d1b/d74/d8a/fad [0,4194304] 0 2024-04-25T02:04:26.223 INFO:tasks.workunit.client.0.smithi162.stdout:2/762: creat d0/d3/d5/d36/d93/de0/f110 x:0 0 0 2024-04-25T02:04:26.267 INFO:tasks.workunit.client.0.smithi162.stdout:2/763: dread - d0/d3/d5/fbf zero size 2024-04-25T02:04:26.955 INFO:tasks.workunit.client.0.smithi162.stdout:4/803: symlink dd/df/d2e/d59/l10a 0 2024-04-25T02:04:27.205 INFO:tasks.workunit.client.0.smithi162.stdout:3/801: rmdir d2/d9/d10/d4c/d51/d63/d87/d90/db3/de3 39 2024-04-25T02:04:27.307 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:15:16.737 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:04:27.314 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:15:16.745 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:04:27.373 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:15:16.804 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:04:27.386 INFO:tasks.workunit.client.0.smithi162.stdout:6/756: getdents d1/d13/d28/d30/d3a 0 2024-04-25T02:04:27.431 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:15:16.779 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:04:27.432 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:15:16.779 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:04:27.434 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:15:16.782 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:04:27.434 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:15:16.782 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:04:27.518 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:15:16.866 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:04:27.525 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:15:16.873 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:04:27.562 INFO:tasks.workunit.client.0.smithi162.stdout:2/764: unlink d0/d3/d7a/lee 0 2024-04-25T02:04:27.621 INFO:tasks.workunit.client.0.smithi162.stdout:1/818: link d15/d1f/d35/d4c/d70/d9f/lba d15/d1f/d23/d30/d4a/d7f/l109 0 2024-04-25T02:04:27.632 INFO:tasks.workunit.client.0.smithi162.stdout:4/804: symlink dd/df/d2e/dd4/l10b 0 2024-04-25T02:04:27.656 INFO:tasks.workunit.client.0.smithi162.stdout:0/881: getdents d0/d7b 0 2024-04-25T02:04:27.658 INFO:tasks.workunit.client.0.smithi162.stdout:7/814: creat df/d2e/f11c x:0 0 0 2024-04-25T02:04:27.666 INFO:tasks.workunit.client.0.smithi162.stdout:3/802: dread d2/d9/d10/d2c/da3/db5/fc0 [0,4194304] 0 2024-04-25T02:04:27.762 INFO:tasks.workunit.client.0.smithi162.stdout:2/765: readlink d0/d3/d1b/d1d/d3a/d63/dba/ldb 0 2024-04-25T02:04:27.988 INFO:tasks.workunit.client.0.smithi162.stdout:1/819: sync 2024-04-25T02:04:28.027 INFO:tasks.workunit.client.0.smithi162.stdout:6/757: creat d1/d13/d28/d30/d8a/ff4 x:0 0 0 2024-04-25T02:04:28.251 INFO:tasks.workunit.client.0.smithi162.stdout:4/805: symlink dd/df/d2e/d4b/l10c 0 2024-04-25T02:04:28.288 INFO:tasks.workunit.client.0.smithi162.stdout:0/882: mknod d0/d1/d4e/c12c 0 2024-04-25T02:04:28.309 INFO:tasks.workunit.client.0.smithi162.stdout:9/739: write d4/f74 [894373,99326] 0 2024-04-25T02:04:28.791 INFO:tasks.workunit.client.0.smithi162.stdout:5/797: dwrite d15/d19/d24/d4d/fb8 [4194304,4194304] 0 2024-04-25T02:04:28.927 INFO:tasks.workunit.client.0.smithi162.stdout:4/806: dread - dd/df/d2e/fce zero size 2024-04-25T02:04:29.079 INFO:tasks.workunit.client.0.smithi162.stdout:2/766: mkdir d0/d3/d1b/d6b/dc0/d5e/db8/d111 0 2024-04-25T02:04:30.027 INFO:tasks.workunit.client.0.smithi162.stdout:9/740: mkdir d4/d9/d15/d1b/d2f/d30/dc1/d59/d105 0 2024-04-25T02:04:30.097 INFO:tasks.workunit.client.0.smithi162.stdout:8/790: dwrite d0/d1a/fae [0,4194304] 0 2024-04-25T02:04:30.396 INFO:tasks.workunit.client.0.smithi162.stdout:5/798: mknod d15/d19/d24/d4d/d7c/d85/dde/c105 0 2024-04-25T02:04:30.519 INFO:tasks.workunit.client.0.smithi162.stdout:4/807: truncate dd/d1a/d4e/fc1 709522 0 2024-04-25T02:04:30.765 INFO:tasks.workunit.client.0.smithi162.stdout:2/767: truncate d0/d3/d1b/d6b/dc0/d5e/fad 812207 0 2024-04-25T02:04:30.772 INFO:tasks.workunit.client.0.smithi162.stdout:9/741: dread d4/d9/d15/f23 [0,4194304] 0 2024-04-25T02:04:30.776 INFO:tasks.workunit.client.0.smithi162.stdout:0/883: mknod d0/df/d20/d25/d55/d6f/d7d/da7/c12d 0 2024-04-25T02:04:31.211 INFO:tasks.workunit.client.0.smithi162.stdout:3/803: creat d2/f10a x:0 0 0 2024-04-25T02:04:31.250 INFO:tasks.workunit.client.0.smithi162.stdout:8/791: rmdir d0/d12/d1b/d8d 39 2024-04-25T02:04:31.262 INFO:tasks.workunit.client.0.smithi162.stdout:6/758: write d1/d13/d28/d30/d63/fb4 [497705,109621] 0 2024-04-25T02:04:31.398 INFO:tasks.workunit.client.0.smithi162.stdout:7/815: write df/d2e/d4c/d58/f112 [4104069,82805] 0 2024-04-25T02:04:31.576 INFO:tasks.workunit.client.0.smithi162.stdout:4/808: creat dd/d1a/d34/d72/f10d x:0 0 0 2024-04-25T02:04:31.681 INFO:tasks.workunit.client.0.smithi162.stdout:1/820: dwrite d15/d1f/d35/d5c/fd6 [0,4194304] 0 2024-04-25T02:04:32.007 INFO:tasks.workunit.client.0.smithi162.stdout:2/768: creat d0/d3/d1b/d6b/dc0/d67/d9c/f112 x:0 0 0 2024-04-25T02:04:32.281 INFO:tasks.workunit.client.0.smithi162.stdout:3/804: symlink d2/d9/d99/l10b 0 2024-04-25T02:04:32.328 INFO:tasks.workunit.client.0.smithi162.stdout:3/805: read d2/d9/d19/f36 [1289635,80155] 0 2024-04-25T02:04:32.584 INFO:tasks.workunit.client.0.smithi162.stdout:8/792: fsync d0/d44/d64/d112/f54 0 2024-04-25T02:04:32.593 INFO:tasks.workunit.client.0.smithi162.stdout:3/806: dread d2/d29/f3c [0,4194304] 0 2024-04-25T02:04:32.920 INFO:tasks.workunit.client.0.smithi162.stdout:7/816: creat df/d2e/d4c/d58/dd3/dd8/def/f11d x:0 0 0 2024-04-25T02:04:33.083 INFO:tasks.workunit.client.0.smithi162.stdout:6/759: rename d1/d13/d28/d30/d8a/dab/fa0 to d1/d46/d7a/d85/ff5 0 2024-04-25T02:04:33.524 INFO:tasks.workunit.client.0.smithi162.stdout:2/769: unlink d0/d3/d1b/d6b/dc0/fb3 0 2024-04-25T02:04:33.703 INFO:tasks.workunit.client.0.smithi162.stdout:5/799: creat d15/d19/d24/d2b/d3b/d3c/f106 x:0 0 0 2024-04-25T02:04:35.245 INFO:tasks.workunit.client.0.smithi162.stdout:0/884: dwrite d0/fd [0,4194304] 0 2024-04-25T02:04:35.593 INFO:tasks.workunit.client.0.smithi162.stdout:7/817: symlink df/d2e/d111/l11e 0 2024-04-25T02:04:35.733 INFO:tasks.workunit.client.0.smithi162.stdout:8/793: mknod d0/d12/c113 0 2024-04-25T02:04:35.928 INFO:tasks.workunit.client.0.smithi162.stdout:3/807: mknod d2/d9/d94/c10c 0 2024-04-25T02:04:36.065 INFO:tasks.workunit.client.0.smithi162.stdout:9/742: link d4/lde d4/d9/d15/d1b/d2f/d30/dc1/d59/l106 0 2024-04-25T02:04:36.287 INFO:tasks.workunit.client.0.smithi162.stdout:7/818: truncate df/f7b 1074789 0 2024-04-25T02:04:36.363 INFO:tasks.workunit.client.0.smithi162.stdout:3/808: fdatasync d2/f65 0 2024-04-25T02:04:36.848 INFO:tasks.workunit.client.0.smithi162.stdout:4/809: dwrite dd/df/d77/fd2 [0,4194304] 0 2024-04-25T02:04:37.124 INFO:tasks.workunit.client.0.smithi162.stdout:6/760: mknod d1/d13/d28/cf6 0 2024-04-25T02:04:37.162 INFO:tasks.workunit.client.0.smithi162.stdout:2/770: link d0/d3/d1b/d6b/dc0/d67/d9c/fef d0/d3/d1b/d1d/f113 0 2024-04-25T02:04:37.175 INFO:tasks.workunit.client.0.smithi162.stdout:5/800: write d15/d19/d24/d2b/d3b/d58/fc6 [538245,55578] 0 2024-04-25T02:04:37.213 INFO:tasks.workunit.client.0.smithi162.stdout:0/885: creat d0/d59/d7e/d100/ded/f12e x:0 0 0 2024-04-25T02:04:37.369 INFO:tasks.workunit.client.0.smithi162.stdout:6/761: sync 2024-04-25T02:04:37.474 INFO:tasks.workunit.client.0.smithi162.stdout:8/794: mknod d0/dfe/c114 0 2024-04-25T02:04:37.498 INFO:tasks.workunit.client.0.smithi162.stdout:7/819: chown df/d2c/fb4 12212 1 2024-04-25T02:04:37.588 INFO:tasks.workunit.client.0.smithi162.stdout:9/743: fsync d4/d8/d85/fed 0 2024-04-25T02:04:37.933 INFO:tasks.workunit.client.0.smithi162.stdout:3/809: creat d2/d9/d10/d4c/d51/d63/d87/d90/f10d x:0 0 0 2024-04-25T02:04:38.488 INFO:tasks.workunit.client.0.smithi162.stdout:4/810: unlink dd/d1a/d4e/d93/fd1 0 2024-04-25T02:04:39.112 INFO:tasks.workunit.client.0.smithi162.stdout:0/886: mkdir d0/df/d20/d37/dfc/d11e/d12f 0 2024-04-25T02:04:39.191 INFO:tasks.workunit.client.0.smithi162.stdout:2/771: mknod d0/d3/d1b/d6b/dc0/d67/d9c/de8/c114 0 2024-04-25T02:04:39.396 INFO:tasks.workunit.client.0.smithi162.stdout:8/795: readlink d0/d12/d1b/d8d/le6 0 2024-04-25T02:04:39.458 INFO:tasks.workunit.client.0.smithi162.stdout:7/820: chown df/d2c/d49/ffd 117 1 2024-04-25T02:04:39.757 INFO:tasks.workunit.client.0.smithi162.stdout:9/744: creat d4/d9/d15/d1b/d2f/d30/dc1/d59/dec/f107 x:0 0 0 2024-04-25T02:04:40.119 INFO:tasks.workunit.client.0.smithi162.stdout:3/810: readlink d2/d9/l16 0 2024-04-25T02:04:40.306 INFO:tasks.workunit.client.0.smithi162.stdout:1/821: link d15/d1f/d23/d30/d4a/fd0 d15/d1f/f10a 0 2024-04-25T02:04:40.970 INFO:tasks.workunit.client.0.smithi162.stdout:8/796: mknod d0/d12/d2b/dc7/c115 0 2024-04-25T02:04:41.007 INFO:tasks.workunit.client.0.smithi162.stdout:8/797: chown d0/d44/d64/d112/f47 14021011 1 2024-04-25T02:04:41.397 INFO:tasks.workunit.client.0.smithi162.stdout:3/811: fsync d2/d9/d10/d2c/da3/db5/fd0 0 2024-04-25T02:04:41.459 INFO:tasks.workunit.client.0.smithi162.stdout:7/821: dread df/d2e/d4c/d8a/f62 [0,4194304] 0 2024-04-25T02:04:41.527 INFO:tasks.workunit.client.0.smithi162.stdout:7/822: chown df/d2c/d63/c65 2559926 1 2024-04-25T02:04:41.573 INFO:tasks.workunit.client.0.smithi162.stdout:4/811: mknod dd/d1a/d34/d9d/df8/c10e 0 2024-04-25T02:04:41.609 INFO:tasks.workunit.client.0.smithi162.stdout:4/812: chown dd/d1a/d34/d9d 316 1 2024-04-25T02:04:41.648 INFO:tasks.workunit.client.0.smithi162.stdout:4/813: read dd/df/d77/f96 [185665,15602] 0 2024-04-25T02:04:41.675 INFO:tasks.workunit.client.0.smithi162.stdout:4/814: readlink dd/d1a/d4e/lea 0 2024-04-25T02:04:42.160 INFO:tasks.workunit.client.0.smithi162.stdout:2/772: symlink d0/d3/d1b/d6b/dc0/d5e/d61/da4/dc3/l115 0 2024-04-25T02:04:42.167 INFO:tasks.workunit.client.0.smithi162.stdout:5/801: dwrite d15/d19/d24/d2b/d3b/f98 [0,4194304] 0 2024-04-25T02:04:42.332 INFO:tasks.workunit.client.0.smithi162.stdout:2/773: chown d0/d3/d1b/d6b/dc0/d5e/d61/da4/lc6 317471259 1 2024-04-25T02:04:42.695 INFO:tasks.workunit.client.0.smithi162.stdout:9/745: unlink d4/d9/d15/fe7 0 2024-04-25T02:04:43.013 INFO:tasks.workunit.client.0.smithi162.stdout:3/812: chown d2/d9/d10/d2c/da3/db5/caa 104877212 1 2024-04-25T02:04:43.104 INFO:tasks.workunit.client.0.smithi162.stdout:7/823: fdatasync df/f12 0 2024-04-25T02:04:43.222 INFO:tasks.workunit.client.0.smithi162.stdout:0/887: write d0/d1/d4e/d76/db0/f121 [1538386,61159] 0 2024-04-25T02:04:43.251 INFO:tasks.workunit.client.0.smithi162.stdout:7/824: sync 2024-04-25T02:04:43.596 INFO:tasks.workunit.client.0.smithi162.stdout:6/762: getdents d1/d13/d28/d7b/dbb 0 2024-04-25T02:04:43.823 INFO:tasks.workunit.client.0.smithi162.stdout:9/746: rename d4/d25/da3 to d4/d25/de5/d108 0 2024-04-25T02:04:44.233 INFO:tasks.workunit.client.0.smithi162.stdout:3/813: mknod d2/ddf/de7/c10e 0 2024-04-25T02:04:44.554 INFO:tasks.workunit.client.0.smithi162.stdout:0/888: creat d0/df/d20/d25/d55/f130 x:0 0 0 2024-04-25T02:04:44.638 INFO:tasks.workunit.client.0.smithi162.stdout:1/822: dwrite d15/d1f/d23/d30/f9c [0,4194304] 0 2024-04-25T02:04:44.737 INFO:tasks.workunit.client.0.smithi162.stdout:7/825: truncate df/d2c/d49/d5d/f60 1613798 0 2024-04-25T02:04:45.421 INFO:tasks.workunit.client.0.smithi162.stdout:9/747: mknod d4/d9/d15/d1b/d2f/d30/dc1/c109 0 2024-04-25T02:04:45.483 INFO:tasks.workunit.client.0.smithi162.stdout:9/748: readlink d4/d9/la8 0 2024-04-25T02:04:45.487 INFO:tasks.workunit.client.0.smithi162.stdout:8/798: dwrite d0/d12/d2b/d87/fb2 [0,4194304] 0 2024-04-25T02:04:45.638 INFO:tasks.workunit.client.0.smithi162.stdout:4/815: creat dd/df/f10f x:0 0 0 2024-04-25T02:04:45.844 INFO:tasks.workunit.client.0.smithi162.stdout:1/823: mknod d15/d1f/d23/d30/d4a/d7f/d97/dbe/c10b 0 2024-04-25T02:04:45.954 INFO:tasks.workunit.client.0.smithi162.stdout:7/826: fdatasync df/d2c/d63/d83/d8b/f9f 0 2024-04-25T02:04:46.073 INFO:tasks.workunit.client.0.smithi162.stdout:5/802: dwrite d15/d1e/f8a [4194304,4194304] 0 2024-04-25T02:04:46.564 INFO:tasks.workunit.client.0.smithi162.stdout:4/816: mkdir dd/df/d2e/de8/d110 0 2024-04-25T02:04:46.951 INFO:tasks.workunit.client.0.smithi162.stdout:9/749: fdatasync d4/d9/d15/d1b/d2f/d30/dc1/d9f/dd1/dee/ff5 0 2024-04-25T02:04:47.282 INFO:tasks.workunit.client.0.smithi162.stdout:7/827: dread - df/d2c/f3b zero size 2024-04-25T02:04:47.532 INFO:tasks.workunit.client.0.smithi162.stdout:2/774: getdents d0/d3/d1b/d6b/dc0/d5e/d61 0 2024-04-25T02:04:47.883 INFO:tasks.workunit.client.0.smithi162.stdout:0/889: link d0/d1/d4e/fac d0/df/d20/d25/dce/f131 0 2024-04-25T02:04:48.196 INFO:tasks.workunit.client.0.smithi162.stdout:1/824: mknod d15/c10c 0 2024-04-25T02:04:48.464 INFO:tasks.workunit.client.0.smithi162.stdout:9/750: chown d4/d9/d15/d1b/d2f/d30/dc1/d9f/dd1/ddc/ldd 36024379 1 2024-04-25T02:04:48.545 INFO:tasks.workunit.client.0.smithi162.stdout:3/814: dwrite d2/d9/d10/d2c/da3/fc8 [0,4194304] 0 2024-04-25T02:04:48.752 INFO:tasks.workunit.client.0.smithi162.stdout:3/815: read d2/d9/d10/d4c/d51/d63/d87/d86/fa2 [4803216,119734] 0 2024-04-25T02:04:49.027 INFO:tasks.workunit.client.0.smithi162.stdout:0/890: creat d0/df/d20/d25/d55/d6f/f132 x:0 0 0 2024-04-25T02:04:49.166 INFO:tasks.workunit.client.0.smithi162.stdout:3/816: dread d2/d9/d10/d2c/da3/db5/fd0 [0,4194304] 0 2024-04-25T02:04:49.525 INFO:tasks.workunit.client.0.smithi162.stdout:9/751: creat d4/d8/d13/dbf/f10a x:0 0 0 2024-04-25T02:04:49.620 INFO:tasks.workunit.client.0.smithi162.stdout:3/817: stat d2/d9/d10/d4c/d51/d63/d87/d86/fa4 0 2024-04-25T02:04:49.714 INFO:tasks.workunit.client.0.smithi162.stdout:6/763: dwrite d1/d13/d28/d30/d66/f9b [0,4194304] 0 2024-04-25T02:04:49.894 INFO:tasks.workunit.client.0.smithi162.stdout:8/799: dwrite d0/fef [0,4194304] 0 2024-04-25T02:04:49.923 INFO:tasks.workunit.client.0.smithi162.stdout:5/803: creat d15/d19/d24/d2b/d3b/f107 x:0 0 0 2024-04-25T02:04:50.714 INFO:tasks.workunit.client.0.smithi162.stdout:2/775: link d0/d3/d1b/d1d/d3a/d63/dba/ccf d0/d3/d5/d36/d93/dbd/c116 0 2024-04-25T02:04:50.956 INFO:tasks.workunit.client.0.smithi162.stdout:9/752: rmdir d4/d9/d15/d1b/d2f/d30/dc1/d59/dec 39 2024-04-25T02:04:51.416 INFO:tasks.workunit.client.0.smithi162.stdout:0/891: creat d0/df/d20/d25/d55/d6f/d7d/d122/f133 x:0 0 0 2024-04-25T02:04:51.487 INFO:tasks.workunit.client.0.smithi162.stdout:4/817: write dd/df/f49 [2003667,43480] 0 2024-04-25T02:04:51.611 INFO:tasks.workunit.client.0.smithi162.stdout:7/828: dwrite df/d2e/fcc [0,4194304] 0 2024-04-25T02:04:51.759 INFO:tasks.workunit.client.0.smithi162.stdout:6/764: mkdir d1/d46/df7 0 2024-04-25T02:04:52.105 INFO:tasks.workunit.client.0.smithi162.stdout:9/753: truncate d4/dc0/fcb 801397 0 2024-04-25T02:04:52.705 INFO:tasks.workunit.client.0.smithi162.stdout:1/825: link d15/d1f/d35/d4c/l8b d15/d69/d4f/dad/l10d 0 2024-04-25T02:04:52.811 INFO:tasks.workunit.client.0.smithi162.stdout:7/829: chown df/d2e/d4c/d58/d93/l115 416268 1 2024-04-25T02:04:52.850 INFO:tasks.workunit.client.0.smithi162.stdout:7/830: read df/f13 [25240,60759] 0 2024-04-25T02:04:52.939 INFO:tasks.workunit.client.0.smithi162.stdout:6/765: creat d1/d13/d28/d30/d3a/dbc/ff8 x:0 0 0 2024-04-25T02:04:53.089 INFO:tasks.workunit.client.0.smithi162.stdout:0/892: truncate d0/df/d20/d37/dfc/f108 416912 0 2024-04-25T02:04:53.189 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:04:53.192 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:04:53.515 INFO:tasks.workunit.client.0.smithi162.stdout:3/818: creat d2/d9/d10/d4c/d51/d63/d87/d90/db3/f10f x:0 0 0 2024-04-25T02:04:53.781 INFO:tasks.workunit.client.0.smithi162.stdout:1/826: symlink d15/d1f/d35/d5c/l10e 0 2024-04-25T02:04:53.816 INFO:tasks.workunit.client.0.smithi162.stdout:1/827: chown d15/d1f/d23/d30/cca 1039 1 2024-04-25T02:04:54.057 INFO:tasks.workunit.client.0.smithi162.stdout:7/831: rename df/d2e/d4c/d58/d93/lc8 to df/d2e/d4c/d8a/db2/l11f 0 2024-04-25T02:04:54.109 INFO:tasks.workunit.client.0.smithi162.stdout:8/800: dwrite d0/f9f [0,4194304] 0 2024-04-25T02:04:54.246 INFO:tasks.workunit.client.0.smithi162.stdout:7/832: chown df/d2e/f11c 56 1 2024-04-25T02:04:54.277 INFO:tasks.workunit.client.0.smithi162.stdout:0/893: mknod d0/df/d20/d25/d55/c134 0 2024-04-25T02:04:54.326 INFO:tasks.workunit.client.0.smithi162.stdout:7/833: dread - df/d2c/d63/d83/d8b/d90/f97 zero size 2024-04-25T02:04:54.545 INFO:tasks.workunit.client.0.smithi162.stdout:8/801: creat d0/d44/d91/f116 x:0 0 0 2024-04-25T02:04:54.599 INFO:tasks.workunit.client.0.smithi162.stdout:3/819: read d2/d9/d19/d3f/f79 [694227,61413] 0 2024-04-25T02:04:54.849 INFO:tasks.workunit.client.0.smithi162.stdout:7/834: fsync df/d2c/d49/d7a/f7d 0 2024-04-25T02:04:55.279 INFO:tasks.workunit.client.0.smithi162.stdout:5/804: creat d15/d19/d24/d2b/d3b/f108 x:0 0 0 2024-04-25T02:04:55.297 INFO:tasks.workunit.client.0.smithi162.stdout:4/818: write dd/f3a [4027245,65818] 0 2024-04-25T02:04:55.412 INFO:tasks.workunit.client.0.smithi162.stdout:9/754: write d4/d9/fc9 [1812408,112821] 0 2024-04-25T02:04:55.578 INFO:tasks.workunit.client.0.smithi162.stdout:0/894: fsync d0/df/d20/d37/d81/fa8 0 2024-04-25T02:04:55.631 INFO:tasks.workunit.client.0.smithi162.stdout:2/776: dwrite d0/fa9 [0,4194304] 0 2024-04-25T02:04:55.737 INFO:tasks.workunit.client.0.smithi162.stdout:3/820: truncate d2/d9/d10/d4c/d51/f7e 1162476 0 2024-04-25T02:04:55.860 INFO:tasks.workunit.client.0.smithi162.stdout:0/895: sync 2024-04-25T02:04:56.266 INFO:tasks.workunit.client.0.smithi162.stdout:6/766: dwrite d1/d46/d7a/d85/fa3 [0,4194304] 0 2024-04-25T02:04:56.393 INFO:tasks.workunit.client.0.smithi162.stdout:6/767: dread - d1/d13/d28/d7b/dbb/fe6 zero size 2024-04-25T02:04:56.543 INFO:tasks.workunit.client.0.smithi162.stdout:1/828: creat d15/d1f/d35/d4c/f10f x:0 0 0 2024-04-25T02:04:56.594 INFO:tasks.workunit.client.0.smithi162.stdout:1/829: stat d15/d1f/d23/d30/d4a/d7f/d97/dbe/c10b 0 2024-04-25T02:04:57.119 INFO:tasks.workunit.client.0.smithi162.stdout:3/821: mkdir d2/d9/d10/d4c/d51/d63/d87/d110 0 2024-04-25T02:04:57.560 INFO:tasks.workunit.client.0.smithi162.stdout:2/777: truncate d0/d3/d1b/d1d/d3a/d63/f79 976112 0 2024-04-25T02:04:57.585 INFO:tasks.workunit.client.0.smithi162.stdout:0/896: symlink d0/d59/d7e/d100/l135 0 2024-04-25T02:04:57.733 INFO:tasks.workunit.client.0.smithi162.stdout:6/768: rmdir d1/d13/d28/d30/d3a/dbc 39 2024-04-25T02:04:57.747 INFO:tasks.workunit.client.0.smithi162.stdout:6/769: chown d1/d46 6481 1 2024-04-25T02:04:57.919 INFO:tasks.workunit.client.0.smithi162.stdout:1/830: mkdir d15/d1f/d35/d4c/d70/d110 0 2024-04-25T02:04:58.151 INFO:tasks.workunit.client.0.smithi162.stdout:4/819: truncate dd/d1a/d34/db1/dba/dfd/db8/f109 891514 0 2024-04-25T02:04:58.290 INFO:tasks.workunit.client.0.smithi162.stdout:3/822: mknod d2/d9/d48/c111 0 2024-04-25T02:04:58.343 INFO:tasks.workunit.client.0.smithi162.stdout:4/820: chown dd/f3a 26078 1 2024-04-25T02:04:58.523 INFO:tasks.workunit.client.0.smithi162.stdout:8/802: dwrite d0/d12/d1b/d74/d8a/da3/fce [0,4194304] 0 2024-04-25T02:04:58.979 INFO:tasks.workunit.client.0.smithi162.stdout:7/835: creat df/f120 x:0 0 0 2024-04-25T02:04:58.988 INFO:tasks.workunit.client.0.smithi162.stdout:0/897: readlink d0/d59/l6b 0 2024-04-25T02:04:59.010 INFO:tasks.workunit.client.0.smithi162.stdout:2/778: rmdir d0/d3/d1b/d1d/d3a 39 2024-04-25T02:04:59.780 INFO:tasks.workunit.client.0.smithi162.stdout:5/805: dwrite d15/d19/d24/d2b/d3b/f98 [0,4194304] 0 2024-04-25T02:04:59.983 INFO:tasks.workunit.client.0.smithi162.stdout:4/821: dread dd/df/d2e/f3d [0,4194304] 0 2024-04-25T02:05:00.570 INFO:tasks.workunit.client.0.smithi162.stdout:7/836: dwrite df/d2e/fcc [0,4194304] 0 2024-04-25T02:05:00.773 INFO:tasks.workunit.client.0.smithi162.stdout:6/770: mknod d1/d13/d28/df1/cf9 0 2024-04-25T02:05:01.236 INFO:tasks.workunit.client.0.smithi162.stdout:3/823: symlink d2/d9/d10/d4c/d51/d63/d87/d90/db3/dcd/l112 0 2024-04-25T02:05:01.502 INFO:tasks.workunit.client.0.smithi162.stdout:3/824: sync 2024-04-25T02:05:01.806 INFO:tasks.workunit.client.0.smithi162.stdout:1/831: write d15/d1f/d35/d4c/d70/d73/db8/fc9 [490425,11800] 0 2024-04-25T02:05:02.146 INFO:tasks.workunit.client.0.smithi162.stdout:7/837: dread - df/d2e/d4c/de8/f102 zero size 2024-04-25T02:05:02.486 INFO:tasks.workunit.client.0.smithi162.stdout:8/803: write d0/d1a/fae [1579663,73668] 0 2024-04-25T02:05:02.784 INFO:tasks.workunit.client.0.smithi162.stdout:9/755: creat d4/f10b x:0 0 0 2024-04-25T02:05:02.788 INFO:tasks.workunit.client.0.smithi162.stdout:0/898: write d0/df/f39 [1850183,30901] 0 2024-04-25T02:05:03.058 INFO:tasks.workunit.client.0.smithi162.stdout:2/779: dwrite d0/f89 [0,4194304] 0 2024-04-25T02:05:03.173 INFO:tasks.workunit.client.0.smithi162.stdout:3/825: symlink d2/d29/l113 0 2024-04-25T02:05:03.273 INFO:tasks.workunit.client.0.smithi162.stdout:7/838: creat df/d2e/d111/f121 x:0 0 0 2024-04-25T02:05:03.401 INFO:tasks.workunit.client.0.smithi162.stdout:3/826: sync 2024-04-25T02:05:03.490 INFO:tasks.workunit.client.0.smithi162.stdout:1/832: dread d15/d1f/d35/d4c/d70/f7e [0,4194304] 0 2024-04-25T02:05:03.544 INFO:tasks.workunit.client.0.smithi162.stdout:8/804: dread d0/d86/dd0/ffd [0,4194304] 0 2024-04-25T02:05:03.566 INFO:tasks.workunit.client.0.smithi162.stdout:0/899: truncate d0/df/d20/d25/dce/f126 213155 0 2024-04-25T02:05:03.922 INFO:tasks.workunit.client.0.smithi162.stdout:4/822: write dd/d1a/d4e/f7f [850676,126157] 0 2024-04-25T02:05:03.991 INFO:tasks.workunit.client.0.smithi162.stdout:3/827: read d2/d9/d10/d4c/f74 [113351,78763] 0 2024-04-25T02:05:04.077 INFO:tasks.workunit.client.0.smithi162.stdout:1/833: rmdir d15/d1f/d35/d4c/d70/d73/df5 39 2024-04-25T02:05:04.237 INFO:tasks.workunit.client.0.smithi162.stdout:5/806: dwrite d15/d19/d24/d2b/fa0 [0,4194304] 0 2024-04-25T02:05:04.491 INFO:tasks.workunit.client.0.smithi162.stdout:7/839: mkdir df/d2e/d4c/d58/dd3/dd0/d122 0 2024-04-25T02:05:04.603 INFO:tasks.workunit.client.0.smithi162.stdout:2/780: truncate d0/f8d 4051957 0 2024-04-25T02:05:04.702 INFO:tasks.workunit.client.0.smithi162.stdout:8/805: dread d0/fa2 [0,4194304] 0 2024-04-25T02:05:04.744 INFO:tasks.workunit.client.0.smithi162.stdout:5/807: chown d15/d19/d24/d2b/d3b/d58/daf/dc8 0 1 2024-04-25T02:05:04.967 INFO:tasks.workunit.client.0.smithi162.stdout:5/808: sync 2024-04-25T02:05:05.031 INFO:tasks.workunit.client.0.smithi162.stdout:5/809: chown d15/d19/d24/d4d/d7c/d85/de7/d7a/d7e/d101/f102 50088969 1 2024-04-25T02:05:05.125 INFO:tasks.workunit.client.0.smithi162.stdout:4/823: mkdir dd/d1a/d34/d72/def/d111 0 2024-04-25T02:05:05.156 INFO:tasks.workunit.client.0.smithi162.stdout:6/771: write d1/d13/d28/f2f [2560217,47685] 0 2024-04-25T02:05:05.422 INFO:tasks.workunit.client.0.smithi162.stdout:7/840: symlink df/d2e/d111/l123 0 2024-04-25T02:05:05.437 INFO:tasks.workunit.client.0.smithi162.stdout:7/841: readlink df/l27 0 2024-04-25T02:05:05.519 INFO:tasks.workunit.client.0.smithi162.stdout:7/842: stat df/d2c/d63/d83/d8b/le3 0 2024-04-25T02:05:05.640 INFO:tasks.workunit.client.0.smithi162.stdout:2/781: symlink d0/d3/d1b/d6b/dc0/d5e/db8/l117 0 2024-04-25T02:05:05.805 INFO:tasks.workunit.client.0.smithi162.stdout:8/806: truncate d0/d12/d1b/d74/d8a/fa7 12519 0 2024-04-25T02:05:06.116 INFO:tasks.workunit.client.0.smithi162.stdout:1/834: truncate d15/d1f/f10a 1111676 0 2024-04-25T02:05:06.195 INFO:tasks.workunit.client.0.smithi162.stdout:4/824: truncate dd/df/d2e/fad 2071524 0 2024-04-25T02:05:06.476 INFO:tasks.workunit.client.0.smithi162.stdout:7/843: fsync df/d2c/d63/d83/d8b/fe9 0 2024-04-25T02:05:06.706 INFO:tasks.workunit.client.0.smithi162.stdout:8/807: truncate d0/d1a/f3d 337506 0 2024-04-25T02:05:06.866 INFO:tasks.workunit.client.0.smithi162.stdout:2/782: dread d0/d3/d1b/d6b/d92/fd4 [0,4194304] 0 2024-04-25T02:05:06.989 INFO:tasks.workunit.client.0.smithi162.stdout:9/756: dwrite d4/d25/f6e [4194304,4194304] 0 2024-04-25T02:05:07.131 INFO:tasks.workunit.client.0.smithi162.stdout:4/825: creat dd/d1a/d34/d57/f112 x:0 0 0 2024-04-25T02:05:07.239 INFO:tasks.workunit.client.0.smithi162.stdout:7/844: fsync df/d2c/d49/d7a/db5/ff9 0 2024-04-25T02:05:07.603 INFO:tasks.workunit.client.0.smithi162.stdout:5/810: rmdir d15/d19/d24/d2b/d3b/d58/daf/d100 0 2024-04-25T02:05:08.024 INFO:tasks.workunit.client.0.smithi162.stdout:3/828: dwrite d2/f8e [4194304,4194304] 0 2024-04-25T02:05:08.140 INFO:tasks.workunit.client.0.smithi162.stdout:9/757: creat d4/d9/f10c x:0 0 0 2024-04-25T02:05:08.748 INFO:tasks.workunit.client.0.smithi162.stdout:0/900: dwrite d0/d59/d7e/d100/ffd [0,4194304] 0 2024-04-25T02:05:08.869 INFO:tasks.workunit.client.0.smithi162.stdout:5/811: symlink d15/d19/d24/d4d/d7c/d85/dde/de5/l109 0 2024-04-25T02:05:09.071 INFO:tasks.workunit.client.0.smithi162.stdout:6/772: getdents d1 0 2024-04-25T02:05:09.343 INFO:tasks.workunit.client.0.smithi162.stdout:3/829: creat d2/d9/d10/d4c/d51/f114 x:0 0 0 2024-04-25T02:05:09.719 INFO:tasks.workunit.client.0.smithi162.stdout:1/835: write d15/d1f/d23/d30/d4a/d7f/d97/dbe/fdc [598513,36869] 0 2024-04-25T02:05:10.230 INFO:tasks.workunit.client.0.smithi162.stdout:0/901: creat d0/df/d20/d37/d81/d92/f136 x:0 0 0 2024-04-25T02:05:10.278 INFO:tasks.workunit.client.0.smithi162.stdout:0/902: dread - d0/df/d20/d37/d81/d92/ffa zero size 2024-04-25T02:05:10.433 INFO:tasks.workunit.client.0.smithi162.stdout:5/812: rename d15/d19/d24/d40 to d15/d19/d24/d4d/d7c/de2/d10a 0 2024-04-25T02:05:10.964 INFO:tasks.workunit.client.0.smithi162.stdout:8/808: creat d0/d12/d1b/d74/d8a/f117 x:0 0 0 2024-04-25T02:05:10.990 INFO:tasks.workunit.client.0.smithi162.stdout:8/809: stat d0/db1/d101/f102 0 2024-04-25T02:05:11.304 INFO:tasks.workunit.client.0.smithi162.stdout:2/783: write d0/d3/d1b/d6b/dc0/d67/fd5 [4949952,4295] 0 2024-04-25T02:05:11.702 INFO:tasks.workunit.client.0.smithi162.stdout:7/845: link df/d2c/d63/d83/d8b/le3 df/d2c/d49/d7a/db5/l124 0 2024-04-25T02:05:11.753 INFO:tasks.workunit.client.0.smithi162.stdout:7/846: stat df/d2e/d4c/d58/dd3/dd0 0 2024-04-25T02:05:11.881 INFO:tasks.workunit.client.0.smithi162.stdout:0/903: symlink d0/df/d20/d25/d55/d6f/l137 0 2024-04-25T02:05:12.177 INFO:tasks.workunit.client.0.smithi162.stdout:5/813: rmdir d15/d19/d24/d4d/d7c/d85/dde/de5 39 2024-04-25T02:05:12.617 INFO:tasks.workunit.client.0.smithi162.stdout:6/773: symlink d1/d13/d28/d30/dca/lfa 0 2024-04-25T02:05:13.020 INFO:tasks.workunit.client.0.smithi162.stdout:2/784: dread - d0/d3/d1b/d6b/dc0/d67/d9c/ff8 zero size 2024-04-25T02:05:13.208 INFO:tasks.workunit.client.0.smithi162.stdout:1/836: mknod d15/d1f/d23/d30/c111 0 2024-04-25T02:05:13.257 INFO:tasks.workunit.client.0.smithi162.stdout:4/826: dwrite dd/d1a/d34/d57/fc6 [4194304,4194304] 0 2024-04-25T02:05:13.420 INFO:tasks.workunit.client.0.smithi162.stdout:7/847: fdatasync df/d2e/fcc 0 2024-04-25T02:05:13.894 INFO:tasks.workunit.client.0.smithi162.stdout:0/904: dread d0/d1/d4e/f86 [0,4194304] 0 2024-04-25T02:05:14.068 INFO:tasks.workunit.client.0.smithi162.stdout:6/774: mkdir d1/d13/d28/d30/d8a/dc3/dfb 0 2024-04-25T02:05:14.769 INFO:tasks.workunit.client.0.smithi162.stdout:9/758: getdents d4/d9/d15/d1b 0 2024-04-25T02:05:15.223 INFO:tasks.workunit.client.0.smithi162.stdout:1/837: mkdir d15/d1f/d35/d4c/d70/d73/db8/df4/d112 0 2024-04-25T02:05:15.262 INFO:tasks.workunit.client.0.smithi162.stdout:7/848: mknod df/d2e/d4c/d8a/db2/df0/d10a/c125 0 2024-04-25T02:05:15.762 INFO:tasks.workunit.client.0.smithi162.stdout:3/830: getdents d2/d9/d94 0 2024-04-25T02:05:15.813 INFO:tasks.workunit.client.0.smithi162.stdout:6/775: dread d1/d13/d28/d30/d8a/fe5 [0,4194304] 0 2024-04-25T02:05:16.376 INFO:tasks.workunit.client.0.smithi162.stdout:9/759: creat d4/d9/da9/f10d x:0 0 0 2024-04-25T02:05:16.501 INFO:tasks.workunit.client.0.smithi162.stdout:8/810: write d0/d44/d91/f116 [629245,24109] 0 2024-04-25T02:05:16.833 INFO:tasks.workunit.client.0.smithi162.stdout:1/838: mknod d15/d1f/d35/d4c/d70/d73/db8/c113 0 2024-04-25T02:05:16.848 INFO:tasks.workunit.client.0.smithi162.stdout:7/849: rename df/d2e/d4c/d8a/f80 to df/d2c/d63/d83/ddc/f126 0 2024-04-25T02:05:17.303 INFO:tasks.workunit.client.0.smithi162.stdout:6/776: mknod d1/d13/d28/d45/cfc 0 2024-04-25T02:05:17.310 INFO:tasks.workunit.client.0.smithi162.stdout:5/814: write d15/d19/d24/d4d/d7c/d85/dde/fe9 [833339,20871] 0 2024-04-25T02:05:17.395 INFO:tasks.workunit.client.0.smithi162.stdout:3/831: truncate d2/d9/fbd 1076772 0 2024-04-25T02:05:17.893 INFO:tasks.workunit.client.0.smithi162.stdout:7/850: stat df/d2e/d4c/d8a/fc2 0 2024-04-25T02:05:18.020 INFO:tasks.workunit.client.0.smithi162.stdout:1/839: creat d15/d1f/d23/f114 x:0 0 0 2024-04-25T02:05:18.422 INFO:tasks.workunit.client.0.smithi162.stdout:9/760: mknod d4/d8/d13/c10e 0 2024-04-25T02:05:18.449 INFO:tasks.workunit.client.0.smithi162.stdout:3/832: dread d2/d9/f66 [0,4194304] 0 2024-04-25T02:05:18.915 INFO:tasks.workunit.client.0.smithi162.stdout:7/851: read df/f33 [1817527,44457] 0 2024-04-25T02:05:18.995 INFO:tasks.workunit.client.0.smithi162.stdout:4/827: write dd/df/d2e/fb5 [4410715,12690] 0 2024-04-25T02:05:19.293 INFO:tasks.workunit.client.0.smithi162.stdout:2/785: dwrite d0/d3/d1b/d6b/dc0/d5e/fc9 [0,4194304] 0 2024-04-25T02:05:19.296 INFO:tasks.workunit.client.0.smithi162.stdout:7/852: chown df/d2c/d63/d83/ddc/fea 321 1 2024-04-25T02:05:19.503 INFO:tasks.workunit.client.0.smithi162.stdout:3/833: fdatasync d2/f71 0 2024-04-25T02:05:19.683 INFO:tasks.workunit.client.0.smithi162.stdout:0/905: write d0/df/f96 [3125635,31012] 0 2024-04-25T02:05:20.017 INFO:tasks.workunit.client.0.smithi162.stdout:6/777: mknod d1/d13/d28/d30/d3a/dbc/def/cfd 0 2024-04-25T02:05:20.175 INFO:tasks.workunit.client.0.smithi162.stdout:4/828: unlink dd/d1a/l5b 0 2024-04-25T02:05:20.326 INFO:tasks.workunit.client.0.smithi162.stdout:9/761: unlink d4/d9/cbc 0 2024-04-25T02:05:20.623 INFO:tasks.workunit.client.0.smithi162.stdout:2/786: symlink d0/d3/d5/d36/d93/l118 0 2024-04-25T02:05:20.629 INFO:tasks.workunit.client.0.smithi162.stdout:7/853: dread - df/d2e/d4c/d58/d82/f91 zero size 2024-04-25T02:05:20.677 INFO:tasks.workunit.client.0.smithi162.stdout:8/811: link d0/d12/d2b/dc7/le9 d0/d12/d1b/l118 0 2024-04-25T02:05:21.391 INFO:tasks.workunit.client.0.smithi162.stdout:9/762: fsync d4/d9/fa 0 2024-04-25T02:05:21.513 INFO:tasks.workunit.client.0.smithi162.stdout:4/829: dread fc [0,4194304] 0 2024-04-25T02:05:21.580 INFO:tasks.workunit.client.0.smithi162.stdout:2/787: creat d0/d3/d1b/d6b/d92/f119 x:0 0 0 2024-04-25T02:05:21.606 INFO:tasks.workunit.client.0.smithi162.stdout:4/830: chown dd/df/d2e/f3d 389127858 1 2024-04-25T02:05:22.131 INFO:tasks.workunit.client.0.smithi162.stdout:9/763: read d4/d8/d13/d38/f5e [2312647,25454] 0 2024-04-25T02:05:22.405 INFO:tasks.workunit.client.0.smithi162.stdout:4/831: dread f5 [0,4194304] 0 2024-04-25T02:05:22.432 INFO:tasks.workunit.client.0.smithi162.stdout:2/788: rename d0/d3/d1b/d6b/dc0/d5e/d61/da4/dc3 to d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/d11a 0 2024-04-25T02:05:22.866 INFO:tasks.workunit.client.0.smithi162.stdout:5/815: creat d15/d19/d24/f10b x:0 0 0 2024-04-25T02:05:22.882 INFO:tasks.workunit.client.0.smithi162.stdout:9/764: creat d4/d8/d13/d38/f10f x:0 0 0 2024-04-25T02:05:22.963 INFO:tasks.workunit.client.0.smithi162.stdout:5/816: chown d15/d19/f1b 411 1 2024-04-25T02:05:22.995 INFO:tasks.workunit.client.0.smithi162.stdout:4/832: mknod dd/df/d58/c113 0 2024-04-25T02:05:23.045 INFO:tasks.workunit.client.0.smithi162.stdout:1/840: write d15/d1f/d35/d4c/d70/d9f/dea/fee [65732,61238] 0 2024-04-25T02:05:23.105 INFO:tasks.workunit.client.0.smithi162.stdout:4/833: chown dd/df/d2e/d4b/fbd 296368 1 2024-04-25T02:05:23.134 INFO:tasks.workunit.client.0.smithi162.stdout:1/841: readlink d15/d1f/d23/d30/l9a 0 2024-04-25T02:05:23.197 INFO:tasks.workunit.client.0.smithi162.stdout:1/842: dread - d15/d1f/d35/fd4 zero size 2024-04-25T02:05:23.334 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:05:23.338 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:05:23.425 INFO:tasks.workunit.client.0.smithi162.stdout:2/789: symlink d0/d3/d1b/l11b 0 2024-04-25T02:05:24.026 INFO:tasks.workunit.client.0.smithi162.stdout:2/790: mkdir d0/d3/d5/d36/d93/dbd/d11c 0 2024-04-25T02:05:24.160 INFO:tasks.workunit.client.0.smithi162.stdout:4/834: mkdir dd/d1a/d34/d72/def/d107/d114 0 2024-04-25T02:05:24.195 INFO:tasks.workunit.client.0.smithi162.stdout:4/835: chown dd/df/d2e/l4f 2 1 2024-04-25T02:05:24.350 INFO:tasks.workunit.client.0.smithi162.stdout:5/817: link d15/d19/d24/f2d d15/d19/d24/dca/f10c 0 2024-04-25T02:05:25.069 INFO:tasks.workunit.client.0.smithi162.stdout:3/834: write d2/d9/d10/d4c/f7c [1771991,105535] 0 2024-04-25T02:05:25.129 INFO:tasks.workunit.client.0.smithi162.stdout:8/812: write d0/d44/d31/f4a [230284,76706] 0 2024-04-25T02:05:25.772 INFO:tasks.workunit.client.0.smithi162.stdout:6/778: dwrite d1/d13/d28/d30/f69 [0,4194304] 0 2024-04-25T02:05:25.838 INFO:tasks.workunit.client.0.smithi162.stdout:0/906: dwrite d0/d1/d6a/f72 [0,4194304] 0 2024-04-25T02:05:26.053 INFO:tasks.workunit.client.0.smithi162.stdout:7/854: dwrite df/d2e/d4c/d58/f112 [0,4194304] 0 2024-04-25T02:05:26.068 INFO:tasks.workunit.client.0.smithi162.stdout:3/835: unlink d2/d29/d5d/c6f 0 2024-04-25T02:05:26.206 INFO:tasks.workunit.client.0.smithi162.stdout:1/843: write d15/d1f/d35/d4c/d8e/f101 [705515,39930] 0 2024-04-25T02:05:26.278 INFO:tasks.workunit.client.0.smithi162.stdout:2/791: write d0/d3/d1b/d6b/dc0/d42/fd2 [32366,52061] 0 2024-04-25T02:05:26.473 INFO:tasks.workunit.client.0.smithi162.stdout:7/855: stat df/d2e/fb8 0 2024-04-25T02:05:26.731 INFO:tasks.workunit.client.0.smithi162.stdout:2/792: stat d0/d3/d7a/d88 0 2024-04-25T02:05:27.164 INFO:tasks.workunit.client.0.smithi162.stdout:2/793: chown d0/f5c 5 1 2024-04-25T02:05:27.262 INFO:tasks.workunit.client.0.smithi162.stdout:5/818: dwrite d15/d19/d24/d4d/d7c/de2/d10a/f74 [4194304,4194304] 0 2024-04-25T02:05:27.401 INFO:tasks.workunit.client.0.smithi162.stdout:4/836: getdents dd/d1a/d34/d9d/df8 0 2024-04-25T02:05:27.408 INFO:tasks.workunit.client.0.smithi162.stdout:8/813: link d0/d12/d3a/f7f d0/d44/d64/f119 0 2024-04-25T02:05:27.419 INFO:tasks.workunit.client.0.smithi162.stdout:9/765: dwrite d4/d9/da9/ff3 [0,4194304] 0 2024-04-25T02:05:27.453 INFO:tasks.workunit.client.0.smithi162.stdout:6/779: dread d1/d5c/f5f [0,4194304] 0 2024-04-25T02:05:27.578 INFO:tasks.workunit.client.0.smithi162.stdout:1/844: unlink d15/d1f/d35/d4c/d8e/f90 0 2024-04-25T02:05:27.644 INFO:tasks.workunit.client.0.smithi162.stdout:7/856: rmdir df/d2c/d49/d7a/dbf 39 2024-04-25T02:05:27.736 INFO:tasks.workunit.client.0.smithi162.stdout:1/845: stat d15/d1f/d23/f51 0 2024-04-25T02:05:27.745 INFO:tasks.workunit.client.0.smithi162.stdout:4/837: chown dd/df/d58/f66 30729184 1 2024-04-25T02:05:27.943 INFO:tasks.workunit.client.0.smithi162.stdout:1/846: chown d15/d1f/d35/d4c/d70/d9f/dea/cfa 32679 1 2024-04-25T02:05:27.982 INFO:tasks.workunit.client.0.smithi162.stdout:2/794: dread d0/d3/d1b/d6b/dc0/d5e/d61/fb5 [0,4194304] 0 2024-04-25T02:05:28.103 INFO:tasks.workunit.client.0.smithi162.stdout:7/857: chown df/d2c/ca3 934151 1 2024-04-25T02:05:28.200 INFO:tasks.workunit.client.0.smithi162.stdout:5/819: creat d15/d19/d24/d4d/d7c/de2/f10d x:0 0 0 2024-04-25T02:05:28.315 INFO:tasks.workunit.client.0.smithi162.stdout:6/780: mknod d1/d13/d28/d7b/dbb/cfe 0 2024-04-25T02:05:28.323 INFO:tasks.workunit.client.0.smithi162.stdout:9/766: fsync d4/d9/d15/d1b/d2f/d30/f9d 0 2024-04-25T02:05:28.484 INFO:tasks.workunit.client.0.smithi162.stdout:1/847: truncate d15/f1a 1486748 0 2024-04-25T02:05:29.016 INFO:tasks.workunit.client.0.smithi162.stdout:0/907: write d0/df/d20/d25/d55/d6f/d7d/f124 [523080,15520] 0 2024-04-25T02:05:29.151 INFO:tasks.workunit.client.0.smithi162.stdout:5/820: symlink d15/d19/d24/d4d/d9d/l10e 0 2024-04-25T02:05:29.286 INFO:tasks.workunit.client.0.smithi162.stdout:3/836: dwrite d2/d9/d99/f75 [0,4194304] 0 2024-04-25T02:05:29.635 INFO:tasks.workunit.client.0.smithi162.stdout:3/837: stat d2/d9/d10/d4c/d51/d63/d87/d90/db3/dcd 0 2024-04-25T02:05:29.785 INFO:tasks.workunit.client.0.smithi162.stdout:1/848: fsync d15/d69/d4f/dad/fe5 0 2024-04-25T02:05:29.889 INFO:tasks.workunit.client.0.smithi162.stdout:1/849: stat d15/d69/f75 0 2024-04-25T02:05:29.892 INFO:tasks.workunit.client.0.smithi162.stdout:6/781: dread d1/d13/d28/f29 [0,4194304] 0 2024-04-25T02:05:30.015 INFO:tasks.workunit.client.0.smithi162.stdout:8/814: creat d0/d12/d1b/d74/d8a/d8f/f11a x:0 0 0 2024-04-25T02:05:30.062 INFO:tasks.workunit.client.0.smithi162.stdout:8/815: chown d0/d12/d2b/ffa 6803 1 2024-04-25T02:05:30.394 INFO:tasks.workunit.client.0.smithi162.stdout:5/821: creat d15/d19/d24/d4d/d7c/d85/de7/d7a/d7e/f10f x:0 0 0 2024-04-25T02:05:30.414 INFO:tasks.workunit.client.0.smithi162.stdout:5/822: chown d15/cb9 121644528 1 2024-04-25T02:05:30.497 INFO:tasks.workunit.client.0.smithi162.stdout:9/767: symlink d4/d8/d13/l110 0 2024-04-25T02:05:30.813 INFO:tasks.workunit.client.0.smithi162.stdout:4/838: write dd/f2c [1668901,109155] 0 2024-04-25T02:05:31.063 INFO:tasks.workunit.client.0.smithi162.stdout:6/782: unlink d1/c41 0 2024-04-25T02:05:31.086 INFO:tasks.workunit.client.0.smithi162.stdout:2/795: write d0/d3/d1b/d6b/dc0/d67/d9c/ff8 [135093,105674] 0 2024-04-25T02:05:31.088 INFO:tasks.workunit.client.0.smithi162.stdout:3/838: dread d2/d9/d10/d4c/f70 [0,4194304] 0 2024-04-25T02:05:31.178 INFO:tasks.workunit.client.0.smithi162.stdout:8/816: mkdir d0/d44/d64/d112/d11b 0 2024-04-25T02:05:31.250 INFO:tasks.workunit.client.0.smithi162.stdout:5/823: mknod d15/d19/d24/d4d/d7c/d85/de7/d7a/d7e/d101/c110 0 2024-04-25T02:05:31.940 INFO:tasks.workunit.client.0.smithi162.stdout:7/858: getdents df/d2e/d4c/d58 0 2024-04-25T02:05:31.980 INFO:tasks.workunit.client.0.smithi162.stdout:7/859: chown df/d2e/d4c/d8a/db2/lb9 74006678 1 2024-04-25T02:05:32.474 INFO:tasks.workunit.client.0.smithi162.stdout:6/783: creat d1/d73/fff x:0 0 0 2024-04-25T02:05:32.863 INFO:tasks.workunit.client.0.smithi162.stdout:0/908: dwrite d0/df/d20/d37/f57 [4194304,4194304] 0 2024-04-25T02:05:33.043 INFO:tasks.workunit.client.0.smithi162.stdout:8/817: creat d0/d86/f11c x:0 0 0 2024-04-25T02:05:33.301 INFO:tasks.workunit.client.0.smithi162.stdout:3/839: truncate d2/d9/d19/d3f/fa9 5064417 0 2024-04-25T02:05:33.800 INFO:tasks.workunit.client.0.smithi162.stdout:5/824: dread d15/d19/d24/f77 [0,4194304] 0 2024-04-25T02:05:34.033 INFO:tasks.workunit.client.0.smithi162.stdout:7/860: dread df/d2e/d4c/d58/d93/fa7 [0,4194304] 0 2024-04-25T02:05:34.049 INFO:tasks.workunit.client.0.smithi162.stdout:6/784: mknod d1/d73/c100 0 2024-04-25T02:05:34.106 INFO:tasks.workunit.client.0.smithi162.stdout:6/785: read d1/f27 [35323,59270] 0 2024-04-25T02:05:34.542 INFO:tasks.workunit.client.0.smithi162.stdout:4/839: dwrite dd/d1a/d34/f51 [4194304,4194304] 0 2024-04-25T02:05:34.653 INFO:tasks.workunit.client.0.smithi162.stdout:0/909: truncate d0/d1/d4e/f86 379363 0 2024-04-25T02:05:34.738 INFO:tasks.workunit.client.0.smithi162.stdout:9/768: link d4/d9/d15/d71/c8c d4/d9/d15/d71/c111 0 2024-04-25T02:05:34.869 INFO:tasks.workunit.client.0.smithi162.stdout:3/840: mknod d2/d9/d94/c115 0 2024-04-25T02:05:35.031 INFO:tasks.workunit.client.0.smithi162.stdout:1/850: getdents d15/d1f/d35/d4c/d70/d9f 0 2024-04-25T02:05:35.210 INFO:tasks.workunit.client.0.smithi162.stdout:5/825: fsync d15/d19/d24/d4d/d7c/fd3 0 2024-04-25T02:05:35.605 INFO:tasks.workunit.client.0.smithi162.stdout:7/861: mkdir df/d2c/d63/d83/d8b/d90/d127 0 2024-04-25T02:05:35.969 INFO:tasks.workunit.client.0.smithi162.stdout:6/786: dread d1/d13/f1f [0,4194304] 0 2024-04-25T02:05:36.409 INFO:tasks.workunit.client.0.smithi162.stdout:4/840: rmdir dd/d1a/d34/d9d/df8 39 2024-04-25T02:05:36.775 INFO:tasks.workunit.client.0.smithi162.stdout:9/769: mkdir d4/d9/d15/d1b/d2f/d30/d112 0 2024-04-25T02:05:37.087 INFO:tasks.workunit.client.0.smithi162.stdout:1/851: symlink d15/d1f/d23/d30/d4a/l115 0 2024-04-25T02:05:37.486 INFO:tasks.workunit.client.0.smithi162.stdout:7/862: symlink df/d2e/d4c/d58/l128 0 2024-04-25T02:05:37.865 INFO:tasks.workunit.client.0.smithi162.stdout:2/796: getdents d0/d3/d1b/d6b/de5 0 2024-04-25T02:05:37.891 INFO:tasks.workunit.client.0.smithi162.stdout:6/787: creat d1/d13/d28/d30/d66/d89/f101 x:0 0 0 2024-04-25T02:05:38.091 INFO:tasks.workunit.client.0.smithi162.stdout:8/818: rmdir d0/d44/d64/d112/d11b 0 2024-04-25T02:05:38.763 INFO:tasks.workunit.client.0.smithi162.stdout:5/826: getdents d15/d19/d24/d2b/d3b/de4 0 2024-04-25T02:05:38.829 INFO:tasks.workunit.client.0.smithi162.stdout:7/863: rmdir df/d2e/d4c/d58 39 2024-04-25T02:05:39.364 INFO:tasks.workunit.client.0.smithi162.stdout:0/910: write d0/df/d20/f45 [2522385,95073] 0 2024-04-25T02:05:39.528 INFO:tasks.workunit.client.0.smithi162.stdout:8/819: dread d0/d44/d91/fb7 [0,4194304] 0 2024-04-25T02:05:40.139 INFO:tasks.workunit.client.0.smithi162.stdout:3/841: creat d2/d9/d10/f116 x:0 0 0 2024-04-25T02:05:40.184 INFO:tasks.workunit.client.0.smithi162.stdout:3/842: chown d2/d9/d10/d4c/f70 6603 1 2024-04-25T02:05:40.947 INFO:tasks.workunit.client.0.smithi162.stdout:3/843: mknod d2/d9/d10/d4c/dfb/dfc/c117 0 2024-04-25T02:05:41.443 INFO:tasks.workunit.client.0.smithi162.stdout:7/864: truncate df/d2c/f6e 14780 0 2024-04-25T02:05:41.460 INFO:tasks.workunit.client.0.smithi162.stdout:0/911: mknod d0/df/d20/d37/d118/c138 0 2024-04-25T02:05:41.693 INFO:tasks.workunit.client.0.smithi162.stdout:9/770: getdents d4/d9/d15/d1b/d2f/d30/dc1/d59 0 2024-04-25T02:05:41.757 INFO:tasks.workunit.client.0.smithi162.stdout:1/852: link d15/d1f/d35/d4c/d70/fec d15/d1f/d23/d30/d4a/d7f/d97/f116 0 2024-04-25T02:05:42.022 INFO:tasks.workunit.client.0.smithi162.stdout:8/820: rename d0/d1a/f32 to d0/d1a/f11d 0 2024-04-25T02:05:42.311 INFO:tasks.workunit.client.0.smithi162.stdout:4/841: dwrite dd/d1a/d34/d9d/fda [0,4194304] 0 2024-04-25T02:05:42.963 INFO:tasks.workunit.client.0.smithi162.stdout:6/788: dwrite d1/d13/d28/d30/d3a/fb7 [0,4194304] 0 2024-04-25T02:05:43.104 INFO:tasks.workunit.client.0.smithi162.stdout:2/797: dwrite d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/da2/de2/fe7 [0,4194304] 0 2024-04-25T02:05:43.286 INFO:tasks.workunit.client.0.smithi162.stdout:7/865: mkdir df/d2e/d4c/d8a/d129 0 2024-04-25T02:05:43.298 INFO:tasks.workunit.client.0.smithi162.stdout:0/912: symlink d0/df/d117/l139 0 2024-04-25T02:05:43.477 INFO:tasks.workunit.client.0.smithi162.stdout:4/842: mkdir dd/d1a/d34/db1/dba/d115 0 2024-04-25T02:05:43.918 INFO:tasks.workunit.client.0.smithi162.stdout:5/827: write d15/d19/d24/d4d/d9d/f104 [578338,13436] 0 2024-04-25T02:05:43.920 INFO:tasks.workunit.client.0.smithi162.stdout:6/789: dread - d1/d46/d7a/d85/ff0 zero size 2024-04-25T02:05:43.965 INFO:tasks.workunit.client.0.smithi162.stdout:2/798: truncate d0/f5a 1218098 0 2024-04-25T02:05:44.041 INFO:tasks.workunit.client.0.smithi162.stdout:2/799: chown d0/d3/d5/l32 56824992 1 2024-04-25T02:05:44.388 INFO:tasks.workunit.client.0.smithi162.stdout:8/821: creat d0/d44/f11e x:0 0 0 2024-04-25T02:05:44.654 INFO:tasks.workunit.client.0.smithi162.stdout:0/913: creat d0/d1/dab/d128/f13a x:0 0 0 2024-04-25T02:05:44.866 INFO:tasks.workunit.client.0.smithi162.stdout:5/828: unlink d15/d19/l2e 0 2024-04-25T02:05:44.881 INFO:tasks.workunit.client.0.smithi162.stdout:6/790: mknod d1/d13/d28/d45/d59/d80/c102 0 2024-04-25T02:05:45.267 INFO:tasks.workunit.client.0.smithi162.stdout:3/844: dwrite d2/d9/d10/d4c/d51/d63/d87/d90/f98 [0,4194304] 0 2024-04-25T02:05:45.642 INFO:tasks.workunit.client.0.smithi162.stdout:4/843: truncate dd/d1a/d4e/fc1 526482 0 2024-04-25T02:05:45.805 INFO:tasks.workunit.client.0.smithi162.stdout:0/914: fsync d0/df/d20/d25/d55/f130 0 2024-04-25T02:05:45.898 INFO:tasks.workunit.client.0.smithi162.stdout:6/791: dread - d1/d13/d28/d30/d8a/ff4 zero size 2024-04-25T02:05:45.922 INFO:tasks.workunit.client.0.smithi162.stdout:6/792: readlink d1/d46/l49 0 2024-04-25T02:05:46.164 INFO:tasks.workunit.client.0.smithi162.stdout:5/829: fdatasync d15/d19/d24/d2b/d3b/d80/ddf/ffa 0 2024-04-25T02:05:46.219 INFO:tasks.workunit.client.0.smithi162.stdout:7/866: link df/d2e/d4c/d8a/db2/lb9 df/d2e/d4c/de8/l12a 0 2024-04-25T02:05:46.490 INFO:tasks.workunit.client.0.smithi162.stdout:4/844: unlink dd/df/d2e/f105 0 2024-04-25T02:05:46.666 INFO:tasks.workunit.client.0.smithi162.stdout:9/771: rename d4/f74 to d4/d8/d13/d38/f113 0 2024-04-25T02:05:46.993 INFO:tasks.workunit.client.0.smithi162.stdout:1/853: dwrite d15/d1f/d35/d4c/d70/d73/db8/fe4 [0,4194304] 0 2024-04-25T02:05:47.127 INFO:tasks.workunit.client.0.smithi162.stdout:5/830: symlink d15/d1e/l111 0 2024-04-25T02:05:47.200 INFO:tasks.workunit.client.0.smithi162.stdout:5/831: chown d15/d19/d24/d2b/d3b/d3c/d3f/f51 6 1 2024-04-25T02:05:47.303 INFO:tasks.workunit.client.0.smithi162.stdout:3/845: unlink d2/d29/d5d/ld3 0 2024-04-25T02:05:47.500 INFO:tasks.workunit.client.0.smithi162.stdout:4/845: fdatasync fc 0 2024-04-25T02:05:47.677 INFO:tasks.workunit.client.0.smithi162.stdout:0/915: rename d0/d59/d7e/cd2 to d0/d1/d4b/c13b 0 2024-04-25T02:05:47.753 INFO:tasks.workunit.client.0.smithi162.stdout:9/772: mknod d4/d9/c114 0 2024-04-25T02:05:47.841 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:16:37.271 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:05:47.857 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:16:37.287 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:05:47.902 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:16:37.250 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:05:47.913 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:16:37.260 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:05:47.914 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:16:37.344 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:05:47.933 INFO:tasks.workunit.client.0.smithi162.stdout:5/832: symlink d15/d19/d24/d2b/d3b/d58/daf/dc8/l112 0 2024-04-25T02:05:47.972 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:16:37.319 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:05:47.976 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:16:37.323 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:05:47.990 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:16:37.338 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:05:48.037 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:16:37.384 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:05:48.410 INFO:tasks.workunit.client.0.smithi162.stdout:1/854: rename d15/lf8 to d15/d69/d4f/l117 0 2024-04-25T02:05:48.544 INFO:tasks.workunit.client.0.smithi162.stdout:0/916: mknod d0/df/d20/d37/ddf/c13c 0 2024-04-25T02:05:48.773 INFO:tasks.workunit.client.0.smithi162.stdout:5/833: dread - d15/d19/d24/d2b/d3b/d3c/f106 zero size 2024-04-25T02:05:49.173 INFO:tasks.workunit.client.0.smithi162.stdout:3/846: mkdir d2/d29/d5d/dcf/d118 0 2024-04-25T02:05:49.195 INFO:tasks.workunit.client.0.smithi162.stdout:3/847: stat d2/d9/d19/fa1 0 2024-04-25T02:05:49.294 INFO:tasks.workunit.client.0.smithi162.stdout:1/855: symlink d15/d1f/d23/d30/d4a/d7f/d97/dbe/dde/l118 0 2024-04-25T02:05:49.640 INFO:tasks.workunit.client.0.smithi162.stdout:8/822: write d0/d12/d1b/d74/d8a/da3/faa [46852,28662] 0 2024-04-25T02:05:49.996 INFO:tasks.workunit.client.0.smithi162.stdout:7/867: link df/d2c/f3b df/d2c/d49/d7a/f12b 0 2024-04-25T02:05:50.246 INFO:tasks.workunit.client.0.smithi162.stdout:2/800: write d0/d3/d7a/d88/ffb [1495073,106268] 0 2024-04-25T02:05:50.405 INFO:tasks.workunit.client.0.smithi162.stdout:0/917: mkdir d0/d1/d4e/df7/d13d 0 2024-04-25T02:05:50.611 INFO:tasks.workunit.client.0.smithi162.stdout:8/823: unlink d0/d44/d31/f3e 0 2024-04-25T02:05:50.984 INFO:tasks.workunit.client.0.smithi162.stdout:4/846: rename dd/d1a/l6a to dd/df/d2e/d59/l116 0 2024-04-25T02:05:51.136 INFO:tasks.workunit.client.0.smithi162.stdout:7/868: mknod df/d2e/d111/c12c 0 2024-04-25T02:05:51.259 INFO:tasks.workunit.client.0.smithi162.stdout:6/793: dwrite d1/d13/d28/f29 [0,4194304] 0 2024-04-25T02:05:51.366 INFO:tasks.workunit.client.0.smithi162.stdout:1/856: symlink d15/d1f/l119 0 2024-04-25T02:05:51.399 INFO:tasks.workunit.client.0.smithi162.stdout:0/918: creat d0/df/d20/d37/d81/f13e x:0 0 0 2024-04-25T02:05:51.854 INFO:tasks.workunit.client.0.smithi162.stdout:8/824: stat d0/d1a/c3b 0 2024-04-25T02:05:51.926 INFO:tasks.workunit.client.0.smithi162.stdout:5/834: link d15/d19/f34 d15/d19/d24/d4d/d7c/d85/de7/ddd/f113 0 2024-04-25T02:05:51.943 INFO:tasks.workunit.client.0.smithi162.stdout:5/835: stat d15/cb9 0 2024-04-25T02:05:52.334 INFO:tasks.workunit.client.0.smithi162.stdout:4/847: unlink dd/l46 0 2024-04-25T02:05:52.357 INFO:tasks.workunit.client.0.smithi162.stdout:6/794: creat d1/f103 x:0 0 0 2024-04-25T02:05:52.583 INFO:tasks.workunit.client.0.smithi162.stdout:2/801: mkdir d0/d3/d1b/d11d 0 2024-04-25T02:05:52.620 INFO:tasks.workunit.client.0.smithi162.stdout:2/802: chown d0/d3/d1b/d6b/d92/d9a/fa3 903080833 1 2024-04-25T02:05:52.968 INFO:tasks.workunit.client.0.smithi162.stdout:1/857: dread d15/d1f/d35/d4c/d70/f81 [0,4194304] 0 2024-04-25T02:05:52.994 INFO:tasks.workunit.client.0.smithi162.stdout:0/919: rename d0/df/f96 to d0/d1/dab/d128/f13f 0 2024-04-25T02:05:53.316 INFO:tasks.workunit.client.0.smithi162.stdout:5/836: dread - d15/d19/d24/d4d/d7c/d85/de7/d7a/d7e/d101/f102 zero size 2024-04-25T02:05:53.415 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:05:53.418 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:05:53.546 INFO:tasks.workunit.client.0.smithi162.stdout:9/773: write d4/d9/da9/f10d [4994,101982] 0 2024-04-25T02:05:53.587 INFO:tasks.workunit.client.0.smithi162.stdout:1/858: sync 2024-04-25T02:05:53.660 INFO:tasks.workunit.client.0.smithi162.stdout:6/795: mknod d1/d13/d28/d53/d71/dc5/de1/c104 0 2024-04-25T02:05:53.769 INFO:tasks.workunit.client.0.smithi162.stdout:2/803: fsync d0/fa9 0 2024-04-25T02:05:54.372 INFO:tasks.workunit.client.0.smithi162.stdout:7/869: creat df/d2e/d4c/f12d x:0 0 0 2024-04-25T02:05:54.467 INFO:tasks.workunit.client.0.smithi162.stdout:9/774: fsync d4/d9/d15/d8a/fa1 0 2024-04-25T02:05:54.781 INFO:tasks.workunit.client.0.smithi162.stdout:6/796: creat d1/d13/d28/d45/d59/d80/f105 x:0 0 0 2024-04-25T02:05:55.105 INFO:tasks.workunit.client.0.smithi162.stdout:3/848: write d2/d9/d10/d2c/da3/db5/fc7 [899961,118888] 0 2024-04-25T02:05:55.107 INFO:tasks.workunit.client.0.smithi162.stdout:2/804: mkdir d0/d3/d5/d36/d93/dbd/d11e 0 2024-04-25T02:05:55.147 INFO:tasks.workunit.client.0.smithi162.stdout:0/920: truncate d0/d1/f9e 1269457 0 2024-04-25T02:05:55.162 INFO:tasks.workunit.client.0.smithi162.stdout:8/825: getdents d0/d12/d2b/d87/de5/dfc 0 2024-04-25T02:05:55.263 INFO:tasks.workunit.client.0.smithi162.stdout:0/921: chown d0/d1/d4e/d76 2971 1 2024-04-25T02:05:55.323 INFO:tasks.workunit.client.0.smithi162.stdout:7/870: fsync f5 0 2024-04-25T02:05:56.237 INFO:tasks.workunit.client.0.smithi162.stdout:5/837: rename d15/d19/d24/d2b/f2c to d15/d19/d24/d2b/d3b/d58/f114 0 2024-04-25T02:05:56.262 INFO:tasks.workunit.client.0.smithi162.stdout:3/849: dread - d2/d9/f39 zero size 2024-04-25T02:05:56.616 INFO:tasks.workunit.client.0.smithi162.stdout:8/826: symlink d0/d12/d2b/d87/de5/l11f 0 2024-04-25T02:05:56.837 INFO:tasks.workunit.client.0.smithi162.stdout:0/922: fsync d0/d1/d6a/f8f 0 2024-04-25T02:05:56.903 INFO:tasks.workunit.client.0.smithi162.stdout:7/871: stat df/d2e/d4c/d58/d82/ld1 0 2024-04-25T02:05:57.482 INFO:tasks.workunit.client.0.smithi162.stdout:6/797: symlink d1/d73/da1/l106 0 2024-04-25T02:05:57.500 INFO:tasks.workunit.client.0.smithi162.stdout:6/798: chown d1/f10 2709 1 2024-04-25T02:05:57.552 INFO:tasks.workunit.client.0.smithi162.stdout:3/850: symlink d2/d9/d10/d4c/d51/ddd/de1/l119 0 2024-04-25T02:05:57.656 INFO:tasks.workunit.client.0.smithi162.stdout:6/799: dread d1/d13/d28/d30/d3a/f5b [0,4194304] 0 2024-04-25T02:05:57.673 INFO:tasks.workunit.client.0.smithi162.stdout:3/851: chown d2/d9/d10/d2c/cdb 35 1 2024-04-25T02:05:57.823 INFO:tasks.workunit.client.0.smithi162.stdout:8/827: symlink d0/d12/d2b/l120 0 2024-04-25T02:05:58.210 INFO:tasks.workunit.client.0.smithi162.stdout:0/923: creat d0/df/d20/d37/da1/f140 x:0 0 0 2024-04-25T02:05:58.331 INFO:tasks.workunit.client.0.smithi162.stdout:4/848: write dd/df/d2e/d59/f9f [961954,23247] 0 2024-04-25T02:05:58.553 INFO:tasks.workunit.client.0.smithi162.stdout:3/852: creat d2/ddf/de7/f11a x:0 0 0 2024-04-25T02:05:58.916 INFO:tasks.workunit.client.0.smithi162.stdout:8/828: write d0/d12/d1b/d74/d8a/da3/faa [3297638,121052] 0 2024-04-25T02:05:59.242 INFO:tasks.workunit.client.0.smithi162.stdout:4/849: symlink dd/d1a/d34/l117 0 2024-04-25T02:05:59.319 INFO:tasks.workunit.client.0.smithi162.stdout:1/859: dwrite d15/d1f/d35/d4c/d70/d73/db8/fe2 [0,4194304] 0 2024-04-25T02:05:59.440 INFO:tasks.workunit.client.0.smithi162.stdout:3/853: mkdir d2/ddf/d11b 0 2024-04-25T02:05:59.730 INFO:tasks.workunit.client.0.smithi162.stdout:8/829: mknod d0/db1/c121 0 2024-04-25T02:05:59.887 INFO:tasks.workunit.client.0.smithi162.stdout:4/850: rmdir dd/df/d2e 39 2024-04-25T02:06:00.123 INFO:tasks.workunit.client.0.smithi162.stdout:1/860: symlink d15/d69/l11a 0 2024-04-25T02:06:01.081 INFO:tasks.workunit.client.0.smithi162.stdout:2/805: write d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/ffe [59049,25264] 0 2024-04-25T02:06:01.412 INFO:tasks.workunit.client.0.smithi162.stdout:1/861: symlink d15/d1f/d35/d4c/d70/d110/l11b 0 2024-04-25T02:06:01.542 INFO:tasks.workunit.client.0.smithi162.stdout:4/851: rename dd/d1a/d34/d57/l8c to dd/df/d2e/d59/dd9/l118 0 2024-04-25T02:06:01.557 INFO:tasks.workunit.client.0.smithi162.stdout:4/852: stat dd/c11 0 2024-04-25T02:06:01.646 INFO:tasks.workunit.client.0.smithi162.stdout:2/806: truncate d0/d3/d1b/fd3 1379782 0 2024-04-25T02:06:01.770 INFO:tasks.workunit.client.0.smithi162.stdout:1/862: mkdir d15/d1f/d35/d4c/d70/d110/d11c 0 2024-04-25T02:06:01.889 INFO:tasks.workunit.client.0.smithi162.stdout:4/853: creat dd/d1a/d34/db1/dba/dfd/f119 x:0 0 0 2024-04-25T02:06:01.954 INFO:tasks.workunit.client.0.smithi162.stdout:9/775: dwrite d4/d9/d15/d8a/ff4 [0,4194304] 0 2024-04-25T02:06:02.097 INFO:tasks.workunit.client.0.smithi162.stdout:9/776: chown d4/d8/d13/d38 517173127 1 2024-04-25T02:06:02.584 INFO:tasks.workunit.client.0.smithi162.stdout:7/872: write fa [1666883,102654] 0 2024-04-25T02:06:02.659 INFO:tasks.workunit.client.0.smithi162.stdout:3/854: write d2/d9/d10/d4c/d51/d63/d87/d86/fa2 [4082047,93186] 0 2024-04-25T02:06:02.785 INFO:tasks.workunit.client.0.smithi162.stdout:1/863: symlink d15/d69/l11d 0 2024-04-25T02:06:03.920 INFO:tasks.workunit.client.0.smithi162.stdout:0/924: dwrite d0/d59/f68 [0,4194304] 0 2024-04-25T02:06:03.999 INFO:tasks.workunit.client.0.smithi162.stdout:6/800: dwrite d1/d13/d28/d30/d8a/dc3/fde [4194304,4194304] 0 2024-04-25T02:06:04.180 INFO:tasks.workunit.client.0.smithi162.stdout:5/838: dwrite d15/d19/f1b [0,4194304] 0 2024-04-25T02:06:04.263 INFO:tasks.workunit.client.0.smithi162.stdout:9/777: mkdir d4/d9/d115 0 2024-04-25T02:06:04.338 INFO:tasks.workunit.client.0.smithi162.stdout:8/830: dwrite d0/d44/d64/f78 [0,4194304] 0 2024-04-25T02:06:04.503 INFO:tasks.workunit.client.0.smithi162.stdout:9/778: sync 2024-04-25T02:06:04.535 INFO:tasks.workunit.client.0.smithi162.stdout:4/854: dread dd/d1a/f26 [0,4194304] 0 2024-04-25T02:06:04.582 INFO:tasks.workunit.client.0.smithi162.stdout:2/807: link d0/d3/d5/d36/d93/l95 d0/d3/d1b/d6b/dc0/d5e/d108/l11f 0 2024-04-25T02:06:04.741 INFO:tasks.workunit.client.0.smithi162.stdout:9/779: dread d4/d8/d13/f53 [0,4194304] 0 2024-04-25T02:06:04.762 INFO:tasks.workunit.client.0.smithi162.stdout:1/864: mkdir d15/d1f/d35/d4c/d70/d73/db8/dbb/d11e 0 2024-04-25T02:06:05.012 INFO:tasks.workunit.client.0.smithi162.stdout:6/801: mknod d1/d13/d28/d45/c107 0 2024-04-25T02:06:05.374 INFO:tasks.workunit.client.0.smithi162.stdout:8/831: creat d0/d12/d1b/d74/d8a/d103/f122 x:0 0 0 2024-04-25T02:06:05.441 INFO:tasks.workunit.client.0.smithi162.stdout:4/855: unlink dd/d1a/d4e/l8b 0 2024-04-25T02:06:05.472 INFO:tasks.workunit.client.0.smithi162.stdout:4/856: chown dd/d1a/d34/d57/l5c 27195007 1 2024-04-25T02:06:05.477 INFO:tasks.workunit.client.0.smithi162.stdout:8/832: sync 2024-04-25T02:06:05.616 INFO:tasks.workunit.client.0.smithi162.stdout:2/808: dread d0/d3/d5/ff0 [0,4194304] 0 2024-04-25T02:06:05.808 INFO:tasks.workunit.client.0.smithi162.stdout:9/780: mkdir d4/d7c/d116 0 2024-04-25T02:06:05.829 INFO:tasks.workunit.client.0.smithi162.stdout:9/781: chown d4/d25/de5 265004 1 2024-04-25T02:06:06.014 INFO:tasks.workunit.client.0.smithi162.stdout:1/865: symlink d15/d1f/d23/d30/d4a/l11f 0 2024-04-25T02:06:06.236 INFO:tasks.workunit.client.0.smithi162.stdout:5/839: write d15/d19/d24/d2b/d3b/d80/fc9 [1136043,93967] 0 2024-04-25T02:06:06.353 INFO:tasks.workunit.client.0.smithi162.stdout:7/873: dwrite df/d2c/f6e [0,4194304] 0 2024-04-25T02:06:06.557 INFO:tasks.workunit.client.0.smithi162.stdout:0/925: dwrite d0/d7b/f9b [0,4194304] 0 2024-04-25T02:06:06.652 INFO:tasks.workunit.client.0.smithi162.stdout:4/857: unlink dd/df/d2e/lf6 0 2024-04-25T02:06:06.676 INFO:tasks.workunit.client.0.smithi162.stdout:8/833: creat d0/db1/f123 x:0 0 0 2024-04-25T02:06:06.716 INFO:tasks.workunit.client.0.smithi162.stdout:3/855: rename d2/d9/d10/fcb to d2/d9/d10/d4c/d51/d63/d87/d90/db3/f11c 0 2024-04-25T02:06:06.765 INFO:tasks.workunit.client.0.smithi162.stdout:6/802: read d1/d13/d28/d45/d59/dbe/fcb [104755,83409] 0 2024-04-25T02:06:06.850 INFO:tasks.workunit.client.0.smithi162.stdout:9/782: symlink d4/d9/d15/d1b/d2f/d30/dc1/d59/dec/l117 0 2024-04-25T02:06:06.874 INFO:tasks.workunit.client.0.smithi162.stdout:5/840: fsync d15/d1e/f22 0 2024-04-25T02:06:06.949 INFO:tasks.workunit.client.0.smithi162.stdout:7/874: fsync df/f96 0 2024-04-25T02:06:07.164 INFO:tasks.workunit.client.0.smithi162.stdout:6/803: stat d1/d13/d28/d45/d59/d80/f105 0 2024-04-25T02:06:07.259 INFO:tasks.workunit.client.0.smithi162.stdout:1/866: dread fe [0,4194304] 0 2024-04-25T02:06:07.279 INFO:tasks.workunit.client.0.smithi162.stdout:6/804: chown d1/d13/f1f 2 1 2024-04-25T02:06:07.460 INFO:tasks.workunit.client.0.smithi162.stdout:6/805: sync 2024-04-25T02:06:08.067 INFO:tasks.workunit.client.0.smithi162.stdout:9/783: mknod d4/d8/d13/d38/c118 0 2024-04-25T02:06:08.452 INFO:tasks.workunit.client.0.smithi162.stdout:0/926: rename d0/d1/d4e/d76/c11b to d0/d1/dab/ddc/c141 0 2024-04-25T02:06:08.486 INFO:tasks.workunit.client.0.smithi162.stdout:0/927: chown d0/df/d20/d37/d81 1286382 1 2024-04-25T02:06:09.026 INFO:tasks.workunit.client.0.smithi162.stdout:5/841: mknod d15/d19/d24/d2b/c115 0 2024-04-25T02:06:09.116 INFO:tasks.workunit.client.0.smithi162.stdout:4/858: write dd/df/d2e/f95 [2069168,81242] 0 2024-04-25T02:06:09.127 INFO:tasks.workunit.client.0.smithi162.stdout:1/867: mkdir d15/d1f/d35/d4c/d70/d9f/d120 0 2024-04-25T02:06:09.172 INFO:tasks.workunit.client.0.smithi162.stdout:6/806: mkdir d1/d13/d28/d53/d71/dc5/d108 0 2024-04-25T02:06:09.641 INFO:tasks.workunit.client.0.smithi162.stdout:9/784: mknod d4/d8/d13/dbf/c119 0 2024-04-25T02:06:09.846 INFO:tasks.workunit.client.0.smithi162.stdout:8/834: write d0/d44/d64/d112/f47 [8725010,122067] 0 2024-04-25T02:06:10.078 INFO:tasks.workunit.client.0.smithi162.stdout:8/835: dwrite d0/d44/d64/f78 [0,4194304] 0 2024-04-25T02:06:10.220 INFO:tasks.workunit.client.0.smithi162.stdout:3/856: symlink d2/d9/d10/d4c/d51/ddd/de1/de4/l11d 0 2024-04-25T02:06:10.266 INFO:tasks.workunit.client.0.smithi162.stdout:0/928: rename d0/df/d20/d37/da1 to d0/df/d20/d25/d55/d142 0 2024-04-25T02:06:10.436 INFO:tasks.workunit.client.0.smithi162.stdout:0/929: chown d0/df/d20/d25/d55/d6f/cc9 6521 1 2024-04-25T02:06:10.472 INFO:tasks.workunit.client.0.smithi162.stdout:3/857: dread d2/d29/f3c [0,4194304] 0 2024-04-25T02:06:10.546 INFO:tasks.workunit.client.0.smithi162.stdout:2/809: link d0/d3/d1b/d6b/dc0/c60 d0/d3/d1b/d6b/dc0/d5e/c120 0 2024-04-25T02:06:10.946 INFO:tasks.workunit.client.0.smithi162.stdout:5/842: dread d15/d19/d24/d2b/d3b/f89 [0,4194304] 0 2024-04-25T02:06:11.002 INFO:tasks.workunit.client.0.smithi162.stdout:6/807: truncate d1/d13/d28/d7b/dbb/fe6 572394 0 2024-04-25T02:06:11.015 INFO:tasks.workunit.client.0.smithi162.stdout:7/875: write df/d2e/d4c/daf/f113 [888016,46820] 0 2024-04-25T02:06:11.536 INFO:tasks.workunit.client.0.smithi162.stdout:9/785: dread - d4/d8/f51 zero size 2024-04-25T02:06:12.060 INFO:tasks.workunit.client.0.smithi162.stdout:2/810: symlink d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/da2/l121 0 2024-04-25T02:06:12.063 INFO:tasks.workunit.client.0.smithi162.stdout:3/858: fdatasync d2/d9/d19/d3f/f79 0 2024-04-25T02:06:12.103 INFO:tasks.workunit.client.0.smithi162.stdout:3/859: stat d2/d9/l16 0 2024-04-25T02:06:12.442 INFO:tasks.workunit.client.0.smithi162.stdout:6/808: chown d1/d13/d28/d53/cae 2780758 1 2024-04-25T02:06:13.086 INFO:tasks.workunit.client.0.smithi162.stdout:9/786: dread d4/f52 [0,4194304] 0 2024-04-25T02:06:13.309 INFO:tasks.workunit.client.0.smithi162.stdout:2/811: symlink d0/d3/d5/d36/d93/l122 0 2024-04-25T02:06:13.336 INFO:tasks.workunit.client.0.smithi162.stdout:3/860: fdatasync d2/d9/d10/d2c/f78 0 2024-04-25T02:06:13.342 INFO:tasks.workunit.client.0.smithi162.stdout:5/843: creat d15/d19/d24/d4d/d7c/d85/dde/de5/f116 x:0 0 0 2024-04-25T02:06:14.010 INFO:tasks.workunit.client.0.smithi162.stdout:9/787: dread d4/d9/d15/f35 [0,4194304] 0 2024-04-25T02:06:14.031 INFO:tasks.workunit.client.0.smithi162.stdout:3/861: rmdir d2/d9/d10/d2c/da3/dba 39 2024-04-25T02:06:14.627 INFO:tasks.workunit.client.0.smithi162.stdout:3/862: unlink d2/d9/f2d 0 2024-04-25T02:06:14.703 INFO:tasks.workunit.client.0.smithi162.stdout:9/788: mkdir d4/d9/d15/d1b/d11a 0 2024-04-25T02:06:14.853 INFO:tasks.workunit.client.0.smithi162.stdout:6/809: link d1/d46/d7a/d85/fa3 d1/d13/d28/d30/d8a/f109 0 2024-04-25T02:06:14.865 INFO:tasks.workunit.client.0.smithi162.stdout:6/810: readlink d1/le8 0 2024-04-25T02:06:14.887 INFO:tasks.workunit.client.0.smithi162.stdout:6/811: stat d1/d13/f1f 0 2024-04-25T02:06:14.968 INFO:tasks.workunit.client.0.smithi162.stdout:3/863: chown d2/d9/d10/d4c/d51/d63/d87/d90/db3/f11c 46870 1 2024-04-25T02:06:15.300 INFO:tasks.workunit.client.0.smithi162.stdout:7/876: getdents df/d2c/d49/d7a/dbf 0 2024-04-25T02:06:15.411 INFO:tasks.workunit.client.0.smithi162.stdout:4/859: dwrite dd/d1a/f22 [0,4194304] 0 2024-04-25T02:06:15.649 INFO:tasks.workunit.client.0.smithi162.stdout:6/812: creat d1/d13/d28/d53/d71/dc5/de1/f10a x:0 0 0 2024-04-25T02:06:15.711 INFO:tasks.workunit.client.0.smithi162.stdout:0/930: write d0/df/f66 [286861,42000] 0 2024-04-25T02:06:15.716 INFO:tasks.workunit.client.0.smithi162.stdout:8/836: write d0/d12/d1b/d74/d8a/da3/fd6 [949694,97133] 0 2024-04-25T02:06:15.767 INFO:tasks.workunit.client.0.smithi162.stdout:1/868: dwrite d15/d1f/d23/d30/d4a/d7f/fdd [0,4194304] 0 2024-04-25T02:06:15.909 INFO:tasks.workunit.client.0.smithi162.stdout:6/813: sync 2024-04-25T02:06:15.949 INFO:tasks.workunit.client.0.smithi162.stdout:2/812: rename d0/d3/d1b/d6b/dc0/d5e/d61/c45 to d0/d3/d1b/c123 0 2024-04-25T02:06:16.005 INFO:tasks.workunit.client.0.smithi162.stdout:6/814: readlink d1/d13/d28/d45/d59/l82 0 2024-04-25T02:06:16.404 INFO:tasks.workunit.client.0.smithi162.stdout:7/877: chown df/d2c/l30 365 1 2024-04-25T02:06:16.494 INFO:tasks.workunit.client.0.smithi162.stdout:4/860: read - dd/df/d2e/d4b/d79/fcb zero size 2024-04-25T02:06:16.596 INFO:tasks.workunit.client.0.smithi162.stdout:3/864: creat d2/ddf/de7/df6/f11e x:0 0 0 2024-04-25T02:06:16.669 INFO:tasks.workunit.client.0.smithi162.stdout:3/865: read d2/d9/d10/d2c/da3/db5/fc0 [3022702,50603] 0 2024-04-25T02:06:16.748 INFO:tasks.workunit.client.0.smithi162.stdout:1/869: fdatasync d15/d1f/f5f 0 2024-04-25T02:06:16.952 INFO:tasks.workunit.client.0.smithi162.stdout:8/837: rename d0/d44/d91/l72 to d0/db1/l124 0 2024-04-25T02:06:17.315 INFO:tasks.workunit.client.0.smithi162.stdout:2/813: dread d0/d3/d1b/f5f [0,4194304] 0 2024-04-25T02:06:17.737 INFO:tasks.workunit.client.0.smithi162.stdout:0/931: mkdir d0/d1/d6a/d143 0 2024-04-25T02:06:17.950 INFO:tasks.workunit.client.0.smithi162.stdout:1/870: fdatasync d15/d1f/d23/f107 0 2024-04-25T02:06:18.084 INFO:tasks.workunit.client.0.smithi162.stdout:4/861: dread dd/df/d2e/d4b/fbd [4194304,4194304] 0 2024-04-25T02:06:18.333 INFO:tasks.workunit.client.0.smithi162.stdout:5/844: dwrite d15/d19/d24/d4d/d7c/de2/f10d [0,4194304] 0 2024-04-25T02:06:18.650 INFO:tasks.workunit.client.0.smithi162.stdout:3/866: getdents d2/d9/d10/de9 0 2024-04-25T02:06:18.867 INFO:tasks.workunit.client.0.smithi162.stdout:0/932: mknod d0/d59/c144 0 2024-04-25T02:06:19.561 INFO:tasks.workunit.client.0.smithi162.stdout:5/845: symlink d15/d19/d24/d4d/d7c/d85/de7/d7a/l117 0 2024-04-25T02:06:19.912 INFO:tasks.workunit.client.0.smithi162.stdout:1/871: truncate d15/d1f/d23/d30/d4a/d7f/d97/fa2 511248 0 2024-04-25T02:06:19.933 INFO:tasks.workunit.client.0.smithi162.stdout:7/878: creat df/d2c/d49/d7a/f12e x:0 0 0 2024-04-25T02:06:20.121 INFO:tasks.workunit.client.0.smithi162.stdout:0/933: mkdir d0/df/d20/d25/d55/d6f/d7d/d122/d145 0 2024-04-25T02:06:20.121 INFO:tasks.workunit.client.0.smithi162.stdout:3/867: rename d2/d9/d10/d4c/d51/d63/f100 to d2/d9/d10/d4c/d51/d63/d87/d110/f11f 0 2024-04-25T02:06:20.218 INFO:tasks.workunit.client.0.smithi162.stdout:3/868: read - d2/d9/d10/d4c/d51/d63/d87/d90/db3/f11c zero size 2024-04-25T02:06:20.253 INFO:tasks.workunit.client.0.smithi162.stdout:4/862: creat dd/df/d2e/dd4/d103/f11a x:0 0 0 2024-04-25T02:06:20.598 INFO:tasks.workunit.client.0.smithi162.stdout:7/879: creat df/d2e/d4c/d58/dd3/dd8/f12f x:0 0 0 2024-04-25T02:06:20.934 INFO:tasks.workunit.client.0.smithi162.stdout:1/872: dwrite d15/d1f/f5f [0,4194304] 0 2024-04-25T02:06:21.130 INFO:tasks.workunit.client.0.smithi162.stdout:9/789: mknod d4/d9/d15/c11b 0 2024-04-25T02:06:21.163 INFO:tasks.workunit.client.0.smithi162.stdout:3/869: creat d2/d9/d10/d4c/d51/d63/d87/de0/f120 x:0 0 0 2024-04-25T02:06:21.477 INFO:tasks.workunit.client.0.smithi162.stdout:5/846: creat d15/d19/d24/d2b/d3b/de4/f118 x:0 0 0 2024-04-25T02:06:21.724 INFO:tasks.workunit.client.0.smithi162.stdout:0/934: mknod d0/df/d20/d25/d55/d6f/d7d/c146 0 2024-04-25T02:06:21.729 INFO:tasks.workunit.client.0.smithi162.stdout:7/880: creat df/d2c/d49/d7a/dbf/f130 x:0 0 0 2024-04-25T02:06:21.916 INFO:tasks.workunit.client.0.smithi162.stdout:8/838: write d0/d12/feb [1398578,29937] 0 2024-04-25T02:06:22.824 INFO:tasks.workunit.client.0.smithi162.stdout:2/814: dwrite d0/d3/d1b/d6b/dc0/d67/d9c/ff8 [0,4194304] 0 2024-04-25T02:06:22.837 INFO:tasks.workunit.client.0.smithi162.stdout:6/815: dwrite d1/d46/d7a/fda [0,4194304] 0 2024-04-25T02:06:23.161 INFO:tasks.workunit.client.0.smithi162.stdout:7/881: unlink df/d2e/d4c/daf/cd6 0 2024-04-25T02:06:23.169 INFO:tasks.workunit.client.0.smithi162.stdout:1/873: mkdir d15/d1f/d35/d4c/d121 0 2024-04-25T02:06:23.375 INFO:tasks.workunit.client.0.smithi162.stdout:3/870: creat d2/d29/d5d/dcf/d118/f121 x:0 0 0 2024-04-25T02:06:23.677 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:06:23.680 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:06:23.956 INFO:tasks.workunit.client.0.smithi162.stdout:6/816: stat d1/d13/d28/d45/f4f 0 2024-04-25T02:06:24.090 INFO:tasks.workunit.client.0.smithi162.stdout:2/815: truncate d0/d3/d1b/d6b/dc0/d5e/d61/f10c 941735 0 2024-04-25T02:06:24.256 INFO:tasks.workunit.client.0.smithi162.stdout:7/882: fdatasync df/d2e/d4c/d8a/fc2 0 2024-04-25T02:06:24.412 INFO:tasks.workunit.client.0.smithi162.stdout:1/874: mkdir d15/d1f/d23/d30/d4a/d7f/d122 0 2024-04-25T02:06:24.520 INFO:tasks.workunit.client.0.smithi162.stdout:8/839: mkdir d0/d12/d1b/d74/d105/d125 0 2024-04-25T02:06:24.673 INFO:tasks.workunit.client.0.smithi162.stdout:3/871: truncate d2/d29/f2a 3979113 0 2024-04-25T02:06:25.076 INFO:tasks.workunit.client.0.smithi162.stdout:2/816: unlink d0/d3/d1b/d6b/dc0/d67/fd5 0 2024-04-25T02:06:25.084 INFO:tasks.workunit.client.0.smithi162.stdout:6/817: dread - d1/d73/fff zero size 2024-04-25T02:06:25.194 INFO:tasks.workunit.client.0.smithi162.stdout:2/817: chown d0/d3/d1b/d6b/dc0/d5e/db8/d111 4717166 1 2024-04-25T02:06:25.383 INFO:tasks.workunit.client.0.smithi162.stdout:7/883: creat df/d2e/d4c/d58/d82/f131 x:0 0 0 2024-04-25T02:06:25.499 INFO:tasks.workunit.client.0.smithi162.stdout:1/875: rmdir d15/d1f/d35 39 2024-04-25T02:06:25.534 INFO:tasks.workunit.client.0.smithi162.stdout:4/863: dwrite dd/d1a/d34/db1/dba/dfd/db8/f104 [0,4194304] 0 2024-04-25T02:06:25.770 INFO:tasks.workunit.client.0.smithi162.stdout:6/818: rmdir d1/d13/d28/d30/d3a 39 2024-04-25T02:06:25.785 INFO:tasks.workunit.client.0.smithi162.stdout:3/872: read d2/f62 [213960,53774] 0 2024-04-25T02:06:25.813 INFO:tasks.workunit.client.0.smithi162.stdout:7/884: chown df/d2c/d63/d83/d8b/d90/fb7 0 1 2024-04-25T02:06:25.876 INFO:tasks.workunit.client.0.smithi162.stdout:4/864: chown dd/df/d77/c9b 54 1 2024-04-25T02:06:25.907 INFO:tasks.workunit.client.0.smithi162.stdout:1/876: dread d15/d1f/d23/f57 [0,4194304] 0 2024-04-25T02:06:25.931 INFO:tasks.workunit.client.0.smithi162.stdout:6/819: chown d1/d46/lc8 348054 1 2024-04-25T02:06:26.065 INFO:tasks.workunit.client.0.smithi162.stdout:5/847: getdents d15/d19/d24/d2b/d3b/de4 0 2024-04-25T02:06:26.091 INFO:tasks.workunit.client.0.smithi162.stdout:2/818: mkdir d0/d3/d1b/d6b/d9e/d124 0 2024-04-25T02:06:26.185 INFO:tasks.workunit.client.0.smithi162.stdout:4/865: sync 2024-04-25T02:06:26.248 INFO:tasks.workunit.client.0.smithi162.stdout:4/866: dread dd/fcf [0,4194304] 0 2024-04-25T02:06:26.274 INFO:tasks.workunit.client.0.smithi162.stdout:1/877: sync 2024-04-25T02:06:26.499 INFO:tasks.workunit.client.0.smithi162.stdout:9/790: write d4/d8/d13/dbf/f10a [200818,108378] 0 2024-04-25T02:06:26.775 INFO:tasks.workunit.client.0.smithi162.stdout:3/873: creat d2/d9/d10/d4c/d51/d63/d87/f122 x:0 0 0 2024-04-25T02:06:26.929 INFO:tasks.workunit.client.0.smithi162.stdout:6/820: rmdir d1/d13/d28/d45 39 2024-04-25T02:06:27.033 INFO:tasks.workunit.client.0.smithi162.stdout:2/819: dread - d0/d3/d1b/d6b/d92/f10b zero size 2024-04-25T02:06:27.271 INFO:tasks.workunit.client.0.smithi162.stdout:4/867: mkdir dd/df/d2e/d4b/d79/d11b 0 2024-04-25T02:06:27.352 INFO:tasks.workunit.client.0.smithi162.stdout:4/868: dread dd/df/d77/f96 [0,4194304] 0 2024-04-25T02:06:27.389 INFO:tasks.workunit.client.0.smithi162.stdout:9/791: symlink d4/d25/de5/l11c 0 2024-04-25T02:06:27.600 INFO:tasks.workunit.client.0.smithi162.stdout:0/935: write d0/d1/d6a/da9/f110 [1572794,29270] 0 2024-04-25T02:06:27.709 INFO:tasks.workunit.client.0.smithi162.stdout:0/936: sync 2024-04-25T02:06:28.472 INFO:tasks.workunit.client.0.smithi162.stdout:1/878: mknod d15/d1f/c123 0 2024-04-25T02:06:28.562 INFO:tasks.workunit.client.0.smithi162.stdout:4/869: rename dd/df/d2e/c32 to dd/df/d7e/c11c 0 2024-04-25T02:06:28.778 INFO:tasks.workunit.client.0.smithi162.stdout:9/792: mkdir d4/d25/de5/d108/d11d 0 2024-04-25T02:06:29.483 INFO:tasks.workunit.client.0.smithi162.stdout:4/870: truncate dd/df/d2e/d4b/ffc 5209601 0 2024-04-25T02:06:29.755 INFO:tasks.workunit.client.0.smithi162.stdout:9/793: truncate d4/f39 3246317 0 2024-04-25T02:06:30.455 INFO:tasks.workunit.client.0.smithi162.stdout:3/874: link d2/d9/lb8 d2/d9/d10/d4c/d51/ddd/de1/de4/l123 0 2024-04-25T02:06:30.689 INFO:tasks.workunit.client.0.smithi162.stdout:4/871: creat dd/d1a/d34/d9d/df8/f11d x:0 0 0 2024-04-25T02:06:30.830 INFO:tasks.workunit.client.0.smithi162.stdout:9/794: mknod d4/d25/de5/d108/d11d/c11e 0 2024-04-25T02:06:30.928 INFO:tasks.workunit.client.0.smithi162.stdout:3/875: stat d2/d9/d10/d4c/d51/f7e 0 2024-04-25T02:06:31.025 INFO:tasks.workunit.client.0.smithi162.stdout:3/876: sync 2024-04-25T02:06:31.059 INFO:tasks.workunit.client.0.smithi162.stdout:4/872: creat dd/d1a/d34/d9d/df8/f11e x:0 0 0 2024-04-25T02:06:31.173 INFO:tasks.workunit.client.0.smithi162.stdout:8/840: rmdir d0/db1 39 2024-04-25T02:06:31.318 INFO:tasks.workunit.client.0.smithi162.stdout:7/885: write df/d2e/d4c/d58/f88 [4508129,93303] 0 2024-04-25T02:06:31.546 INFO:tasks.workunit.client.0.smithi162.stdout:8/841: creat d0/d86/f126 x:0 0 0 2024-04-25T02:06:31.628 INFO:tasks.workunit.client.0.smithi162.stdout:3/877: dread d2/d9/d10/d4c/d51/d63/d87/d86/fcc [0,4194304] 0 2024-04-25T02:06:31.740 INFO:tasks.workunit.client.0.smithi162.stdout:9/795: unlink d4/d8/d13/d38/lb7 0 2024-04-25T02:06:31.873 INFO:tasks.workunit.client.0.smithi162.stdout:4/873: dread dd/d1a/fde [0,4194304] 0 2024-04-25T02:06:31.877 INFO:tasks.workunit.client.0.smithi162.stdout:3/878: chown d2/d9/d19/c42 103780 1 2024-04-25T02:06:31.894 INFO:tasks.workunit.client.0.smithi162.stdout:5/848: write d15/d19/d24/d2b/d3b/d3c/d3f/f6f [1454605,122571] 0 2024-04-25T02:06:31.971 INFO:tasks.workunit.client.0.smithi162.stdout:7/886: symlink df/d2e/d4c/d58/dd3/dd8/def/l132 0 2024-04-25T02:06:32.421 INFO:tasks.workunit.client.0.smithi162.stdout:9/796: truncate d4/d9/f47 4142206 0 2024-04-25T02:06:32.463 INFO:tasks.workunit.client.0.smithi162.stdout:6/821: write d1/d13/d28/d30/d8a/dc3/fde [506920,17376] 0 2024-04-25T02:06:32.723 INFO:tasks.workunit.client.0.smithi162.stdout:7/887: dread df/d2c/d49/d7a/fce [0,4194304] 0 2024-04-25T02:06:32.892 INFO:tasks.workunit.client.0.smithi162.stdout:7/888: sync 2024-04-25T02:06:32.954 INFO:tasks.workunit.client.0.smithi162.stdout:5/849: chown d15/d19/d24/d4d/d7c/d85/dde/de5/ff7 8 1 2024-04-25T02:06:33.143 INFO:tasks.workunit.client.0.smithi162.stdout:8/842: dread d0/d12/d1b/d74/d8a/da3/fb3 [0,4194304] 0 2024-04-25T02:06:33.187 INFO:tasks.workunit.client.0.smithi162.stdout:3/879: creat d2/d9/d10/d4c/d51/d63/d87/d110/f124 x:0 0 0 2024-04-25T02:06:33.202 INFO:tasks.workunit.client.0.smithi162.stdout:2/820: dwrite d0/d3/d5/d36/f65 [0,4194304] 0 2024-04-25T02:06:33.452 INFO:tasks.workunit.client.0.smithi162.stdout:6/822: dread - d1/d13/d28/d53/d71/dc5/fe9 zero size 2024-04-25T02:06:33.484 INFO:tasks.workunit.client.0.smithi162.stdout:3/880: stat d2/d9/d10/d2c/l4d 0 2024-04-25T02:06:33.663 INFO:tasks.workunit.client.0.smithi162.stdout:3/881: stat d2/d9/d10/f116 0 2024-04-25T02:06:33.726 INFO:tasks.workunit.client.0.smithi162.stdout:5/850: rmdir d15/d19/d24/d2b/d3b/d58/daf/dc8 39 2024-04-25T02:06:33.812 INFO:tasks.workunit.client.0.smithi162.stdout:0/937: dwrite d0/df/d20/fbc [0,4194304] 0 2024-04-25T02:06:34.052 INFO:tasks.workunit.client.0.smithi162.stdout:9/797: truncate d4/d9/d15/d1b/d2f/d30/f3d 2272095 0 2024-04-25T02:06:34.214 INFO:tasks.workunit.client.0.smithi162.stdout:2/821: mkdir d0/d3/d1b/d6b/dc0/d5e/d125 0 2024-04-25T02:06:34.332 INFO:tasks.workunit.client.0.smithi162.stdout:1/879: write d15/d1f/d35/d5c/d83/ffd [962512,111249] 0 2024-04-25T02:06:34.376 INFO:tasks.workunit.client.0.smithi162.stdout:1/880: stat d15/d69/d4f/ccf 0 2024-04-25T02:06:34.501 INFO:tasks.workunit.client.0.smithi162.stdout:4/874: link dd/df/d7e/caf dd/d1a/d34/d9d/c11f 0 2024-04-25T02:06:34.880 INFO:tasks.workunit.client.0.smithi162.stdout:3/882: creat d2/d9/d10/d4c/d51/ddd/f125 x:0 0 0 2024-04-25T02:06:35.215 INFO:tasks.workunit.client.0.smithi162.stdout:9/798: unlink d4/d9/d15/d1b/d69/c86 0 2024-04-25T02:06:35.475 INFO:tasks.workunit.client.0.smithi162.stdout:1/881: read d15/d1f/d23/d30/d4a/d7f/fdd [3577639,119768] 0 2024-04-25T02:06:35.994 INFO:tasks.workunit.client.0.smithi162.stdout:3/883: truncate d2/d9/d99/f2f 447501 0 2024-04-25T02:06:36.184 INFO:tasks.workunit.client.0.smithi162.stdout:9/799: unlink d4/d8/d13/cae 0 2024-04-25T02:06:36.403 INFO:tasks.workunit.client.0.smithi162.stdout:1/882: creat d15/d69/d4f/f124 x:0 0 0 2024-04-25T02:06:36.461 INFO:tasks.workunit.client.0.smithi162.stdout:1/883: write d15/d1f/d35/d5c/d83/ffd [683252,92132] 0 2024-04-25T02:06:36.746 INFO:tasks.workunit.client.0.smithi162.stdout:0/938: creat d0/d1/d6a/f147 x:0 0 0 2024-04-25T02:06:36.777 INFO:tasks.workunit.client.0.smithi162.stdout:0/939: chown d0/d1/d4e/dd4 0 1 2024-04-25T02:06:37.062 INFO:tasks.workunit.client.0.smithi162.stdout:9/800: rmdir d4/d7c 39 2024-04-25T02:06:37.096 INFO:tasks.workunit.client.0.smithi162.stdout:9/801: chown d4/d25/f6e 8 1 2024-04-25T02:06:37.344 INFO:tasks.workunit.client.0.smithi162.stdout:6/823: getdents d1/d46/d7a 0 2024-04-25T02:06:38.540 INFO:tasks.workunit.client.0.smithi162.stdout:6/824: creat d1/d46/d7a/f10b x:0 0 0 2024-04-25T02:06:38.715 INFO:tasks.workunit.client.0.smithi162.stdout:0/940: rmdir d0/d1/d4e/d76/dec 0 2024-04-25T02:06:39.569 INFO:tasks.workunit.client.0.smithi162.stdout:6/825: rmdir d1/d13/d28/d30/d3a/d57 39 2024-04-25T02:06:39.579 INFO:tasks.workunit.client.0.smithi162.stdout:8/843: write d0/f9f [4799201,21480] 0 2024-04-25T02:06:39.860 INFO:tasks.workunit.client.0.smithi162.stdout:3/884: write d2/d29/d2e/f31 [3814829,63144] 0 2024-04-25T02:06:40.178 INFO:tasks.workunit.client.0.smithi162.stdout:2/822: dwrite d0/d3/d5/d36/d93/de0/f10f [0,4194304] 0 2024-04-25T02:06:40.189 INFO:tasks.workunit.client.0.smithi162.stdout:5/851: dwrite d15/d19/d24/d4d/d7c/d85/dde/fe9 [0,4194304] 0 2024-04-25T02:06:40.341 INFO:tasks.workunit.client.0.smithi162.stdout:5/852: sync 2024-04-25T02:06:40.447 INFO:tasks.workunit.client.0.smithi162.stdout:1/884: write d15/d1f/d23/d30/d4a/d7f/d97/fa2 [1472214,22956] 0 2024-04-25T02:06:40.751 INFO:tasks.workunit.client.0.smithi162.stdout:9/802: dwrite d4/d8/d85/f94 [0,4194304] 0 2024-04-25T02:06:40.910 INFO:tasks.workunit.client.0.smithi162.stdout:6/826: symlink d1/d13/d28/d30/d63/l10c 0 2024-04-25T02:06:41.317 INFO:tasks.workunit.client.0.smithi162.stdout:3/885: dread - d2/d9/d10/d4c/d51/d63/d87/f122 zero size 2024-04-25T02:06:41.501 INFO:tasks.workunit.client.0.smithi162.stdout:2/823: creat d0/d3/d1b/d6b/d92/f126 x:0 0 0 2024-04-25T02:06:41.730 INFO:tasks.workunit.client.0.smithi162.stdout:9/803: rmdir d4 39 2024-04-25T02:06:41.898 INFO:tasks.workunit.client.0.smithi162.stdout:6/827: readlink d1/d13/d28/l54 0 2024-04-25T02:06:41.980 INFO:tasks.workunit.client.0.smithi162.stdout:0/941: creat d0/df/d20/d25/d51/f148 x:0 0 0 2024-04-25T02:06:42.332 INFO:tasks.workunit.client.0.smithi162.stdout:1/885: creat d15/d1f/d35/d4c/d121/f125 x:0 0 0 2024-04-25T02:06:42.612 INFO:tasks.workunit.client.0.smithi162.stdout:7/889: rename df/d2e/d4c/d58/le6 to df/d2e/l133 0 2024-04-25T02:06:42.669 INFO:tasks.workunit.client.0.smithi162.stdout:9/804: readlink d4/d8/d85/l8e 0 2024-04-25T02:06:42.775 INFO:tasks.workunit.client.0.smithi162.stdout:0/942: dread d0/df/f66 [0,4194304] 0 2024-04-25T02:06:42.808 INFO:tasks.workunit.client.0.smithi162.stdout:7/890: sync 2024-04-25T02:06:43.440 INFO:tasks.workunit.client.0.smithi162.stdout:1/886: dread - d15/d1f/d23/d30/d4a/d7f/fe0 zero size 2024-04-25T02:06:43.641 INFO:tasks.workunit.client.0.smithi162.stdout:2/824: rename d0/d3/d1b/d1d/c52 to d0/d3/d1b/d6b/dc0/d67/d9c/de8/c127 0 2024-04-25T02:06:43.849 INFO:tasks.workunit.client.0.smithi162.stdout:0/943: read - d0/d1/d64/f9c zero size 2024-04-25T02:06:44.538 INFO:tasks.workunit.client.0.smithi162.stdout:2/825: mkdir d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/d128 0 2024-04-25T02:06:44.728 INFO:tasks.workunit.client.0.smithi162.stdout:0/944: symlink d0/df/d20/d25/dce/l149 0 2024-04-25T02:06:44.820 INFO:tasks.workunit.client.0.smithi162.stdout:7/891: mknod df/c134 0 2024-04-25T02:06:45.022 INFO:tasks.workunit.client.0.smithi162.stdout:3/886: link d2/d9/f5f d2/d9/f126 0 2024-04-25T02:06:45.115 INFO:tasks.workunit.client.0.smithi162.stdout:1/887: mknod d15/c126 0 2024-04-25T02:06:45.214 INFO:tasks.workunit.client.0.smithi162.stdout:5/853: write d15/f65 [3664490,101729] 0 2024-04-25T02:06:45.366 INFO:tasks.workunit.client.0.smithi162.stdout:4/875: rmdir dd/df 39 2024-04-25T02:06:45.566 INFO:tasks.workunit.client.0.smithi162.stdout:0/945: fdatasync d0/df/fd1 0 2024-04-25T02:06:45.763 INFO:tasks.workunit.client.0.smithi162.stdout:8/844: write d0/d12/d1b/d74/d8a/fa7 [597126,34693] 0 2024-04-25T02:06:45.767 INFO:tasks.workunit.client.0.smithi162.stdout:2/826: dread d0/d3/d1b/d6b/dc0/d5e/d61/da4/f73 [0,4194304] 0 2024-04-25T02:06:45.781 INFO:tasks.workunit.client.0.smithi162.stdout:0/946: chown d0/d1/d64/l10c 127 1 2024-04-25T02:06:45.821 INFO:tasks.workunit.client.0.smithi162.stdout:1/888: dread - d15/d1f/d23/d30/d4a/d7f/fd1 zero size 2024-04-25T02:06:45.931 INFO:tasks.workunit.client.0.smithi162.stdout:5/854: mkdir d15/d19/d24/d4d/d7c/de2/d119 0 2024-04-25T02:06:46.439 INFO:tasks.workunit.client.0.smithi162.stdout:6/828: rename d1/le8 to d1/d13/d28/d30/l10d 0 2024-04-25T02:06:46.519 INFO:tasks.workunit.client.0.smithi162.stdout:9/805: getdents d4/d9/da9 0 2024-04-25T02:06:46.578 INFO:tasks.workunit.client.0.smithi162.stdout:8/845: mknod d0/d12/d2b/c127 0 2024-04-25T02:06:46.637 INFO:tasks.workunit.client.0.smithi162.stdout:0/947: mkdir d0/d1/d4b/d14a 0 2024-04-25T02:06:46.892 INFO:tasks.workunit.client.0.smithi162.stdout:2/827: dread d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/da2/de2/fe7 [0,4194304] 0 2024-04-25T02:06:47.991 INFO:tasks.workunit.client.0.smithi162.stdout:0/948: read - d0/df/d20/d37/d58/fb6 zero size 2024-04-25T02:06:48.268 INFO:tasks.workunit.client.0.smithi162.stdout:1/889: getdents d15/d1f/d35/d4c/d70/d73/db8/df4/d112 0 2024-04-25T02:06:48.345 INFO:tasks.workunit.client.0.smithi162.stdout:2/828: mkdir d0/d3/d1b/d6b/d92/d9a/d129 0 2024-04-25T02:06:48.736 INFO:tasks.workunit.client.0.smithi162.stdout:7/892: rename df/c16 to df/d2e/d4c/d58/dd3/dd8/c135 0 2024-04-25T02:06:49.085 INFO:tasks.workunit.client.0.smithi162.stdout:0/949: symlink d0/df/d20/d37/d118/l14b 0 2024-04-25T02:06:49.592 INFO:tasks.workunit.client.0.smithi162.stdout:5/855: creat d15/d19/d24/d4d/d7c/d85/dde/f11a x:0 0 0 2024-04-25T02:06:49.633 INFO:tasks.workunit.client.0.smithi162.stdout:5/856: chown d15/d19/d24/d4d/c61 4178 1 2024-04-25T02:06:49.731 INFO:tasks.workunit.client.0.smithi162.stdout:7/893: symlink df/d2e/d4c/d8a/db2/df0/l136 0 2024-04-25T02:06:50.350 INFO:tasks.workunit.client.0.smithi162.stdout:5/857: read d15/d19/d24/d4d/d7c/d85/dde/fe9 [1534746,84118] 0 2024-04-25T02:06:50.527 INFO:tasks.workunit.client.0.smithi162.stdout:4/876: link dd/d1a/d34/ffe dd/df/d2e/f120 0 2024-04-25T02:06:50.623 INFO:tasks.workunit.client.0.smithi162.stdout:8/846: getdents d0/d44/d64/d112 0 2024-04-25T02:06:51.005 INFO:tasks.workunit.client.0.smithi162.stdout:3/887: rename d2/d9/d10/d4c/d51/d63/d87/db6/f8f to d2/d9/d19/f127 0 2024-04-25T02:06:51.822 INFO:tasks.workunit.client.0.smithi162.stdout:0/950: link d0/d7b/c89 d0/df/d20/d37/c14c 0 2024-04-25T02:06:51.836 INFO:tasks.workunit.client.0.smithi162.stdout:6/829: write d1/f24 [999425,67763] 0 2024-04-25T02:06:52.065 INFO:tasks.workunit.client.0.smithi162.stdout:9/806: rename d4/d9/d15/d1b/d2f/d30/f70 to d4/d8/d85/dd6/f11f 0 2024-04-25T02:06:52.079 INFO:tasks.workunit.client.0.smithi162.stdout:3/888: truncate d2/d9/d10/d4c/d51/d63/fff 1022843 0 2024-04-25T02:06:52.149 INFO:tasks.workunit.client.0.smithi162.stdout:9/807: chown d4/d8/d85/d101 25062 1 2024-04-25T02:06:52.150 INFO:tasks.workunit.client.0.smithi162.stdout:3/889: stat d2/d29/d2e/f4f 0 2024-04-25T02:06:52.488 INFO:tasks.workunit.client.0.smithi162.stdout:5/858: mkdir d15/d19/d24/d2b/d3b/d80/de1/d11b 0 2024-04-25T02:06:52.850 INFO:tasks.workunit.client.0.smithi162.stdout:8/847: mknod d0/d12/d1b/c128 0 2024-04-25T02:06:53.710 INFO:tasks.workunit.client.0.smithi162.stdout:0/951: dread - d0/df/d20/d25/d55/d142/f140 zero size 2024-04-25T02:06:53.723 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:06:53.726 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:06:53.730 INFO:tasks.workunit.client.0.smithi162.stdout:2/829: rename d0/d3/d1b/d6b/dc0/d5e/d61/da4/lc6 to d0/d3/d5/d36/l12a 0 2024-04-25T02:06:53.795 INFO:tasks.workunit.client.0.smithi162.stdout:3/890: rmdir d2/d9/d10/d4c/d51/d63/d87 39 2024-04-25T02:06:53.806 INFO:tasks.workunit.client.0.smithi162.stdout:5/859: symlink d15/d19/d24/d2b/d3b/d3c/d3f/l11c 0 2024-04-25T02:06:54.471 INFO:tasks.workunit.client.0.smithi162.stdout:1/890: dwrite d15/d1f/d35/d4c/d70/fec [0,4194304] 0 2024-04-25T02:06:54.591 INFO:tasks.workunit.client.0.smithi162.stdout:8/848: mkdir d0/d1a/d129 0 2024-04-25T02:06:54.640 INFO:tasks.workunit.client.0.smithi162.stdout:9/808: dread d4/d8/d13/dbf/fcf [0,4194304] 0 2024-04-25T02:06:54.685 INFO:tasks.workunit.client.0.smithi162.stdout:7/894: write df/d2e/d4c/d58/dd3/dd8/ff8 [1160228,13876] 0 2024-04-25T02:06:54.767 INFO:tasks.workunit.client.0.smithi162.stdout:3/891: creat d2/ddf/de7/df6/f128 x:0 0 0 2024-04-25T02:06:54.813 INFO:tasks.workunit.client.0.smithi162.stdout:5/860: chown d15/d19/d24/f64 2258 1 2024-04-25T02:06:54.880 INFO:tasks.workunit.client.0.smithi162.stdout:4/877: write dd/d1a/d4e/f56 [911455,31184] 0 2024-04-25T02:06:54.887 INFO:tasks.workunit.client.0.smithi162.stdout:0/952: truncate d0/df/d20/d37/d81/f13e 531255 0 2024-04-25T02:06:54.898 INFO:tasks.workunit.client.0.smithi162.stdout:6/830: symlink d1/l10e 0 2024-04-25T02:06:54.975 INFO:tasks.workunit.client.0.smithi162.stdout:3/892: chown d2/d9/d10/d4c/d51/f7e 38442 1 2024-04-25T02:06:55.371 INFO:tasks.workunit.client.0.smithi162.stdout:1/891: creat d15/d69/f127 x:0 0 0 2024-04-25T02:06:55.496 INFO:tasks.workunit.client.0.smithi162.stdout:7/895: stat df/d2e/ffc 0 2024-04-25T02:06:55.636 INFO:tasks.workunit.client.0.smithi162.stdout:9/809: symlink d4/d9/d15/d1b/d2f/d30/l120 0 2024-04-25T02:06:55.690 INFO:tasks.workunit.client.0.smithi162.stdout:0/953: chown d0/d1/fa6 56 1 2024-04-25T02:06:55.800 INFO:tasks.workunit.client.0.smithi162.stdout:4/878: fsync dd/d1a/f26 0 2024-04-25T02:06:56.093 INFO:tasks.workunit.client.0.smithi162.stdout:5/861: truncate d15/d19/d24/d4d/d7c/d85/fba 199488 0 2024-04-25T02:06:56.498 INFO:tasks.workunit.client.0.smithi162.stdout:8/849: unlink d0/d12/d2b/dc7/fe2 0 2024-04-25T02:06:56.806 INFO:tasks.workunit.client.0.smithi162.stdout:1/892: dread d15/d69/f7d [0,4194304] 0 2024-04-25T02:06:56.854 INFO:tasks.workunit.client.0.smithi162.stdout:1/893: chown d15/d1f/d35/d5c/l91 619 1 2024-04-25T02:06:56.928 INFO:tasks.workunit.client.0.smithi162.stdout:0/954: mkdir d0/df/d20/d37/d118/d14d 0 2024-04-25T02:06:57.128 INFO:tasks.workunit.client.0.smithi162.stdout:1/894: sync 2024-04-25T02:06:57.154 INFO:tasks.workunit.client.0.smithi162.stdout:4/879: truncate dd/df/d58/f66 151383 0 2024-04-25T02:06:57.716 INFO:tasks.workunit.client.0.smithi162.stdout:2/830: write d0/d3/d1b/d6b/dc0/d5e/fc9 [847361,127670] 0 2024-04-25T02:06:58.003 INFO:tasks.workunit.client.0.smithi162.stdout:0/955: rename d0/d1/d6a/da9/f10b to d0/df/d20/d37/d118/f14e 0 2024-04-25T02:06:58.099 INFO:tasks.workunit.client.0.smithi162.stdout:0/956: sync 2024-04-25T02:06:58.235 INFO:tasks.workunit.client.0.smithi162.stdout:4/880: creat dd/df/d2e/dd4/d103/f121 x:0 0 0 2024-04-25T02:06:58.383 INFO:tasks.workunit.client.0.smithi162.stdout:6/831: link d1/d13/d28/c2d d1/d13/d28/d53/d71/dc5/c10f 0 2024-04-25T02:06:59.421 INFO:tasks.workunit.client.0.smithi162.stdout:3/893: write d2/d9/d19/f73 [34525,73009] 0 2024-04-25T02:06:59.720 INFO:tasks.workunit.client.0.smithi162.stdout:7/896: mknod df/d2e/c137 0 2024-04-25T02:06:59.722 INFO:tasks.workunit.client.0.smithi162.stdout:0/957: getdents d0/d1/d4b/d14a 0 2024-04-25T02:06:59.846 INFO:tasks.workunit.client.0.smithi162.stdout:1/895: creat d15/d1f/d35/d4c/d70/d9f/dea/f128 x:0 0 0 2024-04-25T02:06:59.878 INFO:tasks.workunit.client.0.smithi162.stdout:1/896: stat d15/d1f/d35/d4c/f103 0 2024-04-25T02:07:00.024 INFO:tasks.workunit.client.0.smithi162.stdout:4/881: fdatasync dd/df/d2e/fad 0 2024-04-25T02:07:00.802 INFO:tasks.workunit.client.0.smithi162.stdout:3/894: unlink d2/d9/d10/d4c/fae 0 2024-04-25T02:07:01.195 INFO:tasks.workunit.client.0.smithi162.stdout:7/897: symlink df/d2c/l138 0 2024-04-25T02:07:01.308 INFO:tasks.workunit.client.0.smithi162.stdout:4/882: dread dd/d1a/d34/d57/fc6 [0,4194304] 0 2024-04-25T02:07:01.344 INFO:tasks.workunit.client.0.smithi162.stdout:0/958: mknod d0/df/d20/d25/d55/d6f/d7d/d122/d145/c14f 0 2024-04-25T02:07:01.744 INFO:tasks.workunit.client.0.smithi162.stdout:9/810: write d4/d8/d13/f2a [1784553,79727] 0 2024-04-25T02:07:01.753 INFO:tasks.workunit.client.0.smithi162.stdout:8/850: dwrite d0/d12/d1b/d74/d8a/d8f/f11a [0,4194304] 0 2024-04-25T02:07:02.215 INFO:tasks.workunit.client.0.smithi162.stdout:1/897: mkdir d15/d1f/d35/d4c/d70/d73/db8/dbb/d11e/d129 0 2024-04-25T02:07:02.240 INFO:tasks.workunit.client.0.smithi162.stdout:1/898: readlink d15/d69/d4f/l92 0 2024-04-25T02:07:02.318 INFO:tasks.workunit.client.0.smithi162.stdout:3/895: creat d2/da5/f129 x:0 0 0 2024-04-25T02:07:02.617 INFO:tasks.workunit.client.0.smithi162.stdout:4/883: mknod dd/d1a/d4e/c122 0 2024-04-25T02:07:02.639 INFO:tasks.workunit.client.0.smithi162.stdout:5/862: write d15/d19/d24/d4d/d7c/d85/de7/ddd/f113 [417389,41092] 0 2024-04-25T02:07:02.740 INFO:tasks.workunit.client.0.smithi162.stdout:4/884: sync 2024-04-25T02:07:02.826 INFO:tasks.workunit.client.0.smithi162.stdout:2/831: write d0/f8d [5088021,67611] 0 2024-04-25T02:07:03.203 INFO:tasks.workunit.client.0.smithi162.stdout:1/899: fdatasync d15/d1f/d23/fb2 0 2024-04-25T02:07:03.657 INFO:tasks.workunit.client.0.smithi162.stdout:5/863: unlink d15/d19/d24/d2b/d3b/d80/fe8 0 2024-04-25T02:07:03.879 INFO:tasks.workunit.client.0.smithi162.stdout:4/885: symlink dd/d1a/d34/db1/dba/dfd/db8/l123 0 2024-04-25T02:07:04.213 INFO:tasks.workunit.client.0.smithi162.stdout:2/832: creat d0/d3/d7a/d88/f12b x:0 0 0 2024-04-25T02:07:04.552 INFO:tasks.workunit.client.0.smithi162.stdout:6/832: dwrite d1/d13/d28/d7b/dbb/fe6 [0,4194304] 0 2024-04-25T02:07:05.069 INFO:tasks.workunit.client.0.smithi162.stdout:4/886: dread - dd/df/d2e/d4b/d79/f81 zero size 2024-04-25T02:07:05.161 INFO:tasks.workunit.client.0.smithi162.stdout:0/959: link d0/df/d117/l139 d0/df/d20/d37/dfc/d11e/l150 0 2024-04-25T02:07:05.624 INFO:tasks.workunit.client.0.smithi162.stdout:8/851: creat d0/d12/d1b/d74/f12a x:0 0 0 2024-04-25T02:07:05.687 INFO:tasks.workunit.client.0.smithi162.stdout:8/852: write d0/d12/d1b/d74/f12a [341016,31623] 0 2024-04-25T02:07:06.108 INFO:tasks.workunit.client.0.smithi162.stdout:6/833: creat d1/d13/d28/d30/d66/f110 x:0 0 0 2024-04-25T02:07:06.372 INFO:tasks.workunit.client.0.smithi162.stdout:4/887: dread - dd/fc3 zero size 2024-04-25T02:07:07.014 INFO:tasks.workunit.client.0.smithi162.stdout:8/853: dread d0/d1a/f3d [0,4194304] 0 2024-04-25T02:07:07.063 INFO:tasks.workunit.client.0.smithi162.stdout:9/811: write d4/d9/d15/f5c [4870284,109085] 0 2024-04-25T02:07:07.311 INFO:tasks.workunit.client.0.smithi162.stdout:4/888: mknod dd/df/d2e/d4b/d79/c124 0 2024-04-25T02:07:07.481 INFO:tasks.workunit.client.0.smithi162.stdout:4/889: sync 2024-04-25T02:07:07.514 INFO:tasks.workunit.client.0.smithi162.stdout:4/890: chown dd/d1a/d34/d72/la6 1 1 2024-04-25T02:07:07.657 INFO:tasks.workunit.client.0.smithi162.stdout:3/896: write d2/d9/d10/d2c/f5c [1476477,125708] 0 2024-04-25T02:07:07.813 INFO:tasks.workunit.client.0.smithi162.stdout:7/898: write df/d2e/f48 [418053,62034] 0 2024-04-25T02:07:08.206 INFO:tasks.workunit.client.0.smithi162.stdout:0/960: link d0/df/l21 d0/d1/dab/ddc/l151 0 2024-04-25T02:07:09.098 INFO:tasks.workunit.client.0.smithi162.stdout:7/899: symlink df/d2e/d111/l139 0 2024-04-25T02:07:09.513 INFO:tasks.workunit.client.0.smithi162.stdout:7/900: mknod df/d2c/d49/d7a/db5/dc1/c13a 0 2024-04-25T02:07:10.038 INFO:tasks.workunit.client.0.smithi162.stdout:1/900: write d15/d1f/d23/d30/d4a/fd0 [1150599,48501] 0 2024-04-25T02:07:10.189 INFO:tasks.workunit.client.0.smithi162.stdout:1/901: sync 2024-04-25T02:07:10.492 INFO:tasks.workunit.client.0.smithi162.stdout:3/897: link d2/d9/d10/d4c/d51/f114 d2/d9/d10/d2c/da3/dba/f12a 0 2024-04-25T02:07:10.590 INFO:tasks.workunit.client.0.smithi162.stdout:0/961: link d0/d1/ca d0/df/d20/d25/d55/d6f/d7d/da7/c152 0 2024-04-25T02:07:10.597 INFO:tasks.workunit.client.0.smithi162.stdout:2/833: write d0/d3/f16 [1684629,12153] 0 2024-04-25T02:07:10.722 INFO:tasks.workunit.client.0.smithi162.stdout:5/864: dwrite fd [0,4194304] 0 2024-04-25T02:07:10.947 INFO:tasks.workunit.client.0.smithi162.stdout:5/865: chown d15/d19/d24/d2b/d3b/d3c/d3f/f51 12 1 2024-04-25T02:07:11.146 INFO:tasks.workunit.client.0.smithi162.stdout:8/854: write d0/d12/f23 [2953361,84590] 0 2024-04-25T02:07:11.249 INFO:tasks.workunit.client.0.smithi162.stdout:8/855: sync 2024-04-25T02:07:11.942 INFO:tasks.workunit.client.0.smithi162.stdout:4/891: dwrite dd/d1a/d34/db1/fd8 [0,4194304] 0 2024-04-25T02:07:12.120 INFO:tasks.workunit.client.0.smithi162.stdout:6/834: dwrite d1/f2a [0,4194304] 0 2024-04-25T02:07:12.154 INFO:tasks.workunit.client.0.smithi162.stdout:9/812: dwrite d4/d8/d13/dbf/fcf [0,4194304] 0 2024-04-25T02:07:12.714 INFO:tasks.workunit.client.0.smithi162.stdout:7/901: write df/f43 [1304258,67266] 0 2024-04-25T02:07:12.973 INFO:tasks.workunit.client.0.smithi162.stdout:2/834: write d0/d3/d1b/d6b/dc0/d67/d9c/de8/f106 [563298,92645] 0 2024-04-25T02:07:13.850 INFO:tasks.workunit.client.0.smithi162.stdout:1/902: dwrite d15/d1f/d35/d4c/f103 [0,4194304] 0 2024-04-25T02:07:13.955 INFO:tasks.workunit.client.0.smithi162.stdout:3/898: dwrite d2/d9/d10/d2c/da3/fc8 [4194304,4194304] 0 2024-04-25T02:07:13.982 INFO:tasks.workunit.client.0.smithi162.stdout:4/892: fdatasync dd/df/d2e/d4b/ffc 0 2024-04-25T02:07:14.087 INFO:tasks.workunit.client.0.smithi162.stdout:6/835: symlink d1/d13/d28/l111 0 2024-04-25T02:07:14.181 INFO:tasks.workunit.client.0.smithi162.stdout:9/813: mknod d4/d9/d15/d1b/d2f/c121 0 2024-04-25T02:07:14.186 INFO:tasks.workunit.client.0.smithi162.stdout:0/962: dwrite d0/df/d20/d37/d58/fb6 [0,4194304] 0 2024-04-25T02:07:14.256 INFO:tasks.workunit.client.0.smithi162.stdout:3/899: sync 2024-04-25T02:07:14.332 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:18:03.762 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:07:14.339 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:18:03.769 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:07:14.372 INFO:tasks.workunit.client.0.smithi162.stdout:3/900: sync 2024-04-25T02:07:14.374 INFO:tasks.workunit.client.0.smithi162.stdout:5/866: dwrite d15/d19/d24/d2b/f52 [0,4194304] 0 2024-04-25T02:07:14.375 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:18:03.722 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:07:14.377 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:18:03.724 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:07:14.389 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:18:03.736 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:07:14.394 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:18:03.740 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:07:14.402 INFO:tasks.workunit.client.0.smithi162.stdout:7/902: mknod df/d2e/d4c/d58/d82/c13b 0 2024-04-25T02:07:14.434 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:18:03.863 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:07:14.484 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:18:03.831 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:07:14.512 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:18:03.859 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:07:14.668 INFO:tasks.workunit.client.0.smithi162.stdout:3/901: chown d2/d29/d2e/c72 179703187 1 2024-04-25T02:07:14.717 INFO:tasks.workunit.client.0.smithi162.stdout:8/856: dwrite d0/d12/d1b/d74/d8a/f93 [0,4194304] 0 2024-04-25T02:07:14.724 INFO:tasks.workunit.client.0.smithi162.stdout:7/903: rename df/d2c to df/d2c/d49/d5d/d13c 22 2024-04-25T02:07:14.733 INFO:tasks.workunit.client.0.smithi162.stdout:0/963: dread d0/df/d20/d37/f60 [0,4194304] 0 2024-04-25T02:07:14.836 INFO:tasks.workunit.client.0.smithi162.stdout:1/903: mknod d15/d1f/d35/d4c/d70/c12a 0 2024-04-25T02:07:14.964 INFO:tasks.workunit.client.0.smithi162.stdout:1/904: readlink d15/d1f/d23/d30/d4a/d7f/l106 0 2024-04-25T02:07:15.115 INFO:tasks.workunit.client.0.smithi162.stdout:7/904: dread df/f37 [0,4194304] 0 2024-04-25T02:07:15.185 INFO:tasks.workunit.client.0.smithi162.stdout:2/835: symlink d0/d3/d1b/d6b/dc0/d5e/d125/l12c 0 2024-04-25T02:07:15.203 INFO:tasks.workunit.client.0.smithi162.stdout:5/867: creat d15/d19/d24/d4d/d9d/f11d x:0 0 0 2024-04-25T02:07:15.236 INFO:tasks.workunit.client.0.smithi162.stdout:0/964: readlink d0/d1/l5e 0 2024-04-25T02:07:15.327 INFO:tasks.workunit.client.0.smithi162.stdout:5/868: chown d15/d19/d24/d4d/d7c/de2/d10a/dbf/de3/lec 15 1 2024-04-25T02:07:15.539 INFO:tasks.workunit.client.0.smithi162.stdout:1/905: creat d15/d69/d4f/dad/f12b x:0 0 0 2024-04-25T02:07:15.544 INFO:tasks.workunit.client.0.smithi162.stdout:4/893: write dd/f33 [2732895,115163] 0 2024-04-25T02:07:15.581 INFO:tasks.workunit.client.0.smithi162.stdout:3/902: dread - d2/d9/d10/d2c/da3/dba/f12a zero size 2024-04-25T02:07:15.632 INFO:tasks.workunit.client.0.smithi162.stdout:7/905: symlink df/d2e/d4c/d58/dd3/l13d 0 2024-04-25T02:07:15.781 INFO:tasks.workunit.client.0.smithi162.stdout:6/836: creat d1/d13/d28/f112 x:0 0 0 2024-04-25T02:07:15.976 INFO:tasks.workunit.client.0.smithi162.stdout:4/894: dread dd/d1a/d34/d57/f71 [0,4194304] 0 2024-04-25T02:07:16.242 INFO:tasks.workunit.client.0.smithi162.stdout:4/895: dread dd/df/d2e/fad [0,4194304] 0 2024-04-25T02:07:16.276 INFO:tasks.workunit.client.0.smithi162.stdout:0/965: read d0/df/d20/d37/dfc/f108 [348514,30739] 0 2024-04-25T02:07:16.638 INFO:tasks.workunit.client.0.smithi162.stdout:7/906: dread df/d2e/f6c [0,4194304] 0 2024-04-25T02:07:16.722 INFO:tasks.workunit.client.0.smithi162.stdout:9/814: link d4/d9/da9/ff3 d4/d9/d15/d1b/d2f/d30/f122 0 2024-04-25T02:07:16.768 INFO:tasks.workunit.client.0.smithi162.stdout:6/837: chown d1/d13/d28/d45/c52 115259638 1 2024-04-25T02:07:16.834 INFO:tasks.workunit.client.0.smithi162.stdout:8/857: write d0/d1a/fae [3164156,87156] 0 2024-04-25T02:07:17.577 INFO:tasks.workunit.client.0.smithi162.stdout:0/966: creat d0/df/d117/f153 x:0 0 0 2024-04-25T02:07:17.605 INFO:tasks.workunit.client.0.smithi162.stdout:4/896: chown dd/df/d2e/c31 439 1 2024-04-25T02:07:17.808 INFO:tasks.workunit.client.0.smithi162.stdout:7/907: unlink df/d2e/d4c/d8a/db2/df0/f110 0 2024-04-25T02:07:17.853 INFO:tasks.workunit.client.0.smithi162.stdout:5/869: dwrite d15/d19/d24/d4d/d7c/fae [0,4194304] 0 2024-04-25T02:07:17.974 INFO:tasks.workunit.client.0.smithi162.stdout:1/906: write d15/d1f/d23/f114 [917385,97878] 0 2024-04-25T02:07:18.048 INFO:tasks.workunit.client.0.smithi162.stdout:7/908: sync 2024-04-25T02:07:18.411 INFO:tasks.workunit.client.0.smithi162.stdout:3/903: dwrite d2/d9/d99/dd2/ff4 [0,4194304] 0 2024-04-25T02:07:18.524 INFO:tasks.workunit.client.0.smithi162.stdout:2/836: creat d0/d3/d7a/f12d x:0 0 0 2024-04-25T02:07:18.543 INFO:tasks.workunit.client.0.smithi162.stdout:0/967: symlink d0/d1/d64/l154 0 2024-04-25T02:07:18.554 INFO:tasks.workunit.client.0.smithi162.stdout:4/897: mknod dd/d1a/d34/db1/c125 0 2024-04-25T02:07:18.696 INFO:tasks.workunit.client.0.smithi162.stdout:7/909: mknod df/d2e/d4c/d58/d82/c13e 0 2024-04-25T02:07:18.738 INFO:tasks.workunit.client.0.smithi162.stdout:7/910: dread - df/d2e/d4c/d58/f10c zero size 2024-04-25T02:07:18.853 INFO:tasks.workunit.client.0.smithi162.stdout:5/870: creat d15/d19/d24/d4d/d7c/d85/de7/dd1/f11e x:0 0 0 2024-04-25T02:07:18.964 INFO:tasks.workunit.client.0.smithi162.stdout:1/907: mkdir d15/d1f/d23/d30/d4a/d7f/d97/dbe/dde/d12c 0 2024-04-25T02:07:18.984 INFO:tasks.workunit.client.0.smithi162.stdout:6/838: link d1/d13/d28/d30/d3a/fb7 d1/d13/d28/d30/d66/d89/f113 0 2024-04-25T02:07:19.117 INFO:tasks.workunit.client.0.smithi162.stdout:3/904: fdatasync d2/d9/f39 0 2024-04-25T02:07:19.154 INFO:tasks.workunit.client.0.smithi162.stdout:3/905: stat d2/d9/d99 0 2024-04-25T02:07:19.598 INFO:tasks.workunit.client.0.smithi162.stdout:4/898: symlink dd/d1a/d34/d72/def/l126 0 2024-04-25T02:07:20.389 INFO:tasks.workunit.client.0.smithi162.stdout:1/908: chown d15/d1f/d35/c67 1682396 1 2024-04-25T02:07:20.541 INFO:tasks.workunit.client.0.smithi162.stdout:6/839: symlink d1/d13/d28/d53/l114 0 2024-04-25T02:07:20.834 INFO:tasks.workunit.client.0.smithi162.stdout:9/815: write d4/d8/fd0 [1107694,29975] 0 2024-04-25T02:07:20.878 INFO:tasks.workunit.client.0.smithi162.stdout:8/858: write d0/d44/d64/f119 [61005,56835] 0 2024-04-25T02:07:20.943 INFO:tasks.workunit.client.0.smithi162.stdout:8/859: stat d0/d44/d91/c59 0 2024-04-25T02:07:20.959 INFO:tasks.workunit.client.0.smithi162.stdout:9/816: chown d4/d9/d15/d1b/d2f/d30/dc1 32321 1 2024-04-25T02:07:21.160 INFO:tasks.workunit.client.0.smithi162.stdout:4/899: creat dd/df/d58/deb/f127 x:0 0 0 2024-04-25T02:07:22.110 INFO:tasks.workunit.client.0.smithi162.stdout:1/909: mknod d15/d1f/d35/d4c/d70/d110/c12d 0 2024-04-25T02:07:22.124 INFO:tasks.workunit.client.0.smithi162.stdout:6/840: truncate d1/d13/d28/d45/fa5 183167 0 2024-04-25T02:07:22.371 INFO:tasks.workunit.client.0.smithi162.stdout:6/841: chown d1/d13/d28/cf6 2678 1 2024-04-25T02:07:22.395 INFO:tasks.workunit.client.0.smithi162.stdout:3/906: rmdir d2/d9/d10/d4c/d51/d63/d87/d90/db3/dcd 39 2024-04-25T02:07:22.411 INFO:tasks.workunit.client.0.smithi162.stdout:0/968: write d0/df/d20/d25/d55/d6f/d7d/faa [607918,35492] 0 2024-04-25T02:07:22.434 INFO:tasks.workunit.client.0.smithi162.stdout:2/837: dwrite d0/d3/f1a [0,4194304] 0 2024-04-25T02:07:22.592 INFO:tasks.workunit.client.0.smithi162.stdout:6/842: rename d1/d13 to d1/d13/d79/d115 22 2024-04-25T02:07:22.697 INFO:tasks.workunit.client.0.smithi162.stdout:2/838: sync 2024-04-25T02:07:22.700 INFO:tasks.workunit.client.0.smithi162.stdout:7/911: write df/d2e/d4c/daf/fb6 [751669,79611] 0 2024-04-25T02:07:22.728 INFO:tasks.workunit.client.0.smithi162.stdout:5/871: write d15/d19/d24/d4d/d7c/de2/d10a/fe6 [933721,112923] 0 2024-04-25T02:07:22.731 INFO:tasks.workunit.client.0.smithi162.stdout:4/900: unlink dd/df/l75 0 2024-04-25T02:07:22.738 INFO:tasks.workunit.client.0.smithi162.stdout:9/817: read - d4/d9/d15/d1b/d2f/d30/dc1/d59/dec/f104 zero size 2024-04-25T02:07:22.857 INFO:tasks.workunit.client.0.smithi162.stdout:7/912: readlink df/d2e/d4c/d58/le7 0 2024-04-25T02:07:23.383 INFO:tasks.workunit.client.0.smithi162.stdout:8/860: mkdir d0/d12/d2b/d87/dbe/d12b 0 2024-04-25T02:07:23.488 INFO:tasks.workunit.client.0.smithi162.stdout:3/907: mknod d2/d29/d5d/dcf/c12b 0 2024-04-25T02:07:23.531 INFO:tasks.workunit.client.0.smithi162.stdout:3/908: chown d2/d9/d10/d2c/da3/dba/lc5 78 1 2024-04-25T02:07:23.837 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:07:23.840 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:07:24.134 INFO:tasks.workunit.client.0.smithi162.stdout:5/872: creat d15/d19/d24/d2b/f11f x:0 0 0 2024-04-25T02:07:24.312 INFO:tasks.workunit.client.0.smithi162.stdout:7/913: mknod df/d2c/d63/d83/c13f 0 2024-04-25T02:07:24.443 INFO:tasks.workunit.client.0.smithi162.stdout:1/910: mkdir d15/d1f/d35/d4c/d70/d73/d12e 0 2024-04-25T02:07:25.064 INFO:tasks.workunit.client.0.smithi162.stdout:3/909: mknod d2/d9/d94/c12c 0 2024-04-25T02:07:25.568 INFO:tasks.workunit.client.0.smithi162.stdout:2/839: mkdir d0/d3/d1b/d6b/d12e 0 2024-04-25T02:07:25.915 INFO:tasks.workunit.client.0.smithi162.stdout:5/873: mkdir d15/d19/d24/d4d/d7c/de2/d10a/dbf/d120 0 2024-04-25T02:07:26.428 INFO:tasks.workunit.client.0.smithi162.stdout:7/914: symlink df/d2e/d4c/d58/dd3/l140 0 2024-04-25T02:07:26.446 INFO:tasks.workunit.client.0.smithi162.stdout:1/911: mkdir d15/d1f/d23/d30/d4a/d7f/d97/dbe/d12f 0 2024-04-25T02:07:26.876 INFO:tasks.workunit.client.0.smithi162.stdout:2/840: creat d0/d3/d1b/d6b/dc0/d5e/d61/f12f x:0 0 0 2024-04-25T02:07:27.036 INFO:tasks.workunit.client.0.smithi162.stdout:3/910: dread d2/d9/d10/d2c/da3/fc8 [0,4194304] 0 2024-04-25T02:07:27.163 INFO:tasks.workunit.client.0.smithi162.stdout:5/874: creat d15/d19/d24/d4d/d7c/d85/f121 x:0 0 0 2024-04-25T02:07:27.559 INFO:tasks.workunit.client.0.smithi162.stdout:1/912: read d15/f21 [885784,95689] 0 2024-04-25T02:07:27.619 INFO:tasks.workunit.client.0.smithi162.stdout:9/818: link d4/d9/d15/f5c d4/d9/d15/d1b/d2f/f123 0 2024-04-25T02:07:27.817 INFO:tasks.workunit.client.0.smithi162.stdout:9/819: dread d4/d9/da9/f10d [0,4194304] 0 2024-04-25T02:07:27.915 INFO:tasks.workunit.client.0.smithi162.stdout:0/969: write d0/df/d20/d25/d55/f5c [4998351,6920] 0 2024-04-25T02:07:27.923 INFO:tasks.workunit.client.0.smithi162.stdout:3/911: fdatasync d2/da5/ffe 0 2024-04-25T02:07:27.976 INFO:tasks.workunit.client.0.smithi162.stdout:5/875: creat d15/d19/d24/dca/f122 x:0 0 0 2024-04-25T02:07:27.991 INFO:tasks.workunit.client.0.smithi162.stdout:6/843: write d1/d73/d9a/fa6 [427997,112929] 0 2024-04-25T02:07:28.014 INFO:tasks.workunit.client.0.smithi162.stdout:4/901: write dd/df/d2e/f95 [3660280,3024] 0 2024-04-25T02:07:28.072 INFO:tasks.workunit.client.0.smithi162.stdout:1/913: dread d15/f1d [0,4194304] 0 2024-04-25T02:07:28.153 INFO:tasks.workunit.client.0.smithi162.stdout:0/970: chown d0/d1/d6a/da9 1522892448 1 2024-04-25T02:07:28.225 INFO:tasks.workunit.client.0.smithi162.stdout:4/902: dread dd/fcf [0,4194304] 0 2024-04-25T02:07:28.501 INFO:tasks.workunit.client.0.smithi162.stdout:8/861: write d0/d12/d1b/d74/d8a/d8f/f11a [4954783,62453] 0 2024-04-25T02:07:28.646 INFO:tasks.workunit.client.0.smithi162.stdout:5/876: readlink lc 0 2024-04-25T02:07:28.789 INFO:tasks.workunit.client.0.smithi162.stdout:9/820: symlink d4/dc0/l124 0 2024-04-25T02:07:29.117 INFO:tasks.workunit.client.0.smithi162.stdout:2/841: rmdir d0/d3/d1b/d6b/d92/d9a/de4/df2 0 2024-04-25T02:07:29.132 INFO:tasks.workunit.client.0.smithi162.stdout:6/844: unlink d1/d13/d28/cf6 0 2024-04-25T02:07:29.386 INFO:tasks.workunit.client.0.smithi162.stdout:0/971: unlink d0/df/f39 0 2024-04-25T02:07:29.977 INFO:tasks.workunit.client.0.smithi162.stdout:7/915: mkdir df/d141 0 2024-04-25T02:07:30.215 INFO:tasks.workunit.client.0.smithi162.stdout:5/877: unlink d15/d19/d24/d4d/d7c/d85/de7/f82 0 2024-04-25T02:07:30.329 INFO:tasks.workunit.client.0.smithi162.stdout:9/821: truncate d4/d9/d15/d1b/d69/fe0 2123728 0 2024-04-25T02:07:30.590 INFO:tasks.workunit.client.0.smithi162.stdout:6/845: unlink d1/d13/d28/l111 0 2024-04-25T02:07:30.691 INFO:tasks.workunit.client.0.smithi162.stdout:2/842: dread - d0/d3/d5/d69/feb zero size 2024-04-25T02:07:31.209 INFO:tasks.workunit.client.0.smithi162.stdout:7/916: truncate df/d2e/d4c/daf/fd9 1290216 0 2024-04-25T02:07:31.361 INFO:tasks.workunit.client.0.smithi162.stdout:5/878: unlink d15/d1e/l111 0 2024-04-25T02:07:31.421 INFO:tasks.workunit.client.0.smithi162.stdout:5/879: chown d15/d19/d24/d4d/d7c/d85/de7/c90 809053 1 2024-04-25T02:07:31.439 INFO:tasks.workunit.client.0.smithi162.stdout:5/880: stat d15/d19/f1b 0 2024-04-25T02:07:31.474 INFO:tasks.workunit.client.0.smithi162.stdout:5/881: chown d15/d19/d24/d2b/d3b/d58/f9a 983058 1 2024-04-25T02:07:31.595 INFO:tasks.workunit.client.0.smithi162.stdout:9/822: truncate d4/d8/d13/dbf/fcf 1179201 0 2024-04-25T02:07:31.886 INFO:tasks.workunit.client.0.smithi162.stdout:0/972: fdatasync d0/df/d20/d37/d81/d92/f12a 0 2024-04-25T02:07:32.290 INFO:tasks.workunit.client.0.smithi162.stdout:7/917: dread df/d2e/d4c/d58/f88 [0,4194304] 0 2024-04-25T02:07:32.346 INFO:tasks.workunit.client.0.smithi162.stdout:6/846: creat d1/d13/d28/d53/d71/dc5/d108/f116 x:0 0 0 2024-04-25T02:07:32.384 INFO:tasks.workunit.client.0.smithi162.stdout:2/843: mknod d0/d3/d7a/c130 0 2024-04-25T02:07:32.878 INFO:tasks.workunit.client.0.smithi162.stdout:9/823: rename d4/d8/d13/d38 to d4/d25/de5/d125 0 2024-04-25T02:07:32.955 INFO:tasks.workunit.client.0.smithi162.stdout:7/918: dread df/d2e/f48 [0,4194304] 0 2024-04-25T02:07:33.355 INFO:tasks.workunit.client.0.smithi162.stdout:2/844: dread d0/d3/d1b/d6b/dc0/d5e/d61/d66/f24 [0,4194304] 0 2024-04-25T02:07:33.755 INFO:tasks.workunit.client.0.smithi162.stdout:3/912: dwrite d2/d29/f46 [4194304,4194304] 0 2024-04-25T02:07:33.855 INFO:tasks.workunit.client.0.smithi162.stdout:9/824: truncate d4/d8/d85/f94 2696546 0 2024-04-25T02:07:33.885 INFO:tasks.workunit.client.0.smithi162.stdout:6/847: creat d1/d13/d28/d30/d3a/d57/f117 x:0 0 0 2024-04-25T02:07:33.985 INFO:tasks.workunit.client.0.smithi162.stdout:2/845: unlink d0/d3/d1b/l2a 0 2024-04-25T02:07:33.998 INFO:tasks.workunit.client.0.smithi162.stdout:1/914: write d15/d1f/d35/d4c/f6f [2701235,128969] 0 2024-04-25T02:07:34.402 INFO:tasks.workunit.client.0.smithi162.stdout:4/903: dwrite dd/d1a/d34/d57/fc2 [0,4194304] 0 2024-04-25T02:07:35.023 INFO:tasks.workunit.client.0.smithi162.stdout:9/825: rename d4/d9/cb to d4/d25/dfb/c126 0 2024-04-25T02:07:35.108 INFO:tasks.workunit.client.0.smithi162.stdout:9/826: dread d4/d9/d15/f35 [0,4194304] 0 2024-04-25T02:07:35.252 INFO:tasks.workunit.client.0.smithi162.stdout:1/915: creat d15/d1f/d23/d30/d4a/f130 x:0 0 0 2024-04-25T02:07:35.293 INFO:tasks.workunit.client.0.smithi162.stdout:1/916: dread - d15/d69/d4f/dad/fe5 zero size 2024-04-25T02:07:35.322 INFO:tasks.workunit.client.0.smithi162.stdout:1/917: stat d15/d69/d4f/dad/cbd 0 2024-04-25T02:07:35.458 INFO:tasks.workunit.client.0.smithi162.stdout:9/827: sync 2024-04-25T02:07:35.686 INFO:tasks.workunit.client.0.smithi162.stdout:4/904: unlink dd/d1a/d34/cf2 0 2024-04-25T02:07:36.045 INFO:tasks.workunit.client.0.smithi162.stdout:1/918: rmdir d15/d1f/d35/d4c/d70/d9f/dea 39 2024-04-25T02:07:36.081 INFO:tasks.workunit.client.0.smithi162.stdout:8/862: write d0/db1/ff5 [132957,78920] 0 2024-04-25T02:07:36.141 INFO:tasks.workunit.client.0.smithi162.stdout:8/863: readlink d0/d1a/l5e 0 2024-04-25T02:07:36.211 INFO:tasks.workunit.client.0.smithi162.stdout:9/828: creat d4/d9/d15/d1b/d69/f127 x:0 0 0 2024-04-25T02:07:36.379 INFO:tasks.workunit.client.0.smithi162.stdout:4/905: fsync dd/fc3 0 2024-04-25T02:07:36.428 INFO:tasks.workunit.client.0.smithi162.stdout:4/906: chown dd/df/d77/d87/cbc 3922 1 2024-04-25T02:07:36.565 INFO:tasks.workunit.client.0.smithi162.stdout:1/919: fdatasync d15/d1f/d23/d30/d4a/f58 0 2024-04-25T02:07:36.672 INFO:tasks.workunit.client.0.smithi162.stdout:8/864: truncate d0/d12/d1b/d74/f12a 1129749 0 2024-04-25T02:07:36.814 INFO:tasks.workunit.client.0.smithi162.stdout:5/882: write d15/d19/d24/d2b/f52 [2722002,61342] 0 2024-04-25T02:07:36.868 INFO:tasks.workunit.client.0.smithi162.stdout:3/913: getdents d2/d9/d10/d4c/d51/d63/d87/de0 0 2024-04-25T02:07:37.031 INFO:tasks.workunit.client.0.smithi162.stdout:4/907: rename dd/d1a/f37 to dd/df/d2e/dd4/f128 0 2024-04-25T02:07:37.257 INFO:tasks.workunit.client.0.smithi162.stdout:0/973: write d0/d1/d6a/da9/fca [769820,96120] 0 2024-04-25T02:07:37.356 INFO:tasks.workunit.client.0.smithi162.stdout:8/865: mkdir d0/db1/d12c 0 2024-04-25T02:07:37.699 INFO:tasks.workunit.client.0.smithi162.stdout:3/914: truncate d2/d9/d10/d2c/da3/dba/fd1 726084 0 2024-04-25T02:07:37.769 INFO:tasks.workunit.client.0.smithi162.stdout:4/908: mknod dd/df/d2e/dd4/c129 0 2024-04-25T02:07:38.449 INFO:tasks.workunit.client.0.smithi162.stdout:7/919: dwrite df/f15 [4194304,4194304] 0 2024-04-25T02:07:38.765 INFO:tasks.workunit.client.0.smithi162.stdout:3/915: mkdir d2/da5/d12d 0 2024-04-25T02:07:38.795 INFO:tasks.workunit.client.0.smithi162.stdout:3/916: chown d2/d9/d19/c24 3464906 1 2024-04-25T02:07:38.901 INFO:tasks.workunit.client.0.smithi162.stdout:4/909: mknod dd/d1a/d34/db1/c12a 0 2024-04-25T02:07:39.180 INFO:tasks.workunit.client.0.smithi162.stdout:1/920: creat d15/d1f/d23/d30/f131 x:0 0 0 2024-04-25T02:07:39.445 INFO:tasks.workunit.client.0.smithi162.stdout:8/866: mknod d0/db1/d12c/c12d 0 2024-04-25T02:07:40.113 INFO:tasks.workunit.client.0.smithi162.stdout:1/921: rmdir d15/d69/d4f 39 2024-04-25T02:07:40.154 INFO:tasks.workunit.client.0.smithi162.stdout:0/974: link d0/d59/d7e/d9f/cbf d0/df/d20/d37/d58/c155 0 2024-04-25T02:07:40.210 INFO:tasks.workunit.client.0.smithi162.stdout:6/848: dwrite d1/d5c/f5f [0,4194304] 0 2024-04-25T02:07:40.433 INFO:tasks.workunit.client.0.smithi162.stdout:8/867: mknod d0/d12/d1b/d8d/c12e 0 2024-04-25T02:07:40.849 INFO:tasks.workunit.client.0.smithi162.stdout:2/846: dwrite d0/d3/d1b/d6b/dc0/d5e/d61/f9d [0,4194304] 0 2024-04-25T02:07:41.485 INFO:tasks.workunit.client.0.smithi162.stdout:1/922: creat d15/d1f/d23/d30/d4a/f132 x:0 0 0 2024-04-25T02:07:42.268 INFO:tasks.workunit.client.0.smithi162.stdout:1/923: mknod d15/d1f/d35/d4c/d121/c133 0 2024-04-25T02:07:42.707 INFO:tasks.workunit.client.0.smithi162.stdout:9/829: write d4/d9/d15/f88 [1043734,62973] 0 2024-04-25T02:07:43.151 INFO:tasks.workunit.client.0.smithi162.stdout:1/924: unlink d15/d1f/d35/d4c/d70/d9f/dea/cf7 0 2024-04-25T02:07:43.170 INFO:tasks.workunit.client.0.smithi162.stdout:5/883: truncate d15/d19/d24/d2b/f52 1957862 0 2024-04-25T02:07:43.473 INFO:tasks.workunit.client.0.smithi162.stdout:7/920: write df/f101 [564273,86788] 0 2024-04-25T02:07:43.665 INFO:tasks.workunit.client.0.smithi162.stdout:3/917: write d2/d9/d10/d4c/d51/d63/d87/d86/fa4 [2320353,16170] 0 2024-04-25T02:07:43.930 INFO:tasks.workunit.client.0.smithi162.stdout:4/910: dwrite dd/df/f10 [0,4194304] 0 2024-04-25T02:07:44.206 INFO:tasks.workunit.client.0.smithi162.stdout:9/830: rename d4/d9/d15/d1b/d2f/d30/l41 to d4/d9/d15/d8a/l128 0 2024-04-25T02:07:44.534 INFO:tasks.workunit.client.0.smithi162.stdout:9/831: dread d4/d9/fa [0,4194304] 0 2024-04-25T02:07:45.008 INFO:tasks.workunit.client.0.smithi162.stdout:2/847: dread d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/da2/de2/fe7 [0,4194304] 0 2024-04-25T02:07:45.276 INFO:tasks.workunit.client.0.smithi162.stdout:4/911: rename dd/d1a/d34/l63 to dd/d1a/d34/d72/def/d111/l12b 0 2024-04-25T02:07:45.297 INFO:tasks.workunit.client.0.smithi162.stdout:1/925: symlink d15/d1f/d35/d4c/d70/d73/d12e/l134 0 2024-04-25T02:07:45.351 INFO:tasks.workunit.client.0.smithi162.stdout:2/848: dread d0/f5c [0,4194304] 0 2024-04-25T02:07:45.424 INFO:tasks.workunit.client.0.smithi162.stdout:5/884: creat d15/d19/d24/d4d/d7c/de2/d119/f123 x:0 0 0 2024-04-25T02:07:45.774 INFO:tasks.workunit.client.0.smithi162.stdout:6/849: write d1/d13/d28/d30/d66/d89/f101 [871592,51376] 0 2024-04-25T02:07:46.039 INFO:tasks.workunit.client.0.smithi162.stdout:0/975: dwrite d0/d1/d4e/dd4/f101 [0,4194304] 0 2024-04-25T02:07:46.159 INFO:tasks.workunit.client.0.smithi162.stdout:1/926: symlink d15/d1f/d35/d4c/d70/d9f/dea/l135 0 2024-04-25T02:07:46.225 INFO:tasks.workunit.client.0.smithi162.stdout:5/885: fsync d15/d19/f34 0 2024-04-25T02:07:46.478 INFO:tasks.workunit.client.0.smithi162.stdout:7/921: rename df/d2e/d4c/d58 to df/d2c/d63/d83/d8b/d90/d127/d142 0 2024-04-25T02:07:46.844 INFO:tasks.workunit.client.0.smithi162.stdout:4/912: dread dd/df/d2e/f3b [0,4194304] 0 2024-04-25T02:07:46.931 INFO:tasks.workunit.client.0.smithi162.stdout:8/868: dwrite d0/d12/d1b/f6d [0,4194304] 0 2024-04-25T02:07:46.934 INFO:tasks.workunit.client.0.smithi162.stdout:1/927: fsync d15/f34 0 2024-04-25T02:07:47.163 INFO:tasks.workunit.client.0.smithi162.stdout:6/850: mknod d1/d13/d28/c118 0 2024-04-25T02:07:47.178 INFO:tasks.workunit.client.0.smithi162.stdout:0/976: fsync d0/df/d20/d37/d81/fa8 0 2024-04-25T02:07:47.182 INFO:tasks.workunit.client.0.smithi162.stdout:2/849: dread d0/d3/d1b/f4f [0,4194304] 0 2024-04-25T02:07:47.980 INFO:tasks.workunit.client.0.smithi162.stdout:7/922: creat df/d2c/d49/d7a/db5/dc1/f143 x:0 0 0 2024-04-25T02:07:47.981 INFO:tasks.workunit.client.0.smithi162.stdout:4/913: rmdir dd/d1a/d34/db1/dba 39 2024-04-25T02:07:48.213 INFO:tasks.workunit.client.0.smithi162.stdout:6/851: rmdir d1/d73 39 2024-04-25T02:07:48.368 INFO:tasks.workunit.client.0.smithi162.stdout:0/977: mknod d0/df/d20/d25/d55/c156 0 2024-04-25T02:07:49.263 INFO:tasks.workunit.client.0.smithi162.stdout:6/852: creat d1/d13/d28/d30/dca/f119 x:0 0 0 2024-04-25T02:07:49.335 INFO:tasks.workunit.client.0.smithi162.stdout:0/978: readlink d0/d1/l65 0 2024-04-25T02:07:49.362 INFO:tasks.workunit.client.0.smithi162.stdout:3/918: write d2/f25 [818712,25772] 0 2024-04-25T02:07:49.423 INFO:tasks.workunit.client.0.smithi162.stdout:3/919: readlink d2/d9/d99/l1b 0 2024-04-25T02:07:49.561 INFO:tasks.workunit.client.0.smithi162.stdout:6/853: sync 2024-04-25T02:07:49.576 INFO:tasks.workunit.client.0.smithi162.stdout:6/854: chown d1/fbd 517 1 2024-04-25T02:07:49.612 INFO:tasks.workunit.client.0.smithi162.stdout:6/855: read - d1/d13/d28/d30/d8a/ff4 zero size 2024-04-25T02:07:49.965 INFO:tasks.workunit.client.0.smithi162.stdout:0/979: readlink d0/df/d20/d25/d51/l3f 0 2024-04-25T02:07:50.235 INFO:tasks.workunit.client.0.smithi162.stdout:0/980: dread d0/df/d20/d25/d55/d6f/d7d/faa [0,4194304] 0 2024-04-25T02:07:50.779 INFO:tasks.workunit.client.0.smithi162.stdout:8/869: write d0/d12/d1b/f43 [5161907,79547] 0 2024-04-25T02:07:51.015 INFO:tasks.workunit.client.0.smithi162.stdout:5/886: dwrite d15/d19/d24/d2b/fa0 [0,4194304] 0 2024-04-25T02:07:51.166 INFO:tasks.workunit.client.0.smithi162.stdout:2/850: write d0/d3/d1b/d6b/dc0/f54 [304782,3161] 0 2024-04-25T02:07:51.201 INFO:tasks.workunit.client.0.smithi162.stdout:0/981: read d0/d1/d6a/da9/f110 [1487197,39949] 0 2024-04-25T02:07:51.285 INFO:tasks.workunit.client.0.smithi162.stdout:1/928: write d15/d69/d4f/fc4 [202827,56076] 0 2024-04-25T02:07:51.467 INFO:tasks.workunit.client.0.smithi162.stdout:8/870: dread d0/d44/d31/f4a [0,4194304] 0 2024-04-25T02:07:51.727 INFO:tasks.workunit.client.0.smithi162.stdout:9/832: mknod d4/d8/d13/c129 0 2024-04-25T02:07:51.800 INFO:tasks.workunit.client.0.smithi162.stdout:4/914: dwrite dd/f3a [0,4194304] 0 2024-04-25T02:07:51.983 INFO:tasks.workunit.client.0.smithi162.stdout:1/929: truncate d15/d1f/d35/d4c/d121/f125 810785 0 2024-04-25T02:07:52.183 INFO:tasks.workunit.client.0.smithi162.stdout:4/915: chown dd/df/d2e/dd4/d103 264 1 2024-04-25T02:07:52.316 INFO:tasks.workunit.client.0.smithi162.stdout:3/920: write d2/d9/d10/d4c/f74 [1320433,84476] 0 2024-04-25T02:07:52.324 INFO:tasks.workunit.client.0.smithi162.stdout:6/856: write d1/d13/d28/d30/d8a/f109 [489292,10402] 0 2024-04-25T02:07:52.407 INFO:tasks.workunit.client.0.smithi162.stdout:5/887: dread d15/d19/d24/d2b/d3b/d58/f9a [0,4194304] 0 2024-04-25T02:07:52.423 INFO:tasks.workunit.client.0.smithi162.stdout:7/923: dwrite df/d2c/d49/d7a/f7d [0,4194304] 0 2024-04-25T02:07:52.706 INFO:tasks.workunit.client.0.smithi162.stdout:6/857: stat d1/d13/d28/d30/dca 0 2024-04-25T02:07:52.721 INFO:tasks.workunit.client.0.smithi162.stdout:3/921: read d2/f71 [92273,118858] 0 2024-04-25T02:07:52.752 INFO:tasks.workunit.client.0.smithi162.stdout:5/888: chown d15/cb9 3735934 1 2024-04-25T02:07:52.870 INFO:tasks.workunit.client.0.smithi162.stdout:6/858: sync 2024-04-25T02:07:52.955 INFO:tasks.workunit.client.0.smithi162.stdout:8/871: mkdir d0/d12/d1b/d74/d8a/d8f/d12f 0 2024-04-25T02:07:52.986 INFO:tasks.workunit.client.0.smithi162.stdout:3/922: readlink d2/d9/d10/d2c/da3/dba/l8c 0 2024-04-25T02:07:53.086 INFO:tasks.workunit.client.0.smithi162.stdout:9/833: dread d4/d8/d13/fe3 [0,4194304] 0 2024-04-25T02:07:53.151 INFO:tasks.workunit.client.0.smithi162.stdout:1/930: creat d15/d1f/d23/d30/d4a/d7f/f136 x:0 0 0 2024-04-25T02:07:53.206 INFO:tasks.workunit.client.0.smithi162.stdout:4/916: truncate dd/df/f10 3455331 0 2024-04-25T02:07:53.294 INFO:tasks.workunit.client.0.smithi162.stdout:4/917: sync 2024-04-25T02:07:53.484 INFO:tasks.workunit.client.0.smithi162.stdout:7/924: truncate df/d2c/d49/d7a/dbf/fd2 571365 0 2024-04-25T02:07:53.774 INFO:tasks.workunit.client.0.smithi162.stdout:6/859: mknod d1/d13/d28/d45/d59/dbe/c11a 0 2024-04-25T02:07:53.850 INFO:tasks.workunit.client.0.smithi162.stdout:7/925: dread df/d2e/d4c/f53 [0,4194304] 0 2024-04-25T02:07:53.912 INFO:tasks.workunit.client.0.smithi162.stdout:7/926: chown df/d2e/d4c/d8a/db2/df0 526810885 1 2024-04-25T02:07:54.048 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:07:54.051 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:07:54.128 INFO:tasks.workunit.client.0.smithi162.stdout:1/931: dread - d15/d1f/d35/d4c/d70/d9f/fc6 zero size 2024-04-25T02:07:54.142 INFO:tasks.workunit.client.0.smithi162.stdout:0/982: link d0/d1/d64/ff9 d0/d59/d7e/f157 0 2024-04-25T02:07:54.180 INFO:tasks.workunit.client.0.smithi162.stdout:2/851: write d0/d3/f47 [4539521,122193] 0 2024-04-25T02:07:54.275 INFO:tasks.workunit.client.0.smithi162.stdout:5/889: mkdir d15/d19/d24/d4d/d7c/de2/d10a/dbf/d120/d124 0 2024-04-25T02:07:54.378 INFO:tasks.workunit.client.0.smithi162.stdout:8/872: mknod d0/d12/d3a/da5/d10f/c130 0 2024-04-25T02:07:54.405 INFO:tasks.workunit.client.0.smithi162.stdout:8/873: chown d0/db1/f123 7 1 2024-04-25T02:07:54.920 INFO:tasks.workunit.client.0.smithi162.stdout:9/834: symlink d4/d9/d15/d1b/d2f/d30/dc1/d9f/l12a 0 2024-04-25T02:07:55.131 INFO:tasks.workunit.client.0.smithi162.stdout:0/983: fsync d0/fe7 0 2024-04-25T02:07:55.216 INFO:tasks.workunit.client.0.smithi162.stdout:4/918: mkdir dd/d1a/d34/db1/d12c 0 2024-04-25T02:07:55.564 INFO:tasks.workunit.client.0.smithi162.stdout:5/890: creat d15/d1e/f125 x:0 0 0 2024-04-25T02:07:55.620 INFO:tasks.workunit.client.0.smithi162.stdout:4/919: dread dd/d1a/d34/f8e [0,4194304] 0 2024-04-25T02:07:55.677 INFO:tasks.workunit.client.0.smithi162.stdout:8/874: rmdir d0 39 2024-04-25T02:07:56.293 INFO:tasks.workunit.client.0.smithi162.stdout:9/835: creat d4/d9/d15/d1b/d2f/d30/f12b x:0 0 0 2024-04-25T02:07:56.356 INFO:tasks.workunit.client.0.smithi162.stdout:9/836: chown d4/d9/d15/d1b/d2f/d30/dc1/d9f/dd1/ddc 23 1 2024-04-25T02:07:56.941 INFO:tasks.workunit.client.0.smithi162.stdout:2/852: creat d0/d3/d5/d36/d93/de0/f131 x:0 0 0 2024-04-25T02:07:57.054 INFO:tasks.workunit.client.0.smithi162.stdout:4/920: readlink dd/la2 0 2024-04-25T02:07:57.607 INFO:tasks.workunit.client.0.smithi162.stdout:6/860: creat d1/d46/f11b x:0 0 0 2024-04-25T02:07:57.729 INFO:tasks.workunit.client.0.smithi162.stdout:3/923: dwrite d2/d9/d10/d4c/d51/d63/d87/f122 [0,4194304] 0 2024-04-25T02:07:59.065 INFO:tasks.workunit.client.0.smithi162.stdout:1/932: getdents d15/d1f/d23/d30/d4a/d7f/d97/dbe/dde 0 2024-04-25T02:07:59.090 INFO:tasks.workunit.client.0.smithi162.stdout:7/927: write df/f21 [2763683,9814] 0 2024-04-25T02:07:59.192 INFO:tasks.workunit.client.0.smithi162.stdout:8/875: dread d0/d12/d3a/fab [0,4194304] 0 2024-04-25T02:07:59.252 INFO:tasks.workunit.client.0.smithi162.stdout:8/876: chown d0/l9e 980957 1 2024-04-25T02:07:59.414 INFO:tasks.workunit.client.0.smithi162.stdout:8/877: sync 2024-04-25T02:07:59.848 INFO:tasks.workunit.client.0.smithi162.stdout:3/924: unlink d2/d9/d10/d4c/d51/d63/d87/lc1 0 2024-04-25T02:08:00.290 INFO:tasks.workunit.client.0.smithi162.stdout:8/878: creat d0/d86/f131 x:0 0 0 2024-04-25T02:08:00.655 INFO:tasks.workunit.client.0.smithi162.stdout:0/984: dwrite d0/df/d20/d25/d55/d6f/d7d/da7/fb2 [0,4194304] 0 2024-04-25T02:08:00.803 INFO:tasks.workunit.client.0.smithi162.stdout:3/925: fsync d2/f71 0 2024-04-25T02:08:00.963 INFO:tasks.workunit.client.0.smithi162.stdout:1/933: mkdir d15/d1f/d23/d30/d4a/d7f/d97/dbe/dde/d12c/d137 0 2024-04-25T02:08:01.268 INFO:tasks.workunit.client.0.smithi162.stdout:5/891: dwrite d15/d19/d24/d2b/d3b/d80/fc9 [0,4194304] 0 2024-04-25T02:08:01.388 INFO:tasks.workunit.client.0.smithi162.stdout:8/879: truncate d0/d86/f126 547788 0 2024-04-25T02:08:01.871 INFO:tasks.workunit.client.0.smithi162.stdout:4/921: link dd/d1a/d34/f51 dd/d1a/d34/d9d/f12d 0 2024-04-25T02:08:01.944 INFO:tasks.workunit.client.0.smithi162.stdout:1/934: fdatasync d15/d1f/f33 0 2024-04-25T02:08:02.144 INFO:tasks.workunit.client.0.smithi162.stdout:0/985: read d0/d1/d4e/f86 [112486,16688] 0 2024-04-25T02:08:02.292 INFO:tasks.workunit.client.0.smithi162.stdout:5/892: creat d15/d19/d24/d4d/d7c/de2/f126 x:0 0 0 2024-04-25T02:08:02.395 INFO:tasks.workunit.client.0.smithi162.stdout:1/935: stat d15/d1f/d23/d30/d4a/d7f/f136 0 2024-04-25T02:08:02.432 INFO:tasks.workunit.client.0.smithi162.stdout:7/928: getdents df/d2e/d4c/d8a/db2/df0/d10a 0 2024-04-25T02:08:02.587 INFO:tasks.workunit.client.0.smithi162.stdout:7/929: sync 2024-04-25T02:08:02.593 INFO:tasks.workunit.client.0.smithi162.stdout:2/853: dwrite d0/d3/d1b/d6b/dc0/d5e/d61/da4/fa6 [0,4194304] 0 2024-04-25T02:08:02.765 INFO:tasks.workunit.client.0.smithi162.stdout:0/986: chown d0/df/d20/d25/d55/d142 10739374 1 2024-04-25T02:08:02.791 INFO:tasks.workunit.client.0.smithi162.stdout:9/837: dwrite d4/d9/d15/d1b/ffd [0,4194304] 0 2024-04-25T02:08:02.967 INFO:tasks.workunit.client.0.smithi162.stdout:6/861: write d1/d46/d7a/f90 [947688,110070] 0 2024-04-25T02:08:03.051 INFO:tasks.workunit.client.0.smithi162.stdout:4/922: symlink dd/df/d2e/dd4/d103/l12e 0 2024-04-25T02:08:04.119 INFO:tasks.workunit.client.0.smithi162.stdout:4/923: read dd/d1a/d34/d57/fc2 [2149382,78940] 0 2024-04-25T02:08:04.730 INFO:tasks.workunit.client.0.smithi162.stdout:9/838: mkdir d4/d7c/d12c 0 2024-04-25T02:08:04.973 INFO:tasks.workunit.client.0.smithi162.stdout:7/930: truncate df/d2c/d63/d83/ddc/f10f 644249 0 2024-04-25T02:08:05.012 INFO:tasks.workunit.client.0.smithi162.stdout:3/926: write d2/d9/d10/d4c/d51/d63/d87/d90/f98 [4766057,57410] 0 2024-04-25T02:08:05.131 INFO:tasks.workunit.client.0.smithi162.stdout:6/862: mknod d1/d46/c11c 0 2024-04-25T02:08:05.589 INFO:tasks.workunit.client.0.smithi162.stdout:9/839: read d4/f26 [2511044,71380] 0 2024-04-25T02:08:05.928 INFO:tasks.workunit.client.0.smithi162.stdout:3/927: dread d2/ddf/de7/d101/f92 [0,4194304] 0 2024-04-25T02:08:06.619 INFO:tasks.workunit.client.0.smithi162.stdout:9/840: creat d4/d8/d85/d101/f12d x:0 0 0 2024-04-25T02:08:07.002 INFO:tasks.workunit.client.0.smithi162.stdout:9/841: symlink d4/d25/de5/l12e 0 2024-04-25T02:08:07.037 INFO:tasks.workunit.client.0.smithi162.stdout:9/842: chown d4/d9/d15/f88 291841105 1 2024-04-25T02:08:07.237 INFO:tasks.workunit.client.0.smithi162.stdout:0/987: write d0/fe7 [1608437,59120] 0 2024-04-25T02:08:07.463 INFO:tasks.workunit.client.0.smithi162.stdout:5/893: dwrite d15/fa3 [0,4194304] 0 2024-04-25T02:08:07.690 INFO:tasks.workunit.client.0.smithi162.stdout:2/854: write d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/ffc [2127751,8383] 0 2024-04-25T02:08:07.979 INFO:tasks.workunit.client.0.smithi162.stdout:9/843: mkdir d4/d9/d15/d1b/d2f/d30/d112/d12f 0 2024-04-25T02:08:08.010 INFO:tasks.workunit.client.0.smithi162.stdout:4/924: write dd/df/d2e/d4b/d79/fcb [23792,129581] 0 2024-04-25T02:08:08.235 INFO:tasks.workunit.client.0.smithi162.stdout:4/925: stat dd/d1a/f8f 0 2024-04-25T02:08:08.244 INFO:tasks.workunit.client.0.smithi162.stdout:8/880: dwrite d0/d12/d1b/d74/d8a/da3/fce [4194304,4194304] 0 2024-04-25T02:08:08.300 INFO:tasks.workunit.client.0.smithi162.stdout:5/894: rename d15/d19/d24/d2b/d3b/d58/daf/cda to d15/d19/d24/d2b/d3b/d80/de1/d11b/c127 0 2024-04-25T02:08:08.387 INFO:tasks.workunit.client.0.smithi162.stdout:1/936: dwrite d15/d1f/d35/d4c/d70/d73/db8/dbb/ff2 [0,4194304] 0 2024-04-25T02:08:08.571 INFO:tasks.workunit.client.0.smithi162.stdout:7/931: write df/f101 [1493281,51884] 0 2024-04-25T02:08:08.683 INFO:tasks.workunit.client.0.smithi162.stdout:4/926: chown dd/d1a/d4e/c55 207 1 2024-04-25T02:08:08.691 INFO:tasks.workunit.client.0.smithi162.stdout:7/932: stat df/d2e/l51 0 2024-04-25T02:08:09.037 INFO:tasks.workunit.client.0.smithi162.stdout:6/863: dwrite d1/d13/d28/d30/d3a/f3d [0,4194304] 0 2024-04-25T02:08:09.258 INFO:tasks.workunit.client.0.smithi162.stdout:1/937: symlink d15/d1f/d35/d5c/l138 0 2024-04-25T02:08:09.598 INFO:tasks.workunit.client.0.smithi162.stdout:7/933: symlink df/d2c/d49/l144 0 2024-04-25T02:08:09.877 INFO:tasks.workunit.client.0.smithi162.stdout:3/928: dwrite d2/d9/d10/d4c/d51/d63/d87/d90/db3/f10f [0,4194304] 0 2024-04-25T02:08:09.974 INFO:tasks.workunit.client.0.smithi162.stdout:8/881: dread d0/d12/feb [0,4194304] 0 2024-04-25T02:08:10.005 INFO:tasks.workunit.client.0.smithi162.stdout:6/864: fsync d1/d46/d7a/fed 0 2024-04-25T02:08:10.375 INFO:tasks.workunit.client.0.smithi162.stdout:7/934: creat df/d2e/d4c/d8a/db2/f145 x:0 0 0 2024-04-25T02:08:10.511 INFO:tasks.workunit.client.0.smithi162.stdout:8/882: unlink d0/c2 0 2024-04-25T02:08:10.817 INFO:tasks.workunit.client.0.smithi162.stdout:3/929: fsync d2/d9/d19/d3f/f79 0 2024-04-25T02:08:10.886 INFO:tasks.workunit.client.0.smithi162.stdout:8/883: dread d0/d12/d1b/d74/d8a/da3/fce [0,4194304] 0 2024-04-25T02:08:11.113 INFO:tasks.workunit.client.0.smithi162.stdout:7/935: creat df/d2c/d63/d83/d8b/d90/d127/d142/dd3/f146 x:0 0 0 2024-04-25T02:08:11.119 INFO:tasks.workunit.client.0.smithi162.stdout:6/865: fsync d1/d46/f7e 0 2024-04-25T02:08:11.510 INFO:tasks.workunit.client.0.smithi162.stdout:0/988: dwrite d0/df/d20/d25/d55/d77/fb8 [0,4194304] 0 2024-04-25T02:08:11.670 INFO:tasks.workunit.client.0.smithi162.stdout:3/930: readlink d2/d9/lb8 0 2024-04-25T02:08:11.826 INFO:tasks.workunit.client.0.smithi162.stdout:3/931: dread d2/d9/d10/d4c/d51/f7e [0,4194304] 0 2024-04-25T02:08:12.087 INFO:tasks.workunit.client.0.smithi162.stdout:2/855: dwrite d0/d3/d5/d36/d93/f8f [0,4194304] 0 2024-04-25T02:08:12.273 INFO:tasks.workunit.client.0.smithi162.stdout:7/936: symlink df/d2c/d63/d83/d8b/d90/d127/d142/dd3/l147 0 2024-04-25T02:08:12.373 INFO:tasks.workunit.client.0.smithi162.stdout:0/989: mknod d0/df/d20/d37/d81/c158 0 2024-04-25T02:08:12.546 INFO:tasks.workunit.client.0.smithi162.stdout:9/844: dwrite d4/d8/d85/fed [0,4194304] 0 2024-04-25T02:08:12.744 INFO:tasks.workunit.client.0.smithi162.stdout:6/866: mkdir d1/d73/d11d 0 2024-04-25T02:08:12.776 INFO:tasks.workunit.client.0.smithi162.stdout:9/845: chown d4/d7c/ce6 0 1 2024-04-25T02:08:13.029 INFO:tasks.workunit.client.0.smithi162.stdout:9/846: read d4/f26 [1538263,18452] 0 2024-04-25T02:08:13.089 INFO:tasks.workunit.client.0.smithi162.stdout:7/937: dread - df/d2c/d49/d7a/f12b zero size 2024-04-25T02:08:13.179 INFO:tasks.workunit.client.0.smithi162.stdout:1/938: write d15/d69/f3e [447240,16820] 0 2024-04-25T02:08:13.282 INFO:tasks.workunit.client.0.smithi162.stdout:3/932: dread d2/d9/d10/d4c/f74 [0,4194304] 0 2024-04-25T02:08:13.472 INFO:tasks.workunit.client.0.smithi162.stdout:7/938: read df/f33 [2969845,17772] 0 2024-04-25T02:08:13.477 INFO:tasks.workunit.client.0.smithi162.stdout:0/990: rmdir d0/df/d20/d25/d55/d6f 39 2024-04-25T02:08:13.608 INFO:tasks.workunit.client.0.smithi162.stdout:4/927: dwrite dd/df/d2e/f120 [0,4194304] 0 2024-04-25T02:08:14.030 INFO:tasks.workunit.client.0.smithi162.stdout:3/933: dread - d2/f10a zero size 2024-04-25T02:08:14.744 INFO:tasks.workunit.client.0.smithi162.stdout:5/895: rename d15/d19/d24/c5e to d15/d19/d24/d4d/d9d/c128 0 2024-04-25T02:08:14.806 INFO:tasks.workunit.client.0.smithi162.stdout:5/896: readlink d15/d19/d24/d2b/d3b/ldb 0 2024-04-25T02:08:14.929 INFO:tasks.workunit.client.0.smithi162.stdout:8/884: write d0/d12/fa8 [701673,127890] 0 2024-04-25T02:08:15.194 INFO:tasks.workunit.client.0.smithi162.stdout:3/934: creat d2/d9/d48/f12e x:0 0 0 2024-04-25T02:08:15.211 INFO:tasks.workunit.client.0.smithi162.stdout:3/935: stat d2/f65 0 2024-04-25T02:08:15.502 INFO:tasks.workunit.client.0.smithi162.stdout:6/867: creat d1/d13/d28/d30/f11e x:0 0 0 2024-04-25T02:08:15.824 INFO:tasks.workunit.client.0.smithi162.stdout:0/991: rename d0/d1/d4e/d76/ce3 to d0/d1/d4b/d14a/c159 0 2024-04-25T02:08:15.951 INFO:tasks.workunit.client.0.smithi162.stdout:7/939: mkdir df/d2c/d63/d83/d8b/d90/d127/d142/dd3/dd0/d122/d148 0 2024-04-25T02:08:16.314 INFO:tasks.workunit.client.0.smithi162.stdout:1/939: creat d15/d1f/d35/d4c/f139 x:0 0 0 2024-04-25T02:08:16.324 INFO:tasks.workunit.client.0.smithi162.stdout:9/847: creat d4/d9/d15/d1b/d2f/d30/dc1/d9f/f130 x:0 0 0 2024-04-25T02:08:16.363 INFO:tasks.workunit.client.0.smithi162.stdout:1/940: readlink d15/l6d 0 2024-04-25T02:08:16.408 INFO:tasks.workunit.client.0.smithi162.stdout:1/941: stat d15/d1f/d35/d4c/d121 0 2024-04-25T02:08:16.467 INFO:tasks.workunit.client.0.smithi162.stdout:8/885: symlink d0/d12/d2b/d87/de5/l132 0 2024-04-25T02:08:17.174 INFO:tasks.workunit.client.0.smithi162.stdout:2/856: write d0/d3/d1b/fd3 [321488,122732] 0 2024-04-25T02:08:17.423 INFO:tasks.workunit.client.0.smithi162.stdout:0/992: symlink d0/d1/d4b/l15a 0 2024-04-25T02:08:17.483 INFO:tasks.workunit.client.0.smithi162.stdout:7/940: mknod df/d2e/d111/c149 0 2024-04-25T02:08:17.796 INFO:tasks.workunit.client.0.smithi162.stdout:9/848: fdatasync d4/d9/d15/d1b/d2f/f62 0 2024-04-25T02:08:17.807 INFO:tasks.workunit.client.0.smithi162.stdout:1/942: fsync d15/d1f/d35/d4c/f6f 0 2024-04-25T02:08:18.063 INFO:tasks.workunit.client.0.smithi162.stdout:8/886: truncate d0/d12/d1b/d8d/fdf 588868 0 2024-04-25T02:08:18.279 INFO:tasks.workunit.client.0.smithi162.stdout:4/928: write dd/f3a [135368,126160] 0 2024-04-25T02:08:19.332 INFO:tasks.workunit.client.0.smithi162.stdout:5/897: write d15/d19/d24/d2b/fa0 [1896178,68018] 0 2024-04-25T02:08:19.952 INFO:tasks.workunit.client.0.smithi162.stdout:8/887: dread d0/d12/d1b/d74/d8a/f93 [0,4194304] 0 2024-04-25T02:08:20.145 INFO:tasks.workunit.client.0.smithi162.stdout:0/993: creat d0/df/d20/d25/d55/df2/f15b x:0 0 0 2024-04-25T02:08:20.185 INFO:tasks.workunit.client.0.smithi162.stdout:0/994: stat d0/d59/d7e/d100/l106 0 2024-04-25T02:08:20.356 INFO:tasks.workunit.client.0.smithi162.stdout:7/941: mkdir df/d2c/d63/d14a 0 2024-04-25T02:08:20.583 INFO:tasks.workunit.client.0.smithi162.stdout:3/936: dwrite d2/d29/d5d/f68 [0,4194304] 0 2024-04-25T02:08:20.681 INFO:tasks.workunit.client.0.smithi162.stdout:1/943: mkdir d15/d1f/d35/d4c/d70/d9f/d13a 0 2024-04-25T02:08:20.788 INFO:tasks.workunit.client.0.smithi162.stdout:5/898: stat d15/d19/d24/d4d/d9d/cb6 0 2024-04-25T02:08:20.989 INFO:tasks.workunit.client.0.smithi162.stdout:8/888: creat d0/d12/d1b/d74/d105/f133 x:0 0 0 2024-04-25T02:08:21.165 INFO:tasks.workunit.client.0.smithi162.stdout:6/868: getdents d1/d13/d28 0 2024-04-25T02:08:21.333 INFO:tasks.workunit.client.0.smithi162.stdout:0/995: creat d0/d1/d4e/d76/db0/f15c x:0 0 0 2024-04-25T02:08:22.195 INFO:tasks.workunit.client.0.smithi162.stdout:3/937: dread d2/d9/d99/f2f [0,4194304] 0 2024-04-25T02:08:22.564 INFO:tasks.workunit.client.0.smithi162.stdout:1/944: dread d15/d1f/f5f [0,4194304] 0 2024-04-25T02:08:22.657 INFO:tasks.workunit.client.0.smithi162.stdout:2/857: creat d0/d3/d1b/d1d/d3a/d63/f132 x:0 0 0 2024-04-25T02:08:23.755 INFO:tasks.workunit.client.0.smithi162.stdout:4/929: dwrite dd/d1a/d34/d57/fe5 [0,4194304] 0 2024-04-25T02:08:23.857 INFO:tasks.workunit.client.0.smithi162.stdout:2/858: truncate d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/da2/fc7 967736 0 2024-04-25T02:08:24.091 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:08:24.094 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:08:24.537 INFO:tasks.workunit.client.0.smithi162.stdout:2/859: rmdir d0/d3/d1b/d6b/d92/d9a 39 2024-04-25T02:08:24.727 INFO:tasks.workunit.client.0.smithi162.stdout:1/945: creat d15/d1f/d35/d4c/d70/d9f/d120/f13b x:0 0 0 2024-04-25T02:08:25.095 INFO:tasks.workunit.client.0.smithi162.stdout:2/860: read d0/d3/f1a [7178190,59668] 0 2024-04-25T02:08:25.252 INFO:tasks.workunit.client.0.smithi162.stdout:4/930: rmdir dd/df/d2e/de8/d110 0 2024-04-25T02:08:25.668 INFO:tasks.workunit.client.0.smithi162.stdout:8/889: write d0/d44/d64/d112/f54 [2003548,50291] 0 2024-04-25T02:08:25.900 INFO:tasks.workunit.client.0.smithi162.stdout:6/869: write d1/d13/d28/d30/d3a/f3e [4384693,69026] 0 2024-04-25T02:08:26.215 INFO:tasks.workunit.client.0.smithi162.stdout:5/899: dwrite d15/f3a [0,4194304] 0 2024-04-25T02:08:26.350 INFO:tasks.workunit.client.0.smithi162.stdout:4/931: readlink dd/d1a/d34/db1/dba/ldb 0 2024-04-25T02:08:26.874 INFO:tasks.workunit.client.0.smithi162.stdout:9/849: rename d4/d9/d15/d1b/d2f/d30/dc1/d59/d105 to d4/d131 0 2024-04-25T02:08:27.149 INFO:tasks.workunit.client.0.smithi162.stdout:0/996: dwrite d0/d59/f80 [0,4194304] 0 2024-04-25T02:08:27.198 INFO:tasks.workunit.client.0.smithi162.stdout:3/938: dwrite d2/d9/d10/d4c/d51/d63/d87/f122 [4194304,4194304] 0 2024-04-25T02:08:27.229 INFO:tasks.workunit.client.0.smithi162.stdout:7/942: dwrite df/d2e/d4c/d8a/f8f [0,4194304] 0 2024-04-25T02:08:27.457 INFO:tasks.workunit.client.0.smithi162.stdout:2/861: write d0/f74 [3866174,26202] 0 2024-04-25T02:08:27.515 INFO:tasks.workunit.client.0.smithi162.stdout:6/870: mknod d1/d73/da1/c11f 0 2024-04-25T02:08:28.164 INFO:tasks.workunit.client.0.smithi162.stdout:3/939: truncate d2/f65 3031704 0 2024-04-25T02:08:28.370 INFO:tasks.workunit.client.0.smithi162.stdout:2/862: creat d0/d3/d5/d69/f133 x:0 0 0 2024-04-25T02:08:28.568 INFO:tasks.workunit.client.0.smithi162.stdout:7/943: symlink df/d2e/d4c/d8a/db2/df0/l14b 0 2024-04-25T02:08:28.632 INFO:tasks.workunit.client.0.smithi162.stdout:8/890: dwrite d0/d44/d91/f116 [0,4194304] 0 2024-04-25T02:08:30.034 INFO:tasks.workunit.client.0.smithi162.stdout:7/944: dread df/d2c/d63/d83/ddc/f126 [0,4194304] 0 2024-04-25T02:08:30.329 INFO:tasks.workunit.client.0.smithi162.stdout:1/946: rename d15/d1f/fac to d15/d1f/d35/d4c/d70/d9f/f13c 0 2024-04-25T02:08:30.461 INFO:tasks.workunit.client.0.smithi162.stdout:2/863: mknod d0/d3/d1b/d6b/dc0/c134 0 2024-04-25T02:08:30.522 INFO:tasks.workunit.client.0.smithi162.stdout:2/864: chown d0/d3/d1b/d6b/dc0/d67/d9c/de8/f106 18343 1 2024-04-25T02:08:30.703 INFO:tasks.workunit.client.0.smithi162.stdout:0/997: write d0/df/d20/d37/dfc/f108 [772895,52689] 0 2024-04-25T02:08:31.243 INFO:tasks.workunit.client.0.smithi162.stdout:5/900: rename d15/d19/d24/d4d/d7c/d85/dde/de5/ff5 to d15/d19/d24/d2b/d3b/d80/de1/d11b/f129 0 2024-04-25T02:08:31.292 INFO:tasks.workunit.client.0.smithi162.stdout:7/945: read - df/d2e/d4c/d8a/f119 zero size 2024-04-25T02:08:31.364 INFO:tasks.workunit.client.0.smithi162.stdout:0/998: rmdir d0/df/d20/d25/d55/df2 39 2024-04-25T02:08:31.710 INFO:tasks.workunit.client.0.smithi162.stdout:4/932: write dd/d1a/d34/db1/dba/dfd/db8/f109 [1235255,116515] 0 2024-04-25T02:08:31.733 INFO:tasks.workunit.client.0.smithi162.stdout:3/940: write d2/d9/d10/d2c/da3/db5/fd0 [1357425,19722] 0 2024-04-25T02:08:31.794 INFO:tasks.workunit.client.0.smithi162.stdout:6/871: dwrite d1/d13/d28/d30/d3a/f5b [0,4194304] 0 2024-04-25T02:08:31.924 INFO:tasks.workunit.client.0.smithi162.stdout:9/850: rename d4/d9/d15/d1b/d2f/d30/dc1/d9f/dd1/ffc to d4/d9/d115/f132 0 2024-04-25T02:08:32.210 INFO:tasks.workunit.client.0.smithi162.stdout:0/999: read d0/d1/d6a/f72 [730205,1131] 0 2024-04-25T02:08:32.484 INFO:tasks.workunit.client.0.smithi162.stdout:7/946: unlink df/d2c/d63/d83/d8b/d90/d127/d142/f88 0 2024-04-25T02:08:32.722 INFO:tasks.workunit.client.0.smithi162.stdout:8/891: dwrite d0/d12/f24 [4194304,4194304] 0 2024-04-25T02:08:32.851 INFO:tasks.workunit.client.0.smithi162.stdout:4/933: creat dd/df/d2e/d4b/d79/f12f x:0 0 0 2024-04-25T02:08:32.947 INFO:tasks.workunit.client.0.smithi162.stdout:4/934: readlink dd/d1a/d34/db1/dba/dfd/db8/ld7 0 2024-04-25T02:08:32.966 INFO:tasks.workunit.client.0.smithi162.stdout:4/935: chown dd/df/d2e/d4b 407823012 1 2024-04-25T02:08:33.160 INFO:tasks.workunit.client.0.smithi162.stdout:9/851: mkdir d4/d9/da9/d133 0 2024-04-25T02:08:33.194 INFO:tasks.workunit.client.0.smithi162.stdout:3/941: creat d2/d9/d10/d4c/d51/d63/d87/db6/f12f x:0 0 0 2024-04-25T02:08:33.518 INFO:tasks.workunit.client.0.smithi162.stdout:8/892: rename d0/d12/d2b/dc7 to d0/d12/d1b/d8d/d134 0 2024-04-25T02:08:33.618 INFO:tasks.workunit.client.0.smithi162.stdout:6/872: dread d1/d13/d28/d30/d3a/f3e [0,4194304] 0 2024-04-25T02:08:33.713 INFO:tasks.workunit.client.0.smithi162.stdout:5/901: creat d15/d19/d24/d4d/d7c/de2/d10a/f12a x:0 0 0 2024-04-25T02:08:33.750 INFO:tasks.workunit.client.0.smithi162.stdout:9/852: mkdir d4/d8/d13/dbf/d134 0 2024-04-25T02:08:33.801 INFO:tasks.workunit.client.0.smithi162.stdout:5/902: chown d15/d1e/f8a 23793835 1 2024-04-25T02:08:33.835 INFO:tasks.workunit.client.0.smithi162.stdout:9/853: read - d4/d9/d15/d1b/d2f/d30/fd7 zero size 2024-04-25T02:08:34.122 INFO:tasks.workunit.client.0.smithi162.stdout:3/942: mkdir d2/d9/d10/d4c/d51/d63/d87/d86/d130 0 2024-04-25T02:08:34.163 INFO:tasks.workunit.client.0.smithi162.stdout:2/865: write d0/d3/d5/d36/d93/f8f [3924369,101789] 0 2024-04-25T02:08:34.275 INFO:tasks.workunit.client.0.smithi162.stdout:8/893: mknod d0/d12/d3a/da5/c135 0 2024-04-25T02:08:34.451 INFO:tasks.workunit.client.0.smithi162.stdout:1/947: dwrite d15/d1f/d35/fd4 [0,4194304] 0 2024-04-25T02:08:34.618 INFO:tasks.workunit.client.0.smithi162.stdout:5/903: rmdir d15/d19/d24/d2b 39 2024-04-25T02:08:35.001 INFO:tasks.workunit.client.0.smithi162.stdout:9/854: dread d4/d9/d15/d1b/d2f/d30/f122 [0,4194304] 0 2024-04-25T02:08:35.293 INFO:tasks.workunit.client.0.smithi162.stdout:3/943: stat d2/d9/d19/d3f/fa9 0 2024-04-25T02:08:35.564 INFO:tasks.workunit.client.0.smithi162.stdout:6/873: mknod d1/d73/d11d/c120 0 2024-04-25T02:08:36.014 INFO:tasks.workunit.client.0.smithi162.stdout:9/855: creat d4/d9/d15/d1b/d69/f135 x:0 0 0 2024-04-25T02:08:36.153 INFO:tasks.workunit.client.0.smithi162.stdout:3/944: mkdir d2/d9/d10/d4c/dfb/dfc/d131 0 2024-04-25T02:08:36.365 INFO:tasks.workunit.client.0.smithi162.stdout:2/866: unlink d0/d3/d1b/d6b/d92/d9a/de4/cec 0 2024-04-25T02:08:36.642 INFO:tasks.workunit.client.0.smithi162.stdout:7/947: dwrite df/f33 [0,4194304] 0 2024-04-25T02:08:36.818 INFO:tasks.workunit.client.0.smithi162.stdout:6/874: creat d1/d13/d28/d45/d59/dbe/f121 x:0 0 0 2024-04-25T02:08:38.125 INFO:tasks.workunit.client.0.smithi162.stdout:5/904: fdatasync d15/d19/d24/d2b/f52 0 2024-04-25T02:08:38.771 INFO:tasks.workunit.client.0.smithi162.stdout:4/936: dwrite dd/df/d2e/d4b/ffc [0,4194304] 0 2024-04-25T02:08:39.383 INFO:tasks.workunit.client.0.smithi162.stdout:1/948: getdents d15/d1f/d35/d4c/d70/d9f/d120 0 2024-04-25T02:08:39.450 INFO:tasks.workunit.client.0.smithi162.stdout:5/905: truncate d15/d19/d24/d4d/d7c/d85/de7/ddd/f113 4018724 0 2024-04-25T02:08:39.569 INFO:tasks.workunit.client.0.smithi162.stdout:7/948: creat df/d2c/f14c x:0 0 0 2024-04-25T02:08:40.150 INFO:tasks.workunit.client.0.smithi162.stdout:8/894: dwrite d0/d44/d64/d112/f54 [0,4194304] 0 2024-04-25T02:08:40.334 INFO:tasks.workunit.client.0.smithi162.stdout:1/949: creat d15/d1f/d35/d4c/d70/d73/db8/f13d x:0 0 0 2024-04-25T02:08:40.558 INFO:tasks.workunit.client.0.smithi162.stdout:7/949: unlink f5 0 2024-04-25T02:08:40.800 INFO:tasks.workunit.client.0.smithi162.stdout:3/945: write d2/d29/d2e/f31 [3745766,53985] 0 2024-04-25T02:08:41.213 INFO:tasks.workunit.client.0.smithi162.stdout:9/856: dwrite d4/d8/d85/f7b [0,4194304] 0 2024-04-25T02:08:41.362 INFO:tasks.workunit.client.0.smithi162.stdout:2/867: dwrite d0/d3/d1b/d1d/d3a/d63/f71 [0,4194304] 0 2024-04-25T02:08:41.685 INFO:tasks.workunit.client.0.smithi162.stdout:5/906: rename d15/d19/l66 to d15/l12b 0 2024-04-25T02:08:41.715 INFO:tasks.workunit.client.0.smithi162.stdout:5/907: chown d15/f17 23942166 1 2024-04-25T02:08:41.847 INFO:tasks.workunit.client.0.smithi162.stdout:1/950: symlink d15/d1f/d23/d30/d4a/d7f/d97/dbe/d12f/l13e 0 2024-04-25T02:08:41.973 INFO:tasks.workunit.client.0.smithi162.stdout:4/937: getdents dd/df 0 2024-04-25T02:08:42.019 INFO:tasks.workunit.client.0.smithi162.stdout:4/938: chown dd/d1a/d34/d9d/lb7 44288 1 2024-04-25T02:08:42.393 INFO:tasks.workunit.client.0.smithi162.stdout:6/875: dwrite d1/d13/d28/d45/fa5 [0,4194304] 0 2024-04-25T02:08:42.636 INFO:tasks.workunit.client.0.smithi162.stdout:5/908: creat d15/d19/d24/d2b/d3b/d80/de1/f12c x:0 0 0 2024-04-25T02:08:42.814 INFO:tasks.workunit.client.0.smithi162.stdout:1/951: mkdir d15/d1f/d35/d4c/dcd/d13f 0 2024-04-25T02:08:43.188 INFO:tasks.workunit.client.0.smithi162.stdout:3/946: creat d2/d9/d10/d2c/f132 x:0 0 0 2024-04-25T02:08:43.211 INFO:tasks.workunit.client.0.smithi162.stdout:4/939: creat dd/df/d7e/f130 x:0 0 0 2024-04-25T02:08:43.254 INFO:tasks.workunit.client.0.smithi162.stdout:3/947: stat d2/d29/d2e/c72 0 2024-04-25T02:08:43.257 INFO:tasks.workunit.client.0.smithi162.stdout:4/940: chown dd/cac 260432 1 2024-04-25T02:08:43.381 INFO:tasks.workunit.client.0.smithi162.stdout:9/857: unlink d4/d9/d15/d8a/fa1 0 2024-04-25T02:08:43.415 INFO:tasks.workunit.client.0.smithi162.stdout:9/858: chown d4/d9/d15/f35 7441065 1 2024-04-25T02:08:44.276 INFO:tasks.workunit.client.0.smithi162.stdout:6/876: truncate d1/d13/d28/d45/d59/d80/f98 235857 0 2024-04-25T02:08:44.476 INFO:tasks.workunit.client.0.smithi162.stdout:1/952: mknod d15/d1f/d35/d4c/d121/c140 0 2024-04-25T02:08:44.512 INFO:tasks.workunit.client.0.smithi162.stdout:1/953: chown d15/d1f/d23/f51 40 1 2024-04-25T02:08:44.733 INFO:tasks.workunit.client.0.smithi162.stdout:8/895: link d0/d12/d1b/l118 d0/d44/d64/d112/l136 0 2024-04-25T02:08:44.923 INFO:tasks.workunit.client.0.smithi162.stdout:7/950: rename df/d2c/d63/d83/d8b/d90/fe2 to df/d2c/d63/f14d 0 2024-04-25T02:08:45.444 INFO:tasks.workunit.client.0.smithi162.stdout:2/868: write d0/d3/d1b/d6b/dc0/d5e/d61/da4/f73 [2350139,65829] 0 2024-04-25T02:08:45.611 INFO:tasks.workunit.client.0.smithi162.stdout:4/941: mknod dd/d1a/d34/db1/dba/d115/c131 0 2024-04-25T02:08:45.631 INFO:tasks.workunit.client.0.smithi162.stdout:8/896: dread - d0/d86/f11c zero size 2024-04-25T02:08:45.970 INFO:tasks.workunit.client.0.smithi162.stdout:7/951: unlink df/d2c/d63/c64 0 2024-04-25T02:08:46.310 INFO:tasks.workunit.client.0.smithi162.stdout:2/869: symlink d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/d11a/l135 0 2024-04-25T02:08:48.095 INFO:tasks.workunit.client.0.smithi162.stdout:7/952: stat df/d2e/d111/c149 0 2024-04-25T02:08:48.378 INFO:tasks.workunit.client.0.smithi162.stdout:1/954: rename d15/d1f/d35/d4c/d70/d9f/lba to d15/d69/l141 0 2024-04-25T02:08:48.682 INFO:tasks.workunit.client.0.smithi162.stdout:5/909: write d15/d19/d24/d2b/f3d [4087608,2864] 0 2024-04-25T02:08:49.186 INFO:tasks.workunit.client.0.smithi162.stdout:3/948: dwrite d2/d9/d10/d2c/f78 [0,4194304] 0 2024-04-25T02:08:49.208 INFO:tasks.workunit.client.0.smithi162.stdout:6/877: dwrite d1/d73/fdd [0,4194304] 0 2024-04-25T02:08:49.470 INFO:tasks.workunit.client.0.smithi162.stdout:6/878: chown d1/d13/d28/d45/d59/dbe/f121 0 1 2024-04-25T02:08:49.518 INFO:tasks.workunit.client.0.smithi162.stdout:1/955: creat d15/d1f/d35/d4c/d70/d73/db8/dbb/d11e/d129/f142 x:0 0 0 2024-04-25T02:08:49.740 INFO:tasks.workunit.client.0.smithi162.stdout:8/897: write d0/db1/d101/f108 [889430,84711] 0 2024-04-25T02:08:50.183 INFO:tasks.workunit.client.0.smithi162.stdout:1/956: mkdir d15/d1f/d23/d30/d4a/d143 0 2024-04-25T02:08:50.191 INFO:tasks.workunit.client.0.smithi162.stdout:6/879: creat d1/d13/d28/d30/d3a/dbc/def/f122 x:0 0 0 2024-04-25T02:08:50.511 INFO:tasks.workunit.client.0.smithi162.stdout:2/870: dwrite d0/d3/d1b/d6b/d92/fd4 [0,4194304] 0 2024-04-25T02:08:50.730 INFO:tasks.workunit.client.0.smithi162.stdout:9/859: rmdir d4/d9 39 2024-04-25T02:08:51.168 INFO:tasks.workunit.client.0.smithi162.stdout:2/871: creat d0/d3/d1b/d6b/dc0/d5e/d61/f136 x:0 0 0 2024-04-25T02:08:51.217 INFO:tasks.workunit.client.0.smithi162.stdout:4/942: rmdir dd 39 2024-04-25T02:08:51.745 INFO:tasks.workunit.client.0.smithi162.stdout:4/943: chown dd/df/d2e/l82 55970 1 2024-04-25T02:08:51.875 INFO:tasks.workunit.client.0.smithi162.stdout:7/953: write df/d2e/d4c/d8a/db2/f145 [772829,120030] 0 2024-04-25T02:08:52.086 INFO:tasks.workunit.client.0.smithi162.stdout:7/954: dread - df/d2c/d49/d5d/fbe zero size 2024-04-25T02:08:52.111 INFO:tasks.workunit.client.0.smithi162.stdout:2/872: dread d0/d3/d1b/d6b/dc0/d5e/d61/f9d [0,4194304] 0 2024-04-25T02:08:52.282 INFO:tasks.workunit.client.0.smithi162.stdout:3/949: write d2/d29/f3c [3465462,59489] 0 2024-04-25T02:08:52.509 INFO:tasks.workunit.client.0.smithi162.stdout:8/898: dwrite d0/d12/d1b/f43 [0,4194304] 0 2024-04-25T02:08:52.699 INFO:tasks.workunit.client.0.smithi162.stdout:5/910: truncate d15/d19/d24/d4d/d7c/de2/d10a/f7b 4661828 0 2024-04-25T02:08:52.792 INFO:tasks.workunit.client.0.smithi162.stdout:1/957: write d15/d1f/d23/d30/f131 [294022,52501] 0 2024-04-25T02:08:52.864 INFO:tasks.workunit.client.0.smithi162.stdout:6/880: write d1/d13/d28/d30/d3a/f44 [5075417,11782] 0 2024-04-25T02:08:52.897 INFO:tasks.workunit.client.0.smithi162.stdout:9/860: write d4/d8/d13/dbf/f10a [65261,94582] 0 2024-04-25T02:08:52.956 INFO:tasks.workunit.client.0.smithi162.stdout:7/955: readlink df/d2c/lbc 0 2024-04-25T02:08:53.095 INFO:tasks.workunit.client.0.smithi162.stdout:3/950: mkdir d2/d9/d10/d4c/d51/d63/d87/de0/d133 0 2024-04-25T02:08:53.159 INFO:tasks.workunit.client.0.smithi162.stdout:5/911: mkdir d15/d19/d24/d2b/d3b/de4/d12d 0 2024-04-25T02:08:53.218 INFO:tasks.workunit.client.0.smithi162.stdout:4/944: mknod dd/df/d2e/d4b/d79/d11b/c132 0 2024-04-25T02:08:53.387 INFO:tasks.workunit.client.0.smithi162.stdout:2/873: read - d0/d3/d7a/d88/f12b zero size 2024-04-25T02:08:53.670 INFO:tasks.workunit.client.0.smithi162.stdout:1/958: rename d15/d1f/d23/d30/d4a/l11f to d15/d1f/d35/d4c/d70/l144 0 2024-04-25T02:08:53.678 INFO:tasks.workunit.client.0.smithi162.stdout:9/861: dread - d4/d25/de5/d125/f10f zero size 2024-04-25T02:08:53.749 INFO:tasks.workunit.client.0.smithi162.stdout:6/881: dread d1/d46/d7a/fda [0,4194304] 0 2024-04-25T02:08:53.941 INFO:tasks.workunit.client.0.smithi162.stdout:3/951: chown d2/d29/d2e/c104 89327 1 2024-04-25T02:08:54.403 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:08:54.406 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:08:54.620 INFO:tasks.workunit.client.0.smithi162.stdout:8/899: link d0/d12/d1b/c99 d0/d12/d2b/d87/dbe/d12b/c137 0 2024-04-25T02:08:54.940 INFO:tasks.workunit.client.0.smithi162.stdout:1/959: fdatasync d15/d1f/d35/d4c/d70/fec 0 2024-04-25T02:08:55.087 INFO:tasks.workunit.client.0.smithi162.stdout:6/882: creat d1/d13/d28/d30/dca/f123 x:0 0 0 2024-04-25T02:08:55.623 INFO:tasks.workunit.client.0.smithi162.stdout:7/956: rename df/d2c/d63/d83/ddc/f10f to df/d2e/dfe/f14e 0 2024-04-25T02:08:56.650 INFO:tasks.workunit.client.0.smithi162.stdout:1/960: unlink d15/d69/f127 0 2024-04-25T02:08:56.776 INFO:tasks.workunit.client.0.smithi162.stdout:6/883: symlink d1/d13/d28/d53/l124 0 2024-04-25T02:08:57.076 INFO:tasks.workunit.client.0.smithi162.stdout:6/884: stat d1/d46/f97 0 2024-04-25T02:08:57.356 INFO:tasks.workunit.client.0.smithi162.stdout:5/912: dwrite d15/d19/d24/d4d/d7c/de2/d10a/fc5 [0,4194304] 0 2024-04-25T02:08:57.598 INFO:tasks.workunit.client.0.smithi162.stdout:2/874: dwrite d0/d3/d1b/d6b/f8e [0,4194304] 0 2024-04-25T02:08:57.638 INFO:tasks.workunit.client.0.smithi162.stdout:8/900: link d0/d44/d64/d112/l70 d0/d44/d64/d112/l138 0 2024-04-25T02:08:57.663 INFO:tasks.workunit.client.0.smithi162.stdout:4/945: dwrite dd/d1a/d4e/d93/fa5 [4194304,4194304] 0 2024-04-25T02:08:58.010 INFO:tasks.workunit.client.0.smithi162.stdout:3/952: write d2/d29/d5d/f9a [2918494,104089] 0 2024-04-25T02:08:58.344 INFO:tasks.workunit.client.0.smithi162.stdout:9/862: dread - d4/d9/d15/d1b/d2f/d30/dc1/d59/dec/fef zero size 2024-04-25T02:08:58.472 INFO:tasks.workunit.client.0.smithi162.stdout:6/885: unlink d1/d13/d28/d30/d63/f9f 0 2024-04-25T02:08:59.115 INFO:tasks.workunit.client.0.smithi162.stdout:4/946: unlink dd/df/d58/l89 0 2024-04-25T02:08:59.463 INFO:tasks.workunit.client.0.smithi162.stdout:7/957: write df/d2e/d4c/daf/f113 [1240996,116521] 0 2024-04-25T02:08:59.544 INFO:tasks.workunit.client.0.smithi162.stdout:8/901: truncate d0/d12/f2e 1646866 0 2024-04-25T02:08:59.895 INFO:tasks.workunit.client.0.smithi162.stdout:1/961: link d15/d69/d4f/dad/cbd d15/d1f/d23/d30/d4a/d7f/c145 0 2024-04-25T02:08:59.909 INFO:tasks.workunit.client.0.smithi162.stdout:3/953: creat d2/d9/d10/d4c/d51/d63/d87/f134 x:0 0 0 2024-04-25T02:08:59.969 INFO:tasks.workunit.client.0.smithi162.stdout:7/958: dread df/f37 [0,4194304] 0 2024-04-25T02:09:00.019 INFO:tasks.workunit.client.0.smithi162.stdout:2/875: dwrite d0/d3/d1b/d6b/dc0/d5e/d61/f136 [0,4194304] 0 2024-04-25T02:09:00.152 INFO:tasks.workunit.client.0.smithi162.stdout:4/947: rename dd/d1a/f48 to dd/df/d58/f133 0 2024-04-25T02:09:00.267 INFO:tasks.workunit.client.0.smithi162.stdout:6/886: dread d1/d13/d28/d30/d66/d89/f101 [0,4194304] 0 2024-04-25T02:09:00.353 INFO:tasks.workunit.client.0.smithi162.stdout:8/902: dread d0/d44/d31/d65/f9c [0,4194304] 0 2024-04-25T02:09:00.896 INFO:tasks.workunit.client.0.smithi162.stdout:4/948: creat dd/df/d77/d87/f134 x:0 0 0 2024-04-25T02:09:01.312 INFO:tasks.workunit.client.0.smithi162.stdout:7/959: mkdir df/d2c/d63/d83/d8b/d90/d127/d142/dd3/dd8/d14f 0 2024-04-25T02:09:01.705 INFO:tasks.workunit.client.0.smithi162.stdout:8/903: mknod d0/d44/d64/c139 0 2024-04-25T02:09:01.729 INFO:tasks.workunit.client.0.smithi162.stdout:8/904: chown d0/f2d 5 1 2024-04-25T02:09:01.810 INFO:tasks.workunit.client.0.smithi162.stdout:9/863: rmdir d4/d7c/d116 0 2024-04-25T02:09:01.869 INFO:tasks.workunit.client.0.smithi162.stdout:9/864: stat d4/d9/d15/d1b/d2f/d30/dc1/d9f/ff9 0 2024-04-25T02:09:01.922 INFO:tasks.workunit.client.0.smithi162.stdout:3/954: truncate d2/d9/f126 3529071 0 2024-04-25T02:09:02.326 INFO:tasks.workunit.client.0.smithi162.stdout:5/913: write d15/d19/d24/d4d/d7c/d85/de7/dd1/ff1 [661277,109667] 0 2024-04-25T02:09:02.614 INFO:tasks.workunit.client.0.smithi162.stdout:2/876: mknod d0/d3/d1b/d6b/dc0/d5e/db8/d111/c137 0 2024-04-25T02:09:02.698 INFO:tasks.workunit.client.0.smithi162.stdout:8/905: mkdir d0/d12/d2b/d87/dbe/d13a 0 2024-04-25T02:09:02.771 INFO:tasks.workunit.client.0.smithi162.stdout:9/865: read d4/d25/de5/d125/f82 [336345,9482] 0 2024-04-25T02:09:03.276 INFO:tasks.workunit.client.0.smithi162.stdout:7/960: unlink df/d2c/d63/d83/c13f 0 2024-04-25T02:09:03.368 INFO:tasks.workunit.client.0.smithi162.stdout:5/914: mkdir d15/d19/d24/d4d/d7c/d12e 0 2024-04-25T02:09:03.532 INFO:tasks.workunit.client.0.smithi162.stdout:2/877: truncate d0/d3/d1b/d6b/dc0/f54 77281 0 2024-04-25T02:09:03.860 INFO:tasks.workunit.client.0.smithi162.stdout:9/866: dread d4/d8/d85/fed [0,4194304] 0 2024-04-25T02:09:03.900 INFO:tasks.workunit.client.0.smithi162.stdout:9/867: stat d4/d9/d15/d1b/d69/f127 0 2024-04-25T02:09:04.208 INFO:tasks.workunit.client.0.smithi162.stdout:1/962: link d15/d1f/d35/d4c/d121/c133 d15/d1f/d35/d4c/d70/d73/c146 0 2024-04-25T02:09:04.247 INFO:tasks.workunit.client.0.smithi162.stdout:1/963: chown d15/d1f/d35/d5c/f74 285349688 1 2024-04-25T02:09:04.258 INFO:tasks.workunit.client.0.smithi162.stdout:1/964: stat d15/l71 0 2024-04-25T02:09:04.382 INFO:tasks.workunit.client.0.smithi162.stdout:7/961: truncate df/f21 6308862 0 2024-04-25T02:09:04.575 INFO:tasks.workunit.client.0.smithi162.stdout:2/878: readlink d0/d3/d5/d36/d93/l95 0 2024-04-25T02:09:04.971 INFO:tasks.workunit.client.0.smithi162.stdout:4/949: rename dd/c44 to dd/d1a/c135 0 2024-04-25T02:09:05.554 INFO:tasks.workunit.client.0.smithi162.stdout:9/868: mknod d4/d9/d15/d1b/d2f/d30/d112/d12f/c136 0 2024-04-25T02:09:05.558 INFO:tasks.workunit.client.0.smithi162.stdout:6/887: write d1/fe [3292190,22078] 0 2024-04-25T02:09:05.644 INFO:tasks.workunit.client.0.smithi162.stdout:1/965: creat d15/d1f/d35/d4c/d70/d9f/d13a/f147 x:0 0 0 2024-04-25T02:09:05.835 INFO:tasks.workunit.client.0.smithi162.stdout:3/955: rename d2/d9/d99 to d2/d9/d10/d2c/da0/d135 0 2024-04-25T02:09:05.844 INFO:tasks.workunit.client.0.smithi162.stdout:1/966: sync 2024-04-25T02:09:06.245 INFO:tasks.workunit.client.0.smithi162.stdout:7/962: symlink df/d2c/d63/d14a/l150 0 2024-04-25T02:09:06.424 INFO:tasks.workunit.client.0.smithi162.stdout:4/950: mknod dd/d1a/d34/d72/def/d107/c136 0 2024-04-25T02:09:07.713 INFO:tasks.workunit.client.0.smithi162.stdout:2/879: creat d0/d3/d7a/f138 x:0 0 0 2024-04-25T02:09:07.928 INFO:tasks.workunit.client.0.smithi162.stdout:8/906: write d0/d12/d2b/d87/fb2 [2409853,66725] 0 2024-04-25T02:09:08.360 INFO:tasks.workunit.client.0.smithi162.stdout:7/963: mkdir df/d2c/d63/d83/d8b/d90/d127/d142/dd3/dd0/d122/d148/d151 0 2024-04-25T02:09:08.468 INFO:tasks.workunit.client.0.smithi162.stdout:4/951: unlink dd/df/d2e/d59/lca 0 2024-04-25T02:09:08.507 INFO:tasks.workunit.client.0.smithi162.stdout:4/952: stat f7 0 2024-04-25T02:09:08.615 INFO:tasks.workunit.client.0.smithi162.stdout:2/880: truncate d0/d3/d7a/d88/ffb 215268 0 2024-04-25T02:09:08.669 INFO:tasks.workunit.client.0.smithi162.stdout:8/907: fsync d0/d12/d1b/d74/d8a/fad 0 2024-04-25T02:09:08.702 INFO:tasks.workunit.client.0.smithi162.stdout:7/964: dread df/d2e/d4c/d8a/fc2 [0,4194304] 0 2024-04-25T02:09:08.767 INFO:tasks.workunit.client.0.smithi162.stdout:3/956: link d2/d9/d10/d2c/da3/db5/fc0 d2/ddf/d11b/f136 0 2024-04-25T02:09:09.303 INFO:tasks.workunit.client.0.smithi162.stdout:8/908: unlink d0/d1a/c7a 0 2024-04-25T02:09:09.326 INFO:tasks.workunit.client.0.smithi162.stdout:8/909: chown d0/d44/c21 45199 1 2024-04-25T02:09:09.542 INFO:tasks.workunit.client.0.smithi162.stdout:7/965: dread df/f101 [0,4194304] 0 2024-04-25T02:09:09.558 INFO:tasks.workunit.client.0.smithi162.stdout:3/957: read d2/d9/d19/f73 [3221837,103613] 0 2024-04-25T02:09:09.898 INFO:tasks.workunit.client.0.smithi162.stdout:5/915: write d15/d19/d24/d4d/d7c/d85/fba [1054443,26919] 0 2024-04-25T02:09:10.201 INFO:tasks.workunit.client.0.smithi162.stdout:4/953: creat dd/df/d2e/f137 x:0 0 0 2024-04-25T02:09:10.321 INFO:tasks.workunit.client.0.smithi162.stdout:7/966: dread df/d2e/d4c/daf/fb6 [0,4194304] 0 2024-04-25T02:09:11.620 INFO:tasks.workunit.client.0.smithi162.stdout:9/869: dwrite d4/d9/da9/f10d [0,4194304] 0 2024-04-25T02:09:11.859 INFO:tasks.workunit.client.0.smithi162.stdout:3/958: link d2/d9/d10/d4c/d51/c108 d2/d9/d10/d4c/d51/d63/d87/d90/db3/c137 0 2024-04-25T02:09:11.888 INFO:tasks.workunit.client.0.smithi162.stdout:6/888: dwrite d1/d13/d28/d30/d3a/f3c [0,4194304] 0 2024-04-25T02:09:12.848 INFO:tasks.workunit.client.0.smithi162.stdout:1/967: symlink d15/l148 0 2024-04-25T02:09:12.881 INFO:tasks.workunit.client.0.smithi162.stdout:8/910: write d0/d12/d1b/f1f [1251968,17292] 0 2024-04-25T02:09:12.895 INFO:tasks.workunit.client.0.smithi162.stdout:5/916: write d15/d19/d24/d4d/d7c/de2/d10a/fc5 [2647984,62005] 0 2024-04-25T02:09:12.998 INFO:tasks.workunit.client.0.smithi162.stdout:4/954: write dd/df/d2e/f3b [4839883,49171] 0 2024-04-25T02:09:13.134 INFO:tasks.workunit.client.0.smithi162.stdout:1/968: stat d15/d1f/d23/f25 0 2024-04-25T02:09:13.190 INFO:tasks.workunit.client.0.smithi162.stdout:7/967: write df/f23 [3193204,84909] 0 2024-04-25T02:09:13.401 INFO:tasks.workunit.client.0.smithi162.stdout:2/881: dwrite d0/d3/d5/d69/f133 [0,4194304] 0 2024-04-25T02:09:13.961 INFO:tasks.workunit.client.0.smithi162.stdout:8/911: truncate d0/d44/d64/f106 867190 0 2024-04-25T02:09:14.363 INFO:tasks.workunit.client.0.smithi162.stdout:3/959: rmdir d2/d9/d48 39 2024-04-25T02:09:14.561 INFO:tasks.workunit.client.0.smithi162.stdout:1/969: rename d15/d1f/d35/d4c/d70/d9f/dea/l135 to d15/d1f/d35/d4c/d70/d110/d11c/l149 0 2024-04-25T02:09:14.585 INFO:tasks.workunit.client.0.smithi162.stdout:1/970: chown d15/d1f/l45 7 1 2024-04-25T02:09:15.040 INFO:tasks.workunit.client.0.smithi162.stdout:3/960: mkdir d2/ddf/d138 0 2024-04-25T02:09:15.640 INFO:tasks.workunit.client.0.smithi162.stdout:9/870: dwrite d4/d9/d15/d1b/d2f/d30/dc1/d9f/fd4 [0,4194304] 0 2024-04-25T02:09:15.677 INFO:tasks.workunit.client.0.smithi162.stdout:6/889: dwrite d1/d13/d28/d30/d8a/fe5 [0,4194304] 0 2024-04-25T02:09:16.058 INFO:tasks.workunit.client.0.smithi162.stdout:8/912: creat d0/f13b x:0 0 0 2024-04-25T02:09:16.367 INFO:tasks.workunit.client.0.smithi162.stdout:3/961: creat d2/d9/d10/d2c/da3/db5/f139 x:0 0 0 2024-04-25T02:09:16.396 INFO:tasks.workunit.client.0.smithi162.stdout:4/955: write dd/df/d2e/f2f [968993,12294] 0 2024-04-25T02:09:16.691 INFO:tasks.workunit.client.0.smithi162.stdout:5/917: write d15/d19/d24/d2b/ffd [554864,31958] 0 2024-04-25T02:09:16.768 INFO:tasks.workunit.client.0.smithi162.stdout:7/968: write df/d2e/fcd [594945,83097] 0 2024-04-25T02:09:17.212 INFO:tasks.workunit.client.0.smithi162.stdout:2/882: dwrite d0/d3/d7a/fc5 [0,4194304] 0 2024-04-25T02:09:17.396 INFO:tasks.workunit.client.0.smithi162.stdout:4/956: mknod dd/d1a/c138 0 2024-04-25T02:09:17.570 INFO:tasks.workunit.client.0.smithi162.stdout:1/971: dwrite d15/d1f/d23/d30/f5a [4194304,4194304] 0 2024-04-25T02:09:17.692 INFO:tasks.workunit.client.0.smithi162.stdout:3/962: fdatasync d2/d9/d19/d3f/fa9 0 2024-04-25T02:09:17.716 INFO:tasks.workunit.client.0.smithi162.stdout:5/918: read - d15/fed zero size 2024-04-25T02:09:18.195 INFO:tasks.workunit.client.0.smithi162.stdout:7/969: creat df/d2c/d63/d83/d8b/d90/d127/d142/dd3/dd0/d122/f152 x:0 0 0 2024-04-25T02:09:18.438 INFO:tasks.workunit.client.0.smithi162.stdout:7/970: chown df/d2c/d63/d83/d8b/d90/d127/d142/dd3/dd0/d122/d148 9 1 2024-04-25T02:09:18.637 INFO:tasks.workunit.client.0.smithi162.stdout:9/871: dwrite d4/d8/d85/f7a [4194304,4194304] 0 2024-04-25T02:09:18.954 INFO:tasks.workunit.client.0.smithi162.stdout:6/890: dwrite d1/d13/d28/d7b/fc6 [0,4194304] 0 2024-04-25T02:09:19.070 INFO:tasks.workunit.client.0.smithi162.stdout:2/883: rename d0/d3/d1b/d6b/dc0/d5e/d61/da4/c80 to d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dc1/c139 0 2024-04-25T02:09:19.569 INFO:tasks.workunit.client.0.smithi162.stdout:7/971: chown df/l19 476 1 2024-04-25T02:09:19.827 INFO:tasks.workunit.client.0.smithi162.stdout:8/913: write d0/d12/d1b/d74/d8a/f100 [3023382,122259] 0 2024-04-25T02:09:19.868 INFO:tasks.workunit.client.0.smithi162.stdout:8/914: stat d0/d44/d64/ld9 0 2024-04-25T02:09:19.938 INFO:tasks.workunit.client.0.smithi162.stdout:3/963: mkdir d2/d9/d10/d4c/d51/d63/d87/de0/d133/d13a 0 2024-04-25T02:09:20.174 INFO:tasks.workunit.client.0.smithi162.stdout:9/872: fdatasync d4/d9/d15/d1b/d2f/d30/dc1/d9f/fb4 0 2024-04-25T02:09:20.475 INFO:tasks.workunit.client.0.smithi162.stdout:9/873: sync 2024-04-25T02:09:20.503 INFO:tasks.workunit.client.0.smithi162.stdout:9/874: chown d4/d9/d15/c11b 0 1 2024-04-25T02:09:20.679 INFO:tasks.workunit.client.0.smithi162.stdout:2/884: chown d0/d3/c53 7136 1 2024-04-25T02:09:20.879 INFO:tasks.workunit.client.0.smithi162.stdout:5/919: rename d15/d19/d24/d2b/d3b/f98 to d15/d19/d24/d4d/d7c/de2/d119/f12f 0 2024-04-25T02:09:20.976 INFO:tasks.workunit.client.0.smithi162.stdout:5/920: sync 2024-04-25T02:09:21.593 INFO:tasks.workunit.client.0.smithi162.stdout:9/875: mknod d4/d25/de5/d108/d11d/c137 0 2024-04-25T02:09:21.889 INFO:tasks.workunit.client.0.smithi162.stdout:2/885: creat d0/d3/d1b/d6b/dc0/d5e/db8/d111/f13a x:0 0 0 2024-04-25T02:09:21.942 INFO:tasks.workunit.client.0.smithi162.stdout:4/957: dwrite dd/d1a/d34/d57/f112 [0,4194304] 0 2024-04-25T02:09:22.142 INFO:tasks.workunit.client.0.smithi162.stdout:2/886: dread - d0/d3/d1b/d1d/d3a/d63/dba/f104 zero size 2024-04-25T02:09:23.047 INFO:tasks.workunit.client.0.smithi162.stdout:9/876: dread d4/f39 [0,4194304] 0 2024-04-25T02:09:23.197 INFO:tasks.workunit.client.0.smithi162.stdout:4/958: mkdir dd/df/d2e/d4b/d139 0 2024-04-25T02:09:23.227 INFO:tasks.workunit.client.0.smithi162.stdout:4/959: stat dd/d1a/d4e/d93/fd0 0 2024-04-25T02:09:23.978 INFO:tasks.workunit.client.0.smithi162.stdout:6/891: dwrite d1/d13/d28/d45/f61 [8388608,4194304] 0 2024-04-25T02:09:24.354 INFO:tasks.workunit.client.0.smithi162.stdout:1/972: unlink f14 0 2024-04-25T02:09:24.442 INFO:tasks.workunit.client.0.smithi162.stdout:8/915: getdents d0/d12/d3a 0 2024-04-25T02:09:24.445 INFO:tasks.workunit.client.0.smithi162.stdout:1/973: stat d15/d1f/d35/d4c/d70/f7e 0 2024-04-25T02:09:24.453 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:09:24.456 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:09:24.554 INFO:tasks.workunit.client.0.smithi162.stdout:7/972: write df/d2e/d4c/f53 [5235356,52170] 0 2024-04-25T02:09:24.581 INFO:tasks.workunit.client.0.smithi162.stdout:1/974: chown d15/d1f/d35/d4c/d70/d73/db8/c113 232923554 1 2024-04-25T02:09:25.005 INFO:tasks.workunit.client.0.smithi162.stdout:3/964: rename d2/d9/d10/d2c/da0/df5 to d2/d9/d10/d4c/d13b 0 2024-04-25T02:09:25.306 INFO:tasks.workunit.client.0.smithi162.stdout:9/877: getdents d4/d9/da9/d133 0 2024-04-25T02:09:25.324 INFO:tasks.workunit.client.0.smithi162.stdout:5/921: dwrite d15/d19/d24/d2b/fab [0,4194304] 0 2024-04-25T02:09:25.405 INFO:tasks.workunit.client.0.smithi162.stdout:5/922: readlink l4 0 2024-04-25T02:09:25.946 INFO:tasks.workunit.client.0.smithi162.stdout:2/887: link d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/ffc d0/d3/d5/d36/d93/dbd/d11c/f13b 0 2024-04-25T02:09:26.107 INFO:tasks.workunit.client.0.smithi162.stdout:7/973: dread df/d2c/d63/d83/d8b/d90/d127/d142/d82/faa [0,4194304] 0 2024-04-25T02:09:26.622 INFO:tasks.workunit.client.0.smithi162.stdout:5/923: creat d15/d19/d24/d4d/d7c/de2/d10a/dbf/d120/f130 x:0 0 0 2024-04-25T02:09:27.022 INFO:tasks.workunit.client.0.smithi162.stdout:3/965: mkdir d2/ddf/d11b/d13c 0 2024-04-25T02:09:27.039 INFO:tasks.workunit.client.0.smithi162.stdout:7/974: rename df/f13 to df/d2c/d63/d83/d8b/d90/d127/d142/d93/f153 0 2024-04-25T02:09:27.122 INFO:tasks.workunit.client.0.smithi162.stdout:3/966: chown d2/f25 8219074 1 2024-04-25T02:09:27.184 INFO:tasks.workunit.client.0.smithi162.stdout:2/888: truncate d0/d3/d1b/d6b/dc0/d5e/d61/da4/f73 3173191 0 2024-04-25T02:09:27.304 INFO:tasks.workunit.client.0.smithi162.stdout:4/960: dwrite dd/df/f52 [0,4194304] 0 2024-04-25T02:09:27.443 INFO:tasks.workunit.client.0.smithi162.stdout:8/916: creat d0/d12/d1b/d74/d8a/d8f/f13c x:0 0 0 2024-04-25T02:09:27.452 INFO:tasks.workunit.client.0.smithi162.stdout:9/878: mknod d4/d9/d15/d1b/d2f/d30/dc1/d59/c138 0 2024-04-25T02:09:27.508 INFO:tasks.workunit.client.0.smithi162.stdout:5/924: creat d15/d1e/f131 x:0 0 0 2024-04-25T02:09:27.604 INFO:tasks.workunit.client.0.smithi162.stdout:4/961: chown dd/d1a/d34/d57/l7d 193 1 2024-04-25T02:09:27.910 INFO:tasks.workunit.client.0.smithi162.stdout:2/889: dread d0/d3/d1b/d6b/d92/f105 [0,4194304] 0 2024-04-25T02:09:27.944 INFO:tasks.workunit.client.0.smithi162.stdout:3/967: fsync d2/d9/d10/d4c/d51/d63/d87/f134 0 2024-04-25T02:09:28.077 INFO:tasks.workunit.client.0.smithi162.stdout:8/917: unlink d0/d12/d1b/l82 0 2024-04-25T02:09:28.212 INFO:tasks.workunit.client.0.smithi162.stdout:9/879: fsync d4/d25/de5/d125/fba 0 2024-04-25T02:09:28.290 INFO:tasks.workunit.client.0.smithi162.stdout:6/892: dwrite d1/d13/d28/d53/d71/dc5/de1/f10a [0,4194304] 0 2024-04-25T02:09:28.440 INFO:tasks.workunit.client.0.smithi162.stdout:6/893: stat d1/d13/d28/d53/l114 0 2024-04-25T02:09:28.804 INFO:tasks.workunit.client.0.smithi162.stdout:4/962: truncate fc 2465993 0 2024-04-25T02:09:28.852 INFO:tasks.workunit.client.0.smithi162.stdout:1/975: write d15/d1f/d35/d4c/d70/d9f/d13a/f147 [374677,98345] 0 2024-04-25T02:09:29.619 INFO:tasks.workunit.client.0.smithi162.stdout:3/968: dread d2/d9/d10/d4c/d51/d63/d87/d86/fa4 [0,4194304] 0 2024-04-25T02:09:29.728 INFO:tasks.workunit.client.0.smithi162.stdout:9/880: rmdir d4/d8/d85/dd6 39 2024-04-25T02:09:30.087 INFO:tasks.workunit.client.0.smithi162.stdout:5/925: symlink d15/d19/d24/d4d/d7c/d85/dde/l132 0 2024-04-25T02:09:31.516 INFO:tasks.workunit.client.0.smithi162.stdout:5/926: rename d15/d19/d24/d4d/d7c/d85/de7/d7a/d7e/d101/c110 to d15/d19/d24/d4d/d7c/de2/d10a/dbf/d120/d124/c133 0 2024-04-25T02:09:31.533 INFO:tasks.workunit.client.0.smithi162.stdout:7/975: link df/f7b df/d2e/d4c/de8/f154 0 2024-04-25T02:09:31.868 INFO:tasks.workunit.client.0.smithi162.stdout:8/918: creat d0/d12/d1b/d74/d8a/da3/f13d x:0 0 0 2024-04-25T02:09:32.201 INFO:tasks.workunit.client.0.smithi162.stdout:7/976: creat df/d2c/d63/d14a/f155 x:0 0 0 2024-04-25T02:09:32.397 INFO:tasks.workunit.client.0.smithi162.stdout:8/919: truncate d0/d44/d31/fca 384704 0 2024-04-25T02:09:32.868 INFO:tasks.workunit.client.0.smithi162.stdout:7/977: dread df/d2c/d49/d7a/dbf/fd2 [0,4194304] 0 2024-04-25T02:09:32.917 INFO:tasks.workunit.client.0.smithi162.stdout:2/890: dwrite d0/d3/f47 [0,4194304] 0 2024-04-25T02:09:33.034 INFO:tasks.workunit.client.0.smithi162.stdout:8/920: dread d0/db1/ff5 [0,4194304] 0 2024-04-25T02:09:33.168 INFO:tasks.workunit.client.0.smithi162.stdout:7/978: sync 2024-04-25T02:09:33.227 INFO:tasks.workunit.client.0.smithi162.stdout:1/976: dread d15/d1f/d23/f51 [0,4194304] 0 2024-04-25T02:09:33.540 INFO:tasks.workunit.client.0.smithi162.stdout:5/927: getdents d15/d19/d24/d4d/d7c/de2/d10a 0 2024-04-25T02:09:33.624 INFO:tasks.workunit.client.0.smithi162.stdout:8/921: dread d0/d12/d1b/d74/d8a/fad [0,4194304] 0 2024-04-25T02:09:33.713 INFO:tasks.workunit.client.0.smithi162.stdout:9/881: write d4/d9/d15/d1b/d2f/d30/dc1/d59/dec/fef [981547,76190] 0 2024-04-25T02:09:33.849 INFO:tasks.workunit.client.0.smithi162.stdout:6/894: truncate d1/d13/d28/d30/d8a/dc3/fde 9469065 0 2024-04-25T02:09:34.255 INFO:tasks.workunit.client.0.smithi162.stdout:4/963: dwrite dd/d1a/d34/d9d/ff1 [0,4194304] 0 2024-04-25T02:09:34.261 INFO:tasks.workunit.client.0.smithi162.stdout:3/969: dwrite d2/d9/f49 [0,4194304] 0 2024-04-25T02:09:34.413 INFO:tasks.workunit.client.0.smithi162.stdout:1/977: mkdir d15/d1f/d35/d4c/d8e/d14a 0 2024-04-25T02:09:34.806 INFO:tasks.workunit.client.0.smithi162.stdout:1/978: dread d15/d1f/d23/d30/d4a/f58 [0,4194304] 0 2024-04-25T02:09:34.923 INFO:tasks.workunit.client.0.smithi162.stdout:5/928: creat d15/d19/d24/dca/f134 x:0 0 0 2024-04-25T02:09:34.960 INFO:tasks.workunit.client.0.smithi162.stdout:8/922: read d0/f6b [105794,70838] 0 2024-04-25T02:09:35.007 INFO:tasks.workunit.client.0.smithi162.stdout:7/979: mknod df/d2e/d4c/d8a/c156 0 2024-04-25T02:09:35.059 INFO:tasks.workunit.client.0.smithi162.stdout:9/882: dread - d4/d9/f10c zero size 2024-04-25T02:09:35.866 INFO:tasks.workunit.client.0.smithi162.stdout:2/891: link d0/d3/d5/d36/c83 d0/d3/d1b/d6b/d12e/c13c 0 2024-04-25T02:09:36.140 INFO:tasks.workunit.client.0.smithi162.stdout:3/970: creat d2/ddf/d11b/d13c/f13d x:0 0 0 2024-04-25T02:09:36.200 INFO:tasks.workunit.client.0.smithi162.stdout:1/979: symlink d15/d1f/l14b 0 2024-04-25T02:09:36.228 INFO:tasks.workunit.client.0.smithi162.stdout:5/929: mknod d15/d19/d24/d2b/d3b/d58/daf/c135 0 2024-04-25T02:09:36.245 INFO:tasks.workunit.client.0.smithi162.stdout:2/892: truncate d0/d3/d1b/d6b/dc0/d5e/fc9 1962803 0 2024-04-25T02:09:36.341 INFO:tasks.workunit.client.0.smithi162.stdout:2/893: chown d0/d3/d1b/d1d/cf9 0 1 2024-04-25T02:09:36.776 INFO:tasks.workunit.client.0.smithi162.stdout:3/971: symlink d2/d29/d5d/l13e 0 2024-04-25T02:09:37.294 INFO:tasks.workunit.client.0.smithi162.stdout:2/894: mkdir d0/d3/d1b/d6b/dc0/d5e/d13d 0 2024-04-25T02:09:37.755 INFO:tasks.workunit.client.0.smithi162.stdout:8/923: link d0/d12/d2b/d87/dbe/fcb d0/d12/f13e 0 2024-04-25T02:09:38.072 INFO:tasks.workunit.client.0.smithi162.stdout:2/895: rename d0/d3/d5/fbf to d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/d128/f13e 0 2024-04-25T02:09:38.206 INFO:tasks.workunit.client.0.smithi162.stdout:1/980: link d15/d1f/d23/d30/f5a d15/d1f/d35/d4c/d70/f14c 0 2024-04-25T02:09:38.242 INFO:tasks.workunit.client.0.smithi162.stdout:1/981: chown d15/d1f/d23/d30/d4a/d143 3004 1 2024-04-25T02:09:38.719 INFO:tasks.workunit.client.0.smithi162.stdout:4/964: write dd/df/d2e/d59/f9f [1046346,587] 0 2024-04-25T02:09:38.736 INFO:tasks.workunit.client.0.smithi162.stdout:6/895: dwrite d1/d13/d28/d30/d3a/dbc/def/f122 [0,4194304] 0 2024-04-25T02:09:38.969 INFO:tasks.workunit.client.0.smithi162.stdout:2/896: creat d0/d3/d1b/d6b/d92/d9a/f13f x:0 0 0 2024-04-25T02:09:39.124 INFO:tasks.workunit.client.0.smithi162.stdout:1/982: unlink d15/d1f/fb0 0 2024-04-25T02:09:39.735 INFO:tasks.workunit.client.0.smithi162.stdout:7/980: write df/f33 [3647751,31121] 0 2024-04-25T02:09:39.778 INFO:tasks.workunit.client.0.smithi162.stdout:7/981: chown df/f2d 0 1 2024-04-25T02:09:39.830 INFO:tasks.workunit.client.0.smithi162.stdout:7/982: readlink df/d2c/d63/d83/d8b/d90/d127/d142/l74 0 2024-04-25T02:09:39.843 INFO:tasks.workunit.client.0.smithi162.stdout:4/965: truncate dd/d1a/fde 432919 0 2024-04-25T02:09:39.928 INFO:tasks.workunit.client.0.smithi162.stdout:7/983: dread - df/d2c/d63/d83/d8b/d90/d127/d142/fdb zero size 2024-04-25T02:09:40.229 INFO:tasks.workunit.client.0.smithi162.stdout:2/897: symlink d0/d3/d1b/d6b/dc0/d42/l140 0 2024-04-25T02:09:40.500 INFO:tasks.workunit.client.0.smithi162.stdout:9/883: write d4/d9/d15/d1b/d2f/d30/dc1/f103 [417196,96600] 0 2024-04-25T02:09:40.569 INFO:tasks.workunit.client.0.smithi162.stdout:5/930: write d15/d19/d24/f2d [3265483,82601] 0 2024-04-25T02:09:40.591 INFO:tasks.workunit.client.0.smithi162.stdout:3/972: write d2/d9/d48/f12e [393998,99383] 0 2024-04-25T02:09:41.028 INFO:tasks.workunit.client.0.smithi162.stdout:8/924: dwrite d0/d12/d3a/f76 [0,4194304] 0 2024-04-25T02:09:41.413 INFO:tasks.workunit.client.0.smithi162.stdout:1/983: mkdir d15/d1f/d35/d4c/d70/d9f/d14d 0 2024-04-25T02:09:41.443 INFO:tasks.workunit.client.0.smithi162.stdout:1/984: chown d15/d1f/d35/f44 457 1 2024-04-25T02:09:41.942 INFO:tasks.workunit.client.0.smithi162.stdout:5/931: unlink d15/d19/d24/d2b/d3b/d58/daf/c135 0 2024-04-25T02:09:42.575 INFO:tasks.workunit.client.0.smithi162.stdout:1/985: unlink d15/d1f/d23/d30/f131 0 2024-04-25T02:09:42.870 INFO:tasks.workunit.client.0.smithi162.stdout:1/986: sync 2024-04-25T02:09:42.922 INFO:tasks.workunit.client.0.smithi162.stdout:7/984: creat df/d2c/d63/d83/f157 x:0 0 0 2024-04-25T02:09:43.714 INFO:tasks.workunit.client.0.smithi162.stdout:6/896: creat d1/d13/d28/f125 x:0 0 0 2024-04-25T02:09:44.155 INFO:tasks.workunit.client.0.smithi162.stdout:9/884: dwrite d4/d9/d15/d1b/d2f/d30/f9d [0,4194304] 0 2024-04-25T02:09:44.414 INFO:tasks.workunit.client.0.smithi162.stdout:3/973: write d2/d9/d10/d4c/d51/d63/d87/d110/f124 [253262,120386] 0 2024-04-25T02:09:44.716 INFO:tasks.workunit.client.0.smithi162.stdout:4/966: creat dd/f13a x:0 0 0 2024-04-25T02:09:44.803 INFO:tasks.workunit.client.0.smithi162.stdout:3/974: dread - d2/ddf/de7/f11a zero size 2024-04-25T02:09:45.069 INFO:tasks.workunit.client.0.smithi162.stdout:2/898: write d0/d3/d1b/d6b/dc0/d5e/d61/da4/f73 [327123,89263] 0 2024-04-25T02:09:45.109 INFO:tasks.workunit.client.0.smithi162.stdout:5/932: write d15/d19/d24/d4d/d7c/d85/de7/d7a/fac [963729,86352] 0 2024-04-25T02:09:45.372 INFO:tasks.workunit.client.0.smithi162.stdout:8/925: rename d0/d1a/fae to d0/d12/d1b/f13f 0 2024-04-25T02:09:45.617 INFO:tasks.workunit.client.0.smithi162.stdout:1/987: dwrite d15/d1f/d23/f25 [0,4194304] 0 2024-04-25T02:09:46.108 INFO:tasks.workunit.client.0.smithi162.stdout:6/897: dwrite d1/f25 [4194304,4194304] 0 2024-04-25T02:09:46.323 INFO:tasks.workunit.client.0.smithi162.stdout:5/933: truncate d15/d19/d24/d4d/d7c/d85/de7/d7a/d7e/d101/f102 214124 0 2024-04-25T02:09:46.464 INFO:tasks.workunit.client.0.smithi162.stdout:7/985: rename df/d2c/d63/d83/d8b/ca1 to df/d2c/d49/d7a/dbf/c158 0 2024-04-25T02:09:46.581 INFO:tasks.workunit.client.0.smithi162.stdout:8/926: truncate d0/d44/f11e 769343 0 2024-04-25T02:09:46.728 INFO:tasks.workunit.client.0.smithi162.stdout:1/988: rmdir d15/d1f/d35/d4c 39 2024-04-25T02:09:46.857 INFO:tasks.workunit.client.0.smithi162.stdout:1/989: sync 2024-04-25T02:09:46.887 INFO:tasks.workunit.client.0.smithi162.stdout:1/990: chown d15/d1f/d23/f25 2201580 1 2024-04-25T02:09:47.322 INFO:tasks.workunit.client.0.smithi162.stdout:4/967: creat dd/d1a/d34/db1/f13b x:0 0 0 2024-04-25T02:09:47.659 INFO:tasks.workunit.client.0.smithi162.stdout:3/975: write d2/d9/d10/d4c/d51/d63/d87/d86/fa4 [1490056,71417] 0 2024-04-25T02:09:47.748 INFO:tasks.workunit.client.0.smithi162.stdout:3/976: sync 2024-04-25T02:09:48.164 INFO:tasks.workunit.client.0.smithi162.stdout:2/899: write d0/d3/d1b/d6b/dc0/d67/d9c/fef [3818331,111124] 0 2024-04-25T02:09:48.627 INFO:tasks.workunit.client.0.smithi162.stdout:7/986: truncate df/d2e/f48 404087 0 2024-04-25T02:09:48.923 INFO:tasks.workunit.client.0.smithi162.stdout:4/968: mkdir dd/df/d2e/d13c 0 2024-04-25T02:09:49.154 INFO:tasks.workunit.client.0.smithi162.stdout:9/885: rename d4/d9/d15/d1b/d2f/d30/dc1/d9f/l12a to d4/d9/d15/d1b/d2f/d30/dc1/d9f/dd1/l139 0 2024-04-25T02:09:49.184 INFO:tasks.workunit.client.0.smithi162.stdout:2/900: read d0/d3/d1b/d6b/dc0/d67/d9c/de8/f106 [409524,124843] 0 2024-04-25T02:09:49.193 INFO:tasks.workunit.client.0.smithi162.stdout:6/898: mkdir d1/d13/d28/d30/d8a/d126 0 2024-04-25T02:09:49.701 INFO:tasks.workunit.client.0.smithi162.stdout:7/987: mkdir df/d2e/d4c/d8a/db2/df0/d10a/d159 0 2024-04-25T02:09:49.854 INFO:tasks.workunit.client.0.smithi162.stdout:4/969: dread dd/df/d2e/d4b/d79/fcb [0,4194304] 0 2024-04-25T02:09:49.879 INFO:tasks.workunit.client.0.smithi162.stdout:8/927: write d0/d12/d1b/d74/d8a/f117 [83122,21723] 0 2024-04-25T02:09:49.973 INFO:tasks.workunit.client.0.smithi162.stdout:4/970: sync 2024-04-25T02:09:50.273 INFO:tasks.workunit.client.0.smithi162.stdout:4/971: dread dd/d1a/d34/d57/fc2 [0,4194304] 0 2024-04-25T02:09:50.776 INFO:tasks.workunit.client.0.smithi162.stdout:3/977: dwrite d2/d9/d10/d2c/da0/d135/f2f [0,4194304] 0 2024-04-25T02:09:50.914 INFO:tasks.workunit.client.0.smithi162.stdout:7/988: mknod df/d2c/d63/d83/d8b/d90/d127/d142/dd3/dd8/c15a 0 2024-04-25T02:09:51.028 INFO:tasks.workunit.client.0.smithi162.stdout:1/991: dwrite d15/d69/f75 [4194304,4194304] 0 2024-04-25T02:09:51.921 INFO:tasks.workunit.client.0.smithi162.stdout:6/899: creat d1/d13/d28/d45/d59/d80/f127 x:0 0 0 2024-04-25T02:09:51.945 INFO:tasks.workunit.client.0.smithi162.stdout:6/900: chown d1/f48 330 1 2024-04-25T02:09:52.812 INFO:tasks.workunit.client.0.smithi162.stdout:7/989: fdatasync df/d2c/d63/d83/ddc/ff6 0 2024-04-25T02:09:53.114 INFO:tasks.workunit.client.0.smithi162.stdout:2/901: write d0/d3/d1b/d1d/d3a/d63/f71 [3658158,73260] 0 2024-04-25T02:09:53.168 INFO:tasks.workunit.client.0.smithi162.stdout:6/901: read d1/f24 [2756244,92998] 0 2024-04-25T02:09:53.391 INFO:tasks.workunit.client.0.smithi162.stdout:9/886: dwrite d4/d8/d85/feb [0,4194304] 0 2024-04-25T02:09:53.720 INFO:tasks.workunit.client.0.smithi162.stdout:8/928: dwrite d0/d12/d1b/d74/d8a/fad [0,4194304] 0 2024-04-25T02:09:53.859 INFO:tasks.workunit.client.0.smithi162.stdout:8/929: chown d0/d12/d1b/d8d/ld2 9445 1 2024-04-25T02:09:54.141 INFO:tasks.workunit.client.0.smithi162.stdout:3/978: creat d2/d9/d10/d4c/d51/d63/f13f x:0 0 0 2024-04-25T02:09:54.412 INFO:tasks.workunit.client.0.smithi162.stdout:6/902: fsync d1/f27 0 2024-04-25T02:09:54.430 INFO:tasks.workunit.client.0.smithi162.stdout:7/990: getdents df/d2c/d63/d83/d8b/d90/d127/d142/dd3/dd8/d14f 0 2024-04-25T02:09:54.559 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:09:54.562 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:09:54.879 INFO:tasks.workunit.client.0.smithi162.stdout:5/934: rename l4 to d15/d19/d24/d4d/d7c/d85/de7/d7a/d7e/l136 0 2024-04-25T02:09:54.948 INFO:tasks.workunit.client.0.smithi162.stdout:8/930: mknod d0/d86/c140 0 2024-04-25T02:09:54.981 INFO:tasks.workunit.client.0.smithi162.stdout:4/972: write dd/fcf [913191,6540] 0 2024-04-25T02:09:55.286 INFO:tasks.workunit.client.0.smithi162.stdout:7/991: unlink df/d2c/d63/d83/ddc/ff6 0 2024-04-25T02:09:55.351 INFO:tasks.workunit.client.0.smithi162.stdout:7/992: chown df/d2c/d63/d83/d8b/d90/d127/d142/d93/fa7 27361812 1 2024-04-25T02:09:55.371 INFO:tasks.workunit.client.0.smithi162.stdout:7/993: stat df/d2c/d49/cd5 0 2024-04-25T02:09:55.396 INFO:tasks.workunit.client.0.smithi162.stdout:6/903: unlink d1/d13/d28/d30/d3a/d57/f117 0 2024-04-25T02:09:55.573 INFO:tasks.workunit.client.0.smithi162.stdout:2/902: creat d0/d3/d1b/d6b/d12e/f141 x:0 0 0 2024-04-25T02:09:55.631 INFO:tasks.workunit.client.0.smithi162.stdout:2/903: chown d0/d3/d5/l13 31462 1 2024-04-25T02:09:55.826 INFO:tasks.workunit.client.0.smithi162.stdout:5/935: fdatasync d15/d19/d24/d4d/d7c/d85/de7/f92 0 2024-04-25T02:09:56.213 INFO:tasks.workunit.client.0.smithi162.stdout:5/936: dread d15/d1e/f22 [0,4194304] 0 2024-04-25T02:09:56.334 INFO:tasks.workunit.client.0.smithi162.stdout:7/994: fsync f1 0 2024-04-25T02:09:56.537 INFO:tasks.workunit.client.0.smithi162.stdout:6/904: mkdir d1/d13/d28/d30/d3a/d57/d128 0 2024-04-25T02:09:56.553 INFO:tasks.workunit.client.0.smithi162.stdout:1/992: write d15/d1f/d23/f51 [1438291,64818] 0 2024-04-25T02:09:56.823 INFO:tasks.workunit.client.0.smithi162.stdout:8/931: mkdir d0/d12/d2b/d87/dbe/d13a/d141 0 2024-04-25T02:09:57.001 INFO:tasks.workunit.client.0.smithi162.stdout:1/993: dread d15/d1f/d23/d30/d4a/d7f/fdd [0,4194304] 0 2024-04-25T02:09:57.356 INFO:tasks.workunit.client.0.smithi162.stdout:5/937: symlink d15/d19/d24/d2b/d3b/d3c/d3f/l137 0 2024-04-25T02:09:57.401 INFO:tasks.workunit.client.0.smithi162.stdout:5/938: chown d15/d19/d24/d2b/d3b/d3c/f70 0 1 2024-04-25T02:09:57.866 INFO:tasks.workunit.client.0.smithi162.stdout:6/905: fsync d1/d13/d28/d30/d8a/dab/fb5 0 2024-04-25T02:09:58.049 INFO:tasks.workunit.client.0.smithi162.stdout:3/979: getdents d2/d9/d10/d4c/d51/d63/d87 0 2024-04-25T02:09:58.327 INFO:tasks.workunit.client.0.smithi162.stdout:2/904: rename d0/d3/d5 to d0/d3/d1b/d142 0 2024-04-25T02:09:58.350 INFO:tasks.workunit.client.0.smithi162.stdout:6/906: unlink d1/d13/d28/d45/d59/dbe/f121 0 2024-04-25T02:09:58.398 INFO:tasks.workunit.client.0.smithi162.stdout:5/939: read d15/d19/d24/d2b/d3b/d80/de1/d11b/f129 [2432011,73454] 0 2024-04-25T02:09:58.444 INFO:tasks.workunit.client.0.smithi162.stdout:6/907: read d1/f88 [84032,41623] 0 2024-04-25T02:09:58.861 INFO:tasks.workunit.client.0.smithi162.stdout:3/980: unlink d2/da5/leb 0 2024-04-25T02:09:58.946 INFO:tasks.workunit.client.0.smithi162.stdout:9/887: write d4/f21 [2378421,98697] 0 2024-04-25T02:09:59.304 INFO:tasks.workunit.client.0.smithi162.stdout:1/994: creat d15/d1f/d35/d4c/d70/d73/db8/f14e x:0 0 0 2024-04-25T02:09:59.714 INFO:tasks.workunit.client.0.smithi162.stdout:6/908: truncate d1/f21 2417577 0 2024-04-25T02:10:00.158 INFO:tasks.workunit.client.0.smithi162.stdout:9/888: chown d4/d9/d15/d71/c111 93 1 2024-04-25T02:10:00.207 INFO:tasks.workunit.client.0.smithi162.stdout:3/981: dread d2/d29/d5d/f68 [0,4194304] 0 2024-04-25T02:10:00.442 INFO:tasks.workunit.client.0.smithi162.stdout:1/995: mkdir d15/d1f/d23/d30/d4a/d7f/d97/dbe/dde/d12c/d14f 0 2024-04-25T02:10:00.564 INFO:tasks.workunit.client.0.smithi162.stdout:9/889: truncate d4/d9/d15/fd8 800351 0 2024-04-25T02:10:00.803 INFO:tasks.workunit.client.0.smithi162.stdout:4/973: write dd/df/d58/f133 [2603270,16231] 0 2024-04-25T02:10:00.858 INFO:tasks.workunit.client.0.smithi162.stdout:4/974: stat dd/df/d2e/dd4/d103/l12e 0 2024-04-25T02:10:01.227 INFO:tasks.workunit.client.0.smithi162.stdout:7/995: dwrite df/d2c/d63/d83/d8b/d90/d127/d142/dd3/dd0/d122/f152 [0,4194304] 0 2024-04-25T02:10:01.592 INFO:tasks.workunit.client.0.smithi162.stdout:4/975: truncate dd/df/d2e/d59/dd9/fe2 447123 0 2024-04-25T02:10:01.612 INFO:tasks.workunit.client.0.smithi162.stdout:8/932: dwrite d0/d12/f24 [0,4194304] 0 2024-04-25T02:10:01.949 INFO:tasks.workunit.client.0.smithi162.stdout:6/909: creat d1/d13/f129 x:0 0 0 2024-04-25T02:10:02.030 INFO:tasks.workunit.client.0.smithi162.stdout:1/996: mkdir d15/d1f/d23/d30/d4a/d7f/d97/d150 0 2024-04-25T02:10:02.340 INFO:tasks.workunit.client.0.smithi162.stdout:7/996: chown df/c25 7906068 1 2024-04-25T02:10:02.711 INFO:tasks.workunit.client.0.smithi162.stdout:8/933: truncate d0/d44/d31/f6c 176106 0 2024-04-25T02:10:02.882 INFO:tasks.workunit.client.0.smithi162.stdout:6/910: fdatasync d1/f2a 0 2024-04-25T02:10:03.047 INFO:tasks.workunit.client.0.smithi162.stdout:1/997: symlink d15/d1f/d35/d4c/d70/d110/d11c/l151 0 2024-04-25T02:10:03.132 INFO:tasks.workunit.client.0.smithi162.stdout:5/940: dwrite d15/d19/d24/d4d/d7c/de2/f10d [0,4194304] 0 2024-04-25T02:10:03.293 INFO:tasks.workunit.client.0.smithi162.stdout:1/998: chown d15/d69/d4f/dad/f12b 0 1 2024-04-25T02:10:03.412 INFO:tasks.workunit.client.0.smithi162.stdout:9/890: creat d4/d8/d85/f13a x:0 0 0 2024-04-25T02:10:03.509 INFO:tasks.workunit.client.0.smithi162.stdout:8/934: fsync d0/d12/d2b/ffa 0 2024-04-25T02:10:03.649 INFO:tasks.workunit.client.0.smithi162.stdout:6/911: fsync d1/d13/d28/d30/f7c 0 2024-04-25T02:10:03.987 INFO:tasks.workunit.client.0.smithi162.stdout:3/982: write d2/d9/d10/d2c/da0/d135/f3d [1112837,62113] 0 2024-04-25T02:10:04.144 INFO:tasks.workunit.client.0.smithi162.stdout:5/941: rename d15/d19/d24/d2b/d3b/d3c/c9b to d15/d19/d24/d4d/d7c/de2/d119/c138 0 2024-04-25T02:10:04.335 INFO:tasks.workunit.client.0.smithi162.stdout:9/891: mkdir d4/d25/de5/d13b 0 2024-04-25T02:10:04.902 INFO:tasks.workunit.client.0.smithi162.stdout:6/912: symlink d1/d13/d79/l12a 0 2024-04-25T02:10:05.297 INFO:tasks.workunit.client.0.smithi162.stdout:1/999: fdatasync d15/d1f/d35/d4c/d121/f125 0 2024-04-25T02:10:05.762 INFO:tasks.workunit.client.0.smithi162.stdout:9/892: rename d4/d9/d15/d1b/d69/f135 to d4/d9/d15/d8a/f13c 0 2024-04-25T02:10:06.099 INFO:tasks.workunit.client.0.smithi162.stdout:9/893: sync 2024-04-25T02:10:06.187 INFO:tasks.workunit.client.0.smithi162.stdout:2/905: getdents d0/d3/d1b/d6b/d12e 0 2024-04-25T02:10:06.302 INFO:tasks.workunit.client.0.smithi162.stdout:7/997: getdents df/d2e/d4c/d8a 0 2024-04-25T02:10:06.328 INFO:tasks.workunit.client.0.smithi162.stdout:6/913: dread d1/d73/d9a/fa6 [0,4194304] 0 2024-04-25T02:10:06.384 INFO:tasks.workunit.client.0.smithi162.stdout:2/906: chown d0/d3/d1b/d1d/d3a/cb4 0 1 2024-04-25T02:10:06.744 INFO:tasks.workunit.client.0.smithi162.stdout:9/894: dread - d4/d9/d15/d1b/d2f/fce zero size 2024-04-25T02:10:06.936 INFO:tasks.workunit.client.0.smithi162.stdout:6/914: fdatasync d1/d46/f7e 0 2024-04-25T02:10:07.016 INFO:tasks.workunit.client.0.smithi162.stdout:4/976: dwrite dd/df/f10f [0,4194304] 0 2024-04-25T02:10:07.150 INFO:tasks.workunit.client.0.smithi162.stdout:2/907: readlink d0/d3/d1b/d6b/dc0/d5e/d61/d66/l85 0 2024-04-25T02:10:07.463 INFO:tasks.workunit.client.0.smithi162.stdout:9/895: symlink d4/d7c/l13d 0 2024-04-25T02:10:07.790 INFO:tasks.workunit.client.0.smithi162.stdout:4/977: mkdir dd/d1a/d34/db1/dba/d115/d13d 0 2024-04-25T02:10:07.942 INFO:tasks.workunit.client.0.smithi162.stdout:7/998: symlink df/d2c/d63/d83/d8b/d90/d127/d142/dd3/dd8/d14f/l15b 0 2024-04-25T02:10:08.695 INFO:tasks.workunit.client.0.smithi162.stdout:4/978: creat dd/df/d2e/de8/f13e x:0 0 0 2024-04-25T02:10:08.830 INFO:tasks.workunit.client.0.smithi162.stdout:2/908: mkdir d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/d143 0 2024-04-25T02:10:08.972 INFO:tasks.workunit.client.0.smithi162.stdout:8/935: dwrite d0/d12/d2b/d87/fb2 [0,4194304] 0 2024-04-25T02:10:09.235 INFO:tasks.workunit.client.0.smithi162.stdout:6/915: rename d1/d46/d7a/d85/fa3 to d1/d13/d28/d53/d71/dc5/f12b 0 2024-04-25T02:10:09.337 INFO:tasks.workunit.client.0.smithi162.stdout:4/979: fdatasync dd/df/f52 0 2024-04-25T02:10:09.600 INFO:tasks.workunit.client.0.smithi162.stdout:8/936: fsync d0/d12/f24 0 2024-04-25T02:10:09.689 INFO:tasks.workunit.client.0.smithi162.stdout:6/916: fsync d1/d13/d28/d45/d59/f6b 0 2024-04-25T02:10:09.938 INFO:tasks.workunit.client.0.smithi162.stdout:4/980: dread - dd/d1a/d34/d9d/df8/f11e zero size 2024-04-25T02:10:10.090 INFO:tasks.workunit.client.0.smithi162.stdout:3/983: write d2/d9/d10/d4c/d51/d63/f13f [458535,27848] 0 2024-04-25T02:10:10.404 INFO:tasks.workunit.client.0.smithi162.stdout:6/917: unlink d1/d13/d79/l12a 0 2024-04-25T02:10:10.612 INFO:tasks.workunit.client.0.smithi162.stdout:2/909: creat d0/d3/d1b/d142/f144 x:0 0 0 2024-04-25T02:10:10.816 INFO:tasks.workunit.client.0.smithi162.stdout:3/984: chown d2/d9/lde 959 1 2024-04-25T02:10:10.873 INFO:tasks.workunit.client.0.smithi162.stdout:5/942: dwrite f11 [0,4194304] 0 2024-04-25T02:10:11.017 INFO:tasks.workunit.client.0.smithi162.stdout:4/981: dread dd/fcf [0,4194304] 0 2024-04-25T02:10:11.018 INFO:tasks.workunit.client.0.smithi162.stdout:2/910: chown d0/d3/d1b/d6b/dc0/d67 1052 1 2024-04-25T02:10:11.335 INFO:tasks.workunit.client.0.smithi162.stdout:9/896: dwrite d4/d25/de5/d125/f5e [0,4194304] 0 2024-04-25T02:10:11.690 INFO:tasks.workunit.client.0.smithi162.stdout:3/985: dread d2/f65 [0,4194304] 0 2024-04-25T02:10:11.738 INFO:tasks.workunit.client.0.smithi162.stdout:7/999: write df/d2c/d63/d83/d8b/d90/d127/d142/d82/f91 [12974,85894] 0 2024-04-25T02:10:12.242 INFO:tasks.workunit.client.0.smithi162.stdout:6/918: link d1/d46/d7a/f90 d1/f12c 0 2024-04-25T02:10:12.270 INFO:tasks.workunit.client.0.smithi162.stdout:9/897: dread d4/d9/f47 [0,4194304] 0 2024-04-25T02:10:12.625 INFO:tasks.workunit.client.0.smithi162.stdout:2/911: creat d0/d3/d1b/d1d/d3a/d63/f145 x:0 0 0 2024-04-25T02:10:12.632 INFO:tasks.workunit.client.0.smithi162.stdout:6/919: dread d1/d13/f15 [0,4194304] 0 2024-04-25T02:10:12.853 INFO:tasks.workunit.client.0.smithi162.stdout:4/982: link dd/fa1 dd/d1a/d34/db1/dba/dfd/db8/f13f 0 2024-04-25T02:10:12.885 INFO:tasks.workunit.client.0.smithi162.stdout:4/983: stat dd/df/d7e/de9/fff 0 2024-04-25T02:10:13.372 INFO:tasks.workunit.client.0.smithi162.stdout:4/984: truncate dd/df/d58/f83 4138036 0 2024-04-25T02:10:13.596 INFO:tasks.workunit.client.0.smithi162.stdout:8/937: dwrite d0/d44/d64/d112/fc0 [0,4194304] 0 2024-04-25T02:10:13.969 INFO:tasks.workunit.client.0.smithi162.stdout:3/986: write d2/d9/d10/d2c/da0/d135/f75 [11669085,68344] 0 2024-04-25T02:10:13.977 INFO:tasks.workunit.client.0.smithi162.stdout:5/943: dwrite d15/d19/d24/d4d/d7c/de2/d10a/f74 [0,4194304] 0 2024-04-25T02:10:14.068 INFO:tasks.workunit.client.0.smithi162.stdout:6/920: write d1/d13/f50 [4003081,47753] 0 2024-04-25T02:10:14.244 INFO:tasks.workunit.client.0.smithi162.stdout:4/985: rename dd/d1a/d4e/l9e to dd/df/d7e/de9/l140 0 2024-04-25T02:10:14.270 INFO:tasks.workunit.client.0.smithi162.stdout:5/944: sync 2024-04-25T02:10:14.587 INFO:tasks.workunit.client.0.smithi162.stdout:2/912: dwrite d0/d3/d1b/d142/d36/f65 [4194304,4194304] 0 2024-04-25T02:10:14.750 INFO:tasks.workunit.client.0.smithi162.stdout:9/898: getdents d4/d9/d15/d1b 0 2024-04-25T02:10:14.806 INFO:tasks.workunit.client.0.smithi162.stdout:3/987: rename d2/d9/d10/d4c/d51/d63/d87/d86/fa2 to d2/d9/d10/d4c/d51/ddd/f140 0 2024-04-25T02:10:14.835 INFO:tasks.workunit.client.0.smithi162.stdout:5/945: mkdir d15/d19/d24/d4d/d7c/d85/dde/de5/d139 0 2024-04-25T02:10:15.160 INFO:tasks.workunit.client.0.smithi162.stdout:8/938: dwrite d0/f11 [0,4194304] 0 2024-04-25T02:10:15.450 INFO:tasks.workunit.client.0.smithi162.stdout:6/921: write d1/f3f [232324,106907] 0 2024-04-25T02:10:16.209 INFO:tasks.workunit.client.0.smithi162.stdout:4/986: dwrite dd/df/d7e/f130 [0,4194304] 0 2024-04-25T02:10:16.281 INFO:tasks.workunit.client.0.smithi162.stdout:3/988: truncate d2/d29/d5d/f9a 2599593 0 2024-04-25T02:10:16.324 INFO:tasks.workunit.client.0.smithi162.stdout:9/899: read d4/f21 [408868,67104] 0 2024-04-25T02:10:16.356 INFO:tasks.workunit.client.0.smithi162.stdout:2/913: read d0/d3/d1b/d1d/f38 [962828,28438] 0 2024-04-25T02:10:16.717 INFO:tasks.workunit.client.0.smithi162.stdout:8/939: mkdir d0/d12/d2b/d87/d142 0 2024-04-25T02:10:17.302 INFO:tasks.workunit.client.0.smithi162.stdout:9/900: mknod d4/d9/d15/d71/c13e 0 2024-04-25T02:10:17.545 INFO:tasks.workunit.client.0.smithi162.stdout:3/989: chown d2/d9/d10/d4c/d51/d63/d87/d90/db3/de3/ce5 396 1 2024-04-25T02:10:17.995 INFO:tasks.workunit.client.0.smithi162.stdout:6/922: write d1/f25 [5839176,25284] 0 2024-04-25T02:10:18.042 INFO:tasks.workunit.client.0.smithi162.stdout:5/946: link d15/d19/d24/d2b/d3b/d3c/le0 d15/d19/d24/d4d/d7c/d85/dde/df3/l13a 0 2024-04-25T02:10:18.285 INFO:tasks.workunit.client.0.smithi162.stdout:8/940: dread d0/d12/d1b/d74/d8a/d8f/f11a [0,4194304] 0 2024-04-25T02:10:18.353 INFO:tasks.workunit.client.0.smithi162.stdout:3/990: fsync d2/ddf/d11b/d13c/f13d 0 2024-04-25T02:10:18.849 INFO:tasks.workunit.client.0.smithi162.stdout:5/947: creat d15/d19/d24/d2b/d3b/d3c/d3f/f13b x:0 0 0 2024-04-25T02:10:18.883 INFO:tasks.workunit.client.0.smithi162.stdout:4/987: write dd/df/d2e/d59/f9f [1179807,57645] 0 2024-04-25T02:10:19.386 INFO:tasks.workunit.client.0.smithi162.stdout:6/923: mknod d1/d13/d28/d30/d3a/c12d 0 2024-04-25T02:10:19.426 INFO:tasks.workunit.client.0.smithi162.stdout:6/924: stat d1/d13/d28/d30/d8a/fe5 0 2024-04-25T02:10:19.875 INFO:tasks.workunit.client.0.smithi162.stdout:4/988: symlink dd/d1a/d34/d9d/df8/l141 0 2024-04-25T02:10:20.114 INFO:tasks.workunit.client.0.smithi162.stdout:8/941: getdents d0/d12/d3a/da5/d10e 0 2024-04-25T02:10:20.146 INFO:tasks.workunit.client.0.smithi162.stdout:8/942: chown d0/d86/dd0/l110 0 1 2024-04-25T02:10:20.233 INFO:tasks.workunit.client.0.smithi162.stdout:2/914: write d0/d3/d7a/fc5 [991889,47342] 0 2024-04-25T02:10:21.225 INFO:tasks.workunit.client.0.smithi162.stdout:3/991: write d2/d9/d10/d4c/d51/d63/d87/d90/f10d [952573,55584] 0 2024-04-25T02:10:21.240 INFO:tasks.workunit.client.0.smithi162.stdout:5/948: write d15/d19/d24/d2b/d3b/d80/de1/f12c [509560,43503] 0 2024-04-25T02:10:21.274 INFO:tasks.workunit.client.0.smithi162.stdout:4/989: dread - dd/df/d2e/d4b/d79/f12f zero size 2024-04-25T02:10:21.922 INFO:tasks.workunit.client.0.smithi162.stdout:8/943: symlink d0/d12/d2b/d87/dbe/l143 0 2024-04-25T02:10:21.943 INFO:tasks.workunit.client.0.smithi162.stdout:8/944: chown d0/db1/c121 4075320 1 2024-04-25T02:10:22.076 INFO:tasks.workunit.client.0.smithi162.stdout:6/925: creat d1/d13/d28/d30/d3a/d57/d128/f12e x:0 0 0 2024-04-25T02:10:22.130 INFO:tasks.workunit.client.0.smithi162.stdout:6/926: chown d1/d13/d28/d30/d3a/d57/cd9 3 1 2024-04-25T02:10:22.561 INFO:tasks.workunit.client.0.smithi162.stdout:3/992: truncate d2/d29/f80 2148650 0 2024-04-25T02:10:22.818 INFO:tasks.workunit.client.0.smithi162.stdout:9/901: link d4/d8/d85/dd6/f11f d4/d9/d15/d1b/d2f/d30/dc1/d9f/dd1/ddc/f13f 0 2024-04-25T02:10:22.846 INFO:tasks.workunit.client.0.smithi162.stdout:9/902: chown d4/d7c/c72 2130 1 2024-04-25T02:10:22.866 INFO:tasks.workunit.client.0.smithi162.stdout:9/903: chown d4/f39 3199653 1 2024-04-25T02:10:22.882 INFO:tasks.workunit.client.0.smithi162.stdout:9/904: chown d4/d9/d115 6559009 1 2024-04-25T02:10:22.936 INFO:tasks.workunit.client.0.smithi162.stdout:8/945: mkdir d0/d12/d1b/d8d/d144 0 2024-04-25T02:10:23.457 INFO:tasks.workunit.client.0.smithi162.stdout:3/993: truncate d2/d9/d19/d3f/f79 2343587 0 2024-04-25T02:10:23.971 INFO:tasks.workunit.client.0.smithi162.stdout:2/915: creat d0/f146 x:0 0 0 2024-04-25T02:10:24.533 INFO:tasks.workunit.client.0.smithi162.stdout:8/946: write d0/d12/d1b/d74/d8a/da3/fce [8081123,69633] 0 2024-04-25T02:10:24.690 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:10:24.693 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:10:25.001 INFO:tasks.workunit.client.0.smithi162.stdout:8/947: chown d0/d12/d2b/cd8 0 1 2024-04-25T02:10:25.108 INFO:tasks.workunit.client.0.smithi162.stdout:5/949: dwrite f11 [0,4194304] 0 2024-04-25T02:10:25.185 INFO:tasks.workunit.client.0.smithi162.stdout:4/990: dwrite dd/df/d2e/d4b/d79/fcb [0,4194304] 0 2024-04-25T02:10:25.374 INFO:tasks.workunit.client.0.smithi162.stdout:6/927: link d1/d13/d28/d7b/fb8 d1/d13/d28/d53/d71/dc5/dd6/f12f 0 2024-04-25T02:10:25.557 INFO:tasks.workunit.client.0.smithi162.stdout:3/994: dwrite d2/d9/d19/f36 [0,4194304] 0 2024-04-25T02:10:25.796 INFO:tasks.workunit.client.0.smithi162.stdout:2/916: rename d0/d3/d1b/d142/d36/f65 to d0/d3/d1b/d142/f147 0 2024-04-25T02:10:25.824 INFO:tasks.workunit.client.0.smithi162.stdout:9/905: dwrite d4/d25/de5/d125/fbd [0,4194304] 0 2024-04-25T02:10:25.965 INFO:tasks.workunit.client.0.smithi162.stdout:8/948: rmdir d0/d12/d1b/d74 39 2024-04-25T02:10:26.041 INFO:tasks.workunit.client.0.smithi162.stdout:5/950: symlink d15/d19/d24/d4d/d9d/l13c 0 2024-04-25T02:10:26.066 INFO:tasks.workunit.client.0.smithi162.stdout:8/949: chown d0/d86 112 1 2024-04-25T02:10:26.105 INFO:tasks.workunit.client.0.smithi162.stdout:8/950: stat d0/f13b 0 2024-04-25T02:10:26.329 INFO:tasks.workunit.client.0.smithi162.stdout:3/995: read - d2/d9/d10/d2c/f132 zero size 2024-04-25T02:10:26.482 INFO:tasks.workunit.client.0.smithi162.stdout:6/928: dread d1/d13/d79/fcc [0,4194304] 0 2024-04-25T02:10:26.818 INFO:tasks.workunit.client.0.smithi162.stdout:8/951: dread d0/d44/d64/d112/fc0 [0,4194304] 0 2024-04-25T02:10:26.985 INFO:tasks.workunit.client.0.smithi162.stdout:3/996: fsync d2/d9/d10/d2c/f5c 0 2024-04-25T02:10:27.327 INFO:tasks.workunit.client.0.smithi162.stdout:5/951: symlink d15/d19/d24/d4d/d7c/d12e/l13d 0 2024-04-25T02:10:27.364 INFO:tasks.workunit.client.0.smithi162.stdout:8/952: creat d0/d86/f145 x:0 0 0 2024-04-25T02:10:27.430 INFO:tasks.workunit.client.0.smithi162.stdout:6/929: dread d1/d13/d28/d30/d8a/fe5 [0,4194304] 0 2024-04-25T02:10:27.602 INFO:tasks.workunit.client.0.smithi162.stdout:4/991: rmdir dd/d1a/d34/db1/dba/d115/d13d 0 2024-04-25T02:10:27.644 INFO:tasks.workunit.client.0.smithi162.stdout:5/952: dread d15/d19/d24/d2b/f3d [0,4194304] 0 2024-04-25T02:10:27.955 INFO:tasks.workunit.client.0.smithi162.stdout:2/917: dwrite d0/d3/d1b/d6b/dc0/d67/d9c/fef [0,4194304] 0 2024-04-25T02:10:28.046 INFO:tasks.workunit.client.0.smithi162.stdout:3/997: fdatasync d2/d9/d10/d2c/da3/db5/f139 0 2024-04-25T02:10:28.148 INFO:tasks.workunit.client.0.smithi162.stdout:9/906: rmdir d4/d8/d13/dbf/d134 0 2024-04-25T02:10:28.439 INFO:tasks.workunit.client.0.smithi162.stdout:4/992: mknod dd/d1a/d34/db1/dba/dfd/c142 0 2024-04-25T02:10:28.463 INFO:tasks.workunit.client.0.smithi162.stdout:4/993: readlink dd/d1a/d4e/lb2 0 2024-04-25T02:10:28.813 INFO:tasks.workunit.client.0.smithi162.stdout:5/953: mkdir d15/d19/d24/d4d/d7c/de2/d119/d13e 0 2024-04-25T02:10:28.860 INFO:tasks.workunit.client.0.smithi162.stdout:5/954: chown d15/d19/d24/d2b/d3b/d80/fc9 61491957 1 2024-04-25T02:10:29.039 INFO:tasks.workunit.client.0.smithi162.stdout:2/918: mknod d0/d3/d1b/d142/d36/d93/c148 0 2024-04-25T02:10:29.429 INFO:tasks.workunit.client.0.smithi162.stdout:9/907: dread d4/d8/d13/f2a [0,4194304] 0 2024-04-25T02:10:29.690 INFO:tasks.workunit.client.0.smithi162.stdout:6/930: write d1/d46/d7a/d85/ff0 [919544,39087] 0 2024-04-25T02:10:29.858 INFO:tasks.workunit.client.0.smithi162.stdout:4/994: dread dd/df/d7e/f130 [0,4194304] 0 2024-04-25T02:10:29.905 INFO:tasks.workunit.client.0.smithi162.stdout:4/995: chown dd/c68 2 1 2024-04-25T02:10:29.952 INFO:tasks.workunit.client.0.smithi162.stdout:5/955: symlink d15/d19/l13f 0 2024-04-25T02:10:30.365 INFO:tasks.workunit.client.0.smithi162.stdout:9/908: chown d4/d8/d13/l2c 33621 1 2024-04-25T02:10:30.376 INFO:tasks.workunit.client.0.smithi162.stdout:2/919: dread d0/d3/d1b/d142/d36/d93/de0/f10f [0,4194304] 0 2024-04-25T02:10:30.446 INFO:tasks.workunit.client.0.smithi162.stdout:6/931: truncate d1/d13/d28/d53/d71/dc5/fe9 358377 0 2024-04-25T02:10:30.953 INFO:tasks.workunit.client.0.smithi162.stdout:8/953: dwrite d0/d44/d31/fca [0,4194304] 0 2024-04-25T02:10:31.229 INFO:tasks.workunit.client.0.smithi162.stdout:5/956: truncate d15/d19/d24/d2b/d3b/d3c/d3f/f51 4115977 0 2024-04-25T02:10:31.322 INFO:tasks.workunit.client.0.smithi162.stdout:2/920: dread - d0/d3/d1b/d6b/d92/d9a/f13f zero size 2024-04-25T02:10:31.325 INFO:tasks.workunit.client.0.smithi162.stdout:9/909: read - d4/d8/d13/f98 zero size 2024-04-25T02:10:31.336 INFO:tasks.workunit.client.0.smithi162.stdout:4/996: dread dd/df/d2e/f120 [0,4194304] 0 2024-04-25T02:10:31.608 INFO:tasks.workunit.client.0.smithi162.stdout:5/957: read - d15/d19/d24/d2b/d3b/d80/ddf/ffa zero size 2024-04-25T02:10:31.612 INFO:tasks.workunit.client.0.smithi162.stdout:3/998: dwrite d2/d9/f49 [0,4194304] 0 2024-04-25T02:10:31.724 INFO:tasks.workunit.client.0.smithi162.stdout:2/921: read - d0/d3/d1b/d6b/d92/d9a/f13f zero size 2024-04-25T02:10:31.947 INFO:tasks.workunit.client.0.smithi162.stdout:8/954: creat d0/db1/f146 x:0 0 0 2024-04-25T02:10:32.368 INFO:tasks.workunit.client.0.smithi162.stdout:9/910: creat d4/d8/d85/dd6/f140 x:0 0 0 2024-04-25T02:10:32.548 INFO:tasks.workunit.client.0.smithi162.stdout:3/999: dread d2/d9/fbd [0,4194304] 0 2024-04-25T02:10:32.681 INFO:tasks.workunit.client.0.smithi162.stdout:5/958: creat d15/d19/d24/d4d/d7c/d85/de7/d7a/d7e/d101/f140 x:0 0 0 2024-04-25T02:10:33.524 INFO:tasks.workunit.client.0.smithi162.stdout:6/932: dwrite d1/f3f [4194304,4194304] 0 2024-04-25T02:10:34.148 INFO:tasks.workunit.client.0.smithi162.stdout:8/955: mknod d0/d12/d1b/d74/d8a/d8f/c147 0 2024-04-25T02:10:34.159 INFO:tasks.workunit.client.0.smithi162.stdout:4/997: getdents dd/d1a/d34/d9d 0 2024-04-25T02:10:34.348 INFO:tasks.workunit.client.0.smithi162.stdout:5/959: rmdir d15/d19/d24/d4d/d7c/de2/d119/d13e 0 2024-04-25T02:10:34.480 INFO:tasks.workunit.client.0.smithi162.stdout:2/922: getdents d0/d3/d1b/d6b/dc0/d5e/d61/d62 0 2024-04-25T02:10:34.521 INFO:tasks.workunit.client.0.smithi162.stdout:2/923: chown d0/d3/d1b/d6b/dc0/d5e/cd7 51773 1 2024-04-25T02:10:34.551 INFO:tasks.workunit.client.0.smithi162.stdout:8/956: creat d0/d44/d64/f148 x:0 0 0 2024-04-25T02:10:34.599 INFO:tasks.workunit.client.0.smithi162.stdout:8/957: chown d0/d44/d91/c59 2959 1 2024-04-25T02:10:34.776 INFO:tasks.workunit.client.0.smithi162.stdout:4/998: dread dd/d1a/d4e/f7f [0,4194304] 0 2024-04-25T02:10:35.179 INFO:tasks.workunit.client.0.smithi162.stdout:2/924: truncate d0/d3/d1b/d142/d36/d93/f76 3350480 0 2024-04-25T02:10:35.665 INFO:tasks.workunit.client.0.smithi162.stdout:9/911: dwrite d4/d8/d13/f55 [0,4194304] 0 2024-04-25T02:10:35.791 INFO:tasks.workunit.client.0.smithi162.stdout:9/912: chown d4/d8/f5d 15 1 2024-04-25T02:10:35.900 INFO:tasks.workunit.client.0.smithi162.stdout:4/999: mkdir dd/df/d77/d87/d143 0 2024-04-25T02:10:36.197 INFO:tasks.workunit.client.0.smithi162.stdout:6/933: write d1/d13/fcd [515724,109669] 0 2024-04-25T02:10:36.312 INFO:tasks.workunit.client.0.smithi162.stdout:5/960: write d15/d19/d24/f10b [743196,29837] 0 2024-04-25T02:10:36.404 INFO:tasks.workunit.client.0.smithi162.stdout:9/913: mknod d4/d8/d13/dbf/c141 0 2024-04-25T02:10:36.504 INFO:tasks.workunit.client.0.smithi162.stdout:6/934: sync 2024-04-25T02:10:36.901 INFO:tasks.workunit.client.0.smithi162.stdout:5/961: mkdir d15/d19/d24/d2b/d3b/d80/d141 0 2024-04-25T02:10:37.229 INFO:tasks.workunit.client.0.smithi162.stdout:8/958: write d0/d12/d1b/d8d/fdf [507244,115879] 0 2024-04-25T02:10:37.348 INFO:tasks.workunit.client.0.smithi162.stdout:2/925: write d0/d3/d1b/fd3 [854300,43879] 0 2024-04-25T02:10:37.464 INFO:tasks.workunit.client.0.smithi162.stdout:5/962: creat d15/d19/d24/d2b/d3b/d58/daf/dc8/f142 x:0 0 0 2024-04-25T02:10:38.473 INFO:tasks.workunit.client.0.smithi162.stdout:9/914: getdents d4/d9/d15/d1b/d2f/d30 0 2024-04-25T02:10:38.519 INFO:tasks.workunit.client.0.smithi162.stdout:5/963: read d15/d19/d24/d2b/d3b/fb4 [87732,19894] 0 2024-04-25T02:10:38.538 INFO:tasks.workunit.client.0.smithi162.stdout:2/926: dread d0/d3/d1b/d6b/dc0/d5e/d61/da4/f73 [0,4194304] 0 2024-04-25T02:10:38.544 INFO:tasks.workunit.client.0.smithi162.stdout:8/959: mknod d0/d12/d2b/d87/c149 0 2024-04-25T02:10:38.669 INFO:tasks.workunit.client.0.smithi162.stdout:2/927: stat d0/d3/d7a/d88/lb6 0 2024-04-25T02:10:38.925 INFO:tasks.workunit.client.0.smithi162.stdout:9/915: creat d4/d8/d85/d101/f142 x:0 0 0 2024-04-25T02:10:39.146 INFO:tasks.workunit.client.0.smithi162.stdout:5/964: rmdir d15/d19/d24/d4d/d7c/d85/de7/dd1 39 2024-04-25T02:10:39.259 INFO:tasks.workunit.client.0.smithi162.stdout:2/928: fsync d0/d3/d7a/f98 0 2024-04-25T02:10:39.360 INFO:tasks.workunit.client.0.smithi162.stdout:2/929: readlink d0/l39 0 2024-04-25T02:10:39.481 INFO:tasks.workunit.client.0.smithi162.stdout:6/935: dwrite d1/d13/d28/d45/d59/feb [0,4194304] 0 2024-04-25T02:10:39.686 INFO:tasks.workunit.client.0.smithi162.stdout:8/960: fsync d0/d12/d2b/d87/f109 0 2024-04-25T02:10:39.886 INFO:tasks.workunit.client.0.smithi162.stdout:5/965: mknod d15/d1e/c143 0 2024-04-25T02:10:40.106 INFO:tasks.workunit.client.0.smithi162.stdout:6/936: fsync d1/d46/d7a/d85/ff0 0 2024-04-25T02:10:41.319 INFO:tasks.workunit.client.0.smithi162.stdout:9/916: write d4/d9/d15/d1b/d2f/fce [568041,48605] 0 2024-04-25T02:10:41.413 INFO:tasks.workunit.client.0.smithi162.stdout:6/937: write d1/d13/d28/d30/d3a/dbc/ff8 [17686,118286] 0 2024-04-25T02:10:41.593 INFO:tasks.workunit.client.0.smithi162.stdout:9/917: stat d4/d8/d85/l67 0 2024-04-25T02:10:42.225 INFO:tasks.workunit.client.0.smithi162.stdout:2/930: dwrite d0/d3/d1b/d6b/d92/f10b [0,4194304] 0 2024-04-25T02:10:42.341 INFO:tasks.workunit.client.0.smithi162.stdout:6/938: dread - d1/d13/d28/d45/d59/ff2 zero size 2024-04-25T02:10:42.341 INFO:tasks.workunit.client.0.smithi162.stdout:8/961: dwrite d0/d12/d1b/d74/d8a/fa7 [0,4194304] 0 2024-04-25T02:10:42.387 INFO:tasks.workunit.client.0.smithi162.stdout:5/966: dwrite d15/d19/d24/d4d/d9d/f104 [0,4194304] 0 2024-04-25T02:10:42.555 INFO:tasks.workunit.client.0.smithi162.stdout:5/967: stat d15/d19/d24/f64 0 2024-04-25T02:10:42.625 INFO:tasks.workunit.client.0.smithi162.stdout:6/939: read d1/d13/d28/d45/d59/feb [1401390,51651] 0 2024-04-25T02:10:42.898 INFO:tasks.workunit.client.0.smithi162.stdout:2/931: creat d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/da2/de2/f149 x:0 0 0 2024-04-25T02:10:43.114 INFO:tasks.workunit.client.0.smithi162.stdout:6/940: creat d1/d13/d28/d45/d59/f130 x:0 0 0 2024-04-25T02:10:43.267 INFO:tasks.workunit.client.0.smithi162.stdout:5/968: symlink d15/d19/d24/d4d/d7c/d85/de7/ddd/l144 0 2024-04-25T02:10:43.335 INFO:tasks.workunit.client.0.smithi162.stdout:9/918: link d4/d9/d15/d1b/d2f/c8d d4/d9/d15/d1b/d2f/d30/c143 0 2024-04-25T02:10:43.381 INFO:tasks.workunit.client.0.smithi162.stdout:8/962: dwrite d0/fef [0,4194304] 0 2024-04-25T02:10:43.497 INFO:tasks.workunit.client.0.smithi162.stdout:5/969: chown d15/d19/d24/d4d/d7c/d85/dde 13592 1 2024-04-25T02:10:43.693 INFO:tasks.workunit.client.0.smithi162.stdout:8/963: write d0/d12/d1b/d74/d8a/fa7 [4317306,48441] 0 2024-04-25T02:10:43.801 INFO:tasks.workunit.client.0.smithi162.stdout:9/919: creat d4/d131/f144 x:0 0 0 2024-04-25T02:10:43.863 INFO:tasks.workunit.client.0.smithi162.stdout:8/964: dread - d0/d86/f11c zero size 2024-04-25T02:10:43.912 INFO:tasks.workunit.client.0.smithi162.stdout:5/970: mkdir d15/d19/d24/d4d/d7c/d12e/d145 0 2024-04-25T02:10:43.992 INFO:tasks.workunit.client.0.smithi162.stdout:2/932: dwrite d0/d3/f35 [0,4194304] 0 2024-04-25T02:10:44.082 INFO:tasks.workunit.client.0.smithi162.stdout:6/941: creat d1/d13/d28/d30/f131 x:0 0 0 2024-04-25T02:10:44.135 INFO:tasks.workunit.client.0.smithi162.stdout:9/920: mkdir d4/d9/d15/d1b/d69/d145 0 2024-04-25T02:10:44.175 INFO:tasks.workunit.client.0.smithi162.stdout:5/971: fdatasync d15/d19/d24/d4d/d9d/fbe 0 2024-04-25T02:10:44.477 INFO:tasks.workunit.client.0.smithi162.stdout:6/942: readlink d1/d13/d28/l54 0 2024-04-25T02:10:44.484 INFO:tasks.workunit.client.0.smithi162.stdout:2/933: symlink d0/d3/d1b/d1d/d3a/l14a 0 2024-04-25T02:10:44.600 INFO:tasks.workunit.client.0.smithi162.stdout:5/972: write d15/d19/d24/d2b/d3b/f107 [370793,92050] 0 2024-04-25T02:10:44.666 INFO:tasks.workunit.client.0.smithi162.stdout:9/921: symlink d4/d25/l146 0 2024-04-25T02:10:44.724 INFO:tasks.workunit.client.0.smithi162.stdout:9/922: chown d4/ca4 1747261 1 2024-04-25T02:10:44.934 INFO:tasks.workunit.client.0.smithi162.stdout:8/965: link d0/d12/d1b/d74/ca4 d0/d12/d1b/d74/d8a/da3/c14a 0 2024-04-25T02:10:44.935 INFO:tasks.workunit.client.0.smithi162.stdout:9/923: sync 2024-04-25T02:10:44.936 INFO:tasks.workunit.client.0.smithi162.stdout:6/943: unlink d1/d46/d7a/f90 0 2024-04-25T02:10:45.008 INFO:tasks.workunit.client.0.smithi162.stdout:2/934: getdents d0/d3/d1b/d142/d36/df5 0 2024-04-25T02:10:45.037 INFO:tasks.workunit.client.0.smithi162.stdout:5/973: link l5 d15/d19/d24/d2b/l146 0 2024-04-25T02:10:45.060 INFO:tasks.workunit.client.0.smithi162.stdout:2/935: chown d0/d3/d1b/d6b/dc0/d5e/d108 405776727 1 2024-04-25T02:10:45.135 INFO:tasks.workunit.client.0.smithi162.stdout:8/966: chown d0/d12/d1b/d74/f77 152 1 2024-04-25T02:10:45.326 INFO:tasks.workunit.client.0.smithi162.stdout:5/974: write d15/d19/d24/dca/f122 [22186,70629] 0 2024-04-25T02:10:45.422 INFO:tasks.workunit.client.0.smithi162.stdout:2/936: dread d0/d3/d1b/d6b/dc0/d5e/d61/f10c [0,4194304] 0 2024-04-25T02:10:45.618 INFO:tasks.workunit.client.0.smithi162.stdout:9/924: truncate d4/d9/d15/d1b/d2f/d30/dc1/fff 918893 0 2024-04-25T02:10:46.224 INFO:tasks.workunit.client.0.smithi162.stdout:8/967: write d0/d44/d64/d112/f9a [4182540,86898] 0 2024-04-25T02:10:46.503 INFO:tasks.workunit.client.0.smithi162.stdout:2/937: creat d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/d11a/f14b x:0 0 0 2024-04-25T02:10:46.676 INFO:tasks.workunit.client.0.smithi162.stdout:6/944: getdents d1/d13/d28/d30/d3a 0 2024-04-25T02:10:46.962 INFO:tasks.workunit.client.0.smithi162.stdout:9/925: fdatasync d4/d9/d15/d1b/d69/ff0 0 2024-04-25T02:10:47.251 INFO:tasks.workunit.client.0.smithi162.stdout:8/968: creat d0/db1/f14b x:0 0 0 2024-04-25T02:10:47.440 INFO:tasks.workunit.client.0.smithi162.stdout:2/938: mknod d0/d3/d1b/d142/d36/d93/de0/c14c 0 2024-04-25T02:10:47.476 INFO:tasks.workunit.client.0.smithi162.stdout:2/939: chown d0/d3/d7a/d88/f12b 49500 1 2024-04-25T02:10:48.118 INFO:tasks.workunit.client.0.smithi162.stdout:5/975: rmdir d15/d19/d24/d2b/d3b/de4/d12d 0 2024-04-25T02:10:49.114 INFO:tasks.workunit.client.0.smithi162.stdout:9/926: creat d4/d9/d15/d1b/d2f/d30/dc1/d9f/dd1/dee/f147 x:0 0 0 2024-04-25T02:10:49.620 INFO:tasks.workunit.client.0.smithi162.stdout:6/945: symlink d1/d13/d79/l132 0 2024-04-25T02:10:49.783 INFO:tasks.workunit.client.0.smithi162.stdout:9/927: mkdir d4/d131/d148 0 2024-04-25T02:10:50.224 INFO:tasks.workunit.client.0.smithi162.stdout:8/969: dwrite d0/d44/fa9 [0,4194304] 0 2024-04-25T02:10:50.605 INFO:tasks.workunit.client.0.smithi162.stdout:2/940: dwrite d0/d3/d1b/d1d/d3a/d63/ff7 [0,4194304] 0 2024-04-25T02:10:50.948 INFO:tasks.workunit.client.0.smithi162.stdout:5/976: dwrite d15/d19/d24/d4d/d7c/de2/d10a/fc5 [0,4194304] 0 2024-04-25T02:10:51.249 INFO:tasks.workunit.client.0.smithi162.stdout:9/928: write d4/dc0/fb3 [953412,77128] 0 2024-04-25T02:10:51.681 INFO:tasks.workunit.client.0.smithi162.stdout:5/977: mknod d15/d19/d24/d2b/c147 0 2024-04-25T02:10:51.918 INFO:tasks.workunit.client.0.smithi162.stdout:6/946: link d1/d13/d28/d7b/dbb/fe6 d1/f133 0 2024-04-25T02:10:53.108 INFO:tasks.workunit.client.0.smithi162.stdout:9/929: rename d4/d8/d13/c10e to d4/d9/d15/d1b/d2f/d30/d112/d12f/c149 0 2024-04-25T02:10:53.130 INFO:tasks.workunit.client.0.smithi162.stdout:9/930: stat d4/d9/fc9 0 2024-04-25T02:10:53.156 INFO:tasks.workunit.client.0.smithi162.stdout:8/970: link d0/d44/d91/c5f d0/d44/c14c 0 2024-04-25T02:10:53.222 INFO:tasks.workunit.client.0.smithi162.stdout:8/971: readlink d0/d12/d1b/d74/lde 0 2024-04-25T02:10:53.370 INFO:tasks.workunit.client.0.smithi162.stdout:6/947: creat d1/d13/d79/f134 x:0 0 0 2024-04-25T02:10:53.618 INFO:tasks.workunit.client.0.smithi162.stdout:2/941: dwrite d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/f91 [0,4194304] 0 2024-04-25T02:10:54.092 INFO:tasks.workunit.client.0.smithi162.stdout:5/978: dwrite d15/d19/d24/d2b/d3b/d58/fc6 [0,4194304] 0 2024-04-25T02:10:54.532 INFO:tasks.workunit.client.0.smithi162.stdout:6/948: mknod d1/c135 0 2024-04-25T02:10:54.596 INFO:tasks.workunit.client.0.smithi162.stdout:8/972: write d0/d12/d1b/d8d/fb6 [1348651,6049] 0 2024-04-25T02:10:54.779 INFO:tasks.workunit.client.0.smithi162.stdout:9/931: rename d4/d9/d15/d1b/d2f/d30/dc1 to d4/d9/d15/d1b/d2f/d14a 0 2024-04-25T02:10:55.047 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:10:55.050 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:10:55.118 INFO:tasks.workunit.client.0.smithi162.stdout:2/942: creat d0/d3/d1b/d142/d36/d93/dbd/d11c/f14d x:0 0 0 2024-04-25T02:10:55.176 INFO:tasks.workunit.client.0.smithi162.stdout:9/932: dread d4/d9/d15/d1b/d2f/d30/f9d [0,4194304] 0 2024-04-25T02:10:55.319 INFO:tasks.workunit.client.0.smithi162.stdout:8/973: symlink d0/d12/d3a/da5/d10e/l14d 0 2024-04-25T02:10:55.537 INFO:tasks.workunit.client.0.smithi162.stdout:2/943: creat d0/d3/d1b/d6b/d9e/f14e x:0 0 0 2024-04-25T02:10:55.711 INFO:tasks.workunit.client.0.smithi162.stdout:2/944: dread d0/d3/d1b/d142/d36/d93/de0/f10f [0,4194304] 0 2024-04-25T02:10:56.034 INFO:tasks.workunit.client.0.smithi162.stdout:6/949: dwrite d1/d13/d28/d30/d63/fc0 [0,4194304] 0 2024-04-25T02:10:56.278 INFO:tasks.workunit.client.0.smithi162.stdout:5/979: rename d15/d1e/l75 to d15/d19/d24/d4d/d7c/d85/de7/l148 0 2024-04-25T02:10:57.297 INFO:tasks.workunit.client.0.smithi162.stdout:6/950: rmdir d1/d13/d28/d53/d71/dc5 39 2024-04-25T02:10:57.658 INFO:tasks.workunit.client.0.smithi162.stdout:5/980: creat d15/d19/d24/d2b/d3b/d80/de1/d11b/f149 x:0 0 0 2024-04-25T02:10:57.876 INFO:tasks.workunit.client.0.smithi162.stdout:2/945: symlink d0/d3/d1b/d6b/dc0/d5e/d61/d66/l14f 0 2024-04-25T02:10:58.043 INFO:tasks.workunit.client.0.smithi162.stdout:6/951: mkdir d1/d13/d28/d7b/dbb/d136 0 2024-04-25T02:10:58.487 INFO:tasks.workunit.client.0.smithi162.stdout:9/933: dwrite d4/d9/d15/d1b/d2f/d14a/d59/f9c [0,4194304] 0 2024-04-25T02:10:58.491 INFO:tasks.workunit.client.0.smithi162.stdout:2/946: creat d0/d3/d1b/d6b/dc0/d5e/f150 x:0 0 0 2024-04-25T02:10:58.703 INFO:tasks.workunit.client.0.smithi162.stdout:8/974: link d0/d44/d64/f106 d0/d12/d1b/d8d/d134/f14e 0 2024-04-25T02:10:58.765 INFO:tasks.workunit.client.0.smithi162.stdout:9/934: chown d4/d9/d15/d1b/d2f/d30/fd7 24056157 1 2024-04-25T02:10:59.087 INFO:tasks.workunit.client.0.smithi162.stdout:5/981: truncate d15/d19/d24/d4d/d7c/d85/de7/dd1/ff1 390832 0 2024-04-25T02:10:59.342 INFO:tasks.workunit.client.0.smithi162.stdout:9/935: creat d4/d9/d15/d1b/d2f/d14a/f14b x:0 0 0 2024-04-25T02:10:59.864 INFO:tasks.workunit.client.0.smithi162.stdout:6/952: dwrite d1/d13/d28/d45/f61 [0,4194304] 0 2024-04-25T02:11:00.031 INFO:tasks.workunit.client.0.smithi162.stdout:5/982: truncate d15/d19/d24/f10b 799163 0 2024-04-25T02:11:00.169 INFO:tasks.workunit.client.0.smithi162.stdout:8/975: write d0/d1a/fff [70916,93428] 0 2024-04-25T02:11:00.329 INFO:tasks.workunit.client.0.smithi162.stdout:2/947: rename d0/d3/d1b/f5f to d0/d3/d1b/d6b/d92/f151 0 2024-04-25T02:11:00.552 INFO:tasks.workunit.client.0.smithi162.stdout:9/936: truncate d4/d8/d13/f27 589475 0 2024-04-25T02:11:00.567 INFO:tasks.workunit.client.0.smithi162.stdout:5/983: symlink d15/d19/d24/d4d/d7c/d85/de7/d7a/d7e/l14a 0 2024-04-25T02:11:00.572 INFO:tasks.workunit.client.0.smithi162.stdout:8/976: rmdir d0 39 2024-04-25T02:11:00.649 INFO:tasks.workunit.client.0.smithi162.stdout:9/937: readlink d4/d25/de5/d108/lcd 0 2024-04-25T02:11:00.674 INFO:tasks.workunit.client.0.smithi162.stdout:6/953: creat d1/d13/d28/f137 x:0 0 0 2024-04-25T02:11:00.895 INFO:tasks.workunit.client.0.smithi162.stdout:5/984: mknod d15/d19/d24/d2b/d3b/d58/daf/dc8/c14b 0 2024-04-25T02:11:01.108 INFO:tasks.workunit.client.0.smithi162.stdout:9/938: dread d4/d25/de5/d125/f5e [0,4194304] 0 2024-04-25T02:11:01.159 INFO:tasks.workunit.client.0.smithi162.stdout:2/948: rmdir d0/d3/d1b/d11d 0 2024-04-25T02:11:01.898 INFO:tasks.workunit.client.0.smithi162.stdout:6/954: creat d1/d13/d28/d53/d71/dc5/de1/f138 x:0 0 0 2024-04-25T02:11:02.108 INFO:tasks.workunit.client.0.smithi162.stdout:2/949: rename d0/d3/d1b/d142/d69/f7e to d0/d3/d1b/d6b/dc0/d5e/d108/f152 0 2024-04-25T02:11:02.267 INFO:tasks.workunit.client.0.smithi162.stdout:8/977: dread d0/d12/f23 [0,4194304] 0 2024-04-25T02:11:02.357 INFO:tasks.workunit.client.0.smithi162.stdout:5/985: getdents d15/d19/d24/d4d/d7c/d12e/d145 0 2024-04-25T02:11:02.359 INFO:tasks.workunit.client.0.smithi162.stdout:6/955: read - d1/d13/d28/d30/f11e zero size 2024-04-25T02:11:02.396 INFO:tasks.workunit.client.0.smithi162.stdout:5/986: stat d15/d19/c1f 0 2024-04-25T02:11:02.461 INFO:tasks.workunit.client.0.smithi162.stdout:5/987: chown d15/d19/d24/d4d/d7c/de2/d10a/f74 0 1 2024-04-25T02:11:03.207 INFO:tasks.workunit.client.0.smithi162.stdout:5/988: write d15/d19/d24/d4d/d9d/fbe [8541712,77698] 0 2024-04-25T02:11:03.269 INFO:tasks.workunit.client.0.smithi162.stdout:2/950: write d0/d3/d1b/d6b/dc0/d5e/d61/da4/f73 [1910799,80279] 0 2024-04-25T02:11:03.595 INFO:tasks.workunit.client.0.smithi162.stdout:9/939: dwrite d4/d9/d15/d1b/d2f/d30/f12b [0,4194304] 0 2024-04-25T02:11:03.957 INFO:tasks.workunit.client.0.smithi162.stdout:8/978: dwrite d0/d44/d31/f6c [0,4194304] 0 2024-04-25T02:11:04.003 INFO:tasks.workunit.client.0.smithi162.stdout:5/989: rmdir d15/d19/d24/d2b/d3b/d3c/d3f 39 2024-04-25T02:11:04.149 INFO:tasks.workunit.client.0.smithi162.stdout:6/956: dwrite d1/d13/d28/d30/d3a/f3d [0,4194304] 0 2024-04-25T02:11:04.278 INFO:tasks.workunit.client.0.smithi162.stdout:9/940: fdatasync d4/d9/d15/d1b/f2e 0 2024-04-25T02:11:04.518 INFO:tasks.workunit.client.0.smithi162.stdout:8/979: truncate d0/d44/d31/d65/f88 1388587 0 2024-04-25T02:11:04.523 INFO:tasks.workunit.client.0.smithi162.stdout:5/990: fsync d15/d19/d24/d4d/d7c/de2/f10d 0 2024-04-25T02:11:04.701 INFO:tasks.workunit.client.0.smithi162.stdout:9/941: symlink d4/d9/d15/d1b/d69/d145/l14c 0 2024-04-25T02:11:04.728 INFO:tasks.workunit.client.0.smithi162.stdout:9/942: chown d4/d9/d15/f23 0 1 2024-04-25T02:11:04.849 INFO:tasks.workunit.client.0.smithi162.stdout:6/957: rename d1/d73/da1 to d1/d13/d28/d7b/dbb/d139 0 2024-04-25T02:11:04.958 INFO:tasks.workunit.client.0.smithi162.stdout:2/951: link d0/d3/d7a/f138 d0/d3/d1b/d1d/d3a/d10d/f153 0 2024-04-25T02:11:04.973 INFO:tasks.workunit.client.0.smithi162.stdout:9/943: mknod d4/d9/d15/d1b/d2f/d30/c14d 0 2024-04-25T02:11:05.478 INFO:tasks.workunit.client.0.smithi162.stdout:8/980: dwrite d0/d44/d64/d112/f47 [8388608,4194304] 0 2024-04-25T02:11:05.616 INFO:tasks.workunit.client.0.smithi162.stdout:6/958: symlink d1/d13/d28/d53/d71/dc5/dd6/l13a 0 2024-04-25T02:11:05.711 INFO:tasks.workunit.client.0.smithi162.stdout:9/944: unlink d4/d9/d15/d8a/lfe 0 2024-04-25T02:11:06.046 INFO:tasks.workunit.client.0.smithi162.stdout:5/991: link d15/d19/d24/d4d/d7c/d85/dde/de5/ff7 d15/d19/d24/d4d/d7c/d85/de7/f14c 0 2024-04-25T02:11:06.076 INFO:tasks.workunit.client.0.smithi162.stdout:9/945: rename d4/d9/la8 to d4/d9/l14e 0 2024-04-25T02:11:06.077 INFO:tasks.workunit.client.0.smithi162.stdout:2/952: creat d0/d3/d1b/d6b/d92/f154 x:0 0 0 2024-04-25T02:11:06.912 INFO:tasks.workunit.client.0.smithi162.stdout:6/959: symlink d1/l13b 0 2024-04-25T02:11:07.072 INFO:tasks.workunit.client.0.smithi162.stdout:2/953: stat d0/d3/d1b/d142/d36/c83 0 2024-04-25T02:11:07.358 INFO:tasks.workunit.client.0.smithi162.stdout:9/946: truncate d4/d8/d85/fed 5029705 0 2024-04-25T02:11:07.524 INFO:tasks.workunit.client.0.smithi162.stdout:8/981: link d0/d12/c113 d0/d12/d3a/da5/d10f/c14f 0 2024-04-25T02:11:07.659 INFO:tasks.workunit.client.0.smithi162.stdout:6/960: symlink d1/d13/d28/d30/d63/l13c 0 2024-04-25T02:11:08.093 INFO:tasks.workunit.client.0.smithi162.stdout:9/947: creat d4/d8/d85/d101/f14f x:0 0 0 2024-04-25T02:11:08.318 INFO:tasks.workunit.client.0.smithi162.stdout:8/982: truncate d0/d86/fc2 960035 0 2024-04-25T02:11:08.350 INFO:tasks.workunit.client.0.smithi162.stdout:6/961: chown d1/cb3 0 1 2024-04-25T02:11:08.701 INFO:tasks.workunit.client.0.smithi162.stdout:2/954: dread d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/d128/f13e [0,4194304] 0 2024-04-25T02:11:08.738 INFO:tasks.workunit.client.0.smithi162.stdout:5/992: write d15/d19/d24/d2b/d3b/d58/f9a [901546,51354] 0 2024-04-25T02:11:08.956 INFO:tasks.workunit.client.0.smithi162.stdout:8/983: mknod d0/d12/d1b/d74/d8a/d8f/d12f/c150 0 2024-04-25T02:11:08.982 INFO:tasks.workunit.client.0.smithi162.stdout:8/984: chown d0/fa2 567670 1 2024-04-25T02:11:09.107 INFO:tasks.workunit.client.0.smithi162.stdout:6/962: mkdir d1/d5c/d13d 0 2024-04-25T02:11:09.156 INFO:tasks.workunit.client.0.smithi162.stdout:9/948: getdents d4/d8/d85/dd6 0 2024-04-25T02:11:09.263 INFO:tasks.workunit.client.0.smithi162.stdout:8/985: truncate d0/d12/d2b/d87/fa0 1502243 0 2024-04-25T02:11:09.294 INFO:tasks.workunit.client.0.smithi162.stdout:8/986: readlink d0/l9e 0 2024-04-25T02:11:09.694 INFO:tasks.workunit.client.0.smithi162.stdout:9/949: chown d4/d9/d15/d1b/d2f/d14a/d9f/dd1/l139 267102 1 2024-04-25T02:11:09.739 INFO:tasks.workunit.client.0.smithi162.stdout:6/963: fsync d1/f21 0 2024-04-25T02:11:09.739 INFO:tasks.workunit.client.0.smithi162.stdout:2/955: truncate d0/d3/d1b/d6b/dc0/d5e/d61/d66/f9b 541913 0 2024-04-25T02:11:09.986 INFO:tasks.workunit.client.0.smithi162.stdout:5/993: write d15/d19/d24/d2b/d3b/d3c/d3f/f13b [670769,77781] 0 2024-04-25T02:11:10.282 INFO:tasks.workunit.client.0.smithi162.stdout:6/964: mknod d1/d13/d28/d53/c13e 0 2024-04-25T02:11:10.407 INFO:tasks.workunit.client.0.smithi162.stdout:5/994: dread - d15/d19/d24/d4d/d7c/d85/de7/d7a/d7e/d101/f140 zero size 2024-04-25T02:11:10.651 INFO:tasks.workunit.client.0.smithi162.stdout:8/987: dwrite d0/d12/d1b/d74/d8a/da3/fb3 [0,4194304] 0 2024-04-25T02:11:10.891 INFO:tasks.workunit.client.0.smithi162.stdout:6/965: mknod d1/d13/d28/d53/d71/dc5/d108/c13f 0 2024-04-25T02:11:11.179 INFO:tasks.workunit.client.0.smithi162.stdout:9/950: dwrite d4/d9/d15/f5c [4194304,4194304] 0 2024-04-25T02:11:11.489 INFO:tasks.workunit.client.0.smithi162.stdout:2/956: dwrite d0/d3/f47 [0,4194304] 0 2024-04-25T02:11:11.628 INFO:tasks.workunit.client.0.smithi162.stdout:8/988: unlink d0/d12/d1b/d74/d8a/f117 0 2024-04-25T02:11:13.743 INFO:tasks.workunit.client.0.smithi162.stdout:2/957: write d0/d3/d1b/d6b/dc0/d5e/d61/d66/f9b [362380,95760] 0 2024-04-25T02:11:14.010 INFO:tasks.workunit.client.0.smithi162.stdout:5/995: link d15/d19/d24/f10b d15/f14d 0 2024-04-25T02:11:14.608 INFO:tasks.workunit.client.0.smithi162.stdout:9/951: dwrite d4/d9/d15/fd8 [0,4194304] 0 2024-04-25T02:11:14.758 INFO:tasks.workunit.client.0.smithi162.stdout:8/989: dwrite d0/d12/f2e [0,4194304] 0 2024-04-25T02:11:14.941 INFO:tasks.workunit.client.0.smithi162.stdout:6/966: dwrite d1/d13/d28/d53/d71/dc5/fe9 [0,4194304] 0 2024-04-25T02:11:15.375 INFO:tasks.workunit.client.0.smithi162.stdout:2/958: dwrite d0/f8d [4194304,4194304] 0 2024-04-25T02:11:15.500 INFO:tasks.workunit.client.0.smithi162.stdout:5/996: dread d15/d19/d24/d4d/d7c/de2/d10a/fe6 [0,4194304] 0 2024-04-25T02:11:15.527 INFO:tasks.workunit.client.0.smithi162.stdout:6/967: rmdir d1/d13/d28/d7b/dc4 39 2024-04-25T02:11:15.531 INFO:tasks.workunit.client.0.smithi162.stdout:8/990: write d0/d12/d3a/fab [2354098,49462] 0 2024-04-25T02:11:15.555 INFO:tasks.workunit.client.0.smithi162.stdout:9/952: rename d4/d9/c114 to d4/d25/de5/c150 0 2024-04-25T02:11:15.912 INFO:tasks.workunit.client.0.smithi162.stdout:6/968: rmdir d1/d13/d28/d30/d8a/dab 39 2024-04-25T02:11:16.653 INFO:tasks.workunit.client.0.smithi162.stdout:8/991: getdents d0 0 2024-04-25T02:11:16.678 INFO:tasks.workunit.client.0.smithi162.stdout:9/953: write d4/d9/d15/d1b/d2f/d14a/d59/dec/fef [1101048,96505] 0 2024-04-25T02:11:17.143 INFO:tasks.workunit.client.0.smithi162.stdout:2/959: write d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/da2/de2/f149 [423211,76282] 0 2024-04-25T02:11:17.450 INFO:tasks.workunit.client.0.smithi162.stdout:5/997: dwrite d15/d19/d24/d4d/d7c/de2/d10a/dbf/d120/f130 [0,4194304] 0 2024-04-25T02:11:17.625 INFO:tasks.workunit.client.0.smithi162.stdout:8/992: unlink d0/d44/c21 0 2024-04-25T02:11:17.634 INFO:tasks.workunit.client.0.smithi162.stdout:9/954: fsync d4/d8/d85/f7a 0 2024-04-25T02:11:17.690 INFO:tasks.workunit.client.0.smithi162.stdout:5/998: chown d15/d19/d24/d2b/d3b/d58/daf/dc8/fce 10 1 2024-04-25T02:11:17.896 INFO:tasks.workunit.client.0.smithi162.stdout:2/960: creat d0/d3/d1b/d6b/dc0/d67/f155 x:0 0 0 2024-04-25T02:11:17.932 INFO:tasks.workunit.client.0.smithi162.stdout:2/961: chown d0/d3/d1b/d6b/fa5 0 1 2024-04-25T02:11:18.249 INFO:tasks.workunit.client.0.smithi162.stdout:6/969: write d1/d13/d28/d30/d3a/f3d [1361417,97476] 0 2024-04-25T02:11:18.390 INFO:tasks.workunit.client.0.smithi162.stdout:2/962: symlink d0/d3/d1b/d6b/d92/d9a/de4/l156 0 2024-04-25T02:11:18.437 INFO:tasks.workunit.client.0.smithi162.stdout:2/963: read - d0/d3/d1b/d142/d69/feb zero size 2024-04-25T02:11:18.774 INFO:tasks.workunit.client.0.smithi162.stdout:9/955: write d4/d9/d15/d1b/d2f/d14a/d9f/fd4 [5080202,52347] 0 2024-04-25T02:11:18.959 INFO:tasks.workunit.client.0.smithi162.stdout:5/999: creat d15/d19/d24/d2b/d3b/f14e x:0 0 0 2024-04-25T02:11:19.005 INFO:tasks.workunit.client.0.smithi162.stdout:8/993: dwrite d0/d12/fa8 [0,4194304] 0 2024-04-25T02:11:19.119 INFO:tasks.workunit.client.0.smithi162.stdout:2/964: mknod d0/d3/d1b/d1d/d3a/d63/c157 0 2024-04-25T02:11:19.486 INFO:tasks.workunit.client.0.smithi162.stdout:9/956: chown d4/d9/d15/d1b/d2f/d14a/d59/l106 399726812 1 2024-04-25T02:11:19.602 INFO:tasks.workunit.client.0.smithi162.stdout:2/965: creat d0/d3/d1b/d6b/dc0/f158 x:0 0 0 2024-04-25T02:11:19.718 INFO:tasks.workunit.client.0.smithi162.stdout:8/994: creat d0/d12/d1b/d74/f151 x:0 0 0 2024-04-25T02:11:19.825 INFO:tasks.workunit.client.0.smithi162.stdout:6/970: dwrite d1/d13/d28/d45/d59/ff2 [0,4194304] 0 2024-04-25T02:11:20.442 INFO:tasks.workunit.client.0.smithi162.stdout:8/995: creat d0/d12/d1b/d74/d8a/d8f/f152 x:0 0 0 2024-04-25T02:11:20.637 INFO:tasks.workunit.client.0.smithi162.stdout:6/971: creat d1/d13/d28/d30/f140 x:0 0 0 2024-04-25T02:11:20.735 INFO:tasks.workunit.client.0.smithi162.stdout:9/957: dwrite d4/d8/f2d [0,4194304] 0 2024-04-25T02:11:21.014 INFO:tasks.workunit.client.0.smithi162.stdout:2/966: truncate d0/d3/d1b/d142/d36/d93/dbd/d11c/f13b 3865517 0 2024-04-25T02:11:21.163 INFO:tasks.workunit.client.0.smithi162.stdout:6/972: creat d1/d13/d28/d30/d3a/dbc/def/f141 x:0 0 0 2024-04-25T02:11:22.041 INFO:tasks.workunit.client.0.smithi162.stdout:8/996: rename d0/d12/d1b/d8d to d0/d12/d1b/d74/d8a/d8f/d153 0 2024-04-25T02:11:22.196 INFO:tasks.workunit.client.0.smithi162.stdout:6/973: dread d1/f68 [0,4194304] 0 2024-04-25T02:11:22.786 INFO:tasks.workunit.client.0.smithi162.stdout:6/974: creat d1/d13/d28/d53/d71/dc5/d108/f142 x:0 0 0 2024-04-25T02:11:22.844 INFO:tasks.workunit.client.0.smithi162.stdout:9/958: link d4/d8/d13/c80 d4/d9/d115/c151 0 2024-04-25T02:11:22.868 INFO:tasks.workunit.client.0.smithi162.stdout:9/959: chown d4/d8/d85/l96 11207303 1 2024-04-25T02:11:23.159 INFO:tasks.workunit.client.0.smithi162.stdout:8/997: symlink d0/d12/l154 0 2024-04-25T02:11:23.180 INFO:tasks.workunit.client.0.smithi162.stdout:2/967: write d0/d3/f1a [9056110,40821] 0 2024-04-25T02:11:24.027 INFO:tasks.workunit.client.0.smithi162.stdout:6/975: truncate d1/d13/d28/d53/d71/dc5/dd6/f12f 797257 0 2024-04-25T02:11:24.115 INFO:tasks.workunit.client.0.smithi162.stdout:9/960: creat d4/d9/da9/d133/f152 x:0 0 0 2024-04-25T02:11:24.148 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:22:13.577 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:11:24.154 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:22:13.582 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:11:24.159 INFO:tasks.workunit.client.0.smithi162.stdout:2/968: truncate d0/d3/d1b/d1d/d3a/d10d/f153 154924 0 2024-04-25T02:11:24.182 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:22:13.527 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:11:24.185 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:22:13.531 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:11:24.192 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:22:13.538 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:11:24.201 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:22:13.547 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:11:24.331 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:22:13.760 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:11:24.368 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:22:13.714 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:11:24.371 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:22:13.717 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:11:24.538 INFO:tasks.workunit.client.0.smithi162.stdout:8/998: rename d0/d12/c113 to d0/d12/d1b/d74/d105/d125/c155 0 2024-04-25T02:11:24.662 INFO:tasks.workunit.client.0.smithi162.stdout:2/969: sync 2024-04-25T02:11:24.798 INFO:tasks.workunit.client.0.smithi162.stdout:9/961: mkdir d4/d25/de5/d125/d153 0 2024-04-25T02:11:24.996 INFO:tasks.workunit.client.0.smithi162.stdout:9/962: dread d4/d9/d15/d1b/d2f/d30/f3d [0,4194304] 0 2024-04-25T02:11:25.094 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:11:25.096 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:11:25.106 INFO:tasks.workunit.client.0.smithi162.stdout:8/999: mkdir d0/d12/d1b/d74/d8a/d8f/d153/d134/d156 0 2024-04-25T02:11:25.922 INFO:tasks.workunit.client.0.smithi162.stdout:2/970: mknod d0/d3/d1b/d6b/dc0/d5e/d13d/c159 0 2024-04-25T02:11:27.485 INFO:tasks.workunit.client.0.smithi162.stdout:9/963: link d4/l6f d4/d8/d13/l154 0 2024-04-25T02:11:27.505 INFO:tasks.workunit.client.0.smithi162.stdout:6/976: write d1/d46/f97 [599284,66667] 0 2024-04-25T02:11:27.688 INFO:tasks.workunit.client.0.smithi162.stdout:9/964: sync 2024-04-25T02:11:27.737 INFO:tasks.workunit.client.0.smithi162.stdout:9/965: chown d4/d9/d15/f35 424 1 2024-04-25T02:11:28.071 INFO:tasks.workunit.client.0.smithi162.stdout:6/977: rename d1/d46/c11c to d1/d13/d28/d30/d8a/dab/c143 0 2024-04-25T02:11:28.080 INFO:tasks.workunit.client.0.smithi162.stdout:2/971: write d0/d3/d1b/d6b/fa5 [2532067,122628] 0 2024-04-25T02:11:28.188 INFO:tasks.workunit.client.0.smithi162.stdout:6/978: dread - d1/d13/d28/d30/d8a/dab/fb5 zero size 2024-04-25T02:11:28.438 INFO:tasks.workunit.client.0.smithi162.stdout:9/966: mkdir d4/d131/d148/d155 0 2024-04-25T02:11:28.567 INFO:tasks.workunit.client.0.smithi162.stdout:2/972: mkdir d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dc1/d15a 0 2024-04-25T02:11:28.857 INFO:tasks.workunit.client.0.smithi162.stdout:6/979: rmdir d1/d13/d28/d53/d71/dc5/dd6 39 2024-04-25T02:11:29.140 INFO:tasks.workunit.client.0.smithi162.stdout:9/967: creat d4/d25/de5/d108/f156 x:0 0 0 2024-04-25T02:11:29.249 INFO:tasks.workunit.client.0.smithi162.stdout:6/980: fsync d1/d13/f1f 0 2024-04-25T02:11:29.543 INFO:tasks.workunit.client.0.smithi162.stdout:9/968: dread d4/d9/d15/d1b/d2f/d30/f122 [0,4194304] 0 2024-04-25T02:11:29.625 INFO:tasks.workunit.client.0.smithi162.stdout:2/973: rename d0/d3/d1b/d6b/dc0/d67/d9c/fde to d0/d3/d1b/d6b/f15b 0 2024-04-25T02:11:30.250 INFO:tasks.workunit.client.0.smithi162.stdout:2/974: dread - d0/d3/d1b/d6b/d92/f119 zero size 2024-04-25T02:11:30.346 INFO:tasks.workunit.client.0.smithi162.stdout:9/969: rmdir d4/d131/d148/d155 0 2024-04-25T02:11:30.517 INFO:tasks.workunit.client.0.smithi162.stdout:2/975: creat d0/d3/d1b/d6b/dc0/d5e/d61/d62/f15c x:0 0 0 2024-04-25T02:11:30.519 INFO:tasks.workunit.client.0.smithi162.stdout:6/981: getdents d1/d13/d28/d30/d3a 0 2024-04-25T02:11:30.691 INFO:tasks.workunit.client.0.smithi162.stdout:9/970: dread d4/d8/fd0 [0,4194304] 0 2024-04-25T02:11:30.712 INFO:tasks.workunit.client.0.smithi162.stdout:6/982: rmdir d1/d13/d28/d30/d8a 39 2024-04-25T02:11:30.992 INFO:tasks.workunit.client.0.smithi162.stdout:2/976: rename d0/d3/d7a/f138 to d0/d3/d1b/d6b/dc0/d67/f15d 0 2024-04-25T02:11:31.102 INFO:tasks.workunit.client.0.smithi162.stdout:9/971: mknod d4/d9/d15/d1b/d2f/d14a/d9f/dd1/c157 0 2024-04-25T02:11:31.168 INFO:tasks.workunit.client.0.smithi162.stdout:9/972: read d4/d8/d13/fe3 [2453360,45156] 0 2024-04-25T02:11:31.225 INFO:tasks.workunit.client.0.smithi162.stdout:6/983: truncate d1/d13/d28/d7b/fd3 72621 0 2024-04-25T02:11:31.437 INFO:tasks.workunit.client.0.smithi162.stdout:2/977: rename d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/f91 to d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/d128/f15e 0 2024-04-25T02:11:31.817 INFO:tasks.workunit.client.0.smithi162.stdout:9/973: dread d4/d9/da9/f10d [0,4194304] 0 2024-04-25T02:11:32.122 INFO:tasks.workunit.client.0.smithi162.stdout:6/984: creat d1/d46/d7a/f144 x:0 0 0 2024-04-25T02:11:32.281 INFO:tasks.workunit.client.0.smithi162.stdout:2/978: rename d0/d3/d1b/d6b/dc0/d67/d9c/fef to d0/d3/d1b/d6b/de5/f15f 0 2024-04-25T02:11:32.785 INFO:tasks.workunit.client.0.smithi162.stdout:6/985: fdatasync d1/d13/d28/d30/dca/f123 0 2024-04-25T02:11:32.954 INFO:tasks.workunit.client.0.smithi162.stdout:2/979: mkdir d0/d3/d1b/d6b/dc0/d67/d9c/d160 0 2024-04-25T02:11:33.326 INFO:tasks.workunit.client.0.smithi162.stdout:6/986: symlink d1/d13/d28/d45/d59/dbe/l145 0 2024-04-25T02:11:33.735 INFO:tasks.workunit.client.0.smithi162.stdout:9/974: link d4/d25/de5/d125/fba d4/d9/d15/d8a/f158 0 2024-04-25T02:11:33.840 INFO:tasks.workunit.client.0.smithi162.stdout:6/987: symlink d1/d73/l146 0 2024-04-25T02:11:34.400 INFO:tasks.workunit.client.0.smithi162.stdout:6/988: mknod d1/d13/d28/d53/c147 0 2024-04-25T02:11:34.413 INFO:tasks.workunit.client.0.smithi162.stdout:2/980: rmdir d0/d3/d1b/d6b/dc0/d5e/d108 39 2024-04-25T02:11:34.465 INFO:tasks.workunit.client.0.smithi162.stdout:6/989: readlink d1/d5c/l92 0 2024-04-25T02:11:34.517 INFO:tasks.workunit.client.0.smithi162.stdout:6/990: chown d1/d13/d28/d45/c52 1190 1 2024-04-25T02:11:34.534 INFO:tasks.workunit.client.0.smithi162.stdout:6/991: stat d1/d13/l1a 0 2024-04-25T02:11:34.628 INFO:tasks.workunit.client.0.smithi162.stdout:9/975: write d4/d9/d15/d1b/d2f/d14a/d9f/f130 [199849,44763] 0 2024-04-25T02:11:34.724 INFO:tasks.workunit.client.0.smithi162.stdout:6/992: mkdir d1/d13/d28/d30/d66/d148 0 2024-04-25T02:11:35.243 INFO:tasks.workunit.client.0.smithi162.stdout:9/976: write d4/d8/d85/f7b [4741405,27745] 0 2024-04-25T02:11:35.331 INFO:tasks.workunit.client.0.smithi162.stdout:6/993: mknod d1/d13/d28/d7b/c149 0 2024-04-25T02:11:35.495 INFO:tasks.workunit.client.0.smithi162.stdout:9/977: dread - d4/d9/d15/d1b/d2f/d30/fd7 zero size 2024-04-25T02:11:35.539 INFO:tasks.workunit.client.0.smithi162.stdout:2/981: dwrite d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dbe/d128/f15e [0,4194304] 0 2024-04-25T02:11:35.855 INFO:tasks.workunit.client.0.smithi162.stdout:9/978: fsync d4/d9/d15/d1b/d2f/f62 0 2024-04-25T02:11:35.954 INFO:tasks.workunit.client.0.smithi162.stdout:6/994: truncate d1/d13/d28/d53/d71/dc5/fe3 2148034 0 2024-04-25T02:11:36.114 INFO:tasks.workunit.client.0.smithi162.stdout:2/982: truncate d0/d3/d1b/d6b/dc0/d5e/f150 553880 0 2024-04-25T02:11:36.199 INFO:tasks.workunit.client.0.smithi162.stdout:9/979: dread d4/d9/d15/d1b/f9a [0,4194304] 0 2024-04-25T02:11:36.841 INFO:tasks.workunit.client.0.smithi162.stdout:9/980: write d4/d9/d15/d1b/f9a [4202360,26234] 0 2024-04-25T02:11:36.852 INFO:tasks.workunit.client.0.smithi162.stdout:2/983: write d0/d3/d1b/d142/d36/d93/de0/f10f [2169908,37743] 0 2024-04-25T02:11:37.075 INFO:tasks.workunit.client.0.smithi162.stdout:6/995: rename d1/d13/d28/d45/d59/f130 to d1/d13/d28/f14a 0 2024-04-25T02:11:37.362 INFO:tasks.workunit.client.0.smithi162.stdout:9/981: symlink d4/d25/de5/d108/d11d/l159 0 2024-04-25T02:11:37.381 INFO:tasks.workunit.client.0.smithi162.stdout:6/996: symlink d1/d13/d28/d30/dca/l14b 0 2024-04-25T02:11:37.443 INFO:tasks.workunit.client.0.smithi162.stdout:9/982: dread - d4/d8/d13/f98 zero size 2024-04-25T02:11:37.458 INFO:tasks.workunit.client.0.smithi162.stdout:6/997: chown d1/d46/d7a/f10b 1804247 1 2024-04-25T02:11:37.473 INFO:tasks.workunit.client.0.smithi162.stdout:2/984: symlink d0/d3/d1b/d6b/dc0/d5e/l161 0 2024-04-25T02:11:37.939 INFO:tasks.workunit.client.0.smithi162.stdout:9/983: mknod d4/d9/d15/d1b/d2f/d14a/d59/c15a 0 2024-04-25T02:11:37.954 INFO:tasks.workunit.client.0.smithi162.stdout:6/998: mkdir d1/d13/d28/d30/d8a/dc3/dfb/d14c 0 2024-04-25T02:11:38.105 INFO:tasks.workunit.client.0.smithi162.stdout:2/985: write d0/d3/d7a/d88/ffb [1014685,24862] 0 2024-04-25T02:11:38.380 INFO:tasks.workunit.client.0.smithi162.stdout:9/984: truncate d4/d9/f87 4472970 0 2024-04-25T02:11:38.469 INFO:tasks.workunit.client.0.smithi162.stdout:2/986: dread d0/d3/d1b/d1d/d3a/d10d/f153 [0,4194304] 0 2024-04-25T02:11:38.493 INFO:tasks.workunit.client.0.smithi162.stdout:6/999: dread d1/d13/d28/d7b/fb8 [0,4194304] 0 2024-04-25T02:11:38.644 INFO:tasks.workunit.client.0.smithi162.stdout:2/987: dread d0/d3/d1b/d6b/dc0/d67/d9c/de8/f106 [0,4194304] 0 2024-04-25T02:11:38.729 INFO:tasks.workunit.client.0.smithi162.stdout:9/985: write d4/f39 [660996,8993] 0 2024-04-25T02:11:39.019 INFO:tasks.workunit.client.0.smithi162.stdout:9/986: chown d4/d8/d13/l5a 4 1 2024-04-25T02:11:39.066 INFO:tasks.workunit.client.0.smithi162.stdout:2/988: dread d0/d3/d1b/d142/d36/f37 [0,4194304] 0 2024-04-25T02:11:39.322 INFO:tasks.workunit.client.0.smithi162.stdout:9/987: truncate d4/d9/d15/d1b/d2f/d14a/f61 1264192 0 2024-04-25T02:11:39.604 INFO:tasks.workunit.client.0.smithi162.stdout:9/988: symlink d4/d25/de5/d108/d11d/l15b 0 2024-04-25T02:11:39.620 INFO:tasks.workunit.client.0.smithi162.stdout:2/989: link d0/d3/d1b/d6b/d92/d9a/fa3 d0/d3/d1b/d142/d36/df5/f162 0 2024-04-25T02:11:39.795 INFO:tasks.workunit.client.0.smithi162.stdout:9/989: dread d4/d8/d13/f2a [0,4194304] 0 2024-04-25T02:11:39.828 INFO:tasks.workunit.client.0.smithi162.stdout:2/990: creat d0/d3/d1b/d6b/dc0/d5e/db8/f163 x:0 0 0 2024-04-25T02:11:39.963 INFO:tasks.workunit.client.0.smithi162.stdout:2/991: symlink d0/d3/d1b/d6b/d9e/l164 0 2024-04-25T02:11:40.264 INFO:tasks.workunit.client.0.smithi162.stdout:9/990: creat d4/d9/d15/d1b/d2f/d14a/d9f/dd1/f15c x:0 0 0 2024-04-25T02:11:40.403 INFO:tasks.workunit.client.0.smithi162.stdout:2/992: dread d0/f8d [0,4194304] 0 2024-04-25T02:11:40.546 INFO:tasks.workunit.client.0.smithi162.stdout:9/991: rename d4/d9/d15/d1b/d2f/d14a/d59/f9c to d4/d131/f15d 0 2024-04-25T02:11:40.663 INFO:tasks.workunit.client.0.smithi162.stdout:2/993: dread d0/d3/d1b/d6b/dc0/d5e/d61/d66/f9b [0,4194304] 0 2024-04-25T02:11:40.883 INFO:tasks.workunit.client.0.smithi162.stdout:9/992: rename d4/d8/d85/lb2 to d4/d9/d15/d1b/d2f/d14a/d9f/dd1/ddc/l15e 0 2024-04-25T02:11:41.037 INFO:tasks.workunit.client.0.smithi162.stdout:2/994: fsync d0/d3/d1b/d6b/f15b 0 2024-04-25T02:11:41.082 INFO:tasks.workunit.client.0.smithi162.stdout:9/993: read d4/d9/d15/d1b/d2f/d14a/ff6 [834726,19096] 0 2024-04-25T02:11:41.708 INFO:tasks.workunit.client.0.smithi162.stdout:2/995: rmdir d0/d3/d1b/d6b/dc0/d5e 39 2024-04-25T02:11:43.148 INFO:tasks.workunit.client.0.smithi162.stdout:2/996: creat d0/d3/f165 x:0 0 0 2024-04-25T02:11:43.576 INFO:tasks.workunit.client.0.smithi162.stdout:9/994: creat d4/d9/d15/f15f x:0 0 0 2024-04-25T02:11:43.825 INFO:tasks.workunit.client.0.smithi162.stdout:2/997: rename d0/l39 to d0/d3/d7a/d88/l166 0 2024-04-25T02:11:43.837 INFO:tasks.workunit.client.0.smithi162.stdout:9/995: symlink d4/d131/d148/l160 0 2024-04-25T02:11:44.167 INFO:tasks.workunit.client.0.smithi162.stdout:9/996: rename d4/d9/d15/d1b/d2f/d14a/d9f to d4/d25/d161 0 2024-04-25T02:11:44.340 INFO:tasks.workunit.client.0.smithi162.stdout:2/998: symlink d0/d3/d1b/d6b/dc0/d5e/d61/d66/d84/dc1/d15a/l167 0 2024-04-25T02:11:44.548 INFO:tasks.workunit.client.0.smithi162.stdout:9/997: getdents d4/d7c 0 2024-04-25T02:11:44.662 INFO:tasks.workunit.client.0.smithi162.stdout:2/999: link d0/d3/d7a/ff4 d0/d3/d1b/d6b/dc0/d5e/d61/da4/f168 0 2024-04-25T02:11:44.884 INFO:tasks.workunit.client.0.smithi162.stdout:9/998: sync 2024-04-25T02:11:44.907 INFO:tasks.workunit.client.0.smithi162.stdout:9/999: chown d4/d25/de5/d13b 19 1 2024-04-25T02:11:44.928 INFO:tasks.workunit.client.0.smithi162.stderr:+ rm -rf -- ./tmp.18I1mlMutK 2024-04-25T02:11:55.136 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:11:55.140 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:12:25.197 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:12:25.200 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:12:50.729 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:23:40.159 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:12:50.741 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:23:40.171 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:12:50.817 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:23:40.247 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:12:50.849 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:23:40.196 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:12:50.858 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:23:40.204 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:12:50.858 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:23:40.205 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:12:50.862 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:23:40.208 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:12:50.927 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:23:40.274 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:12:50.945 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:23:40.291 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:12:55.318 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:12:55.321 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:13:25.375 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:13:25.378 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:13:55.501 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:13:55.505 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:14:11.360 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:25:00.790 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:14:11.369 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:25:00.800 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:14:11.444 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:25:00.875 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:14:11.484 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:25:00.831 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:14:11.486 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:25:00.834 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:14:11.489 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:25:00.837 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:14:11.498 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:25:00.846 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:14:11.577 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:25:00.925 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:14:11.589 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:25:00.937 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:14:25.594 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:14:25.597 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:14:55.641 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:14:55.644 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:15:25.761 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:15:25.764 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:15:30.472 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:26:19.904 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:15:30.493 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:26:19.925 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:15:30.514 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:26:19.862 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:15:30.515 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:26:19.862 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:15:30.530 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:26:19.878 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:15:30.530 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:26:19.878 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:15:30.605 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:26:20.036 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:15:30.638 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:26:19.986 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:15:30.646 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:26:19.994 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:15:55.837 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:15:55.841 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:16:25.887 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:16:25.890 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:16:56.007 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:16:56.011 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:17:26.062 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:17:26.066 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:17:56.203 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:17:56.206 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:18:26.374 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:18:26.378 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:18:56.480 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:18:56.484 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:19:26.587 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:19:26.590 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:19:38.509 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:30:27.942 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:19:38.529 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:30:27.962 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:19:38.548 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:30:27.897 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:19:38.551 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:30:27.900 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:19:38.559 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:30:27.908 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:19:38.571 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:30:27.920 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:19:38.706 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:30:28.139 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:19:38.722 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:30:28.071 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:19:38.847 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:30:28.196 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:19:56.717 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:19:56.720 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:20:26.990 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:20:26.993 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:20:57.061 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:20:57.064 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:21:14.081 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:32:03.514 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:21:14.098 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:32:03.532 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:21:14.145 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:32:03.495 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:21:14.149 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:32:03.499 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:21:14.151 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:32:03.501 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:21:14.156 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:32:03.505 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:21:14.225 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:32:03.574 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:21:14.237 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:32:03.671 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:21:14.243 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:32:03.593 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:21:27.198 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:21:27.201 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:21:57.325 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:21:57.328 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:22:27.388 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:22:27.391 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:22:34.769 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:33:24.202 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:22:34.774 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:33:24.208 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:22:34.888 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:33:24.238 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:22:34.901 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:33:24.250 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:22:34.908 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:33:24.258 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:22:34.909 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:33:24.258 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:22:34.935 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:33:24.369 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:22:34.977 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:33:24.327 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:22:34.979 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:33:24.329 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:22:57.543 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:22:57.546 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:23:27.704 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:23:27.707 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:23:46.598 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:34:36.032 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:23:46.618 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:34:35.967 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:23:46.632 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:34:35.981 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:23:46.687 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:34:36.036 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:23:46.694 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:34:36.043 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:23:46.695 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:34:36.129 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:23:46.760 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:34:36.109 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:23:46.791 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:34:36.225 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:23:46.893 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:34:36.243 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:23:57.824 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:23:57.827 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:24:02.043 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T02:24:02.044 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T02:24:27.937 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:24:27.941 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:24:58.166 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:24:58.169 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:25:28.215 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:25:28.218 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:25:58.290 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:25:58.293 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:26:28.386 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:26:28.389 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:26:58.498 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:26:58.501 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:27:28.547 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:27:28.551 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:27:56.908 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:38:46.342 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:27:56.935 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:38:46.370 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:27:56.950 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:38:46.300 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:27:56.960 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:38:46.311 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:27:56.970 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:38:46.320 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:27:56.987 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:38:46.337 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:27:57.107 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:38:46.542 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:27:57.120 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:38:46.470 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:27:57.134 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:38:46.484 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:27:58.664 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:27:58.667 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:28:28.793 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:28:28.797 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:28:58.964 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:28:58.967 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:29:29.096 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:29:29.100 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:29:37.042 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:40:26.477 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:29:37.137 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:40:26.572 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:29:37.264 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:40:26.613 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:29:37.264 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:40:26.700 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:29:37.271 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:40:26.621 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:29:37.338 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:40:26.688 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:29:37.349 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:40:26.700 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:29:37.369 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:40:26.719 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:29:37.430 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:40:26.780 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:29:59.161 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:29:59.164 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:30:29.208 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:30:29.211 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:30:57.833 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:41:47.268 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:30:57.837 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:41:47.272 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:30:57.953 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:41:47.302 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:30:57.955 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:41:47.305 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:30:57.958 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:41:47.308 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:30:57.959 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:41:47.309 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:30:57.978 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:41:47.413 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:30:58.024 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:41:47.374 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:30:58.028 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:41:47.378 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:30:59.282 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:30:59.285 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:31:29.332 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:31:29.335 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:31:59.443 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:31:59.447 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:32:02.442 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:42:51.877 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:32:02.478 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:42:51.914 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:32:02.490 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:42:51.840 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:32:02.495 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:42:51.845 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:32:02.505 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:42:51.855 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:32:02.507 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:42:51.857 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:32:02.606 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:42:51.956 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:32:02.621 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:42:52.056 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:32:02.654 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:42:52.004 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:32:29.548 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:32:29.551 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:32:59.697 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:32:59.701 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:33:29.755 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:33:29.758 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:33:59.807 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:33:59.811 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:34:29.914 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:34:29.917 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:35:00.011 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:35:00.014 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:35:30.168 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:35:30.171 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:36:00.241 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:36:00.245 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:36:11.055 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:47:00.490 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:36:11.074 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:47:00.509 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:36:11.093 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:47:00.443 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:36:11.094 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:47:00.444 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:36:11.103 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:47:00.453 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:36:11.105 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:47:00.455 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:36:11.262 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:47:00.697 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:36:11.274 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:47:00.624 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:36:11.281 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:47:00.631 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:36:30.337 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:36:30.340 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:37:00.458 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:37:00.461 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:37:30.610 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:37:30.613 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:37:55.583 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:48:45.017 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:37:55.597 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:48:45.032 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:37:55.679 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:48:45.114 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:37:55.703 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:48:45.053 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:37:55.712 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:48:45.062 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:37:55.717 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:48:45.067 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:37:55.724 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:48:45.074 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:37:55.804 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:48:45.154 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:37:55.807 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:48:45.157 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:38:00.740 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:38:00.743 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:38:30.887 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:38:30.890 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:39:00.930 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:39:00.933 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:39:21.252 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:50:10.686 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:39:21.257 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:50:10.692 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:39:21.335 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:50:10.770 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:39:21.373 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:50:10.723 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:39:21.377 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:50:10.727 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:39:21.377 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:50:10.727 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:39:21.379 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:50:10.729 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:39:21.464 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:50:10.814 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:39:21.464 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:50:10.814 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:39:31.044 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:39:31.047 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:40:01.089 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:40:01.092 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:40:16.108 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:51:05.542 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:40:16.127 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:51:05.562 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:40:16.139 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:51:05.489 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:40:16.144 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:51:05.494 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:40:16.151 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:51:05.501 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:40:16.163 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:51:05.513 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:40:16.220 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:51:05.655 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:40:16.267 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:51:05.616 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:40:16.283 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:51:05.633 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:40:31.212 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:40:31.216 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:41:01.456 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:41:01.459 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:41:31.500 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:41:31.504 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:42:01.638 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:42:01.641 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:42:31.802 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:42:31.805 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:43:01.874 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:43:01.877 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:43:31.947 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:43:31.950 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:44:02.079 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:44:02.082 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:44:25.359 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:55:14.793 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:44:25.368 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:55:14.803 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:44:25.384 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:55:14.734 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:44:25.397 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:55:14.747 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:44:25.399 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:55:14.749 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:44:25.418 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:55:14.767 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:44:25.534 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:55:14.969 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:44:25.566 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:55:14.916 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:44:25.574 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:55:14.924 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:44:32.200 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:44:32.203 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:45:02.278 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:45:02.281 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:45:32.541 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:45:32.544 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:46:02.610 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:46:02.613 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:46:13.961 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:57:03.395 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:46:13.963 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:57:03.398 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:46:14.058 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:57:03.493 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:46:14.078 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:57:03.428 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:46:14.085 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:57:03.435 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:46:14.087 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:57:03.437 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:46:14.095 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:57:03.445 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:46:14.183 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:57:03.533 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:46:14.186 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:57:03.536 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:46:32.790 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:46:32.793 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:47:02.918 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:47:02.921 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:47:33.053 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:47:33.058 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:47:44.656 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:58:34.092 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:47:44.764 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:58:34.199 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:47:44.788 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:58:34.139 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:47:44.793 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:58:34.143 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:47:44.794 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:58:34.145 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:47:44.802 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:58:34.153 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:47:44.837 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:58:34.272 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:47:44.882 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:58:34.232 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:47:44.890 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:58:34.240 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:48:03.109 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:48:03.112 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:48:33.246 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:48:33.249 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:48:33.418 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:59:22.853 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:48:33.428 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:59:22.864 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:48:33.457 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:59:22.808 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:48:33.464 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:59:22.815 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:48:33.465 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:59:22.816 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:48:33.469 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:59:22.820 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:48:33.502 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:01:59:22.937 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:48:33.545 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:01:59:22.896 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:48:33.566 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:01:59:22.917 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:49:03.496 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:49:03.499 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:49:33.552 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:49:33.555 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:50:03.665 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:50:03.668 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:50:33.810 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:50:33.814 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:51:04.170 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:51:04.173 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:51:34.225 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:51:34.232 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:52:04.330 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:52:04.333 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:52:34.443 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:52:34.447 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:52:41.690 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:03:31.126 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:52:41.707 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:03:31.144 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:52:41.741 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:03:31.093 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:52:41.746 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:03:31.098 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:52:41.756 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:03:31.108 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:52:41.760 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:03:31.112 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:52:41.924 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:03:31.360 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:52:41.926 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:03:31.278 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:52:41.936 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:03:31.288 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:53:04.573 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:53:04.576 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:53:34.699 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:53:34.702 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:54:04.805 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:54:04.808 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:54:32.243 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:05:21.678 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:54:32.251 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:05:21.688 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:54:32.330 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:05:21.766 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:54:32.362 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:05:21.714 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:54:32.367 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:05:21.720 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:54:32.372 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:05:21.724 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:54:32.375 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:05:21.727 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:54:32.460 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:05:21.811 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:54:32.481 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:05:21.833 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:54:34.919 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:54:34.922 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:55:05.060 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:55:05.064 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:55:35.148 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:55:35.152 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:56:05.420 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:56:05.423 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:56:08.071 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:06:57.507 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:56:08.073 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:06:57.510 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:56:08.131 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:06:57.567 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:56:08.194 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:06:57.546 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:56:08.197 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:06:57.549 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:56:08.199 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:06:57.551 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:56:08.202 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:06:57.554 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:56:08.254 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:06:57.606 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:56:08.276 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:06:57.628 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:56:35.481 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:56:35.485 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:56:48.094 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:07:37.530 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:56:48.106 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:07:37.543 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:56:48.150 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:07:37.502 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:56:48.151 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:07:37.502 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:56:48.166 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:07:37.519 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:56:48.171 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:07:37.524 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:56:48.172 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:07:37.609 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T02:56:48.267 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:07:37.619 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T02:56:48.335 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:07:37.687 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T02:57:05.576 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:57:05.580 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:57:35.622 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:57:35.627 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:58:05.737 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:58:05.741 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:58:35.846 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:58:35.849 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:59:05.897 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:59:05.900 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:59:36.003 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T02:59:36.007 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:00:06.135 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:00:06.138 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:00:36.420 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:00:36.423 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:00:57.484 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:11:46.920 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T03:00:57.501 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:11:46.938 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T03:00:57.533 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:11:46.885 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T03:00:57.544 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:11:46.896 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T03:00:57.547 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:11:46.899 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T03:00:57.566 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:11:46.918 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T03:00:57.668 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:11:47.105 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T03:00:57.720 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:11:47.073 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T03:00:57.830 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:11:47.182 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T03:01:06.497 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:01:06.500 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:01:36.560 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:01:36.563 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:02:06.613 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:02:06.616 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:02:36.718 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:02:36.721 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:02:55.947 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:13:45.383 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T03:02:55.952 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:13:45.389 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T03:02:56.068 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:13:45.505 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T03:02:56.069 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:13:45.422 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T03:02:56.075 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:13:45.428 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T03:02:56.077 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:13:45.430 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T03:02:56.093 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:13:45.446 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T03:02:56.172 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:13:45.525 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T03:02:56.199 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:13:45.552 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T03:03:06.828 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:03:06.832 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:03:36.957 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:03:36.961 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:04:07.076 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:04:07.079 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:04:31.647 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:15:21.084 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T03:04:31.656 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:15:21.093 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T03:04:31.721 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:15:21.157 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T03:04:31.770 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:15:21.122 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T03:04:31.774 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:15:21.126 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T03:04:31.779 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:15:21.132 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T03:04:31.780 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:15:21.132 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T03:04:31.855 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:15:21.207 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T03:04:31.855 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:15:21.207 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T03:04:37.374 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:04:37.378 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:05:03.517 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:15:52.954 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T03:05:03.530 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:15:52.967 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T03:05:03.561 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:15:52.914 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T03:05:03.562 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:15:52.914 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T03:05:03.568 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:15:52.921 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T03:05:03.576 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:15:52.929 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T03:05:03.621 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:15:53.058 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T03:05:03.650 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:15:53.003 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T03:05:03.749 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:15:53.101 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T03:05:07.496 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:05:07.499 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:05:37.632 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:05:37.635 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:06:07.710 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:06:07.714 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:06:37.764 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:06:37.767 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:07:07.895 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:07:07.899 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:07:38.021 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:07:38.025 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:08:08.140 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:08:08.143 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:08:38.188 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:08:38.192 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:09:08.299 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:09:08.302 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:09:12.563 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:20:02.000 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T03:09:12.576 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:20:02.012 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T03:09:12.593 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:20:01.945 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T03:09:12.599 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:20:01.952 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T03:09:12.603 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:20:01.956 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T03:09:12.632 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:20:01.985 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T03:09:12.763 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:20:02.200 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T03:09:12.764 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:20:02.116 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T03:09:12.853 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:20:02.206 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T03:09:31.667 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-25T03:09:31.668 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T03:09:32.000 DEBUG:teuthology.parallel:result is None 2024-04-25T03:09:32.000 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T03:09:32.436 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T03:09:32.436 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T03:09:32.479 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T03:09:32.479 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T03:09:32.479 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T03:09:32.486 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T03:09:32.486 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T03:09:32.535 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T03:09:32.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.706+0000 7ff1a06e5640 1 Processor -- start 2024-04-25T03:09:32.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.706+0000 7ff1a06e5640 1 -- start start 2024-04-25T03:09:32.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.706+0000 7ff1a06e5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff1980c1890 0x7ff1980c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:32.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.706+0000 7ff1a06e5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff19815c310 0x7ff1980c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:32.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.706+0000 7ff1a06e5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1980c5630 con 0x7ff1980c8ee0 2024-04-25T03:09:32.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.706+0000 7ff1a06e5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7ff19815be80 con 0x7ff1980c1890 2024-04-25T03:09:32.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.706+0000 7ff1a06e5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff1980c58f0 con 0x7ff19815c310 2024-04-25T03:09:32.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.706+0000 7ff19ec82640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ff1980c8ee0 0x7ff1981580a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44862/0 (socket says 172.21.15.162:44862) 2024-04-25T03:09:32.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.706+0000 7ff19ec82640 1 -- 172.21.15.162:0/2041538152 learned_addr learned my addr 172.21.15.162:0/2041538152 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:09:32.708 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.706+0000 7ff19e481640 1 --2- 172.21.15.162:0/2041538152 >> v2:172.21.15.179:3300/0 conn(0x7ff1980c1890 0x7ff1980c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:32.709 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.710+0000 7ff19dc80640 1 --2- 172.21.15.162:0/2041538152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff19815c310 0x7ff1980c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:32.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.710+0000 7ff19d47f640 1 -- 172.21.15.162:0/2041538152 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 956569693 0 0) 0x7ff1980c5630 con 0x7ff1980c8ee0 2024-04-25T03:09:32.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.710+0000 7ff19d47f640 1 -- 172.21.15.162:0/2041538152 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff184003530 con 0x7ff1980c8ee0 2024-04-25T03:09:32.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.714+0000 7ff19e481640 1 -- 172.21.15.162:0/2041538152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff19815c310 msgr2=0x7ff1980c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:32.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.714+0000 7ff19e481640 1 --2- 172.21.15.162:0/2041538152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff19815c310 0x7ff1980c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:32.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.714+0000 7ff19e481640 1 -- 172.21.15.162:0/2041538152 >> v1:172.21.15.162:6789/0 conn(0x7ff1980c8ee0 legacy=0x7ff1981580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:32.716 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.714+0000 7ff19e481640 1 -- 172.21.15.162:0/2041538152 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1980c5bd0 con 0x7ff1980c1890 2024-04-25T03:09:32.721 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.722+0000 7ff19e481640 1 --2- 172.21.15.162:0/2041538152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1980c1890 0x7ff1980c1c70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff1940097c0 tx=0x7ff19401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3a698d7ae6240da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:32.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.730+0000 7ff19d47f640 1 -- 172.21.15.162:0/2041538152 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1940a7070 con 0x7ff1980c1890 2024-04-25T03:09:32.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.730+0000 7ff19d47f640 1 -- 172.21.15.162:0/2041538152 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1940b0070 con 0x7ff1980c1890 2024-04-25T03:09:32.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.730+0000 7ff19d47f640 1 -- 172.21.15.162:0/2041538152 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1940ab890 con 0x7ff1980c1890 2024-04-25T03:09:32.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.730+0000 7ff1a06e5640 1 -- 172.21.15.162:0/2041538152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1980c1890 msgr2=0x7ff1980c1c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:32.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.730+0000 7ff1a06e5640 1 --2- 172.21.15.162:0/2041538152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1980c1890 0x7ff1980c1c70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff1940097c0 tx=0x7ff19401c470 comp rx=0 tx=0).stop 2024-04-25T03:09:32.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.730+0000 7ff1a06e5640 1 -- 172.21.15.162:0/2041538152 shutdown_connections 2024-04-25T03:09:32.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.730+0000 7ff1a06e5640 1 --2- 172.21.15.162:0/2041538152 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff19815c310 0x7ff1980c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:32.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.730+0000 7ff1a06e5640 1 --2- 172.21.15.162:0/2041538152 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1980c1890 0x7ff1980c1c70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:32.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.730+0000 7ff1a06e5640 1 -- 172.21.15.162:0/2041538152 >> 172.21.15.162:0/2041538152 conn(0x7ff1980c83c0 msgr2=0x7ff1980c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:32.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.730+0000 7ff1a06e5640 1 -- 172.21.15.162:0/2041538152 shutdown_connections 2024-04-25T03:09:32.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.730+0000 7ff1a06e5640 1 -- 172.21.15.162:0/2041538152 wait complete. 2024-04-25T03:09:32.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.730+0000 7ff1a06e5640 1 Processor -- start 2024-04-25T03:09:32.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.730+0000 7ff1a06e5640 1 -- start start 2024-04-25T03:09:32.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.734+0000 7ff1a06e5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1980c1890 0x7ff198160b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:32.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.734+0000 7ff1a06e5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1980c8ee0 0x7ff198157650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:32.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.734+0000 7ff1a06e5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff19815c310 0x7ff1980c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:32.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.734+0000 7ff1a06e5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff1980728d0 con 0x7ff1980c1890 2024-04-25T03:09:32.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.734+0000 7ff1a06e5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff198072750 con 0x7ff19815c310 2024-04-25T03:09:32.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.734+0000 7ff1a06e5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff198072a50 con 0x7ff1980c8ee0 2024-04-25T03:09:32.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.734+0000 7ff19e481640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1980c1890 0x7ff198160b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:32.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.734+0000 7ff19e481640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1980c1890 0x7ff198160b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55324/0 (socket says 172.21.15.162:55324) 2024-04-25T03:09:32.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.734+0000 7ff19e481640 1 -- 172.21.15.162:0/3444997724 learned_addr learned my addr 172.21.15.162:0/3444997724 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:32.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.734+0000 7ff19dc80640 1 --2- 172.21.15.162:0/3444997724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1980c8ee0 0x7ff198157650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:32.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.734+0000 7ff19ec82640 1 --2- 172.21.15.162:0/3444997724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff19815c310 0x7ff1980c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:32.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.738+0000 7ff19e481640 1 -- 172.21.15.162:0/3444997724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1980c8ee0 msgr2=0x7ff198157650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:32.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.738+0000 7ff19e481640 1 --2- 172.21.15.162:0/3444997724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1980c8ee0 0x7ff198157650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:32.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.738+0000 7ff19e481640 1 -- 172.21.15.162:0/3444997724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff19815c310 msgr2=0x7ff1980c43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:32.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.738+0000 7ff19e481640 1 --2- 172.21.15.162:0/3444997724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff19815c310 0x7ff1980c43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:32.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.738+0000 7ff19e481640 1 -- 172.21.15.162:0/3444997724 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff19815a330 con 0x7ff1980c1890 2024-04-25T03:09:32.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.738+0000 7ff19e481640 1 --2- 172.21.15.162:0/3444997724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1980c1890 0x7ff198160b00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff19401ab20 tx=0x7ff19401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:32.744 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.742+0000 7ff18effd640 1 -- 172.21.15.162:0/3444997724 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1940bf410 con 0x7ff1980c1890 2024-04-25T03:09:32.744 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.742+0000 7ff18effd640 1 -- 172.21.15.162:0/3444997724 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1940bf5d0 con 0x7ff1980c1890 2024-04-25T03:09:32.744 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.742+0000 7ff18effd640 1 -- 172.21.15.162:0/3444997724 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1940bf9c0 con 0x7ff1980c1890 2024-04-25T03:09:32.744 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.742+0000 7ff1a06e5640 1 -- 172.21.15.162:0/3444997724 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff19815a610 con 0x7ff1980c1890 2024-04-25T03:09:32.744 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.742+0000 7ff1a06e5640 1 -- 172.21.15.162:0/3444997724 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1980c3be0 con 0x7ff1980c1890 2024-04-25T03:09:32.745 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.746+0000 7ff1a06e5640 1 -- 172.21.15.162:0/3444997724 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff19804f5f0 con 0x7ff1980c1890 2024-04-25T03:09:32.766 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.766+0000 7ff18effd640 1 -- 172.21.15.162:0/3444997724 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff1940bd020 con 0x7ff1980c1890 2024-04-25T03:09:32.766 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.766+0000 7ff18effd640 1 --2- 172.21.15.162:0/3444997724 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ff17c067910 0x7ff17c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:32.766 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.766+0000 7ff19dc80640 1 --2- 172.21.15.162:0/3444997724 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ff17c067910 0x7ff17c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:32.766 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.766+0000 7ff19dc80640 1 --2- 172.21.15.162:0/3444997724 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ff17c067910 0x7ff17c069dd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff19813cf20 tx=0x7ff188009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:32.768 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:32.766+0000 7ff18effd640 1 -- 172.21.15.162:0/3444997724 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7ff1940ee8d0 con 0x7ff1980c1890 2024-04-25T03:09:33.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.050+0000 7ff18effd640 1 -- 172.21.15.162:0/3444997724 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ff194016090 con 0x7ff1980c1890 2024-04-25T03:09:33.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.230+0000 7ff1a06e5640 1 -- 172.21.15.162:0/3444997724 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff198074ad0 con 0x7ff1980c1890 2024-04-25T03:09:33.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.330+0000 7ff18effd640 1 -- 172.21.15.162:0/3444997724 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+16835 (secure 0 0 0) 0x7ff1940f0830 con 0x7ff1980c1890 2024-04-25T03:09:33.331 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T03:09:33.331 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":28,"fsid":"e141deed-4794-4a17-83c9-f6e6e8875f5e","created":"2024-04-25T00:49:29.904605+0000","modified":"2024-04-25T00:51:40.137155+0000","last_up_change":"2024-04-25T00:49:51.119342+0000","last_in_change":"2024-04-25T00:49:39.898293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T00:49:52.297093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T00:50:31.644475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T00:50:33.242786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e20986cc-3664-4988-959c-c0b02e380775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6811","nonce":2734546478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6813","nonce":2734546478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6817","nonce":2734546478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6815","nonce":2734546478}]},"public_addr":"172.21.15.162:6811/2734546478","cluster_addr":"172.21.15.162:6813/2734546478","heartbeat_back_addr":"172.21.15.162:6817/2734546478","heartbeat_front_addr":"172.21.15.162:6815/2734546478","state":["exists","up"]},{"osd":1,"uuid":"60f1608a-ecb7-4978-b816-ce6f419e275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6803","nonce":3488816098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6805","nonce":3488816098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6809","nonce":3488816098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6807","nonce":3488816098}]},"public_addr":"172.21.15.162:6803/3488816098","cluster_addr":"172.21.15.162:6805/3488816098","heartbeat_back_addr":"172.21.15.162:6809/3488816098","heartbeat_front_addr":"172.21.15.162:6807/3488816098","state":["exists","up"]},{"osd":2,"uuid":"77552061-8e19-4f49-bc3f-1300955a07b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6819","nonce":234337516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6821","nonce":234337516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6825","nonce":234337516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6823","nonce":234337516}]},"public_addr":"172.21.15.162:6819/234337516","cluster_addr":"172.21.15.162:6821/234337516","heartbeat_back_addr":"172.21.15.162:6825/234337516","heartbeat_front_addr":"172.21.15.162:6823/234337516","state":["exists","up"]},{"osd":3,"uuid":"5b105720-6e6d-4143-b5c4-0a3b1e4a687c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6827","nonce":1726903362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6829","nonce":1726903362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6833","nonce":1726903362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6831","nonce":1726903362}]},"public_addr":"172.21.15.162:6827/1726903362","cluster_addr":"172.21.15.162:6829/1726903362","heartbeat_back_addr":"172.21.15.162:6833/1726903362","heartbeat_front_addr":"172.21.15.162:6831/1726903362","state":["exists","up"]},{"osd":4,"uuid":"611eafc5-2fe0-4c96-ba8c-b1efc3930de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6817","nonce":3338082657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6819","nonce":3338082657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6823","nonce":3338082657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6821","nonce":3338082657}]},"public_addr":"172.21.15.179:6817/3338082657","cluster_addr":"172.21.15.179:6819/3338082657","heartbeat_back_addr":"172.21.15.179:6823/3338082657","heartbeat_front_addr":"172.21.15.179:6821/3338082657","state":["exists","up"]},{"osd":5,"uuid":"b39487f5-c314-4026-90bd-02e30ecca04f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6825","nonce":4129338239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6827","nonce":4129338239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6831","nonce":4129338239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6829","nonce":4129338239}]},"public_addr":"172.21.15.179:6825/4129338239","cluster_addr":"172.21.15.179:6827/4129338239","heartbeat_back_addr":"172.21.15.179:6831/4129338239","heartbeat_front_addr":"172.21.15.179:6829/4129338239","state":["exists","up"]},{"osd":6,"uuid":"1d902755-f992-4070-b30e-e79f5fb22d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6801","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6802","nonce":823843016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6806","nonce":823843016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6815","nonce":823843016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6810","nonce":823843016}]},"public_addr":"172.21.15.179:6802/823843016","cluster_addr":"172.21.15.179:6806/823843016","heartbeat_back_addr":"172.21.15.179:6815/823843016","heartbeat_front_addr":"172.21.15.179:6810/823843016","state":["exists","up"]},{"osd":7,"uuid":"ea529f85-28fd-4dc3-a584-314e71999061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6803","nonce":3403659125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6807","nonce":3403659125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6814","nonce":3403659125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6811","nonce":3403659125}]},"public_addr":"172.21.15.179:6803/3403659125","cluster_addr":"172.21.15.179:6807/3403659125","heartbeat_back_addr":"172.21.15.179:6814/3403659125","heartbeat_front_addr":"172.21.15.179:6811/3403659125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.684518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.583123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.644576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.815957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.787155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.814409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.657210+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.676697+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T03:09:33.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.334+0000 7ff1a06e5640 1 -- 172.21.15.162:0/3444997724 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ff17c067910 msgr2=0x7ff17c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:33.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.334+0000 7ff1a06e5640 1 --2- 172.21.15.162:0/3444997724 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ff17c067910 0x7ff17c069dd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff19813cf20 tx=0x7ff188009190 comp rx=0 tx=0).stop 2024-04-25T03:09:33.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.334+0000 7ff1a06e5640 1 -- 172.21.15.162:0/3444997724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1980c1890 msgr2=0x7ff198160b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:33.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.334+0000 7ff1a06e5640 1 --2- 172.21.15.162:0/3444997724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1980c1890 0x7ff198160b00 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff19401ab20 tx=0x7ff19401acb0 comp rx=0 tx=0).stop 2024-04-25T03:09:33.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.334+0000 7ff1a06e5640 1 -- 172.21.15.162:0/3444997724 shutdown_connections 2024-04-25T03:09:33.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.334+0000 7ff1a06e5640 1 --2- 172.21.15.162:0/3444997724 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff19815c310 0x7ff1980c43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:33.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.334+0000 7ff1a06e5640 1 --2- 172.21.15.162:0/3444997724 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1980c8ee0 0x7ff198157650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:33.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.334+0000 7ff1a06e5640 1 --2- 172.21.15.162:0/3444997724 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ff17c067910 0x7ff17c069dd0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:33.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.334+0000 7ff1a06e5640 1 --2- 172.21.15.162:0/3444997724 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1980c1890 0x7ff198160b00 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:33.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.334+0000 7ff1a06e5640 1 -- 172.21.15.162:0/3444997724 >> 172.21.15.162:0/3444997724 conn(0x7ff1980c83c0 msgr2=0x7ff1980cad80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:33.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.334+0000 7ff1a06e5640 1 -- 172.21.15.162:0/3444997724 shutdown_connections 2024-04-25T03:09:33.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.334+0000 7ff1a06e5640 1 -- 172.21.15.162:0/3444997724 wait complete. 2024-04-25T03:09:33.357 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T00:49:52.297093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T00:50:31.644475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T00:50:33.242786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T03:09:33.357 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T03:09:33.510 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.486+0000 7f872cb93640 1 Processor -- start 2024-04-25T03:09:33.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.486+0000 7f872cb93640 1 -- start start 2024-04-25T03:09:33.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.486+0000 7f872cb93640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87280c8530 0x7f872806cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:33.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.486+0000 7f872cb93640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f87280c8910 0x7f8728167d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:33.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.486+0000 7f872cb93640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87280c6c50 con 0x7f87280c27c0 2024-04-25T03:09:33.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.486+0000 7f872cb93640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f8728167870 con 0x7f87280c8910 2024-04-25T03:09:33.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.486+0000 7f872cb93640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f87280c9fd0 con 0x7f87280c8530 2024-04-25T03:09:33.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.550+0000 7f8726d9d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f87280c8910 0x7f8728167d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:33.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.550+0000 7f8725d9b640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f87280c27c0 0x7f87280caad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:36404/0 (socket says 172.21.15.162:36404) 2024-04-25T03:09:33.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.550+0000 7f8725d9b640 1 -- 172.21.15.162:0/887709163 learned_addr learned my addr 172.21.15.162:0/887709163 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:09:33.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.550+0000 7f872659c640 1 --2- 172.21.15.162:0/887709163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87280c8530 0x7f872806cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:33.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.558+0000 7f872659c640 1 -- 172.21.15.162:0/887709163 >> v2:172.21.15.179:3300/0 conn(0x7f87280c8910 msgr2=0x7f8728167d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:33.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.558+0000 7f872659c640 1 --2- 172.21.15.162:0/887709163 >> v2:172.21.15.179:3300/0 conn(0x7f87280c8910 0x7f8728167d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:33.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.558+0000 7f872659c640 1 -- 172.21.15.162:0/887709163 >> v1:172.21.15.179:6789/0 conn(0x7f87280c27c0 legacy=0x7f87280caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:33.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.558+0000 7f872659c640 1 -- 172.21.15.162:0/887709163 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87280ca2b0 con 0x7f87280c8530 2024-04-25T03:09:33.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.570+0000 7f872659c640 1 --2- 172.21.15.162:0/887709163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87280c8530 0x7f872806cd50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f87100071d0 tx=0x7f871001d480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4f47e7e0b6a64f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:33.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.578+0000 7f872559a640 1 -- 172.21.15.162:0/887709163 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8710008be0 con 0x7f87280c8530 2024-04-25T03:09:33.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.578+0000 7f872559a640 1 -- 172.21.15.162:0/887709163 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87100af070 con 0x7f87280c8530 2024-04-25T03:09:33.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.578+0000 7f872559a640 1 -- 172.21.15.162:0/887709163 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f871000a0d0 con 0x7f87280c8530 2024-04-25T03:09:33.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.578+0000 7f872cb93640 1 -- 172.21.15.162:0/887709163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87280c8530 msgr2=0x7f872806cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:33.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.578+0000 7f872cb93640 1 --2- 172.21.15.162:0/887709163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87280c8530 0x7f872806cd50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f87100071d0 tx=0x7f871001d480 comp rx=0 tx=0).stop 2024-04-25T03:09:33.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.578+0000 7f872cb93640 1 -- 172.21.15.162:0/887709163 shutdown_connections 2024-04-25T03:09:33.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.578+0000 7f872cb93640 1 --2- 172.21.15.162:0/887709163 >> v2:172.21.15.179:3300/0 conn(0x7f87280c8910 0x7f8728167d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:33.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.578+0000 7f872cb93640 1 --2- 172.21.15.162:0/887709163 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87280c8530 0x7f872806cd50 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:33.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.578+0000 7f872cb93640 1 -- 172.21.15.162:0/887709163 >> 172.21.15.162:0/887709163 conn(0x7f872806b210 msgr2=0x7f872806b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:33.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.578+0000 7f872cb93640 1 -- 172.21.15.162:0/887709163 shutdown_connections 2024-04-25T03:09:33.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.578+0000 7f872cb93640 1 -- 172.21.15.162:0/887709163 wait complete. 2024-04-25T03:09:33.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.582+0000 7f872cb93640 1 Processor -- start 2024-04-25T03:09:33.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.582+0000 7f872cb93640 1 -- start start 2024-04-25T03:09:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.582+0000 7f872cb93640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87280c27c0 0x7f872816fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.582+0000 7f872cb93640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87280c8530 0x7f87281703b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.582+0000 7f872cb93640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87280c8910 0x7f872815fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.582+0000 7f872cb93640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8728173ac0 con 0x7f87280c27c0 2024-04-25T03:09:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.582+0000 7f872cb93640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f87281671f0 con 0x7f87280c8910 2024-04-25T03:09:33.583 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.582+0000 7f872cb93640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8728173c40 con 0x7f87280c8530 2024-04-25T03:09:33.585 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.586+0000 7f872659c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87280c27c0 0x7f872816fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:33.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.586+0000 7f8726d9d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87280c8910 0x7f872815fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:33.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.586+0000 7f872659c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87280c27c0 0x7f872816fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55332/0 (socket says 172.21.15.162:55332) 2024-04-25T03:09:33.586 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.586+0000 7f872659c640 1 -- 172.21.15.162:0/1268016806 learned_addr learned my addr 172.21.15.162:0/1268016806 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:33.599 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.598+0000 7f8725d9b640 1 --2- 172.21.15.162:0/1268016806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87280c8530 0x7f87281703b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:33.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.606+0000 7f8725d9b640 1 -- 172.21.15.162:0/1268016806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87280c8910 msgr2=0x7f872815fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:33.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.606+0000 7f8725d9b640 1 --2- 172.21.15.162:0/1268016806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87280c8910 0x7f872815fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:33.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.606+0000 7f8725d9b640 1 -- 172.21.15.162:0/1268016806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87280c27c0 msgr2=0x7f872816fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:33.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.606+0000 7f8725d9b640 1 --2- 172.21.15.162:0/1268016806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87280c27c0 0x7f872816fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:33.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.606+0000 7f8725d9b640 1 -- 172.21.15.162:0/1268016806 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f872816a5a0 con 0x7f87280c8530 2024-04-25T03:09:33.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.682+0000 7f8725d9b640 1 --2- 172.21.15.162:0/1268016806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87280c8530 0x7f87281703b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f871800c3c0 tx=0x7f871800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:33.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.690+0000 7f871effd640 1 -- 172.21.15.162:0/1268016806 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8718017070 con 0x7f87280c8530 2024-04-25T03:09:33.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.690+0000 7f871effd640 1 -- 172.21.15.162:0/1268016806 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8718005cf0 con 0x7f87280c8530 2024-04-25T03:09:33.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.690+0000 7f871effd640 1 -- 172.21.15.162:0/1268016806 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87180072f0 con 0x7f87280c8530 2024-04-25T03:09:33.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.694+0000 7f872cb93640 1 -- 172.21.15.162:0/1268016806 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87281684f0 con 0x7f87280c8530 2024-04-25T03:09:33.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.694+0000 7f872cb93640 1 -- 172.21.15.162:0/1268016806 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8728169f50 con 0x7f87280c8530 2024-04-25T03:09:33.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.694+0000 7f872cb93640 1 -- 172.21.15.162:0/1268016806 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8728068310 con 0x7f87280c8530 2024-04-25T03:09:33.719 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.718+0000 7f871effd640 1 -- 172.21.15.162:0/1268016806 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f871801a070 con 0x7f87280c8530 2024-04-25T03:09:33.719 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.718+0000 7f871effd640 1 --2- 172.21.15.162:0/1268016806 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8708067940 0x7f8708069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:33.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.718+0000 7f872659c640 1 --2- 172.21.15.162:0/1268016806 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8708067940 0x7f8708069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:33.720 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.718+0000 7f872659c640 1 --2- 172.21.15.162:0/1268016806 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8708067940 0x7f8708069e00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f871001bb30 tx=0x7f87100a8000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:33.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.974+0000 7f871effd640 1 -- 172.21.15.162:0/1268016806 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f87180538e0 con 0x7f87280c8530 2024-04-25T03:09:33.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:33.982+0000 7f871effd640 1 -- 172.21.15.162:0/1268016806 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8718021020 con 0x7f87280c8530 2024-04-25T03:09:34.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.186+0000 7f872cb93640 1 -- 172.21.15.162:0/1268016806 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f872816fbd0 con 0x7f87280c8530 2024-04-25T03:09:34.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.202+0000 7f871effd640 1 -- 172.21.15.162:0/1268016806 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f8718055840 con 0x7f87280c8530 2024-04-25T03:09:34.203 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-04-25T03:09:34.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.206+0000 7f872cb93640 1 -- 172.21.15.162:0/1268016806 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8708067940 msgr2=0x7f8708069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:34.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.206+0000 7f872cb93640 1 --2- 172.21.15.162:0/1268016806 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8708067940 0x7f8708069e00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f871001bb30 tx=0x7f87100a8000 comp rx=0 tx=0).stop 2024-04-25T03:09:34.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.206+0000 7f872cb93640 1 -- 172.21.15.162:0/1268016806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87280c8530 msgr2=0x7f87281703b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:34.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.206+0000 7f872cb93640 1 --2- 172.21.15.162:0/1268016806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87280c8530 0x7f87281703b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f871800c3c0 tx=0x7f871800c880 comp rx=0 tx=0).stop 2024-04-25T03:09:34.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.206+0000 7f872cb93640 1 -- 172.21.15.162:0/1268016806 shutdown_connections 2024-04-25T03:09:34.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.206+0000 7f872cb93640 1 --2- 172.21.15.162:0/1268016806 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f87280c8910 0x7f872815fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:34.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.206+0000 7f872cb93640 1 --2- 172.21.15.162:0/1268016806 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f87280c8530 0x7f87281703b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:34.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.206+0000 7f872cb93640 1 --2- 172.21.15.162:0/1268016806 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8708067940 0x7f8708069e00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:34.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.206+0000 7f872cb93640 1 --2- 172.21.15.162:0/1268016806 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f87280c27c0 0x7f872816fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:34.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.206+0000 7f872cb93640 1 -- 172.21.15.162:0/1268016806 >> 172.21.15.162:0/1268016806 conn(0x7f872806b210 msgr2=0x7f87280caad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:34.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.206+0000 7f872cb93640 1 -- 172.21.15.162:0/1268016806 shutdown_connections 2024-04-25T03:09:34.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.206+0000 7f872cb93640 1 -- 172.21.15.162:0/1268016806 wait complete. 2024-04-25T03:09:34.224 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T03:09:34.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.346+0000 7f740d53d640 1 Processor -- start 2024-04-25T03:09:34.348 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.346+0000 7f740d53d640 1 -- start start 2024-04-25T03:09:34.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.350+0000 7f740d53d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7408151410 0x7f74081570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:34.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.350+0000 7f740d53d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f740815b1d0 0x7f74080c2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:34.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.350+0000 7f740d53d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f740815a760 con 0x7f74080c65c0 2024-04-25T03:09:34.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.350+0000 7f740d53d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f74080c3200 con 0x7f7408151410 2024-04-25T03:09:34.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.350+0000 7f740d53d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f740815b5f0 con 0x7f740815b1d0 2024-04-25T03:09:34.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.350+0000 7f74077fe640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f74080c65c0 0x7f7408072c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44874/0 (socket says 172.21.15.162:44874) 2024-04-25T03:09:34.350 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.350+0000 7f74077fe640 1 -- 172.21.15.162:0/3612017523 learned_addr learned my addr 172.21.15.162:0/3612017523 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:09:34.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.350+0000 7f7406ffd640 1 --2- 172.21.15.162:0/3612017523 >> v2:172.21.15.179:3300/0 conn(0x7f7408151410 0x7f74081570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:34.351 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.350+0000 7f74067fc640 1 --2- 172.21.15.162:0/3612017523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f740815b1d0 0x7f74080c2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:34.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.350+0000 7f7405ffb640 1 -- 172.21.15.162:0/3612017523 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2223702996 0 0) 0x7f740815a760 con 0x7f74080c65c0 2024-04-25T03:09:34.353 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.354+0000 7f7405ffb640 1 -- 172.21.15.162:0/3612017523 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f73f0003530 con 0x7f74080c65c0 2024-04-25T03:09:34.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.354+0000 7f7405ffb640 1 -- 172.21.15.162:0/3612017523 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1063002931 0 0) 0x7f73f0003530 con 0x7f74080c65c0 2024-04-25T03:09:34.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.354+0000 7f7405ffb640 1 -- 172.21.15.162:0/3612017523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f740815b1d0 msgr2=0x7f74080c2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:34.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.354+0000 7f7405ffb640 1 --2- 172.21.15.162:0/3612017523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f740815b1d0 0x7f74080c2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:34.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.354+0000 7f7405ffb640 1 -- 172.21.15.162:0/3612017523 >> v2:172.21.15.179:3300/0 conn(0x7f7408151410 msgr2=0x7f74081570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:34.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.354+0000 7f7405ffb640 1 --2- 172.21.15.162:0/3612017523 >> v2:172.21.15.179:3300/0 conn(0x7f7408151410 0x7f74081570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:34.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.354+0000 7f7405ffb640 1 -- 172.21.15.162:0/3612017523 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74081517f0 con 0x7f74080c65c0 2024-04-25T03:09:34.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.354+0000 7f7405ffb640 1 -- 172.21.15.162:0/3612017523 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7f7400001680 con 0x7f74080c65c0 2024-04-25T03:09:34.357 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.354+0000 7f7405ffb640 1 -- 172.21.15.162:0/3612017523 >> v1:172.21.15.162:6789/0 conn(0x7f74080c65c0 legacy=0x7f7408072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:34.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.354+0000 7f7405ffb640 1 --2- 172.21.15.162:0/3612017523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73f00039c0 0x7f73f0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:34.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.354+0000 7f7405ffb640 1 --2- 172.21.15.162:0/3612017523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f0004810 0x7f73f0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:34.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.354+0000 7f7405ffb640 1 --2- 172.21.15.162:0/3612017523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f740815b1d0 0x7f73f00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:34.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.354+0000 7f7405ffb640 1 -- 172.21.15.162:0/3612017523 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f740815b5f0 con 0x7f73f00039c0 2024-04-25T03:09:34.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.354+0000 7f7405ffb640 1 -- 172.21.15.162:0/3612017523 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f73f000dbe0 con 0x7f73f0004810 2024-04-25T03:09:34.358 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.354+0000 7f7405ffb640 1 -- 172.21.15.162:0/3612017523 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f73f000dd60 con 0x7f740815b1d0 2024-04-25T03:09:34.359 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.358+0000 7f7406ffd640 1 --2- 172.21.15.162:0/3612017523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73f00039c0 0x7f73f0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:34.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.362+0000 7f7406ffd640 1 -- 172.21.15.162:0/3612017523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f740815b1d0 msgr2=0x7f73f00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:34.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.362+0000 7f7406ffd640 1 --2- 172.21.15.162:0/3612017523 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f740815b1d0 0x7f73f00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:34.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.362+0000 7f7406ffd640 1 -- 172.21.15.162:0/3612017523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f0004810 msgr2=0x7f73f0004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:34.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.362+0000 7f7406ffd640 1 --2- 172.21.15.162:0/3612017523 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f73f0004810 0x7f73f0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:34.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.362+0000 7f7406ffd640 1 -- 172.21.15.162:0/3612017523 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f0003530 con 0x7f73f00039c0 2024-04-25T03:09:34.366 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.366+0000 7f7406ffd640 1 --2- 172.21.15.162:0/3612017523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73f00039c0 0x7f73f0003de0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f73fc009ae0 tx=0x7f73fc01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=428a780f9777edd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:34.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.370+0000 7f7405ffb640 1 -- 172.21.15.162:0/3612017523 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73fc0096b0 con 0x7f73f00039c0 2024-04-25T03:09:34.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.370+0000 7f7405ffb640 1 -- 172.21.15.162:0/3612017523 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73fc0b0400 con 0x7f73f00039c0 2024-04-25T03:09:34.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.370+0000 7f7405ffb640 1 -- 172.21.15.162:0/3612017523 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73fc0b0830 con 0x7f73f00039c0 2024-04-25T03:09:34.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.370+0000 7f740d53d640 1 -- 172.21.15.162:0/3612017523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73f00039c0 msgr2=0x7f73f0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:34.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.370+0000 7f740d53d640 1 --2- 172.21.15.162:0/3612017523 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f73f00039c0 0x7f73f0003de0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f73fc009ae0 tx=0x7f73fc01ca20 comp rx=0 tx=0).stop 2024-04-25T03:09:34.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.370+0000 7f74077fe640 1 -- 172.21.15.162:0/3612017523 reap_dead start 2024-04-25T03:09:34.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.370+0000 7f740d53d640 1 -- 172.21.15.162:0/3612017523 shutdown_connections 2024-04-25T03:09:34.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.370+0000 7f740d53d640 1 -- 172.21.15.162:0/3612017523 >> 172.21.15.162:0/3612017523 conn(0x7f740806b210 msgr2=0x7f740806b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:34.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.370+0000 7f740d53d640 1 -- 172.21.15.162:0/3612017523 shutdown_connections 2024-04-25T03:09:34.372 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.370+0000 7f740d53d640 1 -- 172.21.15.162:0/3612017523 wait complete. 2024-04-25T03:09:34.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.374+0000 7f740d53d640 1 Processor -- start 2024-04-25T03:09:34.373 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.374+0000 7f740d53d640 1 -- start start 2024-04-25T03:09:34.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.374+0000 7f740d53d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f00039c0 0x7f740815d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:34.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.374+0000 7f740d53d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f740815a310 0x7f74080c1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:34.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.374+0000 7f740d53d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74081f3aa0 0x7f74081f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:34.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.374+0000 7f740d53d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f74080c39f0 con 0x7f740815a310 2024-04-25T03:09:34.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.374+0000 7f740d53d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f740815acb0 con 0x7f74081f3aa0 2024-04-25T03:09:34.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.374+0000 7f740d53d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f74080c3b70 con 0x7f73f00039c0 2024-04-25T03:09:34.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.374+0000 7f74067fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f740815a310 0x7f74080c1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:34.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.374+0000 7f74067fc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f740815a310 0x7f74080c1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55348/0 (socket says 172.21.15.162:55348) 2024-04-25T03:09:34.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.374+0000 7f74067fc640 1 -- 172.21.15.162:0/2567699522 learned_addr learned my addr 172.21.15.162:0/2567699522 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:34.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.374+0000 7f74077fe640 1 --2- 172.21.15.162:0/2567699522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74081f3aa0 0x7f74081f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:34.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.374+0000 7f7406ffd640 1 --2- 172.21.15.162:0/2567699522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f00039c0 0x7f740815d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:34.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.378+0000 7f74067fc640 1 -- 172.21.15.162:0/2567699522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f00039c0 msgr2=0x7f740815d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:34.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.378+0000 7f74067fc640 1 --2- 172.21.15.162:0/2567699522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f00039c0 0x7f740815d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:34.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.378+0000 7f74067fc640 1 -- 172.21.15.162:0/2567699522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74081f3aa0 msgr2=0x7f74081f3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:34.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.378+0000 7f74067fc640 1 --2- 172.21.15.162:0/2567699522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74081f3aa0 0x7f74081f3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:34.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.378+0000 7f74067fc640 1 -- 172.21.15.162:0/2567699522 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74080c1f50 con 0x7f740815a310 2024-04-25T03:09:34.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.382+0000 7f74067fc640 1 --2- 172.21.15.162:0/2567699522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f740815a310 0x7f74080c1630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f73f800ef70 tx=0x7f73f800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:34.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.386+0000 7f73ef7fe640 1 -- 172.21.15.162:0/2567699522 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f8018020 con 0x7f740815a310 2024-04-25T03:09:34.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.386+0000 7f73ef7fe640 1 -- 172.21.15.162:0/2567699522 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73f8014400 con 0x7f740815a310 2024-04-25T03:09:34.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.386+0000 7f740d53d640 1 -- 172.21.15.162:0/2567699522 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74081583c0 con 0x7f740815a310 2024-04-25T03:09:34.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.386+0000 7f73ef7fe640 1 -- 172.21.15.162:0/2567699522 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f80147f0 con 0x7f740815a310 2024-04-25T03:09:34.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.386+0000 7f740d53d640 1 -- 172.21.15.162:0/2567699522 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7408158980 con 0x7f740815a310 2024-04-25T03:09:34.386 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.386+0000 7f740d53d640 1 -- 172.21.15.162:0/2567699522 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7408068310 con 0x7f740815a310 2024-04-25T03:09:34.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.406+0000 7f73ef7fe640 1 -- 172.21.15.162:0/2567699522 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f73f801b020 con 0x7f740815a310 2024-04-25T03:09:34.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.406+0000 7f73ef7fe640 1 --2- 172.21.15.162:0/2567699522 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f73f4067910 0x7f73f4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:34.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.406+0000 7f7406ffd640 1 --2- 172.21.15.162:0/2567699522 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f73f4067910 0x7f73f4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:34.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.406+0000 7f7406ffd640 1 --2- 172.21.15.162:0/2567699522 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f73f4067910 0x7f73f4069dd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0af000 tx=0x7f73fc0046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:34.409 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.410+0000 7f73ef7fe640 1 -- 172.21.15.162:0/2567699522 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f73f8055020 con 0x7f740815a310 2024-04-25T03:09:34.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.690+0000 7f73ef7fe640 1 -- 172.21.15.162:0/2567699522 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f73f8022030 con 0x7f740815a310 2024-04-25T03:09:34.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.850+0000 7f740d53d640 1 -- 172.21.15.162:0/2567699522 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f74080c26c0 con 0x7f740815a310 2024-04-25T03:09:34.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.858+0000 7f73ef7fe640 1 -- 172.21.15.162:0/2567699522 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f73f8056f80 con 0x7f740815a310 2024-04-25T03:09:34.858 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-04-25T03:09:34.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.858+0000 7f740d53d640 1 -- 172.21.15.162:0/2567699522 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f73f4067910 msgr2=0x7f73f4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:34.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.858+0000 7f740d53d640 1 --2- 172.21.15.162:0/2567699522 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f73f4067910 0x7f73f4069dd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f73fc0af000 tx=0x7f73fc0046d0 comp rx=0 tx=0).stop 2024-04-25T03:09:34.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.858+0000 7f740d53d640 1 -- 172.21.15.162:0/2567699522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f740815a310 msgr2=0x7f74080c1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:34.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.858+0000 7f740d53d640 1 --2- 172.21.15.162:0/2567699522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f740815a310 0x7f74080c1630 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f73f800ef70 tx=0x7f73f800b480 comp rx=0 tx=0).stop 2024-04-25T03:09:34.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.858+0000 7f740d53d640 1 -- 172.21.15.162:0/2567699522 shutdown_connections 2024-04-25T03:09:34.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.858+0000 7f740d53d640 1 --2- 172.21.15.162:0/2567699522 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f74081f3aa0 0x7f74081f3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:34.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.858+0000 7f740d53d640 1 --2- 172.21.15.162:0/2567699522 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f73f4067910 0x7f73f4069dd0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:34.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.858+0000 7f740d53d640 1 --2- 172.21.15.162:0/2567699522 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f740815a310 0x7f74080c1630 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:34.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.858+0000 7f740d53d640 1 --2- 172.21.15.162:0/2567699522 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f73f00039c0 0x7f740815d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:34.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.858+0000 7f740d53d640 1 -- 172.21.15.162:0/2567699522 >> 172.21.15.162:0/2567699522 conn(0x7f740806b210 msgr2=0x7f74080c7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:34.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.858+0000 7f740d53d640 1 -- 172.21.15.162:0/2567699522 shutdown_connections 2024-04-25T03:09:34.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:34.858+0000 7f740d53d640 1 -- 172.21.15.162:0/2567699522 wait complete. 2024-04-25T03:09:34.877 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T03:09:35.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.006+0000 7ffbc70aa640 1 Processor -- start 2024-04-25T03:09:35.005 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.006+0000 7ffbc70aa640 1 -- start start 2024-04-25T03:09:35.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.006+0000 7ffbc70aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc0141380 0x7ffbc015c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:35.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.006+0000 7ffbc70aa640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc00c6a80 con 0x7ffbc0141760 2024-04-25T03:09:35.006 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.006+0000 7ffbc70aa640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffbc00c6d60 con 0x7ffbc006dbd0 2024-04-25T03:09:35.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.006+0000 7ffbc70aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc006e080 con 0x7ffbc0141380 2024-04-25T03:09:35.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.006+0000 7ffbbffff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7ffbc0141760 0x7ffbc00c6240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44888/0 (socket says 172.21.15.162:44888) 2024-04-25T03:09:35.007 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.006+0000 7ffbbffff640 1 -- 172.21.15.162:0/3912044626 learned_addr learned my addr 172.21.15.162:0/3912044626 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:09:35.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.006+0000 7ffbc4e46640 1 --2- 172.21.15.162:0/3912044626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc0141380 0x7ffbc015c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:35.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.010+0000 7ffbbf7fe640 1 -- 172.21.15.162:0/3912044626 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1828576061 0 0) 0x7ffbc00c6a80 con 0x7ffbc0141760 2024-04-25T03:09:35.011 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.010+0000 7ffbbf7fe640 1 -- 172.21.15.162:0/3912044626 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbb0003530 con 0x7ffbc0141760 2024-04-25T03:09:35.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.014+0000 7ffbbf7fe640 1 -- 172.21.15.162:0/3912044626 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1047418370 0 0) 0x7ffbc00c6d60 con 0x7ffbc006dbd0 2024-04-25T03:09:35.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.014+0000 7ffbbf7fe640 1 -- 172.21.15.162:0/3912044626 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffbc00c6a80 con 0x7ffbc006dbd0 2024-04-25T03:09:35.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.014+0000 7ffbbf7fe640 1 -- 172.21.15.162:0/3912044626 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2366894160 0 0) 0x7ffbb0003530 con 0x7ffbc0141760 2024-04-25T03:09:35.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.014+0000 7ffbbf7fe640 1 -- 172.21.15.162:0/3912044626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc0141380 msgr2=0x7ffbc015c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:35.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.014+0000 7ffbbf7fe640 1 --2- 172.21.15.162:0/3912044626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc0141380 0x7ffbc015c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:35.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.014+0000 7ffbbf7fe640 1 -- 172.21.15.162:0/3912044626 >> v1:172.21.15.179:6789/0 conn(0x7ffbc006dbd0 legacy=0x7ffbc00c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:35.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.014+0000 7ffbbf7fe640 1 -- 172.21.15.162:0/3912044626 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc015ba00 con 0x7ffbc0141760 2024-04-25T03:09:35.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.014+0000 7ffbbf7fe640 1 -- 172.21.15.162:0/3912044626 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7ffbac001680 con 0x7ffbc0141760 2024-04-25T03:09:35.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.014+0000 7ffbbf7fe640 1 -- 172.21.15.162:0/3912044626 >> v1:172.21.15.162:6789/0 conn(0x7ffbc0141760 legacy=0x7ffbc00c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:35.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.014+0000 7ffbbf7fe640 1 --2- 172.21.15.162:0/3912044626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbb0003b80 0x7ffbb0003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:35.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.014+0000 7ffbbf7fe640 1 --2- 172.21.15.162:0/3912044626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb0004810 0x7ffbb0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:35.016 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.014+0000 7ffbbf7fe640 1 --2- 172.21.15.162:0/3912044626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbb00051d0 0x7ffbb000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:35.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.014+0000 7ffbbf7fe640 1 -- 172.21.15.162:0/3912044626 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc006e080 con 0x7ffbb0004810 2024-04-25T03:09:35.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.014+0000 7ffbbf7fe640 1 -- 172.21.15.162:0/3912044626 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb000c0a0 con 0x7ffbb00051d0 2024-04-25T03:09:35.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.014+0000 7ffbbf7fe640 1 -- 172.21.15.162:0/3912044626 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffbb000c2a0 con 0x7ffbb0003b80 2024-04-25T03:09:35.019 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.018+0000 7ffbbffff640 1 --2- 172.21.15.162:0/3912044626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb0004810 0x7ffbb0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:35.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.022+0000 7ffbc4e46640 1 --2- 172.21.15.162:0/3912044626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbb0003b80 0x7ffbb0003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:35.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.022+0000 7ffbbffff640 1 -- 172.21.15.162:0/3912044626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbb0003b80 msgr2=0x7ffbb0003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:35.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.022+0000 7ffbbffff640 1 --2- 172.21.15.162:0/3912044626 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbb0003b80 0x7ffbb0003f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:35.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.022+0000 7ffbbffff640 1 -- 172.21.15.162:0/3912044626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbb00051d0 msgr2=0x7ffbb000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:35.022 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.022+0000 7ffbbffff640 1 --2- 172.21.15.162:0/3912044626 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbb00051d0 0x7ffbb000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:35.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.022+0000 7ffbbffff640 1 -- 172.21.15.162:0/3912044626 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb0003530 con 0x7ffbb0004810 2024-04-25T03:09:35.025 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.026+0000 7ffbbffff640 1 --2- 172.21.15.162:0/3912044626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb0004810 0x7ffbb0004c90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffbac007fc0 tx=0x7ffbac01cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=442823aabddbdb4b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:35.027 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.026+0000 7ffbbf7fe640 1 -- 172.21.15.162:0/3912044626 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac007c10 con 0x7ffbb0004810 2024-04-25T03:09:35.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.030+0000 7ffbbf7fe640 1 -- 172.21.15.162:0/3912044626 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbac0a9070 con 0x7ffbb0004810 2024-04-25T03:09:35.029 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.030+0000 7ffbbf7fe640 1 -- 172.21.15.162:0/3912044626 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbac005d20 con 0x7ffbb0004810 2024-04-25T03:09:35.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.030+0000 7ffbc70aa640 1 -- 172.21.15.162:0/3912044626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb0004810 msgr2=0x7ffbb0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:35.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.030+0000 7ffbc70aa640 1 --2- 172.21.15.162:0/3912044626 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb0004810 0x7ffbb0004c90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffbac007fc0 tx=0x7ffbac01cb40 comp rx=0 tx=0).stop 2024-04-25T03:09:35.030 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.030+0000 7ffbc5647640 1 -- 172.21.15.162:0/3912044626 reap_dead start 2024-04-25T03:09:35.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.030+0000 7ffbc70aa640 1 -- 172.21.15.162:0/3912044626 shutdown_connections 2024-04-25T03:09:35.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.030+0000 7ffbc70aa640 1 -- 172.21.15.162:0/3912044626 >> 172.21.15.162:0/3912044626 conn(0x7ffbc006b210 msgr2=0x7ffbc006b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:35.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.030+0000 7ffbc70aa640 1 -- 172.21.15.162:0/3912044626 shutdown_connections 2024-04-25T03:09:35.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.030+0000 7ffbc70aa640 1 -- 172.21.15.162:0/3912044626 wait complete. 2024-04-25T03:09:35.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.030+0000 7ffbc70aa640 1 Processor -- start 2024-04-25T03:09:35.031 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.030+0000 7ffbc70aa640 1 -- start start 2024-04-25T03:09:35.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.030+0000 7ffbc70aa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb0004810 0x7ffbc0137520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:35.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.030+0000 7ffbc70aa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc01f25a0 0x7ffbc0136560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:35.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.030+0000 7ffbc70aa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc00cac00 0x7ffbc0151160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:35.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.030+0000 7ffbc70aa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc00c55e0 con 0x7ffbb0004810 2024-04-25T03:09:35.032 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.030+0000 7ffbc70aa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ffbc015c050 con 0x7ffbc01f25a0 2024-04-25T03:09:35.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.030+0000 7ffbc70aa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ffbc00c5760 con 0x7ffbc00cac00 2024-04-25T03:09:35.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.034+0000 7ffbc4e46640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb0004810 0x7ffbc0137520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:35.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.034+0000 7ffbc4e46640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb0004810 0x7ffbc0137520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55362/0 (socket says 172.21.15.162:55362) 2024-04-25T03:09:35.033 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.034+0000 7ffbc4e46640 1 -- 172.21.15.162:0/3872476302 learned_addr learned my addr 172.21.15.162:0/3872476302 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:35.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.034+0000 7ffbc5647640 1 --2- 172.21.15.162:0/3872476302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc00cac00 0x7ffbc0151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:35.034 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.034+0000 7ffbbffff640 1 --2- 172.21.15.162:0/3872476302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc01f25a0 0x7ffbc0136560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:35.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.038+0000 7ffbc4e46640 1 -- 172.21.15.162:0/3872476302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc00cac00 msgr2=0x7ffbc0151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:35.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.038+0000 7ffbc4e46640 1 --2- 172.21.15.162:0/3872476302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc00cac00 0x7ffbc0151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:35.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.038+0000 7ffbc4e46640 1 -- 172.21.15.162:0/3872476302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc01f25a0 msgr2=0x7ffbc0136560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:35.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.038+0000 7ffbc4e46640 1 --2- 172.21.15.162:0/3872476302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc01f25a0 0x7ffbc0136560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:35.037 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.038+0000 7ffbc4e46640 1 -- 172.21.15.162:0/3872476302 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbc0138450 con 0x7ffbb0004810 2024-04-25T03:09:35.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.038+0000 7ffbc4e46640 1 --2- 172.21.15.162:0/3872476302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb0004810 0x7ffbc0137520 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40107c0 tx=0x7ffbb4010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:35.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.042+0000 7ffbbd7fa640 1 -- 172.21.15.162:0/3872476302 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb400f040 con 0x7ffbb0004810 2024-04-25T03:09:35.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.042+0000 7ffbbd7fa640 1 -- 172.21.15.162:0/3872476302 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffbb400e950 con 0x7ffbb0004810 2024-04-25T03:09:35.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.042+0000 7ffbbd7fa640 1 -- 172.21.15.162:0/3872476302 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffbb400ed40 con 0x7ffbb0004810 2024-04-25T03:09:35.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.042+0000 7ffbc70aa640 1 -- 172.21.15.162:0/3872476302 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbc0137df0 con 0x7ffbb0004810 2024-04-25T03:09:35.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.042+0000 7ffbc70aa640 1 -- 172.21.15.162:0/3872476302 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbc01355d0 con 0x7ffbb0004810 2024-04-25T03:09:35.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.046+0000 7ffbc70aa640 1 -- 172.21.15.162:0/3872476302 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbc0068310 con 0x7ffbb0004810 2024-04-25T03:09:35.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.062+0000 7ffbbd7fa640 1 -- 172.21.15.162:0/3872476302 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffbb401c400 con 0x7ffbb0004810 2024-04-25T03:09:35.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.062+0000 7ffbbd7fa640 1 --2- 172.21.15.162:0/3872476302 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ffba4067940 0x7ffba4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:35.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.062+0000 7ffbbffff640 1 --2- 172.21.15.162:0/3872476302 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ffba4067940 0x7ffba4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:35.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.066+0000 7ffbbffff640 1 --2- 172.21.15.162:0/3872476302 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ffba4067940 0x7ffba4069e00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ffbac001410 tx=0x7ffbac0b1040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:35.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.066+0000 7ffbbd7fa640 1 -- 172.21.15.162:0/3872476302 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7ffbb4054740 con 0x7ffbb0004810 2024-04-25T03:09:35.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.382+0000 7ffbbd7fa640 1 -- 172.21.15.162:0/3872476302 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ffbc0137df0 con 0x7ffbb0004810 2024-04-25T03:09:35.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.558+0000 7ffbc70aa640 1 -- 172.21.15.162:0/3872476302 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffbc0072120 con 0x7ffbb0004810 2024-04-25T03:09:35.570 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.570+0000 7ffbbd7fa640 1 -- 172.21.15.162:0/3872476302 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7ffbb4018030 con 0x7ffbb0004810 2024-04-25T03:09:35.570 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-04-25T03:09:35.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.570+0000 7ffbc70aa640 1 -- 172.21.15.162:0/3872476302 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ffba4067940 msgr2=0x7ffba4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:35.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.570+0000 7ffbc70aa640 1 --2- 172.21.15.162:0/3872476302 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ffba4067940 0x7ffba4069e00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ffbac001410 tx=0x7ffbac0b1040 comp rx=0 tx=0).stop 2024-04-25T03:09:35.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.570+0000 7ffbc70aa640 1 -- 172.21.15.162:0/3872476302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb0004810 msgr2=0x7ffbc0137520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:35.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.570+0000 7ffbc70aa640 1 --2- 172.21.15.162:0/3872476302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb0004810 0x7ffbc0137520 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffbb40107c0 tx=0x7ffbb4010c80 comp rx=0 tx=0).stop 2024-04-25T03:09:35.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.570+0000 7ffbc70aa640 1 -- 172.21.15.162:0/3872476302 shutdown_connections 2024-04-25T03:09:35.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.570+0000 7ffbc70aa640 1 --2- 172.21.15.162:0/3872476302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ffbc00cac00 0x7ffbc0151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:35.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.570+0000 7ffbc70aa640 1 --2- 172.21.15.162:0/3872476302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ffbc01f25a0 0x7ffbc0136560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:35.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.570+0000 7ffbc70aa640 1 --2- 172.21.15.162:0/3872476302 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ffba4067940 0x7ffba4069e00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:35.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.570+0000 7ffbc70aa640 1 --2- 172.21.15.162:0/3872476302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ffbb0004810 0x7ffbc0137520 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:35.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.570+0000 7ffbc70aa640 1 -- 172.21.15.162:0/3872476302 >> 172.21.15.162:0/3872476302 conn(0x7ffbc006b210 msgr2=0x7ffbc00c9c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:35.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.570+0000 7ffbc70aa640 1 -- 172.21.15.162:0/3872476302 shutdown_connections 2024-04-25T03:09:35.573 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.570+0000 7ffbc70aa640 1 -- 172.21.15.162:0/3872476302 wait complete. 2024-04-25T03:09:35.591 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T03:09:35.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.714+0000 7fa771c4f640 1 Processor -- start 2024-04-25T03:09:35.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.714+0000 7fa771c4f640 1 -- start start 2024-04-25T03:09:35.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.714+0000 7fa771c4f640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fa76c15acc0 0x7fa76c0c9680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:35.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.714+0000 7fa771c4f640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa76c0ca830 con 0x7fa76c1546e0 2024-04-25T03:09:35.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.714+0000 7fa771c4f640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa76c0caaf0 con 0x7fa76c15b0e0 2024-04-25T03:09:35.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.714+0000 7fa771c4f640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fa76c0ca600 con 0x7fa76c15acc0 2024-04-25T03:09:35.716 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.714+0000 7fa76bfff640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fa76c15b0e0 0x7fa76c164dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:36416/0 (socket says 172.21.15.162:36416) 2024-04-25T03:09:35.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.714+0000 7fa76bfff640 1 -- 172.21.15.162:0/3948543051 learned_addr learned my addr 172.21.15.162:0/3948543051 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:09:35.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.718+0000 7fa76affd640 1 --2- 172.21.15.162:0/3948543051 >> v2:172.21.15.162:3300/0 conn(0x7fa76c15acc0 0x7fa76c0c9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:35.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.722+0000 7fa76a7fc640 1 -- 172.21.15.162:0/3948543051 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3533957825 0 0) 0x7fa76c0caaf0 con 0x7fa76c15b0e0 2024-04-25T03:09:35.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.722+0000 7fa76a7fc640 1 -- 172.21.15.162:0/3948543051 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa754003530 con 0x7fa76c15b0e0 2024-04-25T03:09:35.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.722+0000 7fa76affd640 1 -- 172.21.15.162:0/3948543051 >> v1:172.21.15.179:6789/0 conn(0x7fa76c15b0e0 legacy=0x7fa76c164dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:35.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.722+0000 7fa76affd640 1 -- 172.21.15.162:0/3948543051 >> v1:172.21.15.162:6789/0 conn(0x7fa76c1546e0 legacy=0x7fa76c0c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:35.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.722+0000 7fa76affd640 1 -- 172.21.15.162:0/3948543051 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76c0cadd0 con 0x7fa76c15acc0 2024-04-25T03:09:35.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.726+0000 7fa76affd640 1 --2- 172.21.15.162:0/3948543051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa76c15acc0 0x7fa76c0c9680 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa7600097c0 tx=0x7fa76001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f492a33c3beef1ff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:35.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.734+0000 7fa76a7fc640 1 -- 172.21.15.162:0/3948543051 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7600b5070 con 0x7fa76c15acc0 2024-04-25T03:09:35.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.734+0000 7fa76a7fc640 1 -- 172.21.15.162:0/3948543051 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7600a8990 con 0x7fa76c15acc0 2024-04-25T03:09:35.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.734+0000 7fa76a7fc640 1 -- 172.21.15.162:0/3948543051 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7600a8d60 con 0x7fa76c15acc0 2024-04-25T03:09:35.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.734+0000 7fa771c4f640 1 -- 172.21.15.162:0/3948543051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa76c15acc0 msgr2=0x7fa76c0c9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:35.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.734+0000 7fa771c4f640 1 --2- 172.21.15.162:0/3948543051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa76c15acc0 0x7fa76c0c9680 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa7600097c0 tx=0x7fa76001ec90 comp rx=0 tx=0).stop 2024-04-25T03:09:35.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.734+0000 7fa771c4f640 1 -- 172.21.15.162:0/3948543051 shutdown_connections 2024-04-25T03:09:35.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.734+0000 7fa771c4f640 1 --2- 172.21.15.162:0/3948543051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa76c15acc0 0x7fa76c0c9680 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:35.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.734+0000 7fa771c4f640 1 -- 172.21.15.162:0/3948543051 >> 172.21.15.162:0/3948543051 conn(0x7fa76c071440 msgr2=0x7fa76c071820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:35.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.734+0000 7fa771c4f640 1 -- 172.21.15.162:0/3948543051 shutdown_connections 2024-04-25T03:09:35.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.734+0000 7fa771c4f640 1 -- 172.21.15.162:0/3948543051 wait complete. 2024-04-25T03:09:35.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.738+0000 7fa771c4f640 1 Processor -- start 2024-04-25T03:09:35.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.738+0000 7fa771c4f640 1 -- start start 2024-04-25T03:09:35.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.738+0000 7fa771c4f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa76c1546e0 0x7fa76c1571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:35.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.738+0000 7fa771c4f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa76c15acc0 0x7fa76c14bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:35.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.738+0000 7fa771c4f640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa76c15b0e0 0x7fa76c0c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:35.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.738+0000 7fa771c4f640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c15a7a0 con 0x7fa76c1546e0 2024-04-25T03:09:35.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.738+0000 7fa771c4f640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c0cb390 con 0x7fa76c15b0e0 2024-04-25T03:09:35.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.738+0000 7fa771c4f640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa76c15a450 con 0x7fa76c15acc0 2024-04-25T03:09:35.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.738+0000 7fa76bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa76c15b0e0 0x7fa76c0c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:35.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.742+0000 7fa76affd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa76c15acc0 0x7fa76c14bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:35.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.742+0000 7fa76bfff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa76c15b0e0 0x7fa76c0c3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:44426/0 (socket says 172.21.15.162:44426) 2024-04-25T03:09:35.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.742+0000 7fa76bfff640 1 -- 172.21.15.162:0/1765553904 learned_addr learned my addr 172.21.15.162:0/1765553904 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:35.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.750+0000 7fa76bfff640 1 -- 172.21.15.162:0/1765553904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa76c15acc0 msgr2=0x7fa76c14bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:35.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.750+0000 7fa76bfff640 1 --2- 172.21.15.162:0/1765553904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa76c15acc0 0x7fa76c14bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:35.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.750+0000 7fa76bfff640 1 -- 172.21.15.162:0/1765553904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa76c1546e0 msgr2=0x7fa76c1571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:35.751 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.750+0000 7fa76bfff640 1 --2- 172.21.15.162:0/1765553904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa76c1546e0 0x7fa76c1571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:35.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.750+0000 7fa76bfff640 1 -- 172.21.15.162:0/1765553904 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76c06bca0 con 0x7fa76c15b0e0 2024-04-25T03:09:35.757 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.758+0000 7fa76bfff640 1 --2- 172.21.15.162:0/1765553904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa76c15b0e0 0x7fa76c0c3b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00c390 tx=0x7fa75c00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:35.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.870+0000 7fa753fff640 1 -- 172.21.15.162:0/1765553904 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c017070 con 0x7fa76c15b0e0 2024-04-25T03:09:35.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.870+0000 7fa753fff640 1 -- 172.21.15.162:0/1765553904 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa75c005cf0 con 0x7fa76c15b0e0 2024-04-25T03:09:35.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.870+0000 7fa753fff640 1 -- 172.21.15.162:0/1765553904 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0072d0 con 0x7fa76c15b0e0 2024-04-25T03:09:35.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.870+0000 7fa771c4f640 1 -- 172.21.15.162:0/1765553904 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa76c068520 con 0x7fa76c15b0e0 2024-04-25T03:09:35.869 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.870+0000 7fa771c4f640 1 -- 172.21.15.162:0/1765553904 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa76c1f0600 con 0x7fa76c15b0e0 2024-04-25T03:09:35.870 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:35.870+0000 7fa771c4f640 1 -- 172.21.15.162:0/1765553904 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa76c068310 con 0x7fa76c15b0e0 2024-04-25T03:09:36.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.182+0000 7fa753fff640 1 -- 172.21.15.162:0/1765553904 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa75c01a070 con 0x7fa76c15b0e0 2024-04-25T03:09:36.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.182+0000 7fa753fff640 1 --2- 172.21.15.162:0/1765553904 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa758067910 0x7fa758069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:36.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.182+0000 7fa76b7fe640 1 --2- 172.21.15.162:0/1765553904 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa758067910 0x7fa758069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:36.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.182+0000 7fa76b7fe640 1 --2- 172.21.15.162:0/1765553904 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa758067910 0x7fa758069dd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa764007fd0 tx=0x7fa764007d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:36.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.194+0000 7fa753fff640 1 -- 172.21.15.162:0/1765553904 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7fa75c053900 con 0x7fa76c15b0e0 2024-04-25T03:09:36.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.222+0000 7fa753fff640 1 -- 172.21.15.162:0/1765553904 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fa75c055860 con 0x7fa76c15b0e0 2024-04-25T03:09:36.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.414+0000 7fa771c4f640 1 -- 172.21.15.162:0/1765553904 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa76c0c9460 con 0x7fa76c15b0e0 2024-04-25T03:09:36.424 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.422+0000 7fa753fff640 1 -- 172.21.15.162:0/1765553904 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7fa75c059b60 con 0x7fa76c15b0e0 2024-04-25T03:09:36.424 INFO:teuthology.orchestra.run.smithi162.stderr:listed 0 entries 2024-04-25T03:09:36.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.426+0000 7fa771c4f640 1 -- 172.21.15.162:0/1765553904 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa758067910 msgr2=0x7fa758069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:36.426 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.426+0000 7fa771c4f640 1 --2- 172.21.15.162:0/1765553904 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa758067910 0x7fa758069dd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa764007fd0 tx=0x7fa764007d60 comp rx=0 tx=0).stop 2024-04-25T03:09:36.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.426+0000 7fa771c4f640 1 -- 172.21.15.162:0/1765553904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa76c15b0e0 msgr2=0x7fa76c0c3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:36.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.426+0000 7fa771c4f640 1 --2- 172.21.15.162:0/1765553904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa76c15b0e0 0x7fa76c0c3b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa75c00c390 tx=0x7fa75c00c850 comp rx=0 tx=0).stop 2024-04-25T03:09:36.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.426+0000 7fa771c4f640 1 -- 172.21.15.162:0/1765553904 shutdown_connections 2024-04-25T03:09:36.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.426+0000 7fa771c4f640 1 --2- 172.21.15.162:0/1765553904 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa76c15b0e0 0x7fa76c0c3b10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:36.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.426+0000 7fa771c4f640 1 --2- 172.21.15.162:0/1765553904 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa76c15acc0 0x7fa76c14bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:36.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.426+0000 7fa771c4f640 1 --2- 172.21.15.162:0/1765553904 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa758067910 0x7fa758069dd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:36.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.426+0000 7fa771c4f640 1 --2- 172.21.15.162:0/1765553904 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa76c1546e0 0x7fa76c1571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:36.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.426+0000 7fa771c4f640 1 -- 172.21.15.162:0/1765553904 >> 172.21.15.162:0/1765553904 conn(0x7fa76c071440 msgr2=0x7fa76c152e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:36.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.426+0000 7fa771c4f640 1 -- 172.21.15.162:0/1765553904 shutdown_connections 2024-04-25T03:09:36.427 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.426+0000 7fa771c4f640 1 -- 172.21.15.162:0/1765553904 wait complete. 2024-04-25T03:09:36.445 DEBUG:teuthology.orchestra.run.smithi162:> set -ex 2024-04-25T03:09:36.445 DEBUG:teuthology.orchestra.run.smithi162:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T03:09:36.452 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T03:09:36.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.618+0000 7f815b2de640 1 Processor -- start 2024-04-25T03:09:36.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.618+0000 7f815b2de640 1 -- start start 2024-04-25T03:09:36.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.618+0000 7f815b2de640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81540c6f60 0x7f8154073120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:36.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.618+0000 7f815b2de640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81540c2dc0 con 0x7f8154150b90 2024-04-25T03:09:36.618 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.618+0000 7f815b2de640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81540c3080 con 0x7f81540c7890 2024-04-25T03:09:36.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.618+0000 7f815b2de640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f81540c3360 con 0x7f81540c6f60 2024-04-25T03:09:36.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.618+0000 7f815907a640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f8154150b90 0x7f815406daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44906/0 (socket says 172.21.15.162:44906) 2024-04-25T03:09:36.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.618+0000 7f815907a640 1 -- 172.21.15.162:0/3267867057 learned_addr learned my addr 172.21.15.162:0/3267867057 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:09:36.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.618+0000 7f8158879640 1 --2- 172.21.15.162:0/3267867057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81540c6f60 0x7f8154073120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:36.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.622+0000 7f814bfff640 1 -- 172.21.15.162:0/3267867057 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1378399492 0 0) 0x7f81540c2dc0 con 0x7f8154150b90 2024-04-25T03:09:36.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.622+0000 7f814bfff640 1 -- 172.21.15.162:0/3267867057 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8140003530 con 0x7f8154150b90 2024-04-25T03:09:36.626 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.626+0000 7f814bfff640 1 -- 172.21.15.162:0/3267867057 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 653309931 0 0) 0x7f8140003530 con 0x7f8154150b90 2024-04-25T03:09:36.626 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.626+0000 7f814bfff640 1 -- 172.21.15.162:0/3267867057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81540c6f60 msgr2=0x7f8154073120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:36.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.626+0000 7f814bfff640 1 --2- 172.21.15.162:0/3267867057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81540c6f60 0x7f8154073120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:36.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.626+0000 7f814bfff640 1 -- 172.21.15.162:0/3267867057 >> v1:172.21.15.179:6789/0 conn(0x7f81540c7890 legacy=0x7f8154161100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:36.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.626+0000 7f814bfff640 1 -- 172.21.15.162:0/3267867057 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81540c6510 con 0x7f8154150b90 2024-04-25T03:09:36.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.626+0000 7f814bfff640 1 -- 172.21.15.162:0/3267867057 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7f8150001680 con 0x7f8154150b90 2024-04-25T03:09:36.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.626+0000 7f814bfff640 1 -- 172.21.15.162:0/3267867057 >> v1:172.21.15.162:6789/0 conn(0x7f8154150b90 legacy=0x7f815406daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:36.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.626+0000 7f814bfff640 1 --2- 172.21.15.162:0/3267867057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81400039f0 0x7f8140003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:36.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.626+0000 7f814bfff640 1 --2- 172.21.15.162:0/3267867057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8140004810 0x7f8140004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:36.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.626+0000 7f814bfff640 1 --2- 172.21.15.162:0/3267867057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81540c6f60 0x7f81400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:36.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.626+0000 7f814bfff640 1 -- 172.21.15.162:0/3267867057 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f814000bab0 con 0x7f81400039f0 2024-04-25T03:09:36.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.626+0000 7f814bfff640 1 -- 172.21.15.162:0/3267867057 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f814000bc60 con 0x7f8140004810 2024-04-25T03:09:36.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.626+0000 7f814bfff640 1 -- 172.21.15.162:0/3267867057 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f814000be60 con 0x7f81540c6f60 2024-04-25T03:09:36.628 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.626+0000 7f815907a640 1 --2- 172.21.15.162:0/3267867057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81400039f0 0x7f8140003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:36.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.630+0000 7f8158879640 1 --2- 172.21.15.162:0/3267867057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8140004810 0x7f8140004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:36.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.630+0000 7f815907a640 1 -- 172.21.15.162:0/3267867057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81540c6f60 msgr2=0x7f81400051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:36.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.630+0000 7f815907a640 1 --2- 172.21.15.162:0/3267867057 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f81540c6f60 0x7f81400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:36.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.630+0000 7f815907a640 1 -- 172.21.15.162:0/3267867057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8140004810 msgr2=0x7f8140004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:36.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.630+0000 7f815907a640 1 --2- 172.21.15.162:0/3267867057 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f8140004810 0x7f8140004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:36.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.630+0000 7f815907a640 1 -- 172.21.15.162:0/3267867057 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8140003530 con 0x7f81400039f0 2024-04-25T03:09:36.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.634+0000 7f815907a640 1 --2- 172.21.15.162:0/3267867057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81400039f0 0x7f8140003e10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f815000c0e0 tx=0x7f815001cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4941de6ce1dd6440 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:36.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.638+0000 7f814bfff640 1 -- 172.21.15.162:0/3267867057 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8150007c30 con 0x7f81400039f0 2024-04-25T03:09:36.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.638+0000 7f814bfff640 1 -- 172.21.15.162:0/3267867057 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81500a9020 con 0x7f81400039f0 2024-04-25T03:09:36.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.638+0000 7f814bfff640 1 -- 172.21.15.162:0/3267867057 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8150005b00 con 0x7f81400039f0 2024-04-25T03:09:36.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.638+0000 7f815b2de640 1 -- 172.21.15.162:0/3267867057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81400039f0 msgr2=0x7f8140003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:36.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.638+0000 7f815b2de640 1 --2- 172.21.15.162:0/3267867057 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f81400039f0 0x7f8140003e10 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f815000c0e0 tx=0x7f815001cb40 comp rx=0 tx=0).stop 2024-04-25T03:09:36.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.638+0000 7f815987b640 1 -- 172.21.15.162:0/3267867057 reap_dead start 2024-04-25T03:09:36.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.638+0000 7f815b2de640 1 -- 172.21.15.162:0/3267867057 shutdown_connections 2024-04-25T03:09:36.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.638+0000 7f815b2de640 1 -- 172.21.15.162:0/3267867057 >> 172.21.15.162:0/3267867057 conn(0x7f81540c83c0 msgr2=0x7f81540c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:36.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.638+0000 7f815b2de640 1 -- 172.21.15.162:0/3267867057 shutdown_connections 2024-04-25T03:09:36.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.638+0000 7f815b2de640 1 -- 172.21.15.162:0/3267867057 wait complete. 2024-04-25T03:09:36.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.642+0000 7f815b2de640 1 Processor -- start 2024-04-25T03:09:36.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.642+0000 7f815b2de640 1 -- start start 2024-04-25T03:09:36.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.642+0000 7f815b2de640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f815414d200 0x7f81541f3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:36.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.642+0000 7f815b2de640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f815414d5e0 0x7f81541efd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:36.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.642+0000 7f815b2de640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81541f3a50 0x7f81541f0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:36.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.642+0000 7f815b2de640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8154073530 con 0x7f815414d5e0 2024-04-25T03:09:36.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.642+0000 7f815b2de640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f81540c62c0 con 0x7f81541f3a50 2024-04-25T03:09:36.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.642+0000 7f815b2de640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f8154072bf0 con 0x7f815414d200 2024-04-25T03:09:36.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.642+0000 7f8158879640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f815414d5e0 0x7f81541efd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:36.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.642+0000 7f8158879640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f815414d5e0 0x7f81541efd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55390/0 (socket says 172.21.15.162:55390) 2024-04-25T03:09:36.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.642+0000 7f8158879640 1 -- 172.21.15.162:0/2493100061 learned_addr learned my addr 172.21.15.162:0/2493100061 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:36.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.642+0000 7f815987b640 1 --2- 172.21.15.162:0/2493100061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81541f3a50 0x7f81541f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:36.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.642+0000 7f815907a640 1 --2- 172.21.15.162:0/2493100061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f815414d200 0x7f81541f3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:36.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.646+0000 7f8158879640 1 -- 172.21.15.162:0/2493100061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f815414d200 msgr2=0x7f81541f3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:36.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.646+0000 7f8158879640 1 --2- 172.21.15.162:0/2493100061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f815414d200 0x7f81541f3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:36.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.646+0000 7f8158879640 1 -- 172.21.15.162:0/2493100061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81541f3a50 msgr2=0x7f81541f0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:36.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.646+0000 7f8158879640 1 --2- 172.21.15.162:0/2493100061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81541f3a50 0x7f81541f0250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:36.647 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.646+0000 7f8158879640 1 -- 172.21.15.162:0/2493100061 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81541ef8e0 con 0x7f815414d5e0 2024-04-25T03:09:36.650 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.650+0000 7f8158879640 1 --2- 172.21.15.162:0/2493100061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f815414d5e0 0x7f81541efd10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f814400f980 tx=0x7f814400fe40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:36.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.654+0000 7f8149ffb640 1 -- 172.21.15.162:0/2493100061 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814400b040 con 0x7f815414d5e0 2024-04-25T03:09:36.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.654+0000 7f8149ffb640 1 -- 172.21.15.162:0/2493100061 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f814400dbf0 con 0x7f815414d5e0 2024-04-25T03:09:36.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.654+0000 7f8149ffb640 1 -- 172.21.15.162:0/2493100061 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8144012460 con 0x7f815414d5e0 2024-04-25T03:09:36.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.654+0000 7f815b2de640 1 -- 172.21.15.162:0/2493100061 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f815414a7a0 con 0x7f815414d5e0 2024-04-25T03:09:36.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.654+0000 7f815b2de640 1 -- 172.21.15.162:0/2493100061 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81541469e0 con 0x7f815414d5e0 2024-04-25T03:09:36.654 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.654+0000 7f815b2de640 1 -- 172.21.15.162:0/2493100061 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81541f2e50 con 0x7f815414d5e0 2024-04-25T03:09:36.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.674+0000 7f8149ffb640 1 -- 172.21.15.162:0/2493100061 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8144012600 con 0x7f815414d5e0 2024-04-25T03:09:36.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.674+0000 7f8149ffb640 1 --2- 172.21.15.162:0/2493100061 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f81380678b0 0x7f8138069d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:36.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.674+0000 7f815907a640 1 --2- 172.21.15.162:0/2493100061 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f81380678b0 0x7f8138069d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:36.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.674+0000 7f815907a640 1 --2- 172.21.15.162:0/2493100061 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f81380678b0 0x7f8138069d70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f81500aa000 tx=0x7f81540c4750 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:36.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.950+0000 7f8149ffb640 1 -- 172.21.15.162:0/2493100061 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f8144054ac0 con 0x7f815414d5e0 2024-04-25T03:09:36.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:36.950+0000 7f8149ffb640 1 -- 172.21.15.162:0/2493100061 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f8144017070 con 0x7f815414d5e0 2024-04-25T03:09:37.125 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.122+0000 7f815b2de640 1 -- 172.21.15.162:0/2493100061 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81540c34f0 con 0x7f815414d5e0 2024-04-25T03:09:37.235 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.234+0000 7f8149ffb640 1 -- 172.21.15.162:0/2493100061 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+16835 (secure 0 0 0) 0x7f8144056a20 con 0x7f815414d5e0 2024-04-25T03:09:37.236 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T03:09:37.236 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":28,"fsid":"e141deed-4794-4a17-83c9-f6e6e8875f5e","created":"2024-04-25T00:49:29.904605+0000","modified":"2024-04-25T00:51:40.137155+0000","last_up_change":"2024-04-25T00:49:51.119342+0000","last_in_change":"2024-04-25T00:49:39.898293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T00:49:52.297093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T00:50:31.644475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T00:50:33.242786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e20986cc-3664-4988-959c-c0b02e380775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6811","nonce":2734546478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6813","nonce":2734546478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6817","nonce":2734546478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6815","nonce":2734546478}]},"public_addr":"172.21.15.162:6811/2734546478","cluster_addr":"172.21.15.162:6813/2734546478","heartbeat_back_addr":"172.21.15.162:6817/2734546478","heartbeat_front_addr":"172.21.15.162:6815/2734546478","state":["exists","up"]},{"osd":1,"uuid":"60f1608a-ecb7-4978-b816-ce6f419e275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6803","nonce":3488816098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6805","nonce":3488816098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6809","nonce":3488816098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6807","nonce":3488816098}]},"public_addr":"172.21.15.162:6803/3488816098","cluster_addr":"172.21.15.162:6805/3488816098","heartbeat_back_addr":"172.21.15.162:6809/3488816098","heartbeat_front_addr":"172.21.15.162:6807/3488816098","state":["exists","up"]},{"osd":2,"uuid":"77552061-8e19-4f49-bc3f-1300955a07b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6819","nonce":234337516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6821","nonce":234337516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6825","nonce":234337516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6823","nonce":234337516}]},"public_addr":"172.21.15.162:6819/234337516","cluster_addr":"172.21.15.162:6821/234337516","heartbeat_back_addr":"172.21.15.162:6825/234337516","heartbeat_front_addr":"172.21.15.162:6823/234337516","state":["exists","up"]},{"osd":3,"uuid":"5b105720-6e6d-4143-b5c4-0a3b1e4a687c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6827","nonce":1726903362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6829","nonce":1726903362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6833","nonce":1726903362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6831","nonce":1726903362}]},"public_addr":"172.21.15.162:6827/1726903362","cluster_addr":"172.21.15.162:6829/1726903362","heartbeat_back_addr":"172.21.15.162:6833/1726903362","heartbeat_front_addr":"172.21.15.162:6831/1726903362","state":["exists","up"]},{"osd":4,"uuid":"611eafc5-2fe0-4c96-ba8c-b1efc3930de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6817","nonce":3338082657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6819","nonce":3338082657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6823","nonce":3338082657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6821","nonce":3338082657}]},"public_addr":"172.21.15.179:6817/3338082657","cluster_addr":"172.21.15.179:6819/3338082657","heartbeat_back_addr":"172.21.15.179:6823/3338082657","heartbeat_front_addr":"172.21.15.179:6821/3338082657","state":["exists","up"]},{"osd":5,"uuid":"b39487f5-c314-4026-90bd-02e30ecca04f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6825","nonce":4129338239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6827","nonce":4129338239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6831","nonce":4129338239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6829","nonce":4129338239}]},"public_addr":"172.21.15.179:6825/4129338239","cluster_addr":"172.21.15.179:6827/4129338239","heartbeat_back_addr":"172.21.15.179:6831/4129338239","heartbeat_front_addr":"172.21.15.179:6829/4129338239","state":["exists","up"]},{"osd":6,"uuid":"1d902755-f992-4070-b30e-e79f5fb22d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6801","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6802","nonce":823843016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6806","nonce":823843016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6815","nonce":823843016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6810","nonce":823843016}]},"public_addr":"172.21.15.179:6802/823843016","cluster_addr":"172.21.15.179:6806/823843016","heartbeat_back_addr":"172.21.15.179:6815/823843016","heartbeat_front_addr":"172.21.15.179:6810/823843016","state":["exists","up"]},{"osd":7,"uuid":"ea529f85-28fd-4dc3-a584-314e71999061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6803","nonce":3403659125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6807","nonce":3403659125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6814","nonce":3403659125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6811","nonce":3403659125}]},"public_addr":"172.21.15.179:6803/3403659125","cluster_addr":"172.21.15.179:6807/3403659125","heartbeat_back_addr":"172.21.15.179:6814/3403659125","heartbeat_front_addr":"172.21.15.179:6811/3403659125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.684518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.583123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.644576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.815957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.787155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.814409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.657210+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.676697+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T03:09:37.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.238+0000 7f815b2de640 1 -- 172.21.15.162:0/2493100061 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f81380678b0 msgr2=0x7f8138069d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:37.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.238+0000 7f815b2de640 1 --2- 172.21.15.162:0/2493100061 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f81380678b0 0x7f8138069d70 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f81500aa000 tx=0x7f81540c4750 comp rx=0 tx=0).stop 2024-04-25T03:09:37.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.238+0000 7f815b2de640 1 -- 172.21.15.162:0/2493100061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f815414d5e0 msgr2=0x7f81541efd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:37.238 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.238+0000 7f815b2de640 1 --2- 172.21.15.162:0/2493100061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f815414d5e0 0x7f81541efd10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f814400f980 tx=0x7f814400fe40 comp rx=0 tx=0).stop 2024-04-25T03:09:37.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.238+0000 7f815b2de640 1 -- 172.21.15.162:0/2493100061 shutdown_connections 2024-04-25T03:09:37.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.238+0000 7f815b2de640 1 --2- 172.21.15.162:0/2493100061 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f81541f3a50 0x7f81541f0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:37.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.238+0000 7f815b2de640 1 --2- 172.21.15.162:0/2493100061 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f81380678b0 0x7f8138069d70 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:37.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.238+0000 7f815b2de640 1 --2- 172.21.15.162:0/2493100061 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f815414d5e0 0x7f81541efd10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:37.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.238+0000 7f815b2de640 1 --2- 172.21.15.162:0/2493100061 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f815414d200 0x7f81541f3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:37.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.238+0000 7f815b2de640 1 -- 172.21.15.162:0/2493100061 >> 172.21.15.162:0/2493100061 conn(0x7f81540c83c0 msgr2=0x7f81540c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:37.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.238+0000 7f815b2de640 1 -- 172.21.15.162:0/2493100061 shutdown_connections 2024-04-25T03:09:37.239 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.238+0000 7f815b2de640 1 -- 172.21.15.162:0/2493100061 wait complete. 2024-04-25T03:09:37.259 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T00:49:52.297093+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T00:50:31.644475+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T00:50:33.242786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T03:09:37.260 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T03:09:37.389 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.390+0000 7f1ecee4c640 1 Processor -- start 2024-04-25T03:09:37.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.390+0000 7f1ecee4c640 1 -- start start 2024-04-25T03:09:37.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.390+0000 7f1ecee4c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1ec8141760 0x7f1ec815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:37.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.390+0000 7f1ecee4c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ec806dbd0 0x7f1ec80c8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:37.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.390+0000 7f1ecee4c640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ec80c6a80 con 0x7f1ec8141380 2024-04-25T03:09:37.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.390+0000 7f1ecee4c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1ec806e080 con 0x7f1ec8141760 2024-04-25T03:09:37.390 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.390+0000 7f1ecee4c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec80c7040 con 0x7f1ec806dbd0 2024-04-25T03:09:37.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.390+0000 7f1ec7fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1ec8141760 0x7f1ec815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:37.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.390+0000 7f1eccbe8640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f1ec8141380 0x7f1ec80c6240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44910/0 (socket says 172.21.15.162:44910) 2024-04-25T03:09:37.391 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.390+0000 7f1eccbe8640 1 -- 172.21.15.162:0/2973963776 learned_addr learned my addr 172.21.15.162:0/2973963776 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:09:37.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.390+0000 7f1ecd3e9640 1 --2- 172.21.15.162:0/2973963776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ec806dbd0 0x7f1ec80c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:37.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.394+0000 7f1ec7fff640 1 -- 172.21.15.162:0/2973963776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ec806dbd0 msgr2=0x7f1ec80c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:37.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.394+0000 7f1ec7fff640 1 --2- 172.21.15.162:0/2973963776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ec806dbd0 0x7f1ec80c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:37.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.394+0000 7f1ec7fff640 1 -- 172.21.15.162:0/2973963776 >> v1:172.21.15.162:6789/0 conn(0x7f1ec8141380 legacy=0x7f1ec80c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:37.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.394+0000 7f1ec7fff640 1 -- 172.21.15.162:0/2973963776 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec80c6d60 con 0x7f1ec8141760 2024-04-25T03:09:37.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.394+0000 7f1ecd3e9640 1 --2- 172.21.15.162:0/2973963776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ec806dbd0 0x7f1ec80c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T03:09:37.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.398+0000 7f1ec7fff640 1 --2- 172.21.15.162:0/2973963776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec8141760 0x7f1ec815c4e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40097c0 tx=0x7f1eb401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=519e8fcd3b6d1439 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:37.402 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.402+0000 7f1ec77fe640 1 -- 172.21.15.162:0/2973963776 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb40b0070 con 0x7f1ec8141760 2024-04-25T03:09:37.402 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.402+0000 7f1ec77fe640 1 -- 172.21.15.162:0/2973963776 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb40ab600 con 0x7f1ec8141760 2024-04-25T03:09:37.402 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.402+0000 7f1ec77fe640 1 -- 172.21.15.162:0/2973963776 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb40ab9d0 con 0x7f1ec8141760 2024-04-25T03:09:37.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.402+0000 7f1ecee4c640 1 -- 172.21.15.162:0/2973963776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec8141760 msgr2=0x7f1ec815c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:37.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.402+0000 7f1ecee4c640 1 --2- 172.21.15.162:0/2973963776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec8141760 0x7f1ec815c4e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40097c0 tx=0x7f1eb401c410 comp rx=0 tx=0).stop 2024-04-25T03:09:37.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.402+0000 7f1ecee4c640 1 -- 172.21.15.162:0/2973963776 shutdown_connections 2024-04-25T03:09:37.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.402+0000 7f1ecee4c640 1 --2- 172.21.15.162:0/2973963776 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ec806dbd0 0x7f1ec80c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:37.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.402+0000 7f1ecee4c640 1 --2- 172.21.15.162:0/2973963776 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec8141760 0x7f1ec815c4e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:37.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.402+0000 7f1ecee4c640 1 -- 172.21.15.162:0/2973963776 >> 172.21.15.162:0/2973963776 conn(0x7f1ec806b210 msgr2=0x7f1ec806b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:37.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.402+0000 7f1ecee4c640 1 -- 172.21.15.162:0/2973963776 shutdown_connections 2024-04-25T03:09:37.403 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.402+0000 7f1ecee4c640 1 -- 172.21.15.162:0/2973963776 wait complete. 2024-04-25T03:09:37.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.402+0000 7f1ecee4c640 1 Processor -- start 2024-04-25T03:09:37.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.402+0000 7f1ecee4c640 1 -- start start 2024-04-25T03:09:37.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.406+0000 7f1ecee4c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec806dbd0 0x7f1ec8153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:37.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.406+0000 7f1ecee4c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ec8141380 0x7f1ec8138df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:37.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.406+0000 7f1ecee4c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ec8152cd0 0x7f1ec8139330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:37.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.406+0000 7f1ecee4c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8164df0 con 0x7f1ec806dbd0 2024-04-25T03:09:37.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.406+0000 7f1ecee4c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec8164c70 con 0x7f1ec8152cd0 2024-04-25T03:09:37.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.406+0000 7f1ecee4c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec8164f70 con 0x7f1ec8141380 2024-04-25T03:09:37.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.406+0000 7f1eccbe8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec806dbd0 0x7f1ec8153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:37.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.406+0000 7f1eccbe8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec806dbd0 0x7f1ec8153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55414/0 (socket says 172.21.15.162:55414) 2024-04-25T03:09:37.406 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.406+0000 7f1eccbe8640 1 -- 172.21.15.162:0/2387732708 learned_addr learned my addr 172.21.15.162:0/2387732708 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:37.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.406+0000 7f1ec7fff640 1 --2- 172.21.15.162:0/2387732708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ec8141380 0x7f1ec8138df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:37.407 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.406+0000 7f1ecd3e9640 1 --2- 172.21.15.162:0/2387732708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ec8152cd0 0x7f1ec8139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:37.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.410+0000 7f1eccbe8640 1 -- 172.21.15.162:0/2387732708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ec8141380 msgr2=0x7f1ec8138df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:37.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.410+0000 7f1eccbe8640 1 --2- 172.21.15.162:0/2387732708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ec8141380 0x7f1ec8138df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:37.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.410+0000 7f1eccbe8640 1 -- 172.21.15.162:0/2387732708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ec8152cd0 msgr2=0x7f1ec8139330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:37.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.410+0000 7f1eccbe8640 1 --2- 172.21.15.162:0/2387732708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ec8152cd0 0x7f1ec8139330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:37.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.410+0000 7f1eccbe8640 1 -- 172.21.15.162:0/2387732708 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec813afc0 con 0x7f1ec806dbd0 2024-04-25T03:09:37.412 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.410+0000 7f1eccbe8640 1 --2- 172.21.15.162:0/2387732708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec806dbd0 0x7f1ec8153820 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00c3a0 tx=0x7f1ebc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.414+0000 7f1ec57fa640 1 -- 172.21.15.162:0/2387732708 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc017070 con 0x7f1ec806dbd0 2024-04-25T03:09:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.414+0000 7f1ec57fa640 1 -- 172.21.15.162:0/2387732708 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ebc005cf0 con 0x7f1ec806dbd0 2024-04-25T03:09:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.414+0000 7f1ecee4c640 1 -- 172.21.15.162:0/2387732708 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec81553f0 con 0x7f1ec806dbd0 2024-04-25T03:09:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.414+0000 7f1ec57fa640 1 -- 172.21.15.162:0/2387732708 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ebc0072f0 con 0x7f1ec806dbd0 2024-04-25T03:09:37.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.414+0000 7f1ecee4c640 1 -- 172.21.15.162:0/2387732708 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec8153d60 con 0x7f1ec806dbd0 2024-04-25T03:09:37.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.418+0000 7f1ecee4c640 1 -- 172.21.15.162:0/2387732708 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec8154050 con 0x7f1ec806dbd0 2024-04-25T03:09:37.435 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.434+0000 7f1ec57fa640 1 -- 172.21.15.162:0/2387732708 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1ebc01a070 con 0x7f1ec806dbd0 2024-04-25T03:09:37.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.434+0000 7f1ec57fa640 1 --2- 172.21.15.162:0/2387732708 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1eac067910 0x7f1eac069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:37.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.434+0000 7f1ec7fff640 1 --2- 172.21.15.162:0/2387732708 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1eac067910 0x7f1eac069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:37.436 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.434+0000 7f1ec7fff640 1 --2- 172.21.15.162:0/2387732708 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1eac067910 0x7f1eac069dd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40ad000 tx=0x7f1eb40a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:37.439 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.438+0000 7f1ec57fa640 1 -- 172.21.15.162:0/2387732708 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f1ebc053980 con 0x7f1ec806dbd0 2024-04-25T03:09:37.715 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.714+0000 7f1ec57fa640 1 -- 172.21.15.162:0/2387732708 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f1ebc021020 con 0x7f1ec806dbd0 2024-04-25T03:09:37.880 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.878+0000 7f1ecee4c640 1 -- 172.21.15.162:0/2387732708 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1ec8068310 con 0x7f1ec806dbd0 2024-04-25T03:09:37.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.890+0000 7f1ec57fa640 1 -- 172.21.15.162:0/2387732708 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) ==== 93+0+10 (secure 0 0 0) 0x7f1ebc0558e0 con 0x7f1ec806dbd0 2024-04-25T03:09:37.890 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 1 2024-04-25T03:09:37.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.890+0000 7f1ecee4c640 1 -- 172.21.15.162:0/2387732708 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1eac067910 msgr2=0x7f1eac069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:37.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.890+0000 7f1ecee4c640 1 --2- 172.21.15.162:0/2387732708 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1eac067910 0x7f1eac069dd0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1eb40ad000 tx=0x7f1eb40a6000 comp rx=0 tx=0).stop 2024-04-25T03:09:37.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.894+0000 7f1ecee4c640 1 -- 172.21.15.162:0/2387732708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec806dbd0 msgr2=0x7f1ec8153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:37.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.894+0000 7f1ecee4c640 1 --2- 172.21.15.162:0/2387732708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec806dbd0 0x7f1ec8153820 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1ebc00c3a0 tx=0x7f1ebc00c860 comp rx=0 tx=0).stop 2024-04-25T03:09:37.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.894+0000 7f1ecee4c640 1 -- 172.21.15.162:0/2387732708 shutdown_connections 2024-04-25T03:09:37.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.894+0000 7f1ecee4c640 1 --2- 172.21.15.162:0/2387732708 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1ec8152cd0 0x7f1ec8139330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:37.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.894+0000 7f1ecee4c640 1 --2- 172.21.15.162:0/2387732708 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1ec8141380 0x7f1ec8138df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:37.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.894+0000 7f1ecee4c640 1 --2- 172.21.15.162:0/2387732708 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1eac067910 0x7f1eac069dd0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:37.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.894+0000 7f1ecee4c640 1 --2- 172.21.15.162:0/2387732708 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1ec806dbd0 0x7f1ec8153820 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:37.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.894+0000 7f1ecee4c640 1 -- 172.21.15.162:0/2387732708 >> 172.21.15.162:0/2387732708 conn(0x7f1ec806b210 msgr2=0x7f1ec80c9810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:37.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.894+0000 7f1ecee4c640 1 -- 172.21.15.162:0/2387732708 shutdown_connections 2024-04-25T03:09:37.894 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:37.894+0000 7f1ecee4c640 1 -- 172.21.15.162:0/2387732708 wait complete. 2024-04-25T03:09:37.911 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T03:09:38.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.038+0000 7f1a3e8a7640 1 Processor -- start 2024-04-25T03:09:38.038 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.038+0000 7f1a3e8a7640 1 -- start start 2024-04-25T03:09:38.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.038+0000 7f1a3e8a7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a3813df00 0x7f1a380c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:38.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.038+0000 7f1a3e8a7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1a3806b520 0x7f1a38158320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:38.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.038+0000 7f1a3e8a7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a3815c870 con 0x7f1a380c71d0 2024-04-25T03:09:38.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.038+0000 7f1a3e8a7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f1a38159320 con 0x7f1a3806b520 2024-04-25T03:09:38.039 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.038+0000 7f1a3e8a7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1a38159040 con 0x7f1a3813df00 2024-04-25T03:09:38.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.038+0000 7f1a3ce44640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1a3806b520 0x7f1a38158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:38.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.038+0000 7f1a37fff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a3813df00 0x7f1a380c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:38.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.042+0000 7f1a3ce44640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1a3806b520 0x7f1a38158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:44458/0 (socket says 172.21.15.162:44458) 2024-04-25T03:09:38.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.042+0000 7f1a3ce44640 1 -- 172.21.15.162:0/1893146109 learned_addr learned my addr 172.21.15.162:0/1893146109 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:38.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.046+0000 7f1a3ce44640 1 -- 172.21.15.162:0/1893146109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a3813df00 msgr2=0x7f1a380c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:38.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.046+0000 7f1a3ce44640 1 --2- 172.21.15.162:0/1893146109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a3813df00 0x7f1a380c6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:38.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.046+0000 7f1a3ce44640 1 -- 172.21.15.162:0/1893146109 >> v1:172.21.15.162:6789/0 conn(0x7f1a380c71d0 legacy=0x7f1a380c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:38.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.046+0000 7f1a3ce44640 1 -- 172.21.15.162:0/1893146109 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a3815bab0 con 0x7f1a3806b520 2024-04-25T03:09:38.052 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.050+0000 7f1a3ce44640 1 --2- 172.21.15.162:0/1893146109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a3806b520 0x7f1a38158320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1a30009e50 tx=0x7f1a3001f1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c47bcaada482b8af server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:38.172 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.170+0000 7f1a36ffd640 1 -- 172.21.15.162:0/1893146109 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a300b4070 con 0x7f1a3806b520 2024-04-25T03:09:38.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.170+0000 7f1a36ffd640 1 -- 172.21.15.162:0/1893146109 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a300af400 con 0x7f1a3806b520 2024-04-25T03:09:38.173 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.170+0000 7f1a36ffd640 1 -- 172.21.15.162:0/1893146109 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a300af7d0 con 0x7f1a3806b520 2024-04-25T03:09:38.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.174+0000 7f1a3e8a7640 1 -- 172.21.15.162:0/1893146109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a3806b520 msgr2=0x7f1a38158320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:38.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.174+0000 7f1a3e8a7640 1 --2- 172.21.15.162:0/1893146109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a3806b520 0x7f1a38158320 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1a30009e50 tx=0x7f1a3001f1e0 comp rx=0 tx=0).stop 2024-04-25T03:09:38.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.174+0000 7f1a3e8a7640 1 -- 172.21.15.162:0/1893146109 shutdown_connections 2024-04-25T03:09:38.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.174+0000 7f1a3e8a7640 1 --2- 172.21.15.162:0/1893146109 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a3806b520 0x7f1a38158320 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:38.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.174+0000 7f1a3e8a7640 1 --2- 172.21.15.162:0/1893146109 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a3813df00 0x7f1a380c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:38.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.174+0000 7f1a3e8a7640 1 -- 172.21.15.162:0/1893146109 >> 172.21.15.162:0/1893146109 conn(0x7f1a3806dc70 msgr2=0x7f1a3806e080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:38.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.174+0000 7f1a3e8a7640 1 -- 172.21.15.162:0/1893146109 shutdown_connections 2024-04-25T03:09:38.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.174+0000 7f1a3e8a7640 1 -- 172.21.15.162:0/1893146109 wait complete. 2024-04-25T03:09:38.177 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.174+0000 7f1a3e8a7640 1 Processor -- start 2024-04-25T03:09:38.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.174+0000 7f1a3e8a7640 1 -- start start 2024-04-25T03:09:38.178 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.178+0000 7f1a3e8a7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a3806b520 0x7f1a3815b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:38.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.178+0000 7f1a3e8a7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a380c71d0 0x7f1a38151950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:38.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.178+0000 7f1a3e8a7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a3813df00 0x7f1a38157660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:38.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.178+0000 7f1a3e8a7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3815c350 con 0x7f1a3813df00 2024-04-25T03:09:38.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.178+0000 7f1a3e8a7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3815c070 con 0x7f1a3806b520 2024-04-25T03:09:38.179 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.178+0000 7f1a3e8a7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1a3813e2e0 con 0x7f1a380c71d0 2024-04-25T03:09:38.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.178+0000 7f1a37fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a3806b520 0x7f1a3815b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:38.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.178+0000 7f1a37fff640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a3806b520 0x7f1a3815b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:44460/0 (socket says 172.21.15.162:44460) 2024-04-25T03:09:38.180 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.178+0000 7f1a37fff640 1 -- 172.21.15.162:0/304959538 learned_addr learned my addr 172.21.15.162:0/304959538 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:38.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.182+0000 7f1a377fe640 1 --2- 172.21.15.162:0/304959538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a380c71d0 0x7f1a38151950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:38.187 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.186+0000 7f1a3ce44640 1 --2- 172.21.15.162:0/304959538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a3813df00 0x7f1a38157660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:38.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.186+0000 7f1a37fff640 1 -- 172.21.15.162:0/304959538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a380c71d0 msgr2=0x7f1a38151950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:38.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.186+0000 7f1a37fff640 1 --2- 172.21.15.162:0/304959538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a380c71d0 0x7f1a38151950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:38.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.190+0000 7f1a37fff640 1 -- 172.21.15.162:0/304959538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a3813df00 msgr2=0x7f1a38157660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:38.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.190+0000 7f1a37fff640 1 --2- 172.21.15.162:0/304959538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a3813df00 0x7f1a38157660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:38.189 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.190+0000 7f1a37fff640 1 -- 172.21.15.162:0/304959538 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a381f00a0 con 0x7f1a3806b520 2024-04-25T03:09:38.192 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.190+0000 7f1a37fff640 1 --2- 172.21.15.162:0/304959538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a3806b520 0x7f1a3815b330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00e960 tx=0x7f1a2c00ee20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:38.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.210+0000 7f1a34ff9640 1 -- 172.21.15.162:0/304959538 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c017070 con 0x7f1a3806b520 2024-04-25T03:09:38.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.210+0000 7f1a34ff9640 1 -- 172.21.15.162:0/304959538 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a2c00ca00 con 0x7f1a3806b520 2024-04-25T03:09:38.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.210+0000 7f1a34ff9640 1 -- 172.21.15.162:0/304959538 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2c00cdb0 con 0x7f1a3806b520 2024-04-25T03:09:38.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.210+0000 7f1a3e8a7640 1 -- 172.21.15.162:0/304959538 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a381f0340 con 0x7f1a3806b520 2024-04-25T03:09:38.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.210+0000 7f1a3e8a7640 1 -- 172.21.15.162:0/304959538 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a381f08e0 con 0x7f1a3806b520 2024-04-25T03:09:38.213 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.214+0000 7f1a3e8a7640 1 -- 172.21.15.162:0/304959538 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a38159540 con 0x7f1a3806b520 2024-04-25T03:09:38.436 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:09:38.439 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:09:38.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.526+0000 7f1a34ff9640 1 -- 172.21.15.162:0/304959538 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1a2c01a070 con 0x7f1a3806b520 2024-04-25T03:09:38.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.530+0000 7f1a34ff9640 1 --2- 172.21.15.162:0/304959538 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1a24067910 0x7f1a24069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:38.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.530+0000 7f1a377fe640 1 --2- 172.21.15.162:0/304959538 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1a24067910 0x7f1a24069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:38.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.530+0000 7f1a377fe640 1 --2- 172.21.15.162:0/304959538 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1a24067910 0x7f1a24069dd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1a381edcd0 tx=0x7f1a28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:38.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.534+0000 7f1a34ff9640 1 -- 172.21.15.162:0/304959538 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f1a2c054a10 con 0x7f1a3806b520 2024-04-25T03:09:38.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.554+0000 7f1a34ff9640 1 -- 172.21.15.162:0/304959538 <== mon.1 v2:172.21.15.179:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f1a2c056970 con 0x7f1a3806b520 2024-04-25T03:09:38.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.730+0000 7f1a3e8a7640 1 -- 172.21.15.162:0/304959538 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1a38075110 con 0x7f1a3806b520 2024-04-25T03:09:38.761 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.762+0000 7f1a34ff9640 1 -- 172.21.15.162:0/304959538 <== mon.1 v2:172.21.15.179:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) ==== 104+0+11 (secure 0 0 0) 0x7f1a2c05ac70 con 0x7f1a3806b520 2024-04-25T03:09:38.761 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 32 2024-04-25T03:09:38.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.762+0000 7f1a3e8a7640 1 -- 172.21.15.162:0/304959538 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1a24067910 msgr2=0x7f1a24069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:38.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.762+0000 7f1a3e8a7640 1 --2- 172.21.15.162:0/304959538 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1a24067910 0x7f1a24069dd0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f1a381edcd0 tx=0x7f1a28009040 comp rx=0 tx=0).stop 2024-04-25T03:09:38.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.762+0000 7f1a3e8a7640 1 -- 172.21.15.162:0/304959538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a3806b520 msgr2=0x7f1a3815b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:38.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.762+0000 7f1a3e8a7640 1 --2- 172.21.15.162:0/304959538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a3806b520 0x7f1a3815b330 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c00e960 tx=0x7f1a2c00ee20 comp rx=0 tx=0).stop 2024-04-25T03:09:38.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.762+0000 7f1a3e8a7640 1 -- 172.21.15.162:0/304959538 shutdown_connections 2024-04-25T03:09:38.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.762+0000 7f1a3e8a7640 1 --2- 172.21.15.162:0/304959538 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1a24067910 0x7f1a24069dd0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:38.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.762+0000 7f1a3e8a7640 1 --2- 172.21.15.162:0/304959538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1a3813df00 0x7f1a38157660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:38.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.762+0000 7f1a3e8a7640 1 --2- 172.21.15.162:0/304959538 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1a380c71d0 0x7f1a38151950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:38.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.762+0000 7f1a3e8a7640 1 --2- 172.21.15.162:0/304959538 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1a3806b520 0x7f1a3815b330 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:38.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.762+0000 7f1a3e8a7640 1 -- 172.21.15.162:0/304959538 >> 172.21.15.162:0/304959538 conn(0x7f1a3806dc70 msgr2=0x7f1a380c59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:38.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.762+0000 7f1a3e8a7640 1 -- 172.21.15.162:0/304959538 shutdown_connections 2024-04-25T03:09:38.764 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.762+0000 7f1a3e8a7640 1 -- 172.21.15.162:0/304959538 wait complete. 2024-04-25T03:09:38.783 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T03:09:38.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.950+0000 7f6dcb67c640 1 Processor -- start 2024-04-25T03:09:38.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.950+0000 7f6dcb67c640 1 -- start start 2024-04-25T03:09:38.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.954+0000 7f6dcb67c640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6dc41570d0 0x7f6dc415b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:38.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.954+0000 7f6dcb67c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f6dc40c2cc0 0x7f6dc4072c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:38.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.954+0000 7f6dcb67c640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dc415a760 con 0x7f6dc4151410 2024-04-25T03:09:38.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.954+0000 7f6dcb67c640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f6dc4157520 con 0x7f6dc41570d0 2024-04-25T03:09:38.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.954+0000 7f6dcb67c640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f6dc41517f0 con 0x7f6dc40c2cc0 2024-04-25T03:09:38.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.954+0000 7f6dc8c17640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6dc41570d0 0x7f6dc415b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:38.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.954+0000 7f6dc8c17640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f6dc41570d0 0x7f6dc415b1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55428/0 (socket says 172.21.15.162:55428) 2024-04-25T03:09:38.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.954+0000 7f6dc8c17640 1 -- 172.21.15.162:0/3118260754 learned_addr learned my addr 172.21.15.162:0/3118260754 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:38.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.954+0000 7f6dc9c19640 1 --2- 172.21.15.162:0/3118260754 >> v2:172.21.15.179:3300/0 conn(0x7f6dc40c2cc0 0x7f6dc4072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:38.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.958+0000 7f6dc8c17640 1 -- 172.21.15.162:0/3118260754 >> v2:172.21.15.179:3300/0 conn(0x7f6dc40c2cc0 msgr2=0x7f6dc4072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:38.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.958+0000 7f6dc8c17640 1 --2- 172.21.15.162:0/3118260754 >> v2:172.21.15.179:3300/0 conn(0x7f6dc40c2cc0 0x7f6dc4072c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:38.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.958+0000 7f6dc8c17640 1 -- 172.21.15.162:0/3118260754 >> v1:172.21.15.179:6789/0 conn(0x7f6dc4151410 legacy=0x7f6dc40c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:38.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.958+0000 7f6dc8c17640 1 -- 172.21.15.162:0/3118260754 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc40c3430 con 0x7f6dc41570d0 2024-04-25T03:09:38.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.962+0000 7f6dc8c17640 1 --2- 172.21.15.162:0/3118260754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dc41570d0 0x7f6dc415b1d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6dc406eac0 tx=0x7f6db401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b4661b4a680e04 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:38.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.966+0000 7f6dbbfff640 1 -- 172.21.15.162:0/3118260754 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db40b5070 con 0x7f6dc41570d0 2024-04-25T03:09:38.968 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.966+0000 7f6dbbfff640 1 -- 172.21.15.162:0/3118260754 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db40a89d0 con 0x7f6dc41570d0 2024-04-25T03:09:38.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.966+0000 7f6dbbfff640 1 -- 172.21.15.162:0/3118260754 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db40a8da0 con 0x7f6dc41570d0 2024-04-25T03:09:38.969 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.970+0000 7f6dcb67c640 1 -- 172.21.15.162:0/3118260754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dc41570d0 msgr2=0x7f6dc415b1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:38.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.970+0000 7f6dcb67c640 1 --2- 172.21.15.162:0/3118260754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dc41570d0 0x7f6dc415b1d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6dc406eac0 tx=0x7f6db401ecd0 comp rx=0 tx=0).stop 2024-04-25T03:09:38.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.970+0000 7f6dcb67c640 1 -- 172.21.15.162:0/3118260754 shutdown_connections 2024-04-25T03:09:38.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.970+0000 7f6dcb67c640 1 --2- 172.21.15.162:0/3118260754 >> v2:172.21.15.179:3300/0 conn(0x7f6dc40c2cc0 0x7f6dc4072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:38.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.970+0000 7f6dcb67c640 1 --2- 172.21.15.162:0/3118260754 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dc41570d0 0x7f6dc415b1d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:38.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.970+0000 7f6dcb67c640 1 -- 172.21.15.162:0/3118260754 >> 172.21.15.162:0/3118260754 conn(0x7f6dc406b210 msgr2=0x7f6dc406b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:38.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.970+0000 7f6dcb67c640 1 -- 172.21.15.162:0/3118260754 shutdown_connections 2024-04-25T03:09:38.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.970+0000 7f6dcb67c640 1 -- 172.21.15.162:0/3118260754 wait complete. 2024-04-25T03:09:38.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.970+0000 7f6dcb67c640 1 Processor -- start 2024-04-25T03:09:38.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.970+0000 7f6dcb67c640 1 -- start start 2024-04-25T03:09:38.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.970+0000 7f6dcb67c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dc40c2cc0 0x7f6dc41f37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:38.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.970+0000 7f6dcb67c640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dc4151410 0x7f6dc41e2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:38.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.970+0000 7f6dcb67c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dc41570d0 0x7f6dc4074ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:38.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.970+0000 7f6dcb67c640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc415acb0 con 0x7f6dc40c2cc0 2024-04-25T03:09:38.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.970+0000 7f6dcb67c640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f6dc415a9d0 con 0x7f6dc41570d0 2024-04-25T03:09:38.972 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.970+0000 7f6dcb67c640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f6dc40c6cd0 con 0x7f6dc4151410 2024-04-25T03:09:38.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.970+0000 7f6dc9418640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dc40c2cc0 0x7f6dc41f37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:38.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.974+0000 7f6dc9418640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dc40c2cc0 0x7f6dc41f37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55442/0 (socket says 172.21.15.162:55442) 2024-04-25T03:09:38.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.974+0000 7f6dc9418640 1 -- 172.21.15.162:0/816510687 learned_addr learned my addr 172.21.15.162:0/816510687 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:38.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.974+0000 7f6dc8c17640 1 --2- 172.21.15.162:0/816510687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dc4151410 0x7f6dc41e2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:38.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.974+0000 7f6dc9c19640 1 --2- 172.21.15.162:0/816510687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dc41570d0 0x7f6dc4074ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:38.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.978+0000 7f6dc9418640 1 -- 172.21.15.162:0/816510687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dc4151410 msgr2=0x7f6dc41e2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:38.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.978+0000 7f6dc9418640 1 --2- 172.21.15.162:0/816510687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dc4151410 0x7f6dc41e2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:38.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.978+0000 7f6dc9418640 1 -- 172.21.15.162:0/816510687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dc41570d0 msgr2=0x7f6dc4074ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:38.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.978+0000 7f6dc9418640 1 --2- 172.21.15.162:0/816510687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dc41570d0 0x7f6dc4074ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:38.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.978+0000 7f6dc9418640 1 -- 172.21.15.162:0/816510687 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dc4156510 con 0x7f6dc40c2cc0 2024-04-25T03:09:38.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.978+0000 7f6dc9418640 1 --2- 172.21.15.162:0/816510687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dc40c2cc0 0x7f6dc41f37b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000c450 tx=0x7f6dc000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:38.999 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.998+0000 7f6db9ffb640 1 -- 172.21.15.162:0/816510687 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0012830 con 0x7f6dc40c2cc0 2024-04-25T03:09:38.999 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.998+0000 7f6db9ffb640 1 -- 172.21.15.162:0/816510687 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc0017070 con 0x7f6dc40c2cc0 2024-04-25T03:09:39.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.998+0000 7f6db9ffb640 1 -- 172.21.15.162:0/816510687 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc0012c30 con 0x7f6dc40c2cc0 2024-04-25T03:09:39.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.998+0000 7f6dcb67c640 1 -- 172.21.15.162:0/816510687 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dc4156780 con 0x7f6dc40c2cc0 2024-04-25T03:09:39.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.998+0000 7f6dcb67c640 1 -- 172.21.15.162:0/816510687 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dc4156d40 con 0x7f6dc40c2cc0 2024-04-25T03:09:39.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:38.998+0000 7f6dcb67c640 1 -- 172.21.15.162:0/816510687 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dc4068310 con 0x7f6dc40c2cc0 2024-04-25T03:09:39.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.294+0000 7f6db9ffb640 1 -- 172.21.15.162:0/816510687 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6dc001c460 con 0x7f6dc40c2cc0 2024-04-25T03:09:39.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.294+0000 7f6db9ffb640 1 --2- 172.21.15.162:0/816510687 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6da8067910 0x7f6da8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:39.297 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.298+0000 7f6dc8c17640 1 --2- 172.21.15.162:0/816510687 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6da8067910 0x7f6da8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:39.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.298+0000 7f6dc8c17640 1 --2- 172.21.15.162:0/816510687 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6da8067910 0x7f6da8069dd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6db40b2000 tx=0x7f6db40aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:39.328 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.326+0000 7f6db9ffb640 1 -- 172.21.15.162:0/816510687 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f6dc00549e0 con 0x7f6dc40c2cc0 2024-04-25T03:09:39.329 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.326+0000 7f6db9ffb640 1 -- 172.21.15.162:0/816510687 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f6dc0056940 con 0x7f6dc40c2cc0 2024-04-25T03:09:39.503 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.502+0000 7f6dcb67c640 1 -- 172.21.15.162:0/816510687 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6dc40c26c0 con 0x7f6dc40c2cc0 2024-04-25T03:09:39.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.510+0000 7f6db9ffb640 1 -- 172.21.15.162:0/816510687 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) ==== 100+0+11 (secure 0 0 0) 0x7f6dc005ac40 con 0x7f6dc40c2cc0 2024-04-25T03:09:39.512 INFO:teuthology.orchestra.run.smithi162.stdout:pg_num: 64 2024-04-25T03:09:39.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.514+0000 7f6dcb67c640 1 -- 172.21.15.162:0/816510687 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6da8067910 msgr2=0x7f6da8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:39.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.514+0000 7f6dcb67c640 1 --2- 172.21.15.162:0/816510687 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6da8067910 0x7f6da8069dd0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6db40b2000 tx=0x7f6db40aa070 comp rx=0 tx=0).stop 2024-04-25T03:09:39.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.514+0000 7f6dcb67c640 1 -- 172.21.15.162:0/816510687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dc40c2cc0 msgr2=0x7f6dc41f37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:39.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.514+0000 7f6dcb67c640 1 --2- 172.21.15.162:0/816510687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dc40c2cc0 0x7f6dc41f37b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6dc000c450 tx=0x7f6dc000c910 comp rx=0 tx=0).stop 2024-04-25T03:09:39.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.514+0000 7f6dcb67c640 1 -- 172.21.15.162:0/816510687 shutdown_connections 2024-04-25T03:09:39.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.514+0000 7f6dcb67c640 1 --2- 172.21.15.162:0/816510687 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f6dc41570d0 0x7f6dc4074ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:39.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.514+0000 7f6dcb67c640 1 --2- 172.21.15.162:0/816510687 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f6dc4151410 0x7f6dc41e2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:39.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.514+0000 7f6dcb67c640 1 --2- 172.21.15.162:0/816510687 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f6da8067910 0x7f6da8069dd0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:39.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.514+0000 7f6dcb67c640 1 --2- 172.21.15.162:0/816510687 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f6dc40c2cc0 0x7f6dc41f37b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:39.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.514+0000 7f6dcb67c640 1 -- 172.21.15.162:0/816510687 >> 172.21.15.162:0/816510687 conn(0x7f6dc406b210 msgr2=0x7f6dc40c6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:39.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.514+0000 7f6dcb67c640 1 -- 172.21.15.162:0/816510687 shutdown_connections 2024-04-25T03:09:39.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.514+0000 7f6dcb67c640 1 -- 172.21.15.162:0/816510687 wait complete. 2024-04-25T03:09:39.533 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T03:09:39.651 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.650+0000 7f4c2f518640 1 Processor -- start 2024-04-25T03:09:39.651 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.650+0000 7f4c2f518640 1 -- start start 2024-04-25T03:09:39.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.650+0000 7f4c2f518640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4c28141760 0x7f4c2815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:39.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.650+0000 7f4c2f518640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c2806dbd0 0x7f4c280c8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:39.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.650+0000 7f4c2f518640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c280c6a80 con 0x7f4c28141380 2024-04-25T03:09:39.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.650+0000 7f4c2f518640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f4c2806e080 con 0x7f4c28141760 2024-04-25T03:09:39.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.650+0000 7f4c2f518640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4c280c7040 con 0x7f4c2806dbd0 2024-04-25T03:09:39.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.650+0000 7f4c2cab3640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f4c28141760 0x7f4c2815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:39.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.650+0000 7f4c2d2b4640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f4c28141380 0x7f4c280c6240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:44926/0 (socket says 172.21.15.162:44926) 2024-04-25T03:09:39.653 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.650+0000 7f4c2d2b4640 1 -- 172.21.15.162:0/84628672 learned_addr learned my addr 172.21.15.162:0/84628672 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:09:39.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.654+0000 7f4c2cab3640 1 -- 172.21.15.162:0/84628672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c2806dbd0 msgr2=0x7f4c280c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:39.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.654+0000 7f4c2cab3640 1 --2- 172.21.15.162:0/84628672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c2806dbd0 0x7f4c280c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:39.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.654+0000 7f4c2cab3640 1 -- 172.21.15.162:0/84628672 >> v1:172.21.15.162:6789/0 conn(0x7f4c28141380 legacy=0x7f4c280c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:39.657 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.654+0000 7f4c2cab3640 1 -- 172.21.15.162:0/84628672 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c280c6d60 con 0x7f4c28141760 2024-04-25T03:09:39.661 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.662+0000 7f4c2cab3640 1 --2- 172.21.15.162:0/84628672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c28141760 0x7f4c2815c4e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0097c0 tx=0x7f4c1c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1dfb6c8e5693b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:39.664 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.662+0000 7f4c27fff640 1 -- 172.21.15.162:0/84628672 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0b0070 con 0x7f4c28141760 2024-04-25T03:09:39.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.666+0000 7f4c27fff640 1 -- 172.21.15.162:0/84628672 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c1c0ab600 con 0x7f4c28141760 2024-04-25T03:09:39.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.666+0000 7f4c27fff640 1 -- 172.21.15.162:0/84628672 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c1c0ab9d0 con 0x7f4c28141760 2024-04-25T03:09:39.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.666+0000 7f4c2f518640 1 -- 172.21.15.162:0/84628672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c28141760 msgr2=0x7f4c2815c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:39.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.666+0000 7f4c2f518640 1 --2- 172.21.15.162:0/84628672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c28141760 0x7f4c2815c4e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0097c0 tx=0x7f4c1c01c410 comp rx=0 tx=0).stop 2024-04-25T03:09:39.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.666+0000 7f4c2f518640 1 -- 172.21.15.162:0/84628672 shutdown_connections 2024-04-25T03:09:39.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.666+0000 7f4c2f518640 1 --2- 172.21.15.162:0/84628672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c2806dbd0 0x7f4c280c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:39.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.666+0000 7f4c2f518640 1 --2- 172.21.15.162:0/84628672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c28141760 0x7f4c2815c4e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:39.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.666+0000 7f4c2f518640 1 -- 172.21.15.162:0/84628672 >> 172.21.15.162:0/84628672 conn(0x7f4c2806b210 msgr2=0x7f4c2806b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:39.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.666+0000 7f4c2f518640 1 -- 172.21.15.162:0/84628672 shutdown_connections 2024-04-25T03:09:39.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.666+0000 7f4c2f518640 1 -- 172.21.15.162:0/84628672 wait complete. 2024-04-25T03:09:39.669 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.670+0000 7f4c2f518640 1 Processor -- start 2024-04-25T03:09:39.669 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.670+0000 7f4c2f518640 1 -- start start 2024-04-25T03:09:39.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.670+0000 7f4c2f518640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c2806dbd0 0x7f4c2813b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:39.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.670+0000 7f4c2f518640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c28141380 0x7f4c2813a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:39.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.670+0000 7f4c2f518640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c28141760 0x7f4c28161300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:39.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.670+0000 7f4c2f518640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f4c28164df0 con 0x7f4c2806dbd0 2024-04-25T03:09:39.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.670+0000 7f4c2f518640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f4c28164c70 con 0x7f4c28141760 2024-04-25T03:09:39.670 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.670+0000 7f4c2f518640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f4c28164f70 con 0x7f4c28141380 2024-04-25T03:09:39.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.670+0000 7f4c2d2b4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c2806dbd0 0x7f4c2813b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:39.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.670+0000 7f4c2d2b4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c2806dbd0 0x7f4c2813b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:55456/0 (socket says 172.21.15.162:55456) 2024-04-25T03:09:39.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.670+0000 7f4c2d2b4640 1 -- 172.21.15.162:0/1268512531 learned_addr learned my addr 172.21.15.162:0/1268512531 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:39.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.674+0000 7f4c2d2b4640 1 -- 172.21.15.162:0/1268512531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c28141380 msgr2=0x7f4c2813a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:39.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.674+0000 7f4c2d2b4640 1 --2- 172.21.15.162:0/1268512531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c28141380 0x7f4c2813a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:39.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.674+0000 7f4c2d2b4640 1 -- 172.21.15.162:0/1268512531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c28141760 msgr2=0x7f4c28161300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:39.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.674+0000 7f4c2d2b4640 1 --2- 172.21.15.162:0/1268512531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c28141760 0x7f4c28161300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:39.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.674+0000 7f4c2d2b4640 1 -- 172.21.15.162:0/1268512531 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c281381f0 con 0x7f4c2806dbd0 2024-04-25T03:09:39.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.678+0000 7f4c2d2b4640 1 --2- 172.21.15.162:0/1268512531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c2806dbd0 0x7f4c2813b660 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000caa0 tx=0x7f4c2000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:39.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.682+0000 7f4c25ffb640 1 -- 172.21.15.162:0/1268512531 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c20017070 con 0x7f4c2806dbd0 2024-04-25T03:09:39.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.682+0000 7f4c25ffb640 1 -- 172.21.15.162:0/1268512531 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c2000ac00 con 0x7f4c2806dbd0 2024-04-25T03:09:39.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.682+0000 7f4c25ffb640 1 -- 172.21.15.162:0/1268512531 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c20012400 con 0x7f4c2806dbd0 2024-04-25T03:09:39.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.682+0000 7f4c2f518640 1 -- 172.21.15.162:0/1268512531 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c280c4860 con 0x7f4c2806dbd0 2024-04-25T03:09:39.682 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.682+0000 7f4c2f518640 1 -- 172.21.15.162:0/1268512531 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c28160b00 con 0x7f4c2806dbd0 2024-04-25T03:09:39.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.682+0000 7f4c2f518640 1 -- 172.21.15.162:0/1268512531 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c281608f0 con 0x7f4c2806dbd0 2024-04-25T03:09:39.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.702+0000 7f4c25ffb640 1 -- 172.21.15.162:0/1268512531 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4c2001a070 con 0x7f4c2806dbd0 2024-04-25T03:09:39.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.702+0000 7f4c25ffb640 1 --2- 172.21.15.162:0/1268512531 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4c14067940 0x7f4c14069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:39.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.702+0000 7f4c2cab3640 1 --2- 172.21.15.162:0/1268512531 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4c14067940 0x7f4c14069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:39.703 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:39.702+0000 7f4c2cab3640 1 --2- 172.21.15.162:0/1268512531 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4c14067940 0x7f4c14069e00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0ad000 tx=0x7f4c1c004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:40.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:40.022+0000 7f4c25ffb640 1 -- 172.21.15.162:0/1268512531 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f4c20054380 con 0x7f4c2806dbd0 2024-04-25T03:09:40.024 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:40.022+0000 7f4c25ffb640 1 -- 172.21.15.162:0/1268512531 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f4c20021020 con 0x7f4c2806dbd0 2024-04-25T03:09:40.201 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:40.202+0000 7f4c2f518640 1 -- 172.21.15.162:0/1268512531 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4c28068310 con 0x7f4c2806dbd0 2024-04-25T03:09:40.214 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:40.214+0000 7f4c25ffb640 1 -- 172.21.15.162:0/1268512531 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) ==== 80+0+0 (secure 0 0 0) 0x7f4c200569e0 con 0x7f4c2806dbd0 2024-04-25T03:09:40.214 INFO:teuthology.orchestra.run.smithi162.stderr:listed 0 entries 2024-04-25T03:09:40.218 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:40.218+0000 7f4c2f518640 1 -- 172.21.15.162:0/1268512531 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4c14067940 msgr2=0x7f4c14069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:40.218 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:40.218+0000 7f4c2f518640 1 --2- 172.21.15.162:0/1268512531 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4c14067940 0x7f4c14069e00 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0ad000 tx=0x7f4c1c004740 comp rx=0 tx=0).stop 2024-04-25T03:09:40.218 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:40.218+0000 7f4c2f518640 1 -- 172.21.15.162:0/1268512531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c2806dbd0 msgr2=0x7f4c2813b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:40.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:40.218+0000 7f4c2f518640 1 --2- 172.21.15.162:0/1268512531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c2806dbd0 0x7f4c2813b660 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4c2000caa0 tx=0x7f4c2000cf60 comp rx=0 tx=0).stop 2024-04-25T03:09:40.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:40.218+0000 7f4c2f518640 1 -- 172.21.15.162:0/1268512531 shutdown_connections 2024-04-25T03:09:40.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:40.218+0000 7f4c2f518640 1 --2- 172.21.15.162:0/1268512531 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f4c28141760 0x7f4c28161300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:40.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:40.218+0000 7f4c2f518640 1 --2- 172.21.15.162:0/1268512531 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f4c28141380 0x7f4c2813a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:40.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:40.218+0000 7f4c2f518640 1 --2- 172.21.15.162:0/1268512531 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4c14067940 0x7f4c14069e00 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:40.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:40.218+0000 7f4c2f518640 1 --2- 172.21.15.162:0/1268512531 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f4c2806dbd0 0x7f4c2813b660 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:40.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:40.218+0000 7f4c2f518640 1 -- 172.21.15.162:0/1268512531 >> 172.21.15.162:0/1268512531 conn(0x7f4c2806b210 msgr2=0x7f4c28071ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:40.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:40.218+0000 7f4c2f518640 1 -- 172.21.15.162:0/1268512531 shutdown_connections 2024-04-25T03:09:40.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:40.218+0000 7f4c2f518640 1 -- 172.21.15.162:0/1268512531 wait complete. 2024-04-25T03:09:40.235 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi162.front.sepia.ceph.com... 2024-04-25T03:09:40.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T03:09:40.235 DEBUG:teuthology.orchestra.run.smithi162:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T03:09:40.264 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:09:40.306 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi162.stderr:ceph-fuse[35320]: fuse finished with error 0 and tester_r 0 2024-04-25T03:09:41.254 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi162.stderr:==00:02:18:29.234 35320== 2024-04-25T03:09:41.255 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi162.stderr:==00:02:18:29.234 35320== Exit program on first error (--exit-on-first-error=yes) 2024-04-25T03:09:41.375 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi162.stderr:daemon-helper: command failed with exit status 42 2024-04-25T03:09:46.366 DEBUG:teuthology.orchestra.run:got remote process result: 42 2024-04-25T03:09:46.367 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi162.front.sepia.ceph.com 2024-04-25T03:09:46.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T03:09:46.367 DEBUG:teuthology.orchestra.run.smithi162:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T03:09:46.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T03:09:46.391 DEBUG:teuthology.orchestra.run.smithi162:> ip netns list 2024-04-25T03:09:46.444 INFO:teuthology.orchestra.run.smithi162.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T03:09:46.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T03:09:46.444 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T03:09:46.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T03:09:46.504 DEBUG:teuthology.orchestra.run.smithi162:> sudo ip link delete ceph-brx 2024-04-25T03:09:46.687 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T03:09:46.719 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T03:09:46.719 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T03:09:46.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.841+0000 7f27a2c73640 1 Processor -- start 2024-04-25T03:09:46.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.841+0000 7f27a2c73640 1 -- start start 2024-04-25T03:09:46.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.841+0000 7f27a2c73640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f279c1515e0 0x7f279c0c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:46.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.841+0000 7f27a2c73640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f279c072f60 con 0x7f279c0c8ee0 2024-04-25T03:09:46.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.841+0000 7f27a2c73640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f279c073200 con 0x7f279c151200 2024-04-25T03:09:46.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.841+0000 7f27a2c73640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f279c0c2f60 con 0x7f279c1515e0 2024-04-25T03:09:46.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.845+0000 7f279bfff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f279c1515e0 0x7f279c0c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:46.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.845+0000 7f279bfff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f279c1515e0 0x7f279c0c62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46694/0 (socket says 172.21.15.162:46694) 2024-04-25T03:09:46.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.845+0000 7f279bfff640 1 -- 172.21.15.162:0/3106477477 learned_addr learned my addr 172.21.15.162:0/3106477477 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:46.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.849+0000 7f279bfff640 1 -- 172.21.15.162:0/3106477477 >> v1:172.21.15.179:6789/0 conn(0x7f279c151200 legacy=0x7f279c072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:46.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.849+0000 7f279bfff640 1 -- 172.21.15.162:0/3106477477 >> v1:172.21.15.162:6789/0 conn(0x7f279c0c8ee0 legacy=0x7f279c15a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:46.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.849+0000 7f279bfff640 1 -- 172.21.15.162:0/3106477477 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279c0c3240 con 0x7f279c1515e0 2024-04-25T03:09:46.855 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.853+0000 7f279bfff640 1 --2- 172.21.15.162:0/3106477477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f279c1515e0 0x7f279c0c62c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f278c009870 tx=0x7f278c01e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18cace5ef23a9f8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:46.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.857+0000 7f279b7fe640 1 -- 172.21.15.162:0/3106477477 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c0ad680 con 0x7f279c1515e0 2024-04-25T03:09:46.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.857+0000 7f279b7fe640 1 -- 172.21.15.162:0/3106477477 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f278c0b2070 con 0x7f279c1515e0 2024-04-25T03:09:46.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.857+0000 7f279b7fe640 1 -- 172.21.15.162:0/3106477477 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f278c0ada40 con 0x7f279c1515e0 2024-04-25T03:09:46.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.857+0000 7f27a2c73640 1 -- 172.21.15.162:0/3106477477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f279c1515e0 msgr2=0x7f279c0c62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:46.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.857+0000 7f27a2c73640 1 --2- 172.21.15.162:0/3106477477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f279c1515e0 0x7f279c0c62c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f278c009870 tx=0x7f278c01e770 comp rx=0 tx=0).stop 2024-04-25T03:09:46.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.857+0000 7f27a2c73640 1 -- 172.21.15.162:0/3106477477 shutdown_connections 2024-04-25T03:09:46.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.857+0000 7f27a2c73640 1 --2- 172.21.15.162:0/3106477477 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f279c1515e0 0x7f279c0c62c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:46.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.857+0000 7f27a2c73640 1 -- 172.21.15.162:0/3106477477 >> 172.21.15.162:0/3106477477 conn(0x7f279c0c83c0 msgr2=0x7f279c0c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:46.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.857+0000 7f27a2c73640 1 -- 172.21.15.162:0/3106477477 shutdown_connections 2024-04-25T03:09:46.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.857+0000 7f27a2c73640 1 -- 172.21.15.162:0/3106477477 wait complete. 2024-04-25T03:09:46.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.857+0000 7f27a2c73640 1 Processor -- start 2024-04-25T03:09:46.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.861+0000 7f27a2c73640 1 -- start start 2024-04-25T03:09:46.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.861+0000 7f27a2c73640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f279c0c8ee0 0x7f279c14a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:46.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.861+0000 7f27a2c73640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f279c151200 0x7f279c159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:46.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.861+0000 7f27a2c73640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f279c1515e0 0x7f279c160240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:46.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.861+0000 7f27a2c73640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f279c0723a0 con 0x7f279c0c8ee0 2024-04-25T03:09:46.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.861+0000 7f27a2c73640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f279c072220 con 0x7f279c1515e0 2024-04-25T03:09:46.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.861+0000 7f27a2c73640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f279c072520 con 0x7f279c151200 2024-04-25T03:09:46.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.861+0000 7f27a0a0f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f279c0c8ee0 0x7f279c14a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:46.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.861+0000 7f27a0a0f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f279c0c8ee0 0x7f279c14a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46708/0 (socket says 172.21.15.162:46708) 2024-04-25T03:09:46.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.861+0000 7f27a0a0f640 1 -- 172.21.15.162:0/2886530924 learned_addr learned my addr 172.21.15.162:0/2886530924 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:46.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.861+0000 7f27a1210640 1 --2- 172.21.15.162:0/2886530924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f279c1515e0 0x7f279c160240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:46.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.861+0000 7f279bfff640 1 --2- 172.21.15.162:0/2886530924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f279c151200 0x7f279c159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:46.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.865+0000 7f27a0a0f640 1 -- 172.21.15.162:0/2886530924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f279c151200 msgr2=0x7f279c159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:46.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.865+0000 7f27a0a0f640 1 --2- 172.21.15.162:0/2886530924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f279c151200 0x7f279c159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:46.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.865+0000 7f27a0a0f640 1 -- 172.21.15.162:0/2886530924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f279c1515e0 msgr2=0x7f279c160240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:46.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.865+0000 7f27a0a0f640 1 --2- 172.21.15.162:0/2886530924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f279c1515e0 0x7f279c160240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:46.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.865+0000 7f27a0a0f640 1 -- 172.21.15.162:0/2886530924 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279c1f41f0 con 0x7f279c0c8ee0 2024-04-25T03:09:46.868 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.865+0000 7f27a0a0f640 1 --2- 172.21.15.162:0/2886530924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f279c0c8ee0 0x7f279c14a870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f279000c530 tx=0x7f279000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:46.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.869+0000 7f27997fa640 1 -- 172.21.15.162:0/2886530924 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790016020 con 0x7f279c0c8ee0 2024-04-25T03:09:46.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.869+0000 7f27997fa640 1 -- 172.21.15.162:0/2886530924 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2790005220 con 0x7f279c0c8ee0 2024-04-25T03:09:46.872 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.869+0000 7f27997fa640 1 -- 172.21.15.162:0/2886530924 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790007030 con 0x7f279c0c8ee0 2024-04-25T03:09:46.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.869+0000 7f27a2c73640 1 -- 172.21.15.162:0/2886530924 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f279c1f44d0 con 0x7f279c0c8ee0 2024-04-25T03:09:46.873 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.873+0000 7f27a2c73640 1 -- 172.21.15.162:0/2886530924 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f279c1f4a90 con 0x7f279c0c8ee0 2024-04-25T03:09:46.874 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:46.873+0000 7f27a2c73640 1 -- 172.21.15.162:0/2886530924 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f279c0c27c0 con 0x7f279c0c8ee0 2024-04-25T03:09:47.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.129+0000 7f27997fa640 1 -- 172.21.15.162:0/2886530924 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f27900071d0 con 0x7f279c0c8ee0 2024-04-25T03:09:47.133 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.133+0000 7f27997fa640 1 --2- 172.21.15.162:0/2886530924 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2788067910 0x7f2788069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:47.134 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.133+0000 7f279bfff640 1 --2- 172.21.15.162:0/2886530924 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2788067910 0x7f2788069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:47.135 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.133+0000 7f279bfff640 1 --2- 172.21.15.162:0/2886530924 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2788067910 0x7f2788069dd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f278c0b1000 tx=0x7f278c0a9000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:47.145 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.145+0000 7f27997fa640 1 -- 172.21.15.162:0/2886530924 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f2790054930 con 0x7f279c0c8ee0 2024-04-25T03:09:47.146 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.145+0000 7f27997fa640 1 -- 172.21.15.162:0/2886530924 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f2790020020 con 0x7f279c0c8ee0 2024-04-25T03:09:47.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.317+0000 7f27a2c73640 1 -- 172.21.15.162:0/2886530924 --> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f279c04f5f0 con 0x7f2788067910 2024-04-25T03:09:47.330 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.329+0000 7f27997fa640 1 -- 172.21.15.162:0/2886530924 <== mgr.4100 v2:172.21.15.162:6800/3960394531 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254000 (secure 0 0 0) 0x7f279c04f5f0 con 0x7f2788067910 2024-04-25T03:09:47.333 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T03:09:47.334 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-04-25T03:09:47.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.333+0000 7f27a2c73640 1 -- 172.21.15.162:0/2886530924 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2788067910 msgr2=0x7f2788069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:47.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.333+0000 7f27a2c73640 1 --2- 172.21.15.162:0/2886530924 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2788067910 0x7f2788069dd0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f278c0b1000 tx=0x7f278c0a9000 comp rx=0 tx=0).stop 2024-04-25T03:09:47.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.333+0000 7f27a2c73640 1 -- 172.21.15.162:0/2886530924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f279c0c8ee0 msgr2=0x7f279c14a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:47.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.333+0000 7f27a2c73640 1 --2- 172.21.15.162:0/2886530924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f279c0c8ee0 0x7f279c14a870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f279000c530 tx=0x7f279000c9f0 comp rx=0 tx=0).stop 2024-04-25T03:09:47.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.333+0000 7f27a2c73640 1 -- 172.21.15.162:0/2886530924 shutdown_connections 2024-04-25T03:09:47.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.333+0000 7f27a2c73640 1 --2- 172.21.15.162:0/2886530924 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f279c1515e0 0x7f279c160240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:47.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.333+0000 7f27a2c73640 1 --2- 172.21.15.162:0/2886530924 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f279c151200 0x7f279c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:47.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.333+0000 7f27a2c73640 1 --2- 172.21.15.162:0/2886530924 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f2788067910 0x7f2788069dd0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:47.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.333+0000 7f27a2c73640 1 --2- 172.21.15.162:0/2886530924 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f279c0c8ee0 0x7f279c14a870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:47.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.333+0000 7f27a2c73640 1 -- 172.21.15.162:0/2886530924 >> 172.21.15.162:0/2886530924 conn(0x7f279c0c83c0 msgr2=0x7f279c14ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:47.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.333+0000 7f27a2c73640 1 -- 172.21.15.162:0/2886530924 shutdown_connections 2024-04-25T03:09:47.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.333+0000 7f27a2c73640 1 -- 172.21.15.162:0/2886530924 wait complete. 2024-04-25T03:09:47.352 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":4221,"stamp":"2024-04-25T03:09:47.096161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":213663988,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":7157,"num_read_kb":1391768,"num_write":72243,"num_write_kb":4439398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64949,"ondisk_log_size":64949,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1152376,"kb_used_data":419832,"kb_used_omap":12,"kb_used_meta":732467,"kb_avail":753822344,"statfs":{"total":773094113280,"available":771914080256,"internally_reserved":0,"allocated":429907968,"data_stored":428194960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":750046769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":790,"num_objects":-5,"num_object_clones":0,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":30,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004164"},"pg_stats":[{"pgid":"3.3f","version":"28'428","reported_seq":558,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.658545+0000","last_change":"2024-04-25T00:50:35.761428+0000","last_active":"2024-04-25T03:09:40.658545+0000","last_peered":"2024-04-25T03:09:40.658545+0000","last_clean":"2024-04-25T03:09:40.658545+0000","last_became_active":"2024-04-25T00:50:35.760579+0000","last_became_peered":"2024-04-25T00:50:35.760579+0000","last_unstale":"2024-04-25T03:09:40.658545+0000","last_undegraded":"2024-04-25T03:09:40.658545+0000","last_fullsized":"2024-04-25T03:09:40.658545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:06.236972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25441,"num_write":394,"num_write_kb":67715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'447","reported_seq":651,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.902399+0000","last_change":"2024-04-25T00:50:35.798137+0000","last_active":"2024-04-25T03:09:40.902399+0000","last_peered":"2024-04-25T03:09:40.902399+0000","last_clean":"2024-04-25T03:09:40.902399+0000","last_became_active":"2024-04-25T00:50:35.797354+0000","last_became_peered":"2024-04-25T00:50:35.797354+0000","last_unstale":"2024-04-25T03:09:40.902399+0000","last_undegraded":"2024-04-25T03:09:40.902399+0000","last_fullsized":"2024-04-25T03:09:40.902399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:29:18.970287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":59186,"num_write":421,"num_write_kb":88627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'383","reported_seq":484,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.900038+0000","last_change":"2024-04-25T00:50:35.799370+0000","last_active":"2024-04-25T03:09:40.900038+0000","last_peered":"2024-04-25T03:09:40.900038+0000","last_clean":"2024-04-25T03:09:40.900038+0000","last_became_active":"2024-04-25T00:50:35.798268+0000","last_became_peered":"2024-04-25T00:50:35.798268+0000","last_unstale":"2024-04-25T03:09:40.900038+0000","last_undegraded":"2024-04-25T03:09:40.900038+0000","last_fullsized":"2024-04-25T03:09:40.900038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:27.176441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8918,"num_write":356,"num_write_kb":42288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'378","reported_seq":485,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.726379+0000","last_change":"2024-04-25T00:50:35.877965+0000","last_active":"2024-04-25T03:09:40.726379+0000","last_peered":"2024-04-25T03:09:40.726379+0000","last_clean":"2024-04-25T03:09:40.726379+0000","last_became_active":"2024-04-25T00:50:35.877114+0000","last_became_peered":"2024-04-25T00:50:35.877114+0000","last_unstale":"2024-04-25T03:09:40.726379+0000","last_undegraded":"2024-04-25T03:09:40.726379+0000","last_fullsized":"2024-04-25T03:09:40.726379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:20.857588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":5983,"num_write":348,"num_write_kb":38519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'398","reported_seq":495,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.655255+0000","last_change":"2024-04-25T00:50:35.730647+0000","last_active":"2024-04-25T03:09:40.655255+0000","last_peered":"2024-04-25T03:09:40.655255+0000","last_clean":"2024-04-25T03:09:40.655255+0000","last_became_active":"2024-04-25T00:50:35.729785+0000","last_became_peered":"2024-04-25T00:50:35.729785+0000","last_unstale":"2024-04-25T03:09:40.655255+0000","last_undegraded":"2024-04-25T03:09:40.655255+0000","last_fullsized":"2024-04-25T03:09:40.655255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:02.888747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12535,"num_write":367,"num_write_kb":34849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'384","reported_seq":469,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.058722+0000","last_change":"2024-04-25T00:51:40.324509+0000","last_active":"2024-04-25T03:09:41.058722+0000","last_peered":"2024-04-25T03:09:41.058722+0000","last_clean":"2024-04-25T03:09:41.058722+0000","last_became_active":"2024-04-25T00:51:40.323657+0000","last_became_peered":"2024-04-25T00:51:40.323657+0000","last_unstale":"2024-04-25T03:09:41.058722+0000","last_undegraded":"2024-04-25T03:09:41.058722+0000","last_fullsized":"2024-04-25T03:09:41.058722+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:46:58.981295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9183,"num_write":360,"num_write_kb":42897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"28'423","reported_seq":516,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.632470+0000","last_change":"2024-04-25T00:50:35.797990+0000","last_active":"2024-04-25T03:09:40.632470+0000","last_peered":"2024-04-25T03:09:40.632470+0000","last_clean":"2024-04-25T03:09:40.632470+0000","last_became_active":"2024-04-25T00:50:35.797328+0000","last_became_peered":"2024-04-25T00:50:35.797328+0000","last_unstale":"2024-04-25T03:09:40.632470+0000","last_undegraded":"2024-04-25T03:09:40.632470+0000","last_fullsized":"2024-04-25T03:09:40.632470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:59.565909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6445,"num_write":396,"num_write_kb":56628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'391","reported_seq":537,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.064728+0000","last_change":"2024-04-25T00:50:35.878367+0000","last_active":"2024-04-25T03:09:41.064728+0000","last_peered":"2024-04-25T03:09:41.064728+0000","last_clean":"2024-04-25T03:09:41.064728+0000","last_became_active":"2024-04-25T00:50:35.877581+0000","last_became_peered":"2024-04-25T00:50:35.877581+0000","last_unstale":"2024-04-25T03:09:41.064728+0000","last_undegraded":"2024-04-25T03:09:41.064728+0000","last_fullsized":"2024-04-25T03:09:41.064728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:53.695907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":40559,"num_write":354,"num_write_kb":84336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'417","reported_seq":510,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.066086+0000","last_change":"2024-04-25T00:51:40.608818+0000","last_active":"2024-04-25T03:09:41.066086+0000","last_peered":"2024-04-25T03:09:41.066086+0000","last_clean":"2024-04-25T03:09:41.066086+0000","last_became_active":"2024-04-25T00:51:40.608071+0000","last_became_peered":"2024-04-25T00:51:40.608071+0000","last_unstale":"2024-04-25T03:09:41.066086+0000","last_undegraded":"2024-04-25T03:09:41.066086+0000","last_fullsized":"2024-04-25T03:09:41.066086+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:48:27.210535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14358,"num_write":383,"num_write_kb":47358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"28'402","reported_seq":520,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.088602+0000","last_change":"2024-04-25T00:50:35.765173+0000","last_active":"2024-04-25T03:09:41.088602+0000","last_peered":"2024-04-25T03:09:41.088602+0000","last_clean":"2024-04-25T03:09:41.088602+0000","last_became_active":"2024-04-25T00:50:35.764412+0000","last_became_peered":"2024-04-25T00:50:35.764412+0000","last_unstale":"2024-04-25T03:09:41.088602+0000","last_undegraded":"2024-04-25T03:09:41.088602+0000","last_fullsized":"2024-04-25T03:09:41.088602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:54.948867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":23778,"num_write":367,"num_write_kb":71174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'383","reported_seq":491,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.067336+0000","last_change":"2024-04-25T00:50:35.764526+0000","last_active":"2024-04-25T03:09:41.067336+0000","last_peered":"2024-04-25T03:09:41.067336+0000","last_clean":"2024-04-25T03:09:41.067336+0000","last_became_active":"2024-04-25T00:50:35.763770+0000","last_became_peered":"2024-04-25T00:50:35.763770+0000","last_unstale":"2024-04-25T03:09:41.067336+0000","last_undegraded":"2024-04-25T03:09:41.067336+0000","last_fullsized":"2024-04-25T03:09:41.067336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:15.698294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20604,"num_write":365,"num_write_kb":74840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'373","reported_seq":489,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.657926+0000","last_change":"2024-04-25T00:50:35.822113+0000","last_active":"2024-04-25T03:09:40.657926+0000","last_peered":"2024-04-25T03:09:40.657926+0000","last_clean":"2024-04-25T03:09:40.657926+0000","last_became_active":"2024-04-25T00:50:35.821524+0000","last_became_peered":"2024-04-25T00:50:35.821524+0000","last_unstale":"2024-04-25T03:09:40.657926+0000","last_undegraded":"2024-04-25T03:09:40.657926+0000","last_fullsized":"2024-04-25T03:09:40.657926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:43.722114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22834,"num_write":346,"num_write_kb":67125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'376","reported_seq":454,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.066166+0000","last_change":"2024-04-25T00:50:35.881637+0000","last_active":"2024-04-25T03:09:41.066166+0000","last_peered":"2024-04-25T03:09:41.066166+0000","last_clean":"2024-04-25T03:09:41.066166+0000","last_became_active":"2024-04-25T00:50:35.880661+0000","last_became_peered":"2024-04-25T00:50:35.880661+0000","last_unstale":"2024-04-25T03:09:41.066166+0000","last_undegraded":"2024-04-25T03:09:41.066166+0000","last_fullsized":"2024-04-25T03:09:41.066166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:39.862610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":168,"num_write":340,"num_write_kb":38232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'401","reported_seq":479,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.905393+0000","last_change":"2024-04-25T00:50:35.796996+0000","last_active":"2024-04-25T03:09:40.905393+0000","last_peered":"2024-04-25T03:09:40.905393+0000","last_clean":"2024-04-25T03:09:40.905393+0000","last_became_active":"2024-04-25T00:50:35.795295+0000","last_became_peered":"2024-04-25T00:50:35.795295+0000","last_unstale":"2024-04-25T03:09:40.905393+0000","last_undegraded":"2024-04-25T03:09:40.905393+0000","last_fullsized":"2024-04-25T03:09:40.905393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:29.858476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":22306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'418","reported_seq":579,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.884949+0000","last_change":"2024-04-25T00:50:35.818291+0000","last_active":"2024-04-25T03:09:40.884949+0000","last_peered":"2024-04-25T03:09:40.884949+0000","last_clean":"2024-04-25T03:09:40.884949+0000","last_became_active":"2024-04-25T00:50:35.817575+0000","last_became_peered":"2024-04-25T00:50:35.817575+0000","last_unstale":"2024-04-25T03:09:40.884949+0000","last_undegraded":"2024-04-25T03:09:40.884949+0000","last_fullsized":"2024-04-25T03:09:40.884949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:51.142494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":52039,"num_write":380,"num_write_kb":55267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'423","reported_seq":512,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.662177+0000","last_change":"2024-04-25T00:50:35.797194+0000","last_active":"2024-04-25T03:09:40.662177+0000","last_peered":"2024-04-25T03:09:40.662177+0000","last_clean":"2024-04-25T03:09:40.662177+0000","last_became_active":"2024-04-25T00:50:35.796536+0000","last_became_peered":"2024-04-25T00:50:35.796536+0000","last_unstale":"2024-04-25T03:09:40.662177+0000","last_undegraded":"2024-04-25T03:09:40.662177+0000","last_fullsized":"2024-04-25T03:09:40.662177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:48:27.210535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4763,"num_write":382,"num_write_kb":21763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'399","reported_seq":507,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.655166+0000","last_change":"2024-04-25T00:50:35.729648+0000","last_active":"2024-04-25T03:09:40.655166+0000","last_peered":"2024-04-25T03:09:40.655166+0000","last_clean":"2024-04-25T03:09:40.655166+0000","last_became_active":"2024-04-25T00:50:35.728875+0000","last_became_peered":"2024-04-25T00:50:35.728875+0000","last_unstale":"2024-04-25T03:09:40.655166+0000","last_undegraded":"2024-04-25T03:09:40.655166+0000","last_fullsized":"2024-04-25T03:09:40.655166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:46.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10229,"num_write":366,"num_write_kb":22657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'400","reported_seq":498,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.071871+0000","last_change":"2024-04-25T00:50:35.760953+0000","last_active":"2024-04-25T03:09:41.071871+0000","last_peered":"2024-04-25T03:09:41.071871+0000","last_clean":"2024-04-25T03:09:41.071871+0000","last_became_active":"2024-04-25T00:50:35.760286+0000","last_became_peered":"2024-04-25T00:50:35.760286+0000","last_unstale":"2024-04-25T03:09:41.071871+0000","last_undegraded":"2024-04-25T03:09:41.071871+0000","last_fullsized":"2024-04-25T03:09:41.071871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:57.466393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9641,"num_write":360,"num_write_kb":34623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'447","reported_seq":591,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.651462+0000","last_change":"2024-04-25T00:50:35.732837+0000","last_active":"2024-04-25T03:09:40.651462+0000","last_peered":"2024-04-25T03:09:40.651462+0000","last_clean":"2024-04-25T03:09:40.651462+0000","last_became_active":"2024-04-25T00:50:35.732134+0000","last_became_peered":"2024-04-25T00:50:35.732134+0000","last_unstale":"2024-04-25T03:09:40.651462+0000","last_undegraded":"2024-04-25T03:09:40.651462+0000","last_fullsized":"2024-04-25T03:09:40.651462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:46.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":29174,"num_write":415,"num_write_kb":129675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"28'442","reported_seq":544,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.067632+0000","last_change":"2024-04-25T00:50:35.818607+0000","last_active":"2024-04-25T03:09:41.067632+0000","last_peered":"2024-04-25T03:09:41.067632+0000","last_clean":"2024-04-25T03:09:41.067632+0000","last_became_active":"2024-04-25T00:50:35.818063+0000","last_became_peered":"2024-04-25T00:50:35.818063+0000","last_unstale":"2024-04-25T03:09:41.067632+0000","last_undegraded":"2024-04-25T03:09:41.067632+0000","last_fullsized":"2024-04-25T03:09:41.067632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:15.875347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20728,"num_write":411,"num_write_kb":42636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"28'443","reported_seq":581,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.907106+0000","last_change":"2024-04-25T00:50:35.798297+0000","last_active":"2024-04-25T03:09:40.907106+0000","last_peered":"2024-04-25T03:09:40.907106+0000","last_clean":"2024-04-25T03:09:40.907106+0000","last_became_active":"2024-04-25T00:50:35.797580+0000","last_became_peered":"2024-04-25T00:50:35.797580+0000","last_unstale":"2024-04-25T03:09:40.907106+0000","last_undegraded":"2024-04-25T03:09:40.907106+0000","last_fullsized":"2024-04-25T03:09:40.907106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:06.596770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28574,"num_write":419,"num_write_kb":125045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"28'422","reported_seq":523,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.063896+0000","last_change":"2024-04-25T00:51:40.408412+0000","last_active":"2024-04-25T03:09:41.063896+0000","last_peered":"2024-04-25T03:09:41.063896+0000","last_clean":"2024-04-25T03:09:41.063896+0000","last_became_active":"2024-04-25T00:51:40.407614+0000","last_became_peered":"2024-04-25T00:51:40.407614+0000","last_unstale":"2024-04-25T03:09:41.063896+0000","last_undegraded":"2024-04-25T03:09:41.063896+0000","last_fullsized":"2024-04-25T03:09:41.063896+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:10.742578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":17978,"num_write":385,"num_write_kb":59372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"28'409","reported_seq":522,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.036825+0000","last_change":"2024-04-25T00:50:35.877261+0000","last_active":"2024-04-25T03:09:41.036825+0000","last_peered":"2024-04-25T03:09:41.036825+0000","last_clean":"2024-04-25T03:09:41.036825+0000","last_became_active":"2024-04-25T00:50:35.876489+0000","last_became_peered":"2024-04-25T00:50:35.876489+0000","last_unstale":"2024-04-25T03:09:41.036825+0000","last_undegraded":"2024-04-25T03:09:41.036825+0000","last_fullsized":"2024-04-25T03:09:41.036825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:14:31.440563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":9083,"num_write":379,"num_write_kb":55476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'437","reported_seq":561,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.651386+0000","last_change":"2024-04-25T00:50:35.877693+0000","last_active":"2024-04-25T03:09:40.651386+0000","last_peered":"2024-04-25T03:09:40.651386+0000","last_clean":"2024-04-25T03:09:40.651386+0000","last_became_active":"2024-04-25T00:50:35.876870+0000","last_became_peered":"2024-04-25T00:50:35.876870+0000","last_unstale":"2024-04-25T03:09:40.651386+0000","last_undegraded":"2024-04-25T03:09:40.651386+0000","last_fullsized":"2024-04-25T03:09:40.651386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:53.474315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":19659,"num_write":409,"num_write_kb":79764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"28'386","reported_seq":490,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.030696+0000","last_change":"2024-04-25T00:50:35.881027+0000","last_active":"2024-04-25T03:09:41.030696+0000","last_peered":"2024-04-25T03:09:41.030696+0000","last_clean":"2024-04-25T03:09:41.030696+0000","last_became_active":"2024-04-25T00:50:35.880477+0000","last_became_peered":"2024-04-25T00:50:35.880477+0000","last_unstale":"2024-04-25T03:09:41.030696+0000","last_undegraded":"2024-04-25T03:09:41.030696+0000","last_fullsized":"2024-04-25T03:09:41.030696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:55:59.176935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12882,"num_write":369,"num_write_kb":38131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"28'477","reported_seq":598,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.088090+0000","last_change":"2024-04-25T00:50:35.765295+0000","last_active":"2024-04-25T03:09:41.088090+0000","last_peered":"2024-04-25T03:09:41.088090+0000","last_clean":"2024-04-25T03:09:41.088090+0000","last_became_active":"2024-04-25T00:50:35.764358+0000","last_became_peered":"2024-04-25T00:50:35.764358+0000","last_unstale":"2024-04-25T03:09:41.088090+0000","last_undegraded":"2024-04-25T03:09:41.088090+0000","last_fullsized":"2024-04-25T03:09:41.088090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:15.104631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":19569,"num_write":439,"num_write_kb":84809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'424","reported_seq":585,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.888427+0000","last_change":"2024-04-25T00:50:35.869695+0000","last_active":"2024-04-25T03:09:40.888427+0000","last_peered":"2024-04-25T03:09:40.888427+0000","last_clean":"2024-04-25T03:09:40.888427+0000","last_became_active":"2024-04-25T00:50:35.868857+0000","last_became_peered":"2024-04-25T00:50:35.868857+0000","last_unstale":"2024-04-25T03:09:40.888427+0000","last_undegraded":"2024-04-25T03:09:40.888427+0000","last_fullsized":"2024-04-25T03:09:40.888427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:35:38.295580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50759,"num_write":394,"num_write_kb":108657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"28'403","reported_seq":563,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.033206+0000","last_change":"2024-04-25T00:50:35.884507+0000","last_active":"2024-04-25T03:09:41.033206+0000","last_peered":"2024-04-25T03:09:41.033206+0000","last_clean":"2024-04-25T03:09:41.033206+0000","last_became_active":"2024-04-25T00:50:35.883901+0000","last_became_peered":"2024-04-25T00:50:35.883901+0000","last_unstale":"2024-04-25T03:09:41.033206+0000","last_undegraded":"2024-04-25T03:09:41.033206+0000","last_fullsized":"2024-04-25T03:09:41.033206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:40.533818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":36518,"num_write":378,"num_write_kb":108957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'386","reported_seq":490,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.906940+0000","last_change":"2024-04-25T00:50:35.878649+0000","last_active":"2024-04-25T03:09:40.906940+0000","last_peered":"2024-04-25T03:09:40.906940+0000","last_clean":"2024-04-25T03:09:40.906940+0000","last_became_active":"2024-04-25T00:50:35.877870+0000","last_became_peered":"2024-04-25T00:50:35.877870+0000","last_unstale":"2024-04-25T03:09:40.906940+0000","last_undegraded":"2024-04-25T03:09:40.906940+0000","last_fullsized":"2024-04-25T03:09:40.906940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12325,"num_write":357,"num_write_kb":37847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"28'487","reported_seq":632,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.644401+0000","last_change":"2024-04-25T00:50:35.869614+0000","last_active":"2024-04-25T03:09:40.644401+0000","last_peered":"2024-04-25T03:09:40.644401+0000","last_clean":"2024-04-25T03:09:40.644401+0000","last_became_active":"2024-04-25T00:50:35.869016+0000","last_became_peered":"2024-04-25T00:50:35.869016+0000","last_unstale":"2024-04-25T03:09:40.644401+0000","last_undegraded":"2024-04-25T03:09:40.644401+0000","last_fullsized":"2024-04-25T03:09:40.644401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:02.888747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33246,"num_write":457,"num_write_kb":117202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"28'457","reported_seq":577,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.066664+0000","last_change":"2024-04-25T00:50:35.728757+0000","last_active":"2024-04-25T03:09:41.066664+0000","last_peered":"2024-04-25T03:09:41.066664+0000","last_clean":"2024-04-25T03:09:41.066664+0000","last_became_active":"2024-04-25T00:50:35.728271+0000","last_became_peered":"2024-04-25T00:50:35.728271+0000","last_unstale":"2024-04-25T03:09:41.066664+0000","last_undegraded":"2024-04-25T03:09:41.066664+0000","last_fullsized":"2024-04-25T03:09:41.066664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:43.722114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18149,"num_write":425,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"28'412","reported_seq":509,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.071602+0000","last_change":"2024-04-25T00:50:35.802347+0000","last_active":"2024-04-25T03:09:41.071602+0000","last_peered":"2024-04-25T03:09:41.071602+0000","last_clean":"2024-04-25T03:09:41.071602+0000","last_became_active":"2024-04-25T00:50:35.801389+0000","last_became_peered":"2024-04-25T00:50:35.801389+0000","last_unstale":"2024-04-25T03:09:41.071602+0000","last_undegraded":"2024-04-25T03:09:41.071602+0000","last_fullsized":"2024-04-25T03:09:41.071602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:27.176441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4792,"num_write":381,"num_write_kb":30347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"28'401","reported_seq":506,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.654605+0000","last_change":"2024-04-25T00:50:35.822222+0000","last_active":"2024-04-25T03:09:40.654605+0000","last_peered":"2024-04-25T03:09:40.654605+0000","last_clean":"2024-04-25T03:09:40.654605+0000","last_became_active":"2024-04-25T00:50:35.821484+0000","last_became_peered":"2024-04-25T00:50:35.821484+0000","last_unstale":"2024-04-25T03:09:40.654605+0000","last_undegraded":"2024-04-25T03:09:40.654605+0000","last_fullsized":"2024-04-25T03:09:40.654605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:59.921295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18401,"num_write":362,"num_write_kb":62496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'364","reported_seq":442,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:06.145410+0000","last_change":"2024-04-25T00:50:33.391742+0000","last_active":"2024-04-25T03:08:06.145410+0000","last_peered":"2024-04-25T03:08:06.145410+0000","last_clean":"2024-04-25T03:08:06.145410+0000","last_became_active":"2024-04-25T00:50:33.390901+0000","last_became_peered":"2024-04-25T00:50:33.390901+0000","last_unstale":"2024-04-25T03:08:06.145410+0000","last_undegraded":"2024-04-25T03:08:06.145410+0000","last_fullsized":"2024-04-25T03:08:06.145410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:27.804469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":4231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'355","reported_seq":433,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.907459+0000","last_change":"2024-04-25T00:50:35.821496+0000","last_active":"2024-04-25T03:09:40.907459+0000","last_peered":"2024-04-25T03:09:40.907459+0000","last_clean":"2024-04-25T03:09:40.907459+0000","last_became_active":"2024-04-25T00:50:35.820763+0000","last_became_peered":"2024-04-25T00:50:35.820763+0000","last_unstale":"2024-04-25T03:09:40.907459+0000","last_undegraded":"2024-04-25T03:09:40.907459+0000","last_fullsized":"2024-04-25T03:09:40.907459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:15.698294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":529,"num_write":324,"num_write_kb":17419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"28'2226","reported_seq":2304,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:58.865093+0000","last_change":"2024-04-25T00:50:33.394753+0000","last_active":"2024-04-25T03:07:58.865093+0000","last_peered":"2024-04-25T03:07:58.865093+0000","last_clean":"2024-04-25T03:07:58.865093+0000","last_became_active":"2024-04-25T00:50:33.392951+0000","last_became_peered":"2024-04-25T00:50:33.392951+0000","last_unstale":"2024-04-25T03:07:58.865093+0000","last_undegraded":"2024-04-25T03:07:58.865093+0000","last_fullsized":"2024-04-25T03:07:58.865093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2226,"log_dups_size":0,"ondisk_log_size":2226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:41.175588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2166,"num_write_kb":17433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'819","reported_seq":899,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:06.154833+0000","last_change":"2024-04-25T00:50:33.393229+0000","last_active":"2024-04-25T03:09:06.154833+0000","last_peered":"2024-04-25T03:09:06.154833+0000","last_clean":"2024-04-25T03:09:06.154833+0000","last_became_active":"2024-04-25T00:50:33.392817+0000","last_became_peered":"2024-04-25T00:50:33.392817+0000","last_unstale":"2024-04-25T03:09:06.154833+0000","last_undegraded":"2024-04-25T03:09:06.154833+0000","last_fullsized":"2024-04-25T03:09:06.154833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:31:12.131616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":4477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'429","reported_seq":503,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.898490+0000","last_change":"2024-04-25T00:51:40.320773+0000","last_active":"2024-04-25T03:09:40.898490+0000","last_peered":"2024-04-25T03:09:40.898490+0000","last_clean":"2024-04-25T03:09:40.898490+0000","last_became_active":"2024-04-25T00:51:40.319726+0000","last_became_peered":"2024-04-25T00:51:40.319726+0000","last_unstale":"2024-04-25T03:09:40.898490+0000","last_undegraded":"2024-04-25T03:09:40.898490+0000","last_fullsized":"2024-04-25T03:09:40.898490+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:38:21.556620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4282,"num_write":403,"num_write_kb":55112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'1293","reported_seq":1373,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:22.138872+0000","last_change":"2024-04-25T00:50:33.383755+0000","last_active":"2024-04-25T03:08:22.138872+0000","last_peered":"2024-04-25T03:08:22.138872+0000","last_clean":"2024-04-25T03:08:22.138872+0000","last_became_active":"2024-04-25T00:50:33.382925+0000","last_became_peered":"2024-04-25T00:50:33.382925+0000","last_unstale":"2024-04-25T03:08:22.138872+0000","last_undegraded":"2024-04-25T03:08:22.138872+0000","last_fullsized":"2024-04-25T03:08:22.138872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1293,"log_dups_size":0,"ondisk_log_size":1293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:52.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1222,"num_write_kb":12901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'453","reported_seq":605,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.893325+0000","last_change":"2024-04-25T00:50:35.869794+0000","last_active":"2024-04-25T03:09:40.893325+0000","last_peered":"2024-04-25T03:09:40.893325+0000","last_clean":"2024-04-25T03:09:40.893325+0000","last_became_active":"2024-04-25T00:50:35.869028+0000","last_became_peered":"2024-04-25T00:50:35.869028+0000","last_unstale":"2024-04-25T03:09:40.893325+0000","last_undegraded":"2024-04-25T03:09:40.893325+0000","last_fullsized":"2024-04-25T03:09:40.893325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:49.891966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":36096,"num_write":419,"num_write_kb":96892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'61","reported_seq":141,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.363278+0000","last_change":"2024-04-25T00:50:33.394082+0000","last_active":"2024-04-25T03:09:40.363278+0000","last_peered":"2024-04-25T03:09:40.363278+0000","last_clean":"2024-04-25T03:09:40.363278+0000","last_became_active":"2024-04-25T00:50:33.392792+0000","last_became_peered":"2024-04-25T00:50:33.392792+0000","last_unstale":"2024-04-25T03:09:40.363278+0000","last_undegraded":"2024-04-25T03:09:40.363278+0000","last_fullsized":"2024-04-25T03:09:40.363278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:35:15.441104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'435","reported_seq":547,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.723136+0000","last_change":"2024-04-25T00:50:35.729414+0000","last_active":"2024-04-25T03:09:40.723136+0000","last_peered":"2024-04-25T03:09:40.723136+0000","last_clean":"2024-04-25T03:09:40.723136+0000","last_became_active":"2024-04-25T00:50:35.728725+0000","last_became_peered":"2024-04-25T00:50:35.728725+0000","last_unstale":"2024-04-25T03:09:40.723136+0000","last_undegraded":"2024-04-25T03:09:40.723136+0000","last_fullsized":"2024-04-25T03:09:40.723136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:05.046355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":25476,"num_write":407,"num_write_kb":112477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'1187","reported_seq":1267,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.378202+0000","last_change":"2024-04-25T00:50:33.388191+0000","last_active":"2024-04-25T03:09:40.378202+0000","last_peered":"2024-04-25T03:09:40.378202+0000","last_clean":"2024-04-25T03:09:40.378202+0000","last_became_active":"2024-04-25T00:50:33.387266+0000","last_became_peered":"2024-04-25T00:50:33.387266+0000","last_unstale":"2024-04-25T03:09:40.378202+0000","last_undegraded":"2024-04-25T03:09:40.378202+0000","last_fullsized":"2024-04-25T03:09:40.378202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1187,"log_dups_size":0,"ondisk_log_size":1187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:08.400693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10267224,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1125,"num_write_kb":10596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'390","reported_seq":492,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.900667+0000","last_change":"2024-04-25T00:50:35.799783+0000","last_active":"2024-04-25T03:09:40.900667+0000","last_peered":"2024-04-25T03:09:40.900667+0000","last_clean":"2024-04-25T03:09:40.900667+0000","last_became_active":"2024-04-25T00:50:35.798471+0000","last_became_peered":"2024-04-25T00:50:35.798471+0000","last_unstale":"2024-04-25T03:09:40.900667+0000","last_undegraded":"2024-04-25T03:09:40.900667+0000","last_fullsized":"2024-04-25T03:09:40.900667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:15.104631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14757,"num_write":355,"num_write_kb":59761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"28'3380","reported_seq":3460,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:34.194188+0000","last_change":"2024-04-25T00:50:33.304731+0000","last_active":"2024-04-25T03:09:34.194188+0000","last_peered":"2024-04-25T03:09:34.194188+0000","last_clean":"2024-04-25T03:09:34.194188+0000","last_became_active":"2024-04-25T00:50:33.303821+0000","last_became_peered":"2024-04-25T00:50:33.303821+0000","last_unstale":"2024-04-25T03:09:34.194188+0000","last_undegraded":"2024-04-25T03:09:34.194188+0000","last_fullsized":"2024-04-25T03:09:34.194188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3380,"log_dups_size":0,"ondisk_log_size":3380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:32.196488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3329,"num_write_kb":11127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'419","reported_seq":559,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.663718+0000","last_change":"2024-04-25T00:50:35.828727+0000","last_active":"2024-04-25T03:09:40.663718+0000","last_peered":"2024-04-25T03:09:40.663718+0000","last_clean":"2024-04-25T03:09:40.663718+0000","last_became_active":"2024-04-25T00:50:35.827617+0000","last_became_peered":"2024-04-25T00:50:35.827617+0000","last_unstale":"2024-04-25T03:09:40.663718+0000","last_undegraded":"2024-04-25T03:09:40.663718+0000","last_fullsized":"2024-04-25T03:09:40.663718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:30:10.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":28588,"num_write":390,"num_write_kb":92970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"28'2245","reported_seq":2327,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:19.177513+0000","last_change":"2024-04-25T00:50:33.391005+0000","last_active":"2024-04-25T03:09:19.177513+0000","last_peered":"2024-04-25T03:09:19.177513+0000","last_clean":"2024-04-25T03:09:19.177513+0000","last_became_active":"2024-04-25T00:50:33.390133+0000","last_became_peered":"2024-04-25T00:50:33.390133+0000","last_unstale":"2024-04-25T03:09:19.177513+0000","last_undegraded":"2024-04-25T03:09:19.177513+0000","last_fullsized":"2024-04-25T03:09:19.177513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2245,"log_dups_size":0,"ondisk_log_size":2245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:19.913188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2203,"num_write_kb":13669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'392","reported_seq":516,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.662684+0000","last_change":"2024-04-25T00:50:35.876022+0000","last_active":"2024-04-25T03:09:40.662684+0000","last_peered":"2024-04-25T03:09:40.662684+0000","last_clean":"2024-04-25T03:09:40.662684+0000","last_became_active":"2024-04-25T00:50:35.875322+0000","last_became_peered":"2024-04-25T00:50:35.875322+0000","last_unstale":"2024-04-25T03:09:40.662684+0000","last_undegraded":"2024-04-25T03:09:40.662684+0000","last_fullsized":"2024-04-25T03:09:40.662684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":27925,"num_write":356,"num_write_kb":62573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"28'713","reported_seq":795,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:59.810791+0000","last_change":"2024-04-25T00:50:33.387295+0000","last_active":"2024-04-25T03:07:59.810791+0000","last_peered":"2024-04-25T03:07:59.810791+0000","last_clean":"2024-04-25T03:07:59.810791+0000","last_became_active":"2024-04-25T00:50:33.386297+0000","last_became_peered":"2024-04-25T00:50:33.386297+0000","last_unstale":"2024-04-25T03:07:59.810791+0000","last_undegraded":"2024-04-25T03:07:59.810791+0000","last_fullsized":"2024-04-25T03:07:59.810791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:31:57.597514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":8480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'401","reported_seq":490,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.905548+0000","last_change":"2024-04-25T00:50:35.796873+0000","last_active":"2024-04-25T03:09:40.905548+0000","last_peered":"2024-04-25T03:09:40.905548+0000","last_clean":"2024-04-25T03:09:40.905548+0000","last_became_active":"2024-04-25T00:50:35.796012+0000","last_became_peered":"2024-04-25T00:50:35.796012+0000","last_unstale":"2024-04-25T03:09:40.905548+0000","last_undegraded":"2024-04-25T03:09:40.905548+0000","last_fullsized":"2024-04-25T03:09:40.905548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:22.255073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4846,"num_write":362,"num_write_kb":30162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"28'56","reported_seq":138,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:33.058035+0000","last_change":"2024-04-25T00:50:33.385522+0000","last_active":"2024-04-25T03:09:33.058035+0000","last_peered":"2024-04-25T03:09:33.058035+0000","last_clean":"2024-04-25T03:09:33.058035+0000","last_became_active":"2024-04-25T00:50:33.384620+0000","last_became_peered":"2024-04-25T00:50:33.384620+0000","last_unstale":"2024-04-25T03:09:33.058035+0000","last_undegraded":"2024-04-25T03:09:33.058035+0000","last_fullsized":"2024-04-25T03:09:33.058035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:24.908029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'414","reported_seq":522,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.720638+0000","last_change":"2024-04-25T00:50:35.820565+0000","last_active":"2024-04-25T03:09:40.720638+0000","last_peered":"2024-04-25T03:09:40.720638+0000","last_clean":"2024-04-25T03:09:40.720638+0000","last_became_active":"2024-04-25T00:50:35.819683+0000","last_became_peered":"2024-04-25T00:50:35.819683+0000","last_unstale":"2024-04-25T03:09:40.720638+0000","last_undegraded":"2024-04-25T03:09:40.720638+0000","last_fullsized":"2024-04-25T03:09:40.720638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:28.655307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":8938,"num_write":378,"num_write_kb":68659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'60","reported_seq":142,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:17.098745+0000","last_change":"2024-04-25T00:50:33.390745+0000","last_active":"2024-04-25T03:08:17.098745+0000","last_peered":"2024-04-25T03:08:17.098745+0000","last_clean":"2024-04-25T03:08:17.098745+0000","last_became_active":"2024-04-25T00:50:33.390089+0000","last_became_peered":"2024-04-25T00:50:33.390089+0000","last_unstale":"2024-04-25T03:08:17.098745+0000","last_undegraded":"2024-04-25T03:08:17.098745+0000","last_fullsized":"2024-04-25T03:08:17.098745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:51.294701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'418","reported_seq":511,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.070072+0000","last_change":"2024-04-25T00:50:35.801766+0000","last_active":"2024-04-25T03:09:41.070072+0000","last_peered":"2024-04-25T03:09:41.070072+0000","last_clean":"2024-04-25T03:09:41.070072+0000","last_became_active":"2024-04-25T00:50:35.801060+0000","last_became_peered":"2024-04-25T00:50:35.801060+0000","last_unstale":"2024-04-25T03:09:41.070072+0000","last_undegraded":"2024-04-25T03:09:41.070072+0000","last_fullsized":"2024-04-25T03:09:41.070072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9600,"num_write":393,"num_write_kb":50549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"28'894","reported_seq":976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:31.197675+0000","last_change":"2024-04-25T00:50:33.327283+0000","last_active":"2024-04-25T03:09:31.197675+0000","last_peered":"2024-04-25T03:09:31.197675+0000","last_clean":"2024-04-25T03:09:31.197675+0000","last_became_active":"2024-04-25T00:50:33.326464+0000","last_became_peered":"2024-04-25T00:50:33.326464+0000","last_unstale":"2024-04-25T03:09:31.197675+0000","last_undegraded":"2024-04-25T03:09:31.197675+0000","last_fullsized":"2024-04-25T03:09:31.197675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:26:26.328621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":8609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'491","reported_seq":685,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.662645+0000","last_change":"2024-04-25T00:50:35.825910+0000","last_active":"2024-04-25T03:09:40.662645+0000","last_peered":"2024-04-25T03:09:40.662645+0000","last_clean":"2024-04-25T03:09:40.662645+0000","last_became_active":"2024-04-25T00:50:35.825246+0000","last_became_peered":"2024-04-25T00:50:35.825246+0000","last_unstale":"2024-04-25T03:09:40.662645+0000","last_undegraded":"2024-04-25T03:09:40.662645+0000","last_fullsized":"2024-04-25T03:09:40.662645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:40.106788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":62450,"num_write":458,"num_write_kb":109145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'805","reported_seq":889,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:32.246466+0000","last_change":"2024-04-25T00:50:33.393856+0000","last_active":"2024-04-25T03:08:32.246466+0000","last_peered":"2024-04-25T03:08:32.246466+0000","last_clean":"2024-04-25T03:08:32.246466+0000","last_became_active":"2024-04-25T00:50:33.393153+0000","last_became_peered":"2024-04-25T00:50:33.393153+0000","last_unstale":"2024-04-25T03:08:32.246466+0000","last_undegraded":"2024-04-25T03:08:32.246466+0000","last_fullsized":"2024-04-25T03:08:32.246466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:55.179146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":4477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'357","reported_seq":488,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.665816+0000","last_change":"2024-04-25T00:50:35.811993+0000","last_active":"2024-04-25T03:09:40.665816+0000","last_peered":"2024-04-25T03:09:40.665816+0000","last_clean":"2024-04-25T03:09:40.665816+0000","last_became_active":"2024-04-25T00:50:35.811267+0000","last_became_peered":"2024-04-25T00:50:35.811267+0000","last_unstale":"2024-04-25T03:09:40.665816+0000","last_undegraded":"2024-04-25T03:09:40.665816+0000","last_fullsized":"2024-04-25T03:09:40.665816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:40:20.385617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":21001,"num_write":331,"num_write_kb":38526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'903","reported_seq":987,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:20.853159+0000","last_change":"2024-04-25T00:50:33.383040+0000","last_active":"2024-04-25T03:07:20.853159+0000","last_peered":"2024-04-25T03:07:20.853159+0000","last_clean":"2024-04-25T03:07:20.853159+0000","last_became_active":"2024-04-25T00:50:33.382270+0000","last_became_peered":"2024-04-25T00:50:33.382270+0000","last_unstale":"2024-04-25T03:07:20.853159+0000","last_undegraded":"2024-04-25T03:07:20.853159+0000","last_fullsized":"2024-04-25T03:07:20.853159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:13.866739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":844,"num_write_kb":4518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'401","reported_seq":521,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.707568+0000","last_change":"2024-04-25T00:50:35.818234+0000","last_active":"2024-04-25T03:09:40.707568+0000","last_peered":"2024-04-25T03:09:40.707568+0000","last_clean":"2024-04-25T03:09:40.707568+0000","last_became_active":"2024-04-25T00:50:35.817707+0000","last_became_peered":"2024-04-25T00:50:35.817707+0000","last_unstale":"2024-04-25T03:09:40.707568+0000","last_undegraded":"2024-04-25T03:09:40.707568+0000","last_fullsized":"2024-04-25T03:09:40.707568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:31.998886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16207,"num_write":370,"num_write_kb":59244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"28'326","reported_seq":410,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:46.654107+0000","last_change":"2024-04-25T00:50:33.389774+0000","last_active":"2024-04-25T03:07:46.654107+0000","last_peered":"2024-04-25T03:07:46.654107+0000","last_clean":"2024-04-25T03:07:46.654107+0000","last_became_active":"2024-04-25T00:50:33.389092+0000","last_became_peered":"2024-04-25T00:50:33.389092+0000","last_unstale":"2024-04-25T03:07:46.654107+0000","last_undegraded":"2024-04-25T03:07:46.654107+0000","last_fullsized":"2024-04-25T03:07:46.654107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:30.722771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'441","reported_seq":582,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.646651+0000","last_change":"2024-04-25T00:50:35.869211+0000","last_active":"2024-04-25T03:09:40.646651+0000","last_peered":"2024-04-25T03:09:40.646651+0000","last_clean":"2024-04-25T03:09:40.646651+0000","last_became_active":"2024-04-25T00:50:35.868798+0000","last_became_peered":"2024-04-25T00:50:35.868798+0000","last_unstale":"2024-04-25T03:09:40.646651+0000","last_undegraded":"2024-04-25T03:09:40.646651+0000","last_fullsized":"2024-04-25T03:09:40.646651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:40.106788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27029,"num_write":413,"num_write_kb":63857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"28'319","reported_seq":403,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:15.892809+0000","last_change":"2024-04-25T00:50:33.329578+0000","last_active":"2024-04-25T03:09:15.892809+0000","last_peered":"2024-04-25T03:09:15.892809+0000","last_clean":"2024-04-25T03:09:15.892809+0000","last_became_active":"2024-04-25T00:50:33.328950+0000","last_became_peered":"2024-04-25T00:50:33.328950+0000","last_unstale":"2024-04-25T03:09:15.892809+0000","last_undegraded":"2024-04-25T03:09:15.892809+0000","last_fullsized":"2024-04-25T03:09:15.892809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:55.179146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196056,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":254,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'426","reported_seq":560,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.709661+0000","last_change":"2024-04-25T00:50:35.734419+0000","last_active":"2024-04-25T03:09:40.709661+0000","last_peered":"2024-04-25T03:09:40.709661+0000","last_clean":"2024-04-25T03:09:40.709661+0000","last_became_active":"2024-04-25T00:50:35.733696+0000","last_became_peered":"2024-04-25T00:50:35.733696+0000","last_unstale":"2024-04-25T03:09:40.709661+0000","last_undegraded":"2024-04-25T03:09:40.709661+0000","last_fullsized":"2024-04-25T03:09:40.709661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:05.046355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":28368,"num_write":395,"num_write_kb":71042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":248,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:06:32.174332+0000","last_change":"2024-04-25T00:49:55.281216+0000","last_active":"2024-04-25T03:06:32.174332+0000","last_peered":"2024-04-25T03:06:32.174332+0000","last_clean":"2024-04-25T03:06:32.174332+0000","last_became_active":"2024-04-25T00:49:55.278022+0000","last_became_peered":"2024-04-25T00:49:55.278022+0000","last_unstale":"2024-04-25T03:06:32.174332+0000","last_undegraded":"2024-04-25T03:06:32.174332+0000","last_fullsized":"2024-04-25T03:06:32.174332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:49:52.475299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:49:52.475299+0000","last_clean_scrub_stamp":"2024-04-25T00:49:52.475299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:17.046656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"28'385","reported_seq":474,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:11.554423+0000","last_change":"2024-04-25T00:50:33.325228+0000","last_active":"2024-04-25T03:09:11.554423+0000","last_peered":"2024-04-25T03:09:11.554423+0000","last_clean":"2024-04-25T03:09:11.554423+0000","last_became_active":"2024-04-25T00:50:33.324579+0000","last_became_peered":"2024-04-25T00:50:33.324579+0000","last_unstale":"2024-04-25T03:09:11.554423+0000","last_undegraded":"2024-04-25T03:09:11.554423+0000","last_fullsized":"2024-04-25T03:09:11.554423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:12.762746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'354","reported_seq":469,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.039589+0000","last_change":"2024-04-25T00:50:35.880348+0000","last_active":"2024-04-25T03:09:41.039589+0000","last_peered":"2024-04-25T03:09:41.039589+0000","last_clean":"2024-04-25T03:09:41.039589+0000","last_became_active":"2024-04-25T00:50:35.878438+0000","last_became_peered":"2024-04-25T00:50:35.878438+0000","last_unstale":"2024-04-25T03:09:41.039589+0000","last_undegraded":"2024-04-25T03:09:41.039589+0000","last_fullsized":"2024-04-25T03:09:41.039589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:44.093119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20480,"num_write":322,"num_write_kb":49980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"28'1052","reported_seq":1144,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:51.863301+0000","last_change":"2024-04-25T00:50:33.321385+0000","last_active":"2024-04-25T03:08:51.863301+0000","last_peered":"2024-04-25T03:08:51.863301+0000","last_clean":"2024-04-25T03:08:51.863301+0000","last_became_active":"2024-04-25T00:50:33.320800+0000","last_became_peered":"2024-04-25T00:50:33.320800+0000","last_unstale":"2024-04-25T03:08:51.863301+0000","last_undegraded":"2024-04-25T03:08:51.863301+0000","last_fullsized":"2024-04-25T03:08:51.863301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:04.254885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":991,"num_write_kb":12720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"28'420","reported_seq":532,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.894623+0000","last_change":"2024-04-25T00:50:35.815056+0000","last_active":"2024-04-25T03:09:40.894623+0000","last_peered":"2024-04-25T03:09:40.894623+0000","last_clean":"2024-04-25T03:09:40.894623+0000","last_became_active":"2024-04-25T00:50:35.814163+0000","last_became_peered":"2024-04-25T00:50:35.814163+0000","last_unstale":"2024-04-25T03:09:40.894623+0000","last_undegraded":"2024-04-25T03:09:40.894623+0000","last_fullsized":"2024-04-25T03:09:40.894623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:50:52.289674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14110,"num_write":386,"num_write_kb":112699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"28'4457","reported_seq":8941,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:36.126848+0000","last_change":"2024-04-25T00:50:33.384695+0000","last_active":"2024-04-25T03:09:36.126848+0000","last_peered":"2024-04-25T03:09:36.126848+0000","last_clean":"2024-04-25T03:09:36.126848+0000","last_became_active":"2024-04-25T00:50:33.383692+0000","last_became_peered":"2024-04-25T00:50:33.383692+0000","last_unstale":"2024-04-25T03:09:36.126848+0000","last_undegraded":"2024-04-25T03:09:36.126848+0000","last_fullsized":"2024-04-25T03:09:36.126848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":4457,"log_dups_size":0,"ondisk_log_size":4457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:57.579410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1471076,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4395,"num_read_kb":4765,"num_write":4402,"num_write_kb":4769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'402","reported_seq":517,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.888992+0000","last_change":"2024-04-25T00:50:35.723048+0000","last_active":"2024-04-25T03:09:40.888992+0000","last_peered":"2024-04-25T03:09:40.888992+0000","last_clean":"2024-04-25T03:09:40.888992+0000","last_became_active":"2024-04-25T00:50:35.722500+0000","last_became_peered":"2024-04-25T00:50:35.722500+0000","last_unstale":"2024-04-25T03:09:40.888992+0000","last_undegraded":"2024-04-25T03:09:40.888992+0000","last_fullsized":"2024-04-25T03:09:40.888992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:20:39.082516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13853,"num_write":369,"num_write_kb":30117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"28'1036","reported_seq":1125,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:06:02.117152+0000","last_change":"2024-04-25T00:50:33.305927+0000","last_active":"2024-04-25T03:06:02.117152+0000","last_peered":"2024-04-25T03:06:02.117152+0000","last_clean":"2024-04-25T03:06:02.117152+0000","last_became_active":"2024-04-25T00:50:33.305159+0000","last_became_peered":"2024-04-25T00:50:33.305159+0000","last_unstale":"2024-04-25T03:06:02.117152+0000","last_undegraded":"2024-04-25T03:06:02.117152+0000","last_fullsized":"2024-04-25T03:06:02.117152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1036,"log_dups_size":0,"ondisk_log_size":1036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:46:56.639410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":968,"num_write_kb":8653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'394","reported_seq":551,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.639498+0000","last_change":"2024-04-25T00:50:35.824491+0000","last_active":"2024-04-25T03:09:40.639498+0000","last_peered":"2024-04-25T03:09:40.639498+0000","last_clean":"2024-04-25T03:09:40.639498+0000","last_became_active":"2024-04-25T00:50:35.823320+0000","last_became_peered":"2024-04-25T00:50:35.823320+0000","last_unstale":"2024-04-25T03:09:40.639498+0000","last_undegraded":"2024-04-25T03:09:40.639498+0000","last_fullsized":"2024-04-25T03:09:40.639498+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:57.466393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":47782,"num_write":359,"num_write_kb":62996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"28'368","reported_seq":457,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:04.082610+0000","last_change":"2024-04-25T00:50:33.304490+0000","last_active":"2024-04-25T03:08:04.082610+0000","last_peered":"2024-04-25T03:08:04.082610+0000","last_clean":"2024-04-25T03:08:04.082610+0000","last_became_active":"2024-04-25T00:50:33.303671+0000","last_became_peered":"2024-04-25T00:50:33.303671+0000","last_unstale":"2024-04-25T03:08:04.082610+0000","last_undegraded":"2024-04-25T03:08:04.082610+0000","last_fullsized":"2024-04-25T03:08:04.082610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:30.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":4247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'437","reported_seq":572,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.663449+0000","last_change":"2024-04-25T00:50:35.878641+0000","last_active":"2024-04-25T03:09:40.663449+0000","last_peered":"2024-04-25T03:09:40.663449+0000","last_clean":"2024-04-25T03:09:40.663449+0000","last_became_active":"2024-04-25T00:50:35.876958+0000","last_became_peered":"2024-04-25T00:50:35.876958+0000","last_unstale":"2024-04-25T03:09:40.663449+0000","last_undegraded":"2024-04-25T03:09:40.663449+0000","last_fullsized":"2024-04-25T03:09:40.663449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:59.565909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":21227,"num_write":402,"num_write_kb":75746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"28'1039","reported_seq":1128,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:42.196406+0000","last_change":"2024-04-25T00:50:33.319229+0000","last_active":"2024-04-25T03:08:42.196406+0000","last_peered":"2024-04-25T03:08:42.196406+0000","last_clean":"2024-04-25T03:08:42.196406+0000","last_became_active":"2024-04-25T00:50:33.318945+0000","last_became_peered":"2024-04-25T00:50:33.318945+0000","last_unstale":"2024-04-25T03:08:42.196406+0000","last_undegraded":"2024-04-25T03:08:42.196406+0000","last_fullsized":"2024-04-25T03:08:42.196406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:51.132430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":986,"num_write_kb":8683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'399","reported_seq":518,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.885582+0000","last_change":"2024-04-25T00:50:35.722521+0000","last_active":"2024-04-25T03:09:40.885582+0000","last_peered":"2024-04-25T03:09:40.885582+0000","last_clean":"2024-04-25T03:09:40.885582+0000","last_became_active":"2024-04-25T00:50:35.722128+0000","last_became_peered":"2024-04-25T00:50:35.722128+0000","last_unstale":"2024-04-25T03:09:40.885582+0000","last_undegraded":"2024-04-25T03:09:40.885582+0000","last_fullsized":"2024-04-25T03:09:40.885582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:59:36.793140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19866,"num_write":357,"num_write_kb":75325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"28'6462","reported_seq":6549,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:34.387247+0000","last_change":"2024-04-25T00:50:33.387402+0000","last_active":"2024-04-25T03:09:34.387247+0000","last_peered":"2024-04-25T03:09:34.387247+0000","last_clean":"2024-04-25T03:09:34.387247+0000","last_became_active":"2024-04-25T00:50:33.386631+0000","last_became_peered":"2024-04-25T00:50:33.386631+0000","last_unstale":"2024-04-25T03:09:34.387247+0000","last_undegraded":"2024-04-25T03:09:34.387247+0000","last_fullsized":"2024-04-25T03:09:34.387247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":6462,"log_dups_size":0,"ondisk_log_size":6462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:11:49.105412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17492,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'357","reported_seq":506,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.032804+0000","last_change":"2024-04-25T00:50:35.882715+0000","last_active":"2024-04-25T03:09:41.032804+0000","last_peered":"2024-04-25T03:09:41.032804+0000","last_clean":"2024-04-25T03:09:41.032804+0000","last_became_active":"2024-04-25T00:50:35.878416+0000","last_became_peered":"2024-04-25T00:50:35.878416+0000","last_unstale":"2024-04-25T03:09:41.032804+0000","last_undegraded":"2024-04-25T03:09:41.032804+0000","last_fullsized":"2024-04-25T03:09:41.032804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:35.413796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":29447,"num_write":334,"num_write_kb":70980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"28'373","reported_seq":460,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:17.108484+0000","last_change":"2024-04-25T00:50:33.393211+0000","last_active":"2024-04-25T03:09:17.108484+0000","last_peered":"2024-04-25T03:09:17.108484+0000","last_clean":"2024-04-25T03:09:17.108484+0000","last_became_active":"2024-04-25T00:50:33.392381+0000","last_became_peered":"2024-04-25T00:50:33.392381+0000","last_unstale":"2024-04-25T03:09:17.108484+0000","last_undegraded":"2024-04-25T03:09:17.108484+0000","last_fullsized":"2024-04-25T03:09:17.108484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:18:05.276269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'446","reported_seq":575,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.904553+0000","last_change":"2024-04-25T00:50:35.798491+0000","last_active":"2024-04-25T03:09:40.904553+0000","last_peered":"2024-04-25T03:09:40.904553+0000","last_clean":"2024-04-25T03:09:40.904553+0000","last_became_active":"2024-04-25T00:50:35.796775+0000","last_became_peered":"2024-04-25T00:50:35.796775+0000","last_unstale":"2024-04-25T03:09:40.904553+0000","last_undegraded":"2024-04-25T03:09:40.904553+0000","last_fullsized":"2024-04-25T03:09:40.904553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:54.948867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":29188,"num_write":413,"num_write_kb":79416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"28'380","reported_seq":467,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:41.219949+0000","last_change":"2024-04-25T00:50:33.321163+0000","last_active":"2024-04-25T03:08:41.219949+0000","last_peered":"2024-04-25T03:08:41.219949+0000","last_clean":"2024-04-25T03:08:41.219949+0000","last_became_active":"2024-04-25T00:50:33.320554+0000","last_became_peered":"2024-04-25T00:50:33.320554+0000","last_unstale":"2024-04-25T03:08:41.219949+0000","last_undegraded":"2024-04-25T03:08:41.219949+0000","last_fullsized":"2024-04-25T03:08:41.219949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:13.533462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":317,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'445","reported_seq":576,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.394213+0000","last_change":"2024-04-25T00:50:35.824154+0000","last_active":"2024-04-25T03:09:40.394213+0000","last_peered":"2024-04-25T03:09:40.394213+0000","last_clean":"2024-04-25T03:09:40.394213+0000","last_became_active":"2024-04-25T00:50:35.823269+0000","last_became_peered":"2024-04-25T00:50:35.823269+0000","last_unstale":"2024-04-25T03:09:40.394213+0000","last_undegraded":"2024-04-25T03:09:40.394213+0000","last_fullsized":"2024-04-25T03:09:40.394213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:16.208624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25774,"num_write":415,"num_write_kb":54462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'452","reported_seq":539,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:45.788461+0000","last_change":"2024-04-25T00:50:33.319985+0000","last_active":"2024-04-25T03:07:45.788461+0000","last_peered":"2024-04-25T03:07:45.788461+0000","last_clean":"2024-04-25T03:07:45.788461+0000","last_became_active":"2024-04-25T00:50:33.319198+0000","last_became_peered":"2024-04-25T00:50:33.319198+0000","last_unstale":"2024-04-25T03:07:45.788461+0000","last_undegraded":"2024-04-25T03:07:45.788461+0000","last_fullsized":"2024-04-25T03:07:45.788461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:01.398188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'409","reported_seq":537,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.056760+0000","last_change":"2024-04-25T00:50:35.883007+0000","last_active":"2024-04-25T03:09:41.056760+0000","last_peered":"2024-04-25T03:09:41.056760+0000","last_clean":"2024-04-25T03:09:41.056760+0000","last_became_active":"2024-04-25T00:50:35.881829+0000","last_became_peered":"2024-04-25T00:50:35.881829+0000","last_unstale":"2024-04-25T03:09:41.056760+0000","last_undegraded":"2024-04-25T03:09:41.056760+0000","last_fullsized":"2024-04-25T03:09:41.056760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:02.444745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":18047,"num_write":372,"num_write_kb":46881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'1205","reported_seq":1291,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:43.888245+0000","last_change":"2024-04-25T00:50:33.384397+0000","last_active":"2024-04-25T03:07:43.888245+0000","last_peered":"2024-04-25T03:07:43.888245+0000","last_clean":"2024-04-25T03:07:43.888245+0000","last_became_active":"2024-04-25T00:50:33.383622+0000","last_became_peered":"2024-04-25T00:50:33.383622+0000","last_unstale":"2024-04-25T03:07:43.888245+0000","last_undegraded":"2024-04-25T03:07:43.888245+0000","last_fullsized":"2024-04-25T03:07:43.888245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1205,"log_dups_size":0,"ondisk_log_size":1205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:31.816914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":8761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'428","reported_seq":553,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.052021+0000","last_change":"2024-04-25T00:50:35.881976+0000","last_active":"2024-04-25T03:09:41.052021+0000","last_peered":"2024-04-25T03:09:41.052021+0000","last_clean":"2024-04-25T03:09:41.052021+0000","last_became_active":"2024-04-25T00:50:35.881269+0000","last_became_peered":"2024-04-25T00:50:35.881269+0000","last_unstale":"2024-04-25T03:09:41.052021+0000","last_undegraded":"2024-04-25T03:09:41.052021+0000","last_fullsized":"2024-04-25T03:09:41.052021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:54.302741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19611,"num_write":396,"num_write_kb":67446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1399","reported_seq":1483,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:07.562053+0000","last_change":"2024-04-25T00:50:33.390041+0000","last_active":"2024-04-25T03:08:07.562053+0000","last_peered":"2024-04-25T03:08:07.562053+0000","last_clean":"2024-04-25T03:08:07.562053+0000","last_became_active":"2024-04-25T00:50:33.389095+0000","last_became_peered":"2024-04-25T00:50:33.389095+0000","last_unstale":"2024-04-25T03:08:07.562053+0000","last_undegraded":"2024-04-25T03:08:07.562053+0000","last_fullsized":"2024-04-25T03:08:07.562053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1399,"log_dups_size":0,"ondisk_log_size":1399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:00.569613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1344,"num_write_kb":12923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'449","reported_seq":610,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.070319+0000","last_change":"2024-04-25T00:50:35.812195+0000","last_active":"2024-04-25T03:09:41.070319+0000","last_peered":"2024-04-25T03:09:41.070319+0000","last_clean":"2024-04-25T03:09:41.070319+0000","last_became_active":"2024-04-25T00:50:35.811410+0000","last_became_peered":"2024-04-25T00:50:35.811410+0000","last_unstale":"2024-04-25T03:09:41.070319+0000","last_undegraded":"2024-04-25T03:09:41.070319+0000","last_fullsized":"2024-04-25T03:09:41.070319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:06.596770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42516,"num_write":419,"num_write_kb":125381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"28'392","reported_seq":512,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.722040+0000","last_change":"2024-04-25T00:50:35.821808+0000","last_active":"2024-04-25T03:09:40.722040+0000","last_peered":"2024-04-25T03:09:40.722040+0000","last_clean":"2024-04-25T03:09:40.722040+0000","last_became_active":"2024-04-25T00:50:35.821062+0000","last_became_peered":"2024-04-25T00:50:35.821062+0000","last_unstale":"2024-04-25T03:09:40.722040+0000","last_undegraded":"2024-04-25T03:09:40.722040+0000","last_fullsized":"2024-04-25T03:09:40.722040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":28880,"num_write":348,"num_write_kb":60862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"28'845","reported_seq":923,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:40.321237+0000","last_change":"2024-04-25T00:50:33.319853+0000","last_active":"2024-04-25T03:08:40.321237+0000","last_peered":"2024-04-25T03:08:40.321237+0000","last_clean":"2024-04-25T03:08:40.321237+0000","last_became_active":"2024-04-25T00:50:33.319197+0000","last_became_peered":"2024-04-25T00:50:33.319197+0000","last_unstale":"2024-04-25T03:08:40.321237+0000","last_undegraded":"2024-04-25T03:08:40.321237+0000","last_fullsized":"2024-04-25T03:08:40.321237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:24.834556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":4488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'367","reported_seq":495,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.726212+0000","last_change":"2024-04-25T00:50:35.812044+0000","last_active":"2024-04-25T03:09:40.726212+0000","last_peered":"2024-04-25T03:09:40.726212+0000","last_clean":"2024-04-25T03:09:40.726212+0000","last_became_active":"2024-04-25T00:50:35.811281+0000","last_became_peered":"2024-04-25T00:50:35.811281+0000","last_unstale":"2024-04-25T03:09:40.726212+0000","last_undegraded":"2024-04-25T03:09:40.726212+0000","last_fullsized":"2024-04-25T03:09:40.726212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:28.655307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":25463,"num_write":336,"num_write_kb":42887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1943","reported_seq":2021,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:09.463635+0000","last_change":"2024-04-25T00:50:33.382775+0000","last_active":"2024-04-25T03:09:09.463635+0000","last_peered":"2024-04-25T03:09:09.463635+0000","last_clean":"2024-04-25T03:09:09.463635+0000","last_became_active":"2024-04-25T00:50:33.382218+0000","last_became_peered":"2024-04-25T00:50:33.382218+0000","last_unstale":"2024-04-25T03:09:09.463635+0000","last_undegraded":"2024-04-25T03:09:09.463635+0000","last_fullsized":"2024-04-25T03:09:09.463635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:52.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1878,"num_write_kb":17269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"28'382","reported_seq":539,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.902056+0000","last_change":"2024-04-25T00:50:35.802543+0000","last_active":"2024-04-25T03:09:40.902056+0000","last_peered":"2024-04-25T03:09:40.902056+0000","last_clean":"2024-04-25T03:09:40.902056+0000","last_became_active":"2024-04-25T00:50:35.801799+0000","last_became_peered":"2024-04-25T00:50:35.801799+0000","last_unstale":"2024-04-25T03:09:40.902056+0000","last_undegraded":"2024-04-25T03:09:40.902056+0000","last_fullsized":"2024-04-25T03:09:40.902056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:15.875347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":38798,"num_write":356,"num_write_kb":55918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"28'667","reported_seq":759,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:44.643827+0000","last_change":"2024-04-25T00:50:33.389565+0000","last_active":"2024-04-25T03:07:44.643827+0000","last_peered":"2024-04-25T03:07:44.643827+0000","last_clean":"2024-04-25T03:07:44.643827+0000","last_became_active":"2024-04-25T00:50:33.388773+0000","last_became_peered":"2024-04-25T00:50:33.388773+0000","last_unstale":"2024-04-25T03:07:44.643827+0000","last_undegraded":"2024-04-25T03:07:44.643827+0000","last_fullsized":"2024-04-25T03:07:44.643827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:42.721375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"28'435","reported_seq":551,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.030287+0000","last_change":"2024-04-25T00:50:35.877410+0000","last_active":"2024-04-25T03:09:41.030287+0000","last_peered":"2024-04-25T03:09:41.030287+0000","last_clean":"2024-04-25T03:09:41.030287+0000","last_became_active":"2024-04-25T00:50:35.876576+0000","last_became_peered":"2024-04-25T00:50:35.876576+0000","last_unstale":"2024-04-25T03:09:41.030287+0000","last_undegraded":"2024-04-25T03:09:41.030287+0000","last_fullsized":"2024-04-25T03:09:41.030287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:15.762503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17268,"num_write":403,"num_write_kb":121594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"28'723","reported_seq":812,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:31.807513+0000","last_change":"2024-04-25T00:50:33.319601+0000","last_active":"2024-04-25T03:08:31.807513+0000","last_peered":"2024-04-25T03:08:31.807513+0000","last_clean":"2024-04-25T03:08:31.807513+0000","last_became_active":"2024-04-25T00:50:33.318940+0000","last_became_peered":"2024-04-25T00:50:33.318940+0000","last_unstale":"2024-04-25T03:08:31.807513+0000","last_undegraded":"2024-04-25T03:08:31.807513+0000","last_fullsized":"2024-04-25T03:08:31.807513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:41.175588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":687,"num_write_kb":8496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2646,"num_read_kb":1386903,"num_write":24369,"num_write_kb":4205310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26395,"ondisk_log_size":26395,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":213073620,"num_objects":149,"num_object_clones":0,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":0,"num_read":4395,"num_read_kb":4765,"num_write":47715,"num_write_kb":231672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":426393600,"data_stored":426147240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38437,"ondisk_log_size":38437,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719478420,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177932,"kb_used_data":78724,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94193908,"statfs":{"total":96636764160,"available":96454561792,"internally_reserved":0,"allocated":80613376,"data_stored":80393199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":101579210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719478420,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":162792,"kb_used_data":63584,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94209048,"statfs":{"total":96636764160,"available":96470065152,"internally_reserved":0,"allocated":65110016,"data_stored":64903593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719478420,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150528,"kb_used_data":51320,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94221312,"statfs":{"total":96636764160,"available":96482623488,"internally_reserved":0,"allocated":52551680,"data_stored":52323151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719478418,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147132,"kb_used_data":57652,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94224708,"statfs":{"total":96636764160,"available":96486100992,"internally_reserved":0,"allocated":59035648,"data_stored":58830541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719478419,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97828,"kb_used_data":22236,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94274012,"statfs":{"total":96636764160,"available":96536588288,"internally_reserved":0,"allocated":22769664,"data_stored":22552901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424511123,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150240,"kb_used_data":42712,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94221600,"statfs":{"total":96636764160,"available":96482918400,"internally_reserved":0,"allocated":43737088,"data_stored":43524455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110098887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424511124,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109060,"kb_used_data":45948,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94262780,"statfs":{"total":96636764160,"available":96525086720,"internally_reserved":0,"allocated":47050752,"data_stored":46836959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543827,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":156864,"kb_used_data":57656,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94214976,"statfs":{"total":96636764160,"available":96476135424,"internally_reserved":0,"allocated":59039744,"data_stored":58830161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46166016,"data_stored":46138218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":58748928,"data_stored":58721788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22478848,"data_stored":22444528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":43446272,"data_stored":43416082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":58744832,"data_stored":58722168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":52260864,"data_stored":52214778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":64819200,"data_stored":64795220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":79728640,"data_stored":79694458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T03:09:47.356 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T03:09:47.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.517+0000 7f46a0e2a640 1 Processor -- start 2024-04-25T03:09:47.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.517+0000 7f46a0e2a640 1 -- start start 2024-04-25T03:09:47.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.517+0000 7f46a0e2a640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f469c151200 0x7f469c072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:47.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.517+0000 7f46a0e2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f469c1515e0 0x7f469c0c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:47.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.517+0000 7f46a0e2a640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f469c073200 con 0x7f469c0c8ee0 2024-04-25T03:09:47.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.517+0000 7f46a0e2a640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f469c0c2f60 con 0x7f469c151200 2024-04-25T03:09:47.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.517+0000 7f46a0e2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f469c0c3240 con 0x7f469c1515e0 2024-04-25T03:09:47.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.517+0000 7f469a59c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f469c151200 0x7f469c072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:47.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.517+0000 7f4699d9b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f469c1515e0 0x7f469c0c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:47.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.517+0000 7f469a59c640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f469c151200 0x7f469c072850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:45490/0 (socket says 172.21.15.162:45490) 2024-04-25T03:09:47.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.517+0000 7f469a59c640 1 -- 172.21.15.162:0/1505968054 learned_addr learned my addr 172.21.15.162:0/1505968054 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:47.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.525+0000 7f469a59c640 1 -- 172.21.15.162:0/1505968054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f469c1515e0 msgr2=0x7f469c0c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:47.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.525+0000 7f469a59c640 1 --2- 172.21.15.162:0/1505968054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f469c1515e0 0x7f469c0c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:47.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.525+0000 7f469a59c640 1 -- 172.21.15.162:0/1505968054 >> v1:172.21.15.179:6789/0 conn(0x7f469c0c8ee0 legacy=0x7f469c15a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:47.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.525+0000 7f469a59c640 1 -- 172.21.15.162:0/1505968054 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469c0c3520 con 0x7f469c151200 2024-04-25T03:09:47.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.533+0000 7f469a59c640 1 --2- 172.21.15.162:0/1505968054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f469c151200 0x7f469c072850 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f468c009870 tx=0x7f468c01c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=731738ffa6e2f6a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:47.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.545+0000 7f469959a640 1 -- 172.21.15.162:0/1505968054 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c0b0070 con 0x7f469c151200 2024-04-25T03:09:47.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.545+0000 7f469959a640 1 -- 172.21.15.162:0/1505968054 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f468c0ab600 con 0x7f469c151200 2024-04-25T03:09:47.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.545+0000 7f469959a640 1 -- 172.21.15.162:0/1505968054 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c0ab9d0 con 0x7f469c151200 2024-04-25T03:09:47.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.545+0000 7f46a0e2a640 1 -- 172.21.15.162:0/1505968054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f469c151200 msgr2=0x7f469c072850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:47.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.545+0000 7f46a0e2a640 1 --2- 172.21.15.162:0/1505968054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f469c151200 0x7f469c072850 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f468c009870 tx=0x7f468c01c520 comp rx=0 tx=0).stop 2024-04-25T03:09:47.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.545+0000 7f46a0e2a640 1 -- 172.21.15.162:0/1505968054 shutdown_connections 2024-04-25T03:09:47.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.545+0000 7f46a0e2a640 1 --2- 172.21.15.162:0/1505968054 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f469c1515e0 0x7f469c0c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:47.549 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.545+0000 7f46a0e2a640 1 --2- 172.21.15.162:0/1505968054 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f469c151200 0x7f469c072850 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:47.549 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.545+0000 7f46a0e2a640 1 -- 172.21.15.162:0/1505968054 >> 172.21.15.162:0/1505968054 conn(0x7f469c0c83c0 msgr2=0x7f469c0c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:47.549 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.545+0000 7f46a0e2a640 1 -- 172.21.15.162:0/1505968054 shutdown_connections 2024-04-25T03:09:47.549 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.545+0000 7f46a0e2a640 1 -- 172.21.15.162:0/1505968054 wait complete. 2024-04-25T03:09:47.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.549+0000 7f46a0e2a640 1 Processor -- start 2024-04-25T03:09:47.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.549+0000 7f46a0e2a640 1 -- start start 2024-04-25T03:09:47.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.549+0000 7f46a0e2a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f469c0c8ee0 0x7f469c149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:47.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.549+0000 7f46a0e2a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f469c151200 0x7f469c15a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:47.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.549+0000 7f46a0e2a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f469c1515e0 0x7f469c159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:47.550 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.549+0000 7f46a0e2a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f469c071b10 con 0x7f469c151200 2024-04-25T03:09:47.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.549+0000 7f46a0e2a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f469c071990 con 0x7f469c1515e0 2024-04-25T03:09:47.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.549+0000 7f46a0e2a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f469c071c90 con 0x7f469c0c8ee0 2024-04-25T03:09:47.551 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.549+0000 7f4699d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f469c151200 0x7f469c15a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:47.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.549+0000 7f4699d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f469c151200 0x7f469c15a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46718/0 (socket says 172.21.15.162:46718) 2024-04-25T03:09:47.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.549+0000 7f4699d9b640 1 -- 172.21.15.162:0/2939604351 learned_addr learned my addr 172.21.15.162:0/2939604351 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:47.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.549+0000 7f469a59c640 1 --2- 172.21.15.162:0/2939604351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f469c0c8ee0 0x7f469c149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:47.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.549+0000 7f469ad9d640 1 --2- 172.21.15.162:0/2939604351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f469c1515e0 0x7f469c159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:47.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.553+0000 7f4699d9b640 1 -- 172.21.15.162:0/2939604351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f469c0c8ee0 msgr2=0x7f469c149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:47.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.553+0000 7f4699d9b640 1 --2- 172.21.15.162:0/2939604351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f469c0c8ee0 0x7f469c149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:47.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.553+0000 7f4699d9b640 1 -- 172.21.15.162:0/2939604351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f469c1515e0 msgr2=0x7f469c159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:47.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.553+0000 7f4699d9b640 1 --2- 172.21.15.162:0/2939604351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f469c1515e0 0x7f469c159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:47.555 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.553+0000 7f4699d9b640 1 -- 172.21.15.162:0/2939604351 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469c151a60 con 0x7f469c151200 2024-04-25T03:09:47.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.557+0000 7f4699d9b640 1 --2- 172.21.15.162:0/2939604351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f469c151200 0x7f469c15a290 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f469000e8a0 tx=0x7f469000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:47.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.561+0000 7f468affd640 1 -- 172.21.15.162:0/2939604351 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690017070 con 0x7f469c151200 2024-04-25T03:09:47.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.561+0000 7f468affd640 1 -- 172.21.15.162:0/2939604351 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f469000c940 con 0x7f469c151200 2024-04-25T03:09:47.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.561+0000 7f468affd640 1 -- 172.21.15.162:0/2939604351 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469000ccf0 con 0x7f469c151200 2024-04-25T03:09:47.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.561+0000 7f46a0e2a640 1 -- 172.21.15.162:0/2939604351 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f469c151d40 con 0x7f469c151200 2024-04-25T03:09:47.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.561+0000 7f46a0e2a640 1 -- 172.21.15.162:0/2939604351 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f469c152300 con 0x7f469c151200 2024-04-25T03:09:47.563 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.561+0000 7f46a0e2a640 1 -- 172.21.15.162:0/2939604351 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f469c0c27c0 con 0x7f469c151200 2024-04-25T03:09:47.862 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.861+0000 7f468affd640 1 -- 172.21.15.162:0/2939604351 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f469001a070 con 0x7f469c151200 2024-04-25T03:09:47.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.861+0000 7f468affd640 1 --2- 172.21.15.162:0/2939604351 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f467c067940 0x7f467c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:47.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.861+0000 7f469a59c640 1 --2- 172.21.15.162:0/2939604351 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f467c067940 0x7f467c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:47.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.861+0000 7f469a59c640 1 --2- 172.21.15.162:0/2939604351 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f467c067940 0x7f467c069e00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f468c0ad000 tx=0x7f468c0a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:47.897 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.897+0000 7f468affd640 1 -- 172.21.15.162:0/2939604351 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f46900547b0 con 0x7f469c151200 2024-04-25T03:09:47.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:47.897+0000 7f468affd640 1 -- 172.21.15.162:0/2939604351 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f4690056710 con 0x7f469c151200 2024-04-25T03:09:48.074 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.073+0000 7f46a0e2a640 1 -- 172.21.15.162:0/2939604351 --> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f469c04f5f0 con 0x7f467c067940 2024-04-25T03:09:48.085 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.081+0000 7f468affd640 1 -- 172.21.15.162:0/2939604351 <== mgr.4100 v2:172.21.15.162:6800/3960394531 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254000 (secure 0 0 0) 0x7f469c04f5f0 con 0x7f467c067940 2024-04-25T03:09:48.087 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T03:09:48.088 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-04-25T03:09:48.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.085+0000 7f46a0e2a640 1 -- 172.21.15.162:0/2939604351 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f467c067940 msgr2=0x7f467c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:48.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.085+0000 7f46a0e2a640 1 --2- 172.21.15.162:0/2939604351 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f467c067940 0x7f467c069e00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f468c0ad000 tx=0x7f468c0a6000 comp rx=0 tx=0).stop 2024-04-25T03:09:48.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.085+0000 7f46a0e2a640 1 -- 172.21.15.162:0/2939604351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f469c151200 msgr2=0x7f469c15a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:48.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.085+0000 7f46a0e2a640 1 --2- 172.21.15.162:0/2939604351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f469c151200 0x7f469c15a290 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f469000e8a0 tx=0x7f469000eca0 comp rx=0 tx=0).stop 2024-04-25T03:09:48.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.085+0000 7f46a0e2a640 1 -- 172.21.15.162:0/2939604351 shutdown_connections 2024-04-25T03:09:48.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.085+0000 7f46a0e2a640 1 --2- 172.21.15.162:0/2939604351 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f469c1515e0 0x7f469c159460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:48.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.085+0000 7f46a0e2a640 1 --2- 172.21.15.162:0/2939604351 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f467c067940 0x7f467c069e00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:48.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.085+0000 7f46a0e2a640 1 --2- 172.21.15.162:0/2939604351 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f469c151200 0x7f469c15a290 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:48.090 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.085+0000 7f46a0e2a640 1 --2- 172.21.15.162:0/2939604351 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f469c0c8ee0 0x7f469c149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:48.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.085+0000 7f46a0e2a640 1 -- 172.21.15.162:0/2939604351 >> 172.21.15.162:0/2939604351 conn(0x7f469c0c83c0 msgr2=0x7f469c0c6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:48.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.085+0000 7f46a0e2a640 1 -- 172.21.15.162:0/2939604351 shutdown_connections 2024-04-25T03:09:48.091 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.085+0000 7f46a0e2a640 1 -- 172.21.15.162:0/2939604351 wait complete. 2024-04-25T03:09:48.112 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":4221,"stamp":"2024-04-25T03:09:47.096161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":213663988,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":7157,"num_read_kb":1391768,"num_write":72243,"num_write_kb":4439398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64949,"ondisk_log_size":64949,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1152376,"kb_used_data":419832,"kb_used_omap":12,"kb_used_meta":732467,"kb_avail":753822344,"statfs":{"total":773094113280,"available":771914080256,"internally_reserved":0,"allocated":429907968,"data_stored":428194960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":750046769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":790,"num_objects":-5,"num_object_clones":0,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":30,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004164"},"pg_stats":[{"pgid":"3.3f","version":"28'428","reported_seq":558,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.658545+0000","last_change":"2024-04-25T00:50:35.761428+0000","last_active":"2024-04-25T03:09:40.658545+0000","last_peered":"2024-04-25T03:09:40.658545+0000","last_clean":"2024-04-25T03:09:40.658545+0000","last_became_active":"2024-04-25T00:50:35.760579+0000","last_became_peered":"2024-04-25T00:50:35.760579+0000","last_unstale":"2024-04-25T03:09:40.658545+0000","last_undegraded":"2024-04-25T03:09:40.658545+0000","last_fullsized":"2024-04-25T03:09:40.658545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:06.236972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25441,"num_write":394,"num_write_kb":67715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'447","reported_seq":651,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.902399+0000","last_change":"2024-04-25T00:50:35.798137+0000","last_active":"2024-04-25T03:09:40.902399+0000","last_peered":"2024-04-25T03:09:40.902399+0000","last_clean":"2024-04-25T03:09:40.902399+0000","last_became_active":"2024-04-25T00:50:35.797354+0000","last_became_peered":"2024-04-25T00:50:35.797354+0000","last_unstale":"2024-04-25T03:09:40.902399+0000","last_undegraded":"2024-04-25T03:09:40.902399+0000","last_fullsized":"2024-04-25T03:09:40.902399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:29:18.970287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":59186,"num_write":421,"num_write_kb":88627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'383","reported_seq":484,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.900038+0000","last_change":"2024-04-25T00:50:35.799370+0000","last_active":"2024-04-25T03:09:40.900038+0000","last_peered":"2024-04-25T03:09:40.900038+0000","last_clean":"2024-04-25T03:09:40.900038+0000","last_became_active":"2024-04-25T00:50:35.798268+0000","last_became_peered":"2024-04-25T00:50:35.798268+0000","last_unstale":"2024-04-25T03:09:40.900038+0000","last_undegraded":"2024-04-25T03:09:40.900038+0000","last_fullsized":"2024-04-25T03:09:40.900038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:27.176441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8918,"num_write":356,"num_write_kb":42288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'378","reported_seq":485,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.726379+0000","last_change":"2024-04-25T00:50:35.877965+0000","last_active":"2024-04-25T03:09:40.726379+0000","last_peered":"2024-04-25T03:09:40.726379+0000","last_clean":"2024-04-25T03:09:40.726379+0000","last_became_active":"2024-04-25T00:50:35.877114+0000","last_became_peered":"2024-04-25T00:50:35.877114+0000","last_unstale":"2024-04-25T03:09:40.726379+0000","last_undegraded":"2024-04-25T03:09:40.726379+0000","last_fullsized":"2024-04-25T03:09:40.726379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:20.857588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":5983,"num_write":348,"num_write_kb":38519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'398","reported_seq":495,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.655255+0000","last_change":"2024-04-25T00:50:35.730647+0000","last_active":"2024-04-25T03:09:40.655255+0000","last_peered":"2024-04-25T03:09:40.655255+0000","last_clean":"2024-04-25T03:09:40.655255+0000","last_became_active":"2024-04-25T00:50:35.729785+0000","last_became_peered":"2024-04-25T00:50:35.729785+0000","last_unstale":"2024-04-25T03:09:40.655255+0000","last_undegraded":"2024-04-25T03:09:40.655255+0000","last_fullsized":"2024-04-25T03:09:40.655255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:02.888747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12535,"num_write":367,"num_write_kb":34849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'384","reported_seq":469,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.058722+0000","last_change":"2024-04-25T00:51:40.324509+0000","last_active":"2024-04-25T03:09:41.058722+0000","last_peered":"2024-04-25T03:09:41.058722+0000","last_clean":"2024-04-25T03:09:41.058722+0000","last_became_active":"2024-04-25T00:51:40.323657+0000","last_became_peered":"2024-04-25T00:51:40.323657+0000","last_unstale":"2024-04-25T03:09:41.058722+0000","last_undegraded":"2024-04-25T03:09:41.058722+0000","last_fullsized":"2024-04-25T03:09:41.058722+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:46:58.981295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9183,"num_write":360,"num_write_kb":42897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"28'423","reported_seq":516,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.632470+0000","last_change":"2024-04-25T00:50:35.797990+0000","last_active":"2024-04-25T03:09:40.632470+0000","last_peered":"2024-04-25T03:09:40.632470+0000","last_clean":"2024-04-25T03:09:40.632470+0000","last_became_active":"2024-04-25T00:50:35.797328+0000","last_became_peered":"2024-04-25T00:50:35.797328+0000","last_unstale":"2024-04-25T03:09:40.632470+0000","last_undegraded":"2024-04-25T03:09:40.632470+0000","last_fullsized":"2024-04-25T03:09:40.632470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:59.565909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6445,"num_write":396,"num_write_kb":56628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'391","reported_seq":537,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.064728+0000","last_change":"2024-04-25T00:50:35.878367+0000","last_active":"2024-04-25T03:09:41.064728+0000","last_peered":"2024-04-25T03:09:41.064728+0000","last_clean":"2024-04-25T03:09:41.064728+0000","last_became_active":"2024-04-25T00:50:35.877581+0000","last_became_peered":"2024-04-25T00:50:35.877581+0000","last_unstale":"2024-04-25T03:09:41.064728+0000","last_undegraded":"2024-04-25T03:09:41.064728+0000","last_fullsized":"2024-04-25T03:09:41.064728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:53.695907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":40559,"num_write":354,"num_write_kb":84336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'417","reported_seq":510,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.066086+0000","last_change":"2024-04-25T00:51:40.608818+0000","last_active":"2024-04-25T03:09:41.066086+0000","last_peered":"2024-04-25T03:09:41.066086+0000","last_clean":"2024-04-25T03:09:41.066086+0000","last_became_active":"2024-04-25T00:51:40.608071+0000","last_became_peered":"2024-04-25T00:51:40.608071+0000","last_unstale":"2024-04-25T03:09:41.066086+0000","last_undegraded":"2024-04-25T03:09:41.066086+0000","last_fullsized":"2024-04-25T03:09:41.066086+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:48:27.210535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14358,"num_write":383,"num_write_kb":47358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"28'402","reported_seq":520,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.088602+0000","last_change":"2024-04-25T00:50:35.765173+0000","last_active":"2024-04-25T03:09:41.088602+0000","last_peered":"2024-04-25T03:09:41.088602+0000","last_clean":"2024-04-25T03:09:41.088602+0000","last_became_active":"2024-04-25T00:50:35.764412+0000","last_became_peered":"2024-04-25T00:50:35.764412+0000","last_unstale":"2024-04-25T03:09:41.088602+0000","last_undegraded":"2024-04-25T03:09:41.088602+0000","last_fullsized":"2024-04-25T03:09:41.088602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:54.948867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":23778,"num_write":367,"num_write_kb":71174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'383","reported_seq":491,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.067336+0000","last_change":"2024-04-25T00:50:35.764526+0000","last_active":"2024-04-25T03:09:41.067336+0000","last_peered":"2024-04-25T03:09:41.067336+0000","last_clean":"2024-04-25T03:09:41.067336+0000","last_became_active":"2024-04-25T00:50:35.763770+0000","last_became_peered":"2024-04-25T00:50:35.763770+0000","last_unstale":"2024-04-25T03:09:41.067336+0000","last_undegraded":"2024-04-25T03:09:41.067336+0000","last_fullsized":"2024-04-25T03:09:41.067336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:15.698294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20604,"num_write":365,"num_write_kb":74840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'373","reported_seq":489,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.657926+0000","last_change":"2024-04-25T00:50:35.822113+0000","last_active":"2024-04-25T03:09:40.657926+0000","last_peered":"2024-04-25T03:09:40.657926+0000","last_clean":"2024-04-25T03:09:40.657926+0000","last_became_active":"2024-04-25T00:50:35.821524+0000","last_became_peered":"2024-04-25T00:50:35.821524+0000","last_unstale":"2024-04-25T03:09:40.657926+0000","last_undegraded":"2024-04-25T03:09:40.657926+0000","last_fullsized":"2024-04-25T03:09:40.657926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:43.722114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22834,"num_write":346,"num_write_kb":67125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'376","reported_seq":454,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.066166+0000","last_change":"2024-04-25T00:50:35.881637+0000","last_active":"2024-04-25T03:09:41.066166+0000","last_peered":"2024-04-25T03:09:41.066166+0000","last_clean":"2024-04-25T03:09:41.066166+0000","last_became_active":"2024-04-25T00:50:35.880661+0000","last_became_peered":"2024-04-25T00:50:35.880661+0000","last_unstale":"2024-04-25T03:09:41.066166+0000","last_undegraded":"2024-04-25T03:09:41.066166+0000","last_fullsized":"2024-04-25T03:09:41.066166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:39.862610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":168,"num_write":340,"num_write_kb":38232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'401","reported_seq":479,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.905393+0000","last_change":"2024-04-25T00:50:35.796996+0000","last_active":"2024-04-25T03:09:40.905393+0000","last_peered":"2024-04-25T03:09:40.905393+0000","last_clean":"2024-04-25T03:09:40.905393+0000","last_became_active":"2024-04-25T00:50:35.795295+0000","last_became_peered":"2024-04-25T00:50:35.795295+0000","last_unstale":"2024-04-25T03:09:40.905393+0000","last_undegraded":"2024-04-25T03:09:40.905393+0000","last_fullsized":"2024-04-25T03:09:40.905393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:29.858476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":22306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'418","reported_seq":579,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.884949+0000","last_change":"2024-04-25T00:50:35.818291+0000","last_active":"2024-04-25T03:09:40.884949+0000","last_peered":"2024-04-25T03:09:40.884949+0000","last_clean":"2024-04-25T03:09:40.884949+0000","last_became_active":"2024-04-25T00:50:35.817575+0000","last_became_peered":"2024-04-25T00:50:35.817575+0000","last_unstale":"2024-04-25T03:09:40.884949+0000","last_undegraded":"2024-04-25T03:09:40.884949+0000","last_fullsized":"2024-04-25T03:09:40.884949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:51.142494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":52039,"num_write":380,"num_write_kb":55267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'423","reported_seq":512,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.662177+0000","last_change":"2024-04-25T00:50:35.797194+0000","last_active":"2024-04-25T03:09:40.662177+0000","last_peered":"2024-04-25T03:09:40.662177+0000","last_clean":"2024-04-25T03:09:40.662177+0000","last_became_active":"2024-04-25T00:50:35.796536+0000","last_became_peered":"2024-04-25T00:50:35.796536+0000","last_unstale":"2024-04-25T03:09:40.662177+0000","last_undegraded":"2024-04-25T03:09:40.662177+0000","last_fullsized":"2024-04-25T03:09:40.662177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:48:27.210535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4763,"num_write":382,"num_write_kb":21763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'399","reported_seq":507,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.655166+0000","last_change":"2024-04-25T00:50:35.729648+0000","last_active":"2024-04-25T03:09:40.655166+0000","last_peered":"2024-04-25T03:09:40.655166+0000","last_clean":"2024-04-25T03:09:40.655166+0000","last_became_active":"2024-04-25T00:50:35.728875+0000","last_became_peered":"2024-04-25T00:50:35.728875+0000","last_unstale":"2024-04-25T03:09:40.655166+0000","last_undegraded":"2024-04-25T03:09:40.655166+0000","last_fullsized":"2024-04-25T03:09:40.655166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:46.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10229,"num_write":366,"num_write_kb":22657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'400","reported_seq":498,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.071871+0000","last_change":"2024-04-25T00:50:35.760953+0000","last_active":"2024-04-25T03:09:41.071871+0000","last_peered":"2024-04-25T03:09:41.071871+0000","last_clean":"2024-04-25T03:09:41.071871+0000","last_became_active":"2024-04-25T00:50:35.760286+0000","last_became_peered":"2024-04-25T00:50:35.760286+0000","last_unstale":"2024-04-25T03:09:41.071871+0000","last_undegraded":"2024-04-25T03:09:41.071871+0000","last_fullsized":"2024-04-25T03:09:41.071871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:57.466393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9641,"num_write":360,"num_write_kb":34623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'447","reported_seq":591,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.651462+0000","last_change":"2024-04-25T00:50:35.732837+0000","last_active":"2024-04-25T03:09:40.651462+0000","last_peered":"2024-04-25T03:09:40.651462+0000","last_clean":"2024-04-25T03:09:40.651462+0000","last_became_active":"2024-04-25T00:50:35.732134+0000","last_became_peered":"2024-04-25T00:50:35.732134+0000","last_unstale":"2024-04-25T03:09:40.651462+0000","last_undegraded":"2024-04-25T03:09:40.651462+0000","last_fullsized":"2024-04-25T03:09:40.651462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:46.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":29174,"num_write":415,"num_write_kb":129675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"28'442","reported_seq":544,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.067632+0000","last_change":"2024-04-25T00:50:35.818607+0000","last_active":"2024-04-25T03:09:41.067632+0000","last_peered":"2024-04-25T03:09:41.067632+0000","last_clean":"2024-04-25T03:09:41.067632+0000","last_became_active":"2024-04-25T00:50:35.818063+0000","last_became_peered":"2024-04-25T00:50:35.818063+0000","last_unstale":"2024-04-25T03:09:41.067632+0000","last_undegraded":"2024-04-25T03:09:41.067632+0000","last_fullsized":"2024-04-25T03:09:41.067632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:15.875347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20728,"num_write":411,"num_write_kb":42636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"28'443","reported_seq":581,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.907106+0000","last_change":"2024-04-25T00:50:35.798297+0000","last_active":"2024-04-25T03:09:40.907106+0000","last_peered":"2024-04-25T03:09:40.907106+0000","last_clean":"2024-04-25T03:09:40.907106+0000","last_became_active":"2024-04-25T00:50:35.797580+0000","last_became_peered":"2024-04-25T00:50:35.797580+0000","last_unstale":"2024-04-25T03:09:40.907106+0000","last_undegraded":"2024-04-25T03:09:40.907106+0000","last_fullsized":"2024-04-25T03:09:40.907106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:06.596770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28574,"num_write":419,"num_write_kb":125045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"28'422","reported_seq":523,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.063896+0000","last_change":"2024-04-25T00:51:40.408412+0000","last_active":"2024-04-25T03:09:41.063896+0000","last_peered":"2024-04-25T03:09:41.063896+0000","last_clean":"2024-04-25T03:09:41.063896+0000","last_became_active":"2024-04-25T00:51:40.407614+0000","last_became_peered":"2024-04-25T00:51:40.407614+0000","last_unstale":"2024-04-25T03:09:41.063896+0000","last_undegraded":"2024-04-25T03:09:41.063896+0000","last_fullsized":"2024-04-25T03:09:41.063896+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:10.742578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":17978,"num_write":385,"num_write_kb":59372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"28'409","reported_seq":522,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.036825+0000","last_change":"2024-04-25T00:50:35.877261+0000","last_active":"2024-04-25T03:09:41.036825+0000","last_peered":"2024-04-25T03:09:41.036825+0000","last_clean":"2024-04-25T03:09:41.036825+0000","last_became_active":"2024-04-25T00:50:35.876489+0000","last_became_peered":"2024-04-25T00:50:35.876489+0000","last_unstale":"2024-04-25T03:09:41.036825+0000","last_undegraded":"2024-04-25T03:09:41.036825+0000","last_fullsized":"2024-04-25T03:09:41.036825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:14:31.440563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":9083,"num_write":379,"num_write_kb":55476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'437","reported_seq":561,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.651386+0000","last_change":"2024-04-25T00:50:35.877693+0000","last_active":"2024-04-25T03:09:40.651386+0000","last_peered":"2024-04-25T03:09:40.651386+0000","last_clean":"2024-04-25T03:09:40.651386+0000","last_became_active":"2024-04-25T00:50:35.876870+0000","last_became_peered":"2024-04-25T00:50:35.876870+0000","last_unstale":"2024-04-25T03:09:40.651386+0000","last_undegraded":"2024-04-25T03:09:40.651386+0000","last_fullsized":"2024-04-25T03:09:40.651386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:53.474315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":19659,"num_write":409,"num_write_kb":79764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"28'386","reported_seq":490,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.030696+0000","last_change":"2024-04-25T00:50:35.881027+0000","last_active":"2024-04-25T03:09:41.030696+0000","last_peered":"2024-04-25T03:09:41.030696+0000","last_clean":"2024-04-25T03:09:41.030696+0000","last_became_active":"2024-04-25T00:50:35.880477+0000","last_became_peered":"2024-04-25T00:50:35.880477+0000","last_unstale":"2024-04-25T03:09:41.030696+0000","last_undegraded":"2024-04-25T03:09:41.030696+0000","last_fullsized":"2024-04-25T03:09:41.030696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:55:59.176935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12882,"num_write":369,"num_write_kb":38131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"28'477","reported_seq":598,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.088090+0000","last_change":"2024-04-25T00:50:35.765295+0000","last_active":"2024-04-25T03:09:41.088090+0000","last_peered":"2024-04-25T03:09:41.088090+0000","last_clean":"2024-04-25T03:09:41.088090+0000","last_became_active":"2024-04-25T00:50:35.764358+0000","last_became_peered":"2024-04-25T00:50:35.764358+0000","last_unstale":"2024-04-25T03:09:41.088090+0000","last_undegraded":"2024-04-25T03:09:41.088090+0000","last_fullsized":"2024-04-25T03:09:41.088090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:15.104631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":19569,"num_write":439,"num_write_kb":84809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'424","reported_seq":585,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.888427+0000","last_change":"2024-04-25T00:50:35.869695+0000","last_active":"2024-04-25T03:09:40.888427+0000","last_peered":"2024-04-25T03:09:40.888427+0000","last_clean":"2024-04-25T03:09:40.888427+0000","last_became_active":"2024-04-25T00:50:35.868857+0000","last_became_peered":"2024-04-25T00:50:35.868857+0000","last_unstale":"2024-04-25T03:09:40.888427+0000","last_undegraded":"2024-04-25T03:09:40.888427+0000","last_fullsized":"2024-04-25T03:09:40.888427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:35:38.295580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50759,"num_write":394,"num_write_kb":108657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"28'403","reported_seq":563,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.033206+0000","last_change":"2024-04-25T00:50:35.884507+0000","last_active":"2024-04-25T03:09:41.033206+0000","last_peered":"2024-04-25T03:09:41.033206+0000","last_clean":"2024-04-25T03:09:41.033206+0000","last_became_active":"2024-04-25T00:50:35.883901+0000","last_became_peered":"2024-04-25T00:50:35.883901+0000","last_unstale":"2024-04-25T03:09:41.033206+0000","last_undegraded":"2024-04-25T03:09:41.033206+0000","last_fullsized":"2024-04-25T03:09:41.033206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:40.533818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":36518,"num_write":378,"num_write_kb":108957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'386","reported_seq":490,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.906940+0000","last_change":"2024-04-25T00:50:35.878649+0000","last_active":"2024-04-25T03:09:40.906940+0000","last_peered":"2024-04-25T03:09:40.906940+0000","last_clean":"2024-04-25T03:09:40.906940+0000","last_became_active":"2024-04-25T00:50:35.877870+0000","last_became_peered":"2024-04-25T00:50:35.877870+0000","last_unstale":"2024-04-25T03:09:40.906940+0000","last_undegraded":"2024-04-25T03:09:40.906940+0000","last_fullsized":"2024-04-25T03:09:40.906940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12325,"num_write":357,"num_write_kb":37847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"28'487","reported_seq":632,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.644401+0000","last_change":"2024-04-25T00:50:35.869614+0000","last_active":"2024-04-25T03:09:40.644401+0000","last_peered":"2024-04-25T03:09:40.644401+0000","last_clean":"2024-04-25T03:09:40.644401+0000","last_became_active":"2024-04-25T00:50:35.869016+0000","last_became_peered":"2024-04-25T00:50:35.869016+0000","last_unstale":"2024-04-25T03:09:40.644401+0000","last_undegraded":"2024-04-25T03:09:40.644401+0000","last_fullsized":"2024-04-25T03:09:40.644401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:02.888747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33246,"num_write":457,"num_write_kb":117202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"28'457","reported_seq":577,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.066664+0000","last_change":"2024-04-25T00:50:35.728757+0000","last_active":"2024-04-25T03:09:41.066664+0000","last_peered":"2024-04-25T03:09:41.066664+0000","last_clean":"2024-04-25T03:09:41.066664+0000","last_became_active":"2024-04-25T00:50:35.728271+0000","last_became_peered":"2024-04-25T00:50:35.728271+0000","last_unstale":"2024-04-25T03:09:41.066664+0000","last_undegraded":"2024-04-25T03:09:41.066664+0000","last_fullsized":"2024-04-25T03:09:41.066664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:43.722114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18149,"num_write":425,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"28'412","reported_seq":509,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.071602+0000","last_change":"2024-04-25T00:50:35.802347+0000","last_active":"2024-04-25T03:09:41.071602+0000","last_peered":"2024-04-25T03:09:41.071602+0000","last_clean":"2024-04-25T03:09:41.071602+0000","last_became_active":"2024-04-25T00:50:35.801389+0000","last_became_peered":"2024-04-25T00:50:35.801389+0000","last_unstale":"2024-04-25T03:09:41.071602+0000","last_undegraded":"2024-04-25T03:09:41.071602+0000","last_fullsized":"2024-04-25T03:09:41.071602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:27.176441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4792,"num_write":381,"num_write_kb":30347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"28'401","reported_seq":506,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.654605+0000","last_change":"2024-04-25T00:50:35.822222+0000","last_active":"2024-04-25T03:09:40.654605+0000","last_peered":"2024-04-25T03:09:40.654605+0000","last_clean":"2024-04-25T03:09:40.654605+0000","last_became_active":"2024-04-25T00:50:35.821484+0000","last_became_peered":"2024-04-25T00:50:35.821484+0000","last_unstale":"2024-04-25T03:09:40.654605+0000","last_undegraded":"2024-04-25T03:09:40.654605+0000","last_fullsized":"2024-04-25T03:09:40.654605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:59.921295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18401,"num_write":362,"num_write_kb":62496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'364","reported_seq":442,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:06.145410+0000","last_change":"2024-04-25T00:50:33.391742+0000","last_active":"2024-04-25T03:08:06.145410+0000","last_peered":"2024-04-25T03:08:06.145410+0000","last_clean":"2024-04-25T03:08:06.145410+0000","last_became_active":"2024-04-25T00:50:33.390901+0000","last_became_peered":"2024-04-25T00:50:33.390901+0000","last_unstale":"2024-04-25T03:08:06.145410+0000","last_undegraded":"2024-04-25T03:08:06.145410+0000","last_fullsized":"2024-04-25T03:08:06.145410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:27.804469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":4231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'355","reported_seq":433,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.907459+0000","last_change":"2024-04-25T00:50:35.821496+0000","last_active":"2024-04-25T03:09:40.907459+0000","last_peered":"2024-04-25T03:09:40.907459+0000","last_clean":"2024-04-25T03:09:40.907459+0000","last_became_active":"2024-04-25T00:50:35.820763+0000","last_became_peered":"2024-04-25T00:50:35.820763+0000","last_unstale":"2024-04-25T03:09:40.907459+0000","last_undegraded":"2024-04-25T03:09:40.907459+0000","last_fullsized":"2024-04-25T03:09:40.907459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:15.698294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":529,"num_write":324,"num_write_kb":17419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"28'2226","reported_seq":2304,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:58.865093+0000","last_change":"2024-04-25T00:50:33.394753+0000","last_active":"2024-04-25T03:07:58.865093+0000","last_peered":"2024-04-25T03:07:58.865093+0000","last_clean":"2024-04-25T03:07:58.865093+0000","last_became_active":"2024-04-25T00:50:33.392951+0000","last_became_peered":"2024-04-25T00:50:33.392951+0000","last_unstale":"2024-04-25T03:07:58.865093+0000","last_undegraded":"2024-04-25T03:07:58.865093+0000","last_fullsized":"2024-04-25T03:07:58.865093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2226,"log_dups_size":0,"ondisk_log_size":2226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:41.175588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2166,"num_write_kb":17433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'819","reported_seq":899,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:06.154833+0000","last_change":"2024-04-25T00:50:33.393229+0000","last_active":"2024-04-25T03:09:06.154833+0000","last_peered":"2024-04-25T03:09:06.154833+0000","last_clean":"2024-04-25T03:09:06.154833+0000","last_became_active":"2024-04-25T00:50:33.392817+0000","last_became_peered":"2024-04-25T00:50:33.392817+0000","last_unstale":"2024-04-25T03:09:06.154833+0000","last_undegraded":"2024-04-25T03:09:06.154833+0000","last_fullsized":"2024-04-25T03:09:06.154833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:31:12.131616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":4477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'429","reported_seq":503,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.898490+0000","last_change":"2024-04-25T00:51:40.320773+0000","last_active":"2024-04-25T03:09:40.898490+0000","last_peered":"2024-04-25T03:09:40.898490+0000","last_clean":"2024-04-25T03:09:40.898490+0000","last_became_active":"2024-04-25T00:51:40.319726+0000","last_became_peered":"2024-04-25T00:51:40.319726+0000","last_unstale":"2024-04-25T03:09:40.898490+0000","last_undegraded":"2024-04-25T03:09:40.898490+0000","last_fullsized":"2024-04-25T03:09:40.898490+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:38:21.556620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4282,"num_write":403,"num_write_kb":55112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'1293","reported_seq":1373,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:22.138872+0000","last_change":"2024-04-25T00:50:33.383755+0000","last_active":"2024-04-25T03:08:22.138872+0000","last_peered":"2024-04-25T03:08:22.138872+0000","last_clean":"2024-04-25T03:08:22.138872+0000","last_became_active":"2024-04-25T00:50:33.382925+0000","last_became_peered":"2024-04-25T00:50:33.382925+0000","last_unstale":"2024-04-25T03:08:22.138872+0000","last_undegraded":"2024-04-25T03:08:22.138872+0000","last_fullsized":"2024-04-25T03:08:22.138872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1293,"log_dups_size":0,"ondisk_log_size":1293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:52.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1222,"num_write_kb":12901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'453","reported_seq":605,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.893325+0000","last_change":"2024-04-25T00:50:35.869794+0000","last_active":"2024-04-25T03:09:40.893325+0000","last_peered":"2024-04-25T03:09:40.893325+0000","last_clean":"2024-04-25T03:09:40.893325+0000","last_became_active":"2024-04-25T00:50:35.869028+0000","last_became_peered":"2024-04-25T00:50:35.869028+0000","last_unstale":"2024-04-25T03:09:40.893325+0000","last_undegraded":"2024-04-25T03:09:40.893325+0000","last_fullsized":"2024-04-25T03:09:40.893325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:49.891966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":36096,"num_write":419,"num_write_kb":96892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'61","reported_seq":141,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.363278+0000","last_change":"2024-04-25T00:50:33.394082+0000","last_active":"2024-04-25T03:09:40.363278+0000","last_peered":"2024-04-25T03:09:40.363278+0000","last_clean":"2024-04-25T03:09:40.363278+0000","last_became_active":"2024-04-25T00:50:33.392792+0000","last_became_peered":"2024-04-25T00:50:33.392792+0000","last_unstale":"2024-04-25T03:09:40.363278+0000","last_undegraded":"2024-04-25T03:09:40.363278+0000","last_fullsized":"2024-04-25T03:09:40.363278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:35:15.441104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'435","reported_seq":547,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.723136+0000","last_change":"2024-04-25T00:50:35.729414+0000","last_active":"2024-04-25T03:09:40.723136+0000","last_peered":"2024-04-25T03:09:40.723136+0000","last_clean":"2024-04-25T03:09:40.723136+0000","last_became_active":"2024-04-25T00:50:35.728725+0000","last_became_peered":"2024-04-25T00:50:35.728725+0000","last_unstale":"2024-04-25T03:09:40.723136+0000","last_undegraded":"2024-04-25T03:09:40.723136+0000","last_fullsized":"2024-04-25T03:09:40.723136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:05.046355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":25476,"num_write":407,"num_write_kb":112477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'1187","reported_seq":1267,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.378202+0000","last_change":"2024-04-25T00:50:33.388191+0000","last_active":"2024-04-25T03:09:40.378202+0000","last_peered":"2024-04-25T03:09:40.378202+0000","last_clean":"2024-04-25T03:09:40.378202+0000","last_became_active":"2024-04-25T00:50:33.387266+0000","last_became_peered":"2024-04-25T00:50:33.387266+0000","last_unstale":"2024-04-25T03:09:40.378202+0000","last_undegraded":"2024-04-25T03:09:40.378202+0000","last_fullsized":"2024-04-25T03:09:40.378202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1187,"log_dups_size":0,"ondisk_log_size":1187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:08.400693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10267224,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1125,"num_write_kb":10596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'390","reported_seq":492,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.900667+0000","last_change":"2024-04-25T00:50:35.799783+0000","last_active":"2024-04-25T03:09:40.900667+0000","last_peered":"2024-04-25T03:09:40.900667+0000","last_clean":"2024-04-25T03:09:40.900667+0000","last_became_active":"2024-04-25T00:50:35.798471+0000","last_became_peered":"2024-04-25T00:50:35.798471+0000","last_unstale":"2024-04-25T03:09:40.900667+0000","last_undegraded":"2024-04-25T03:09:40.900667+0000","last_fullsized":"2024-04-25T03:09:40.900667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:15.104631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14757,"num_write":355,"num_write_kb":59761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"28'3380","reported_seq":3460,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:34.194188+0000","last_change":"2024-04-25T00:50:33.304731+0000","last_active":"2024-04-25T03:09:34.194188+0000","last_peered":"2024-04-25T03:09:34.194188+0000","last_clean":"2024-04-25T03:09:34.194188+0000","last_became_active":"2024-04-25T00:50:33.303821+0000","last_became_peered":"2024-04-25T00:50:33.303821+0000","last_unstale":"2024-04-25T03:09:34.194188+0000","last_undegraded":"2024-04-25T03:09:34.194188+0000","last_fullsized":"2024-04-25T03:09:34.194188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3380,"log_dups_size":0,"ondisk_log_size":3380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:32.196488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3329,"num_write_kb":11127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'419","reported_seq":559,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.663718+0000","last_change":"2024-04-25T00:50:35.828727+0000","last_active":"2024-04-25T03:09:40.663718+0000","last_peered":"2024-04-25T03:09:40.663718+0000","last_clean":"2024-04-25T03:09:40.663718+0000","last_became_active":"2024-04-25T00:50:35.827617+0000","last_became_peered":"2024-04-25T00:50:35.827617+0000","last_unstale":"2024-04-25T03:09:40.663718+0000","last_undegraded":"2024-04-25T03:09:40.663718+0000","last_fullsized":"2024-04-25T03:09:40.663718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:30:10.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":28588,"num_write":390,"num_write_kb":92970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"28'2245","reported_seq":2327,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:19.177513+0000","last_change":"2024-04-25T00:50:33.391005+0000","last_active":"2024-04-25T03:09:19.177513+0000","last_peered":"2024-04-25T03:09:19.177513+0000","last_clean":"2024-04-25T03:09:19.177513+0000","last_became_active":"2024-04-25T00:50:33.390133+0000","last_became_peered":"2024-04-25T00:50:33.390133+0000","last_unstale":"2024-04-25T03:09:19.177513+0000","last_undegraded":"2024-04-25T03:09:19.177513+0000","last_fullsized":"2024-04-25T03:09:19.177513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2245,"log_dups_size":0,"ondisk_log_size":2245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:19.913188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2203,"num_write_kb":13669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'392","reported_seq":516,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.662684+0000","last_change":"2024-04-25T00:50:35.876022+0000","last_active":"2024-04-25T03:09:40.662684+0000","last_peered":"2024-04-25T03:09:40.662684+0000","last_clean":"2024-04-25T03:09:40.662684+0000","last_became_active":"2024-04-25T00:50:35.875322+0000","last_became_peered":"2024-04-25T00:50:35.875322+0000","last_unstale":"2024-04-25T03:09:40.662684+0000","last_undegraded":"2024-04-25T03:09:40.662684+0000","last_fullsized":"2024-04-25T03:09:40.662684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":27925,"num_write":356,"num_write_kb":62573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"28'713","reported_seq":795,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:59.810791+0000","last_change":"2024-04-25T00:50:33.387295+0000","last_active":"2024-04-25T03:07:59.810791+0000","last_peered":"2024-04-25T03:07:59.810791+0000","last_clean":"2024-04-25T03:07:59.810791+0000","last_became_active":"2024-04-25T00:50:33.386297+0000","last_became_peered":"2024-04-25T00:50:33.386297+0000","last_unstale":"2024-04-25T03:07:59.810791+0000","last_undegraded":"2024-04-25T03:07:59.810791+0000","last_fullsized":"2024-04-25T03:07:59.810791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:31:57.597514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":8480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'401","reported_seq":490,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.905548+0000","last_change":"2024-04-25T00:50:35.796873+0000","last_active":"2024-04-25T03:09:40.905548+0000","last_peered":"2024-04-25T03:09:40.905548+0000","last_clean":"2024-04-25T03:09:40.905548+0000","last_became_active":"2024-04-25T00:50:35.796012+0000","last_became_peered":"2024-04-25T00:50:35.796012+0000","last_unstale":"2024-04-25T03:09:40.905548+0000","last_undegraded":"2024-04-25T03:09:40.905548+0000","last_fullsized":"2024-04-25T03:09:40.905548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:22.255073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4846,"num_write":362,"num_write_kb":30162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"28'56","reported_seq":138,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:33.058035+0000","last_change":"2024-04-25T00:50:33.385522+0000","last_active":"2024-04-25T03:09:33.058035+0000","last_peered":"2024-04-25T03:09:33.058035+0000","last_clean":"2024-04-25T03:09:33.058035+0000","last_became_active":"2024-04-25T00:50:33.384620+0000","last_became_peered":"2024-04-25T00:50:33.384620+0000","last_unstale":"2024-04-25T03:09:33.058035+0000","last_undegraded":"2024-04-25T03:09:33.058035+0000","last_fullsized":"2024-04-25T03:09:33.058035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:24.908029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'414","reported_seq":522,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.720638+0000","last_change":"2024-04-25T00:50:35.820565+0000","last_active":"2024-04-25T03:09:40.720638+0000","last_peered":"2024-04-25T03:09:40.720638+0000","last_clean":"2024-04-25T03:09:40.720638+0000","last_became_active":"2024-04-25T00:50:35.819683+0000","last_became_peered":"2024-04-25T00:50:35.819683+0000","last_unstale":"2024-04-25T03:09:40.720638+0000","last_undegraded":"2024-04-25T03:09:40.720638+0000","last_fullsized":"2024-04-25T03:09:40.720638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:28.655307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":8938,"num_write":378,"num_write_kb":68659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'60","reported_seq":142,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:17.098745+0000","last_change":"2024-04-25T00:50:33.390745+0000","last_active":"2024-04-25T03:08:17.098745+0000","last_peered":"2024-04-25T03:08:17.098745+0000","last_clean":"2024-04-25T03:08:17.098745+0000","last_became_active":"2024-04-25T00:50:33.390089+0000","last_became_peered":"2024-04-25T00:50:33.390089+0000","last_unstale":"2024-04-25T03:08:17.098745+0000","last_undegraded":"2024-04-25T03:08:17.098745+0000","last_fullsized":"2024-04-25T03:08:17.098745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:51.294701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'418","reported_seq":511,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.070072+0000","last_change":"2024-04-25T00:50:35.801766+0000","last_active":"2024-04-25T03:09:41.070072+0000","last_peered":"2024-04-25T03:09:41.070072+0000","last_clean":"2024-04-25T03:09:41.070072+0000","last_became_active":"2024-04-25T00:50:35.801060+0000","last_became_peered":"2024-04-25T00:50:35.801060+0000","last_unstale":"2024-04-25T03:09:41.070072+0000","last_undegraded":"2024-04-25T03:09:41.070072+0000","last_fullsized":"2024-04-25T03:09:41.070072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9600,"num_write":393,"num_write_kb":50549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"28'894","reported_seq":976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:31.197675+0000","last_change":"2024-04-25T00:50:33.327283+0000","last_active":"2024-04-25T03:09:31.197675+0000","last_peered":"2024-04-25T03:09:31.197675+0000","last_clean":"2024-04-25T03:09:31.197675+0000","last_became_active":"2024-04-25T00:50:33.326464+0000","last_became_peered":"2024-04-25T00:50:33.326464+0000","last_unstale":"2024-04-25T03:09:31.197675+0000","last_undegraded":"2024-04-25T03:09:31.197675+0000","last_fullsized":"2024-04-25T03:09:31.197675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:26:26.328621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":8609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'491","reported_seq":685,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.662645+0000","last_change":"2024-04-25T00:50:35.825910+0000","last_active":"2024-04-25T03:09:40.662645+0000","last_peered":"2024-04-25T03:09:40.662645+0000","last_clean":"2024-04-25T03:09:40.662645+0000","last_became_active":"2024-04-25T00:50:35.825246+0000","last_became_peered":"2024-04-25T00:50:35.825246+0000","last_unstale":"2024-04-25T03:09:40.662645+0000","last_undegraded":"2024-04-25T03:09:40.662645+0000","last_fullsized":"2024-04-25T03:09:40.662645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:40.106788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":62450,"num_write":458,"num_write_kb":109145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'805","reported_seq":889,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:32.246466+0000","last_change":"2024-04-25T00:50:33.393856+0000","last_active":"2024-04-25T03:08:32.246466+0000","last_peered":"2024-04-25T03:08:32.246466+0000","last_clean":"2024-04-25T03:08:32.246466+0000","last_became_active":"2024-04-25T00:50:33.393153+0000","last_became_peered":"2024-04-25T00:50:33.393153+0000","last_unstale":"2024-04-25T03:08:32.246466+0000","last_undegraded":"2024-04-25T03:08:32.246466+0000","last_fullsized":"2024-04-25T03:08:32.246466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:55.179146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":4477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'357","reported_seq":488,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.665816+0000","last_change":"2024-04-25T00:50:35.811993+0000","last_active":"2024-04-25T03:09:40.665816+0000","last_peered":"2024-04-25T03:09:40.665816+0000","last_clean":"2024-04-25T03:09:40.665816+0000","last_became_active":"2024-04-25T00:50:35.811267+0000","last_became_peered":"2024-04-25T00:50:35.811267+0000","last_unstale":"2024-04-25T03:09:40.665816+0000","last_undegraded":"2024-04-25T03:09:40.665816+0000","last_fullsized":"2024-04-25T03:09:40.665816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:40:20.385617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":21001,"num_write":331,"num_write_kb":38526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'903","reported_seq":987,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:20.853159+0000","last_change":"2024-04-25T00:50:33.383040+0000","last_active":"2024-04-25T03:07:20.853159+0000","last_peered":"2024-04-25T03:07:20.853159+0000","last_clean":"2024-04-25T03:07:20.853159+0000","last_became_active":"2024-04-25T00:50:33.382270+0000","last_became_peered":"2024-04-25T00:50:33.382270+0000","last_unstale":"2024-04-25T03:07:20.853159+0000","last_undegraded":"2024-04-25T03:07:20.853159+0000","last_fullsized":"2024-04-25T03:07:20.853159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:13.866739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":844,"num_write_kb":4518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'401","reported_seq":521,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.707568+0000","last_change":"2024-04-25T00:50:35.818234+0000","last_active":"2024-04-25T03:09:40.707568+0000","last_peered":"2024-04-25T03:09:40.707568+0000","last_clean":"2024-04-25T03:09:40.707568+0000","last_became_active":"2024-04-25T00:50:35.817707+0000","last_became_peered":"2024-04-25T00:50:35.817707+0000","last_unstale":"2024-04-25T03:09:40.707568+0000","last_undegraded":"2024-04-25T03:09:40.707568+0000","last_fullsized":"2024-04-25T03:09:40.707568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:31.998886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16207,"num_write":370,"num_write_kb":59244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"28'326","reported_seq":410,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:46.654107+0000","last_change":"2024-04-25T00:50:33.389774+0000","last_active":"2024-04-25T03:07:46.654107+0000","last_peered":"2024-04-25T03:07:46.654107+0000","last_clean":"2024-04-25T03:07:46.654107+0000","last_became_active":"2024-04-25T00:50:33.389092+0000","last_became_peered":"2024-04-25T00:50:33.389092+0000","last_unstale":"2024-04-25T03:07:46.654107+0000","last_undegraded":"2024-04-25T03:07:46.654107+0000","last_fullsized":"2024-04-25T03:07:46.654107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:30.722771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'441","reported_seq":582,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.646651+0000","last_change":"2024-04-25T00:50:35.869211+0000","last_active":"2024-04-25T03:09:40.646651+0000","last_peered":"2024-04-25T03:09:40.646651+0000","last_clean":"2024-04-25T03:09:40.646651+0000","last_became_active":"2024-04-25T00:50:35.868798+0000","last_became_peered":"2024-04-25T00:50:35.868798+0000","last_unstale":"2024-04-25T03:09:40.646651+0000","last_undegraded":"2024-04-25T03:09:40.646651+0000","last_fullsized":"2024-04-25T03:09:40.646651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:40.106788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27029,"num_write":413,"num_write_kb":63857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"28'319","reported_seq":403,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:15.892809+0000","last_change":"2024-04-25T00:50:33.329578+0000","last_active":"2024-04-25T03:09:15.892809+0000","last_peered":"2024-04-25T03:09:15.892809+0000","last_clean":"2024-04-25T03:09:15.892809+0000","last_became_active":"2024-04-25T00:50:33.328950+0000","last_became_peered":"2024-04-25T00:50:33.328950+0000","last_unstale":"2024-04-25T03:09:15.892809+0000","last_undegraded":"2024-04-25T03:09:15.892809+0000","last_fullsized":"2024-04-25T03:09:15.892809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:55.179146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196056,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":254,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'426","reported_seq":560,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.709661+0000","last_change":"2024-04-25T00:50:35.734419+0000","last_active":"2024-04-25T03:09:40.709661+0000","last_peered":"2024-04-25T03:09:40.709661+0000","last_clean":"2024-04-25T03:09:40.709661+0000","last_became_active":"2024-04-25T00:50:35.733696+0000","last_became_peered":"2024-04-25T00:50:35.733696+0000","last_unstale":"2024-04-25T03:09:40.709661+0000","last_undegraded":"2024-04-25T03:09:40.709661+0000","last_fullsized":"2024-04-25T03:09:40.709661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:05.046355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":28368,"num_write":395,"num_write_kb":71042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":248,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:06:32.174332+0000","last_change":"2024-04-25T00:49:55.281216+0000","last_active":"2024-04-25T03:06:32.174332+0000","last_peered":"2024-04-25T03:06:32.174332+0000","last_clean":"2024-04-25T03:06:32.174332+0000","last_became_active":"2024-04-25T00:49:55.278022+0000","last_became_peered":"2024-04-25T00:49:55.278022+0000","last_unstale":"2024-04-25T03:06:32.174332+0000","last_undegraded":"2024-04-25T03:06:32.174332+0000","last_fullsized":"2024-04-25T03:06:32.174332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:49:52.475299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:49:52.475299+0000","last_clean_scrub_stamp":"2024-04-25T00:49:52.475299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:17.046656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"28'385","reported_seq":474,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:11.554423+0000","last_change":"2024-04-25T00:50:33.325228+0000","last_active":"2024-04-25T03:09:11.554423+0000","last_peered":"2024-04-25T03:09:11.554423+0000","last_clean":"2024-04-25T03:09:11.554423+0000","last_became_active":"2024-04-25T00:50:33.324579+0000","last_became_peered":"2024-04-25T00:50:33.324579+0000","last_unstale":"2024-04-25T03:09:11.554423+0000","last_undegraded":"2024-04-25T03:09:11.554423+0000","last_fullsized":"2024-04-25T03:09:11.554423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:12.762746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'354","reported_seq":469,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.039589+0000","last_change":"2024-04-25T00:50:35.880348+0000","last_active":"2024-04-25T03:09:41.039589+0000","last_peered":"2024-04-25T03:09:41.039589+0000","last_clean":"2024-04-25T03:09:41.039589+0000","last_became_active":"2024-04-25T00:50:35.878438+0000","last_became_peered":"2024-04-25T00:50:35.878438+0000","last_unstale":"2024-04-25T03:09:41.039589+0000","last_undegraded":"2024-04-25T03:09:41.039589+0000","last_fullsized":"2024-04-25T03:09:41.039589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:44.093119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20480,"num_write":322,"num_write_kb":49980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"28'1052","reported_seq":1144,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:51.863301+0000","last_change":"2024-04-25T00:50:33.321385+0000","last_active":"2024-04-25T03:08:51.863301+0000","last_peered":"2024-04-25T03:08:51.863301+0000","last_clean":"2024-04-25T03:08:51.863301+0000","last_became_active":"2024-04-25T00:50:33.320800+0000","last_became_peered":"2024-04-25T00:50:33.320800+0000","last_unstale":"2024-04-25T03:08:51.863301+0000","last_undegraded":"2024-04-25T03:08:51.863301+0000","last_fullsized":"2024-04-25T03:08:51.863301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:04.254885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":991,"num_write_kb":12720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"28'420","reported_seq":532,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.894623+0000","last_change":"2024-04-25T00:50:35.815056+0000","last_active":"2024-04-25T03:09:40.894623+0000","last_peered":"2024-04-25T03:09:40.894623+0000","last_clean":"2024-04-25T03:09:40.894623+0000","last_became_active":"2024-04-25T00:50:35.814163+0000","last_became_peered":"2024-04-25T00:50:35.814163+0000","last_unstale":"2024-04-25T03:09:40.894623+0000","last_undegraded":"2024-04-25T03:09:40.894623+0000","last_fullsized":"2024-04-25T03:09:40.894623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:50:52.289674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14110,"num_write":386,"num_write_kb":112699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"28'4457","reported_seq":8941,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:36.126848+0000","last_change":"2024-04-25T00:50:33.384695+0000","last_active":"2024-04-25T03:09:36.126848+0000","last_peered":"2024-04-25T03:09:36.126848+0000","last_clean":"2024-04-25T03:09:36.126848+0000","last_became_active":"2024-04-25T00:50:33.383692+0000","last_became_peered":"2024-04-25T00:50:33.383692+0000","last_unstale":"2024-04-25T03:09:36.126848+0000","last_undegraded":"2024-04-25T03:09:36.126848+0000","last_fullsized":"2024-04-25T03:09:36.126848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":4457,"log_dups_size":0,"ondisk_log_size":4457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:57.579410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1471076,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4395,"num_read_kb":4765,"num_write":4402,"num_write_kb":4769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'402","reported_seq":517,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.888992+0000","last_change":"2024-04-25T00:50:35.723048+0000","last_active":"2024-04-25T03:09:40.888992+0000","last_peered":"2024-04-25T03:09:40.888992+0000","last_clean":"2024-04-25T03:09:40.888992+0000","last_became_active":"2024-04-25T00:50:35.722500+0000","last_became_peered":"2024-04-25T00:50:35.722500+0000","last_unstale":"2024-04-25T03:09:40.888992+0000","last_undegraded":"2024-04-25T03:09:40.888992+0000","last_fullsized":"2024-04-25T03:09:40.888992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:20:39.082516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13853,"num_write":369,"num_write_kb":30117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"28'1036","reported_seq":1125,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:06:02.117152+0000","last_change":"2024-04-25T00:50:33.305927+0000","last_active":"2024-04-25T03:06:02.117152+0000","last_peered":"2024-04-25T03:06:02.117152+0000","last_clean":"2024-04-25T03:06:02.117152+0000","last_became_active":"2024-04-25T00:50:33.305159+0000","last_became_peered":"2024-04-25T00:50:33.305159+0000","last_unstale":"2024-04-25T03:06:02.117152+0000","last_undegraded":"2024-04-25T03:06:02.117152+0000","last_fullsized":"2024-04-25T03:06:02.117152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1036,"log_dups_size":0,"ondisk_log_size":1036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:46:56.639410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":968,"num_write_kb":8653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'394","reported_seq":551,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.639498+0000","last_change":"2024-04-25T00:50:35.824491+0000","last_active":"2024-04-25T03:09:40.639498+0000","last_peered":"2024-04-25T03:09:40.639498+0000","last_clean":"2024-04-25T03:09:40.639498+0000","last_became_active":"2024-04-25T00:50:35.823320+0000","last_became_peered":"2024-04-25T00:50:35.823320+0000","last_unstale":"2024-04-25T03:09:40.639498+0000","last_undegraded":"2024-04-25T03:09:40.639498+0000","last_fullsized":"2024-04-25T03:09:40.639498+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:57.466393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":47782,"num_write":359,"num_write_kb":62996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"28'368","reported_seq":457,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:04.082610+0000","last_change":"2024-04-25T00:50:33.304490+0000","last_active":"2024-04-25T03:08:04.082610+0000","last_peered":"2024-04-25T03:08:04.082610+0000","last_clean":"2024-04-25T03:08:04.082610+0000","last_became_active":"2024-04-25T00:50:33.303671+0000","last_became_peered":"2024-04-25T00:50:33.303671+0000","last_unstale":"2024-04-25T03:08:04.082610+0000","last_undegraded":"2024-04-25T03:08:04.082610+0000","last_fullsized":"2024-04-25T03:08:04.082610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:30.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":4247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'437","reported_seq":572,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.663449+0000","last_change":"2024-04-25T00:50:35.878641+0000","last_active":"2024-04-25T03:09:40.663449+0000","last_peered":"2024-04-25T03:09:40.663449+0000","last_clean":"2024-04-25T03:09:40.663449+0000","last_became_active":"2024-04-25T00:50:35.876958+0000","last_became_peered":"2024-04-25T00:50:35.876958+0000","last_unstale":"2024-04-25T03:09:40.663449+0000","last_undegraded":"2024-04-25T03:09:40.663449+0000","last_fullsized":"2024-04-25T03:09:40.663449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:59.565909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":21227,"num_write":402,"num_write_kb":75746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"28'1039","reported_seq":1128,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:42.196406+0000","last_change":"2024-04-25T00:50:33.319229+0000","last_active":"2024-04-25T03:08:42.196406+0000","last_peered":"2024-04-25T03:08:42.196406+0000","last_clean":"2024-04-25T03:08:42.196406+0000","last_became_active":"2024-04-25T00:50:33.318945+0000","last_became_peered":"2024-04-25T00:50:33.318945+0000","last_unstale":"2024-04-25T03:08:42.196406+0000","last_undegraded":"2024-04-25T03:08:42.196406+0000","last_fullsized":"2024-04-25T03:08:42.196406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:51.132430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":986,"num_write_kb":8683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'399","reported_seq":518,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.885582+0000","last_change":"2024-04-25T00:50:35.722521+0000","last_active":"2024-04-25T03:09:40.885582+0000","last_peered":"2024-04-25T03:09:40.885582+0000","last_clean":"2024-04-25T03:09:40.885582+0000","last_became_active":"2024-04-25T00:50:35.722128+0000","last_became_peered":"2024-04-25T00:50:35.722128+0000","last_unstale":"2024-04-25T03:09:40.885582+0000","last_undegraded":"2024-04-25T03:09:40.885582+0000","last_fullsized":"2024-04-25T03:09:40.885582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:59:36.793140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19866,"num_write":357,"num_write_kb":75325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"28'6462","reported_seq":6549,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:34.387247+0000","last_change":"2024-04-25T00:50:33.387402+0000","last_active":"2024-04-25T03:09:34.387247+0000","last_peered":"2024-04-25T03:09:34.387247+0000","last_clean":"2024-04-25T03:09:34.387247+0000","last_became_active":"2024-04-25T00:50:33.386631+0000","last_became_peered":"2024-04-25T00:50:33.386631+0000","last_unstale":"2024-04-25T03:09:34.387247+0000","last_undegraded":"2024-04-25T03:09:34.387247+0000","last_fullsized":"2024-04-25T03:09:34.387247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":6462,"log_dups_size":0,"ondisk_log_size":6462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:11:49.105412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17492,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'357","reported_seq":506,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.032804+0000","last_change":"2024-04-25T00:50:35.882715+0000","last_active":"2024-04-25T03:09:41.032804+0000","last_peered":"2024-04-25T03:09:41.032804+0000","last_clean":"2024-04-25T03:09:41.032804+0000","last_became_active":"2024-04-25T00:50:35.878416+0000","last_became_peered":"2024-04-25T00:50:35.878416+0000","last_unstale":"2024-04-25T03:09:41.032804+0000","last_undegraded":"2024-04-25T03:09:41.032804+0000","last_fullsized":"2024-04-25T03:09:41.032804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:35.413796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":29447,"num_write":334,"num_write_kb":70980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"28'373","reported_seq":460,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:17.108484+0000","last_change":"2024-04-25T00:50:33.393211+0000","last_active":"2024-04-25T03:09:17.108484+0000","last_peered":"2024-04-25T03:09:17.108484+0000","last_clean":"2024-04-25T03:09:17.108484+0000","last_became_active":"2024-04-25T00:50:33.392381+0000","last_became_peered":"2024-04-25T00:50:33.392381+0000","last_unstale":"2024-04-25T03:09:17.108484+0000","last_undegraded":"2024-04-25T03:09:17.108484+0000","last_fullsized":"2024-04-25T03:09:17.108484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:18:05.276269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'446","reported_seq":575,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.904553+0000","last_change":"2024-04-25T00:50:35.798491+0000","last_active":"2024-04-25T03:09:40.904553+0000","last_peered":"2024-04-25T03:09:40.904553+0000","last_clean":"2024-04-25T03:09:40.904553+0000","last_became_active":"2024-04-25T00:50:35.796775+0000","last_became_peered":"2024-04-25T00:50:35.796775+0000","last_unstale":"2024-04-25T03:09:40.904553+0000","last_undegraded":"2024-04-25T03:09:40.904553+0000","last_fullsized":"2024-04-25T03:09:40.904553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:54.948867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":29188,"num_write":413,"num_write_kb":79416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"28'380","reported_seq":467,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:41.219949+0000","last_change":"2024-04-25T00:50:33.321163+0000","last_active":"2024-04-25T03:08:41.219949+0000","last_peered":"2024-04-25T03:08:41.219949+0000","last_clean":"2024-04-25T03:08:41.219949+0000","last_became_active":"2024-04-25T00:50:33.320554+0000","last_became_peered":"2024-04-25T00:50:33.320554+0000","last_unstale":"2024-04-25T03:08:41.219949+0000","last_undegraded":"2024-04-25T03:08:41.219949+0000","last_fullsized":"2024-04-25T03:08:41.219949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:13.533462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":317,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'445","reported_seq":576,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.394213+0000","last_change":"2024-04-25T00:50:35.824154+0000","last_active":"2024-04-25T03:09:40.394213+0000","last_peered":"2024-04-25T03:09:40.394213+0000","last_clean":"2024-04-25T03:09:40.394213+0000","last_became_active":"2024-04-25T00:50:35.823269+0000","last_became_peered":"2024-04-25T00:50:35.823269+0000","last_unstale":"2024-04-25T03:09:40.394213+0000","last_undegraded":"2024-04-25T03:09:40.394213+0000","last_fullsized":"2024-04-25T03:09:40.394213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:16.208624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25774,"num_write":415,"num_write_kb":54462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'452","reported_seq":539,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:45.788461+0000","last_change":"2024-04-25T00:50:33.319985+0000","last_active":"2024-04-25T03:07:45.788461+0000","last_peered":"2024-04-25T03:07:45.788461+0000","last_clean":"2024-04-25T03:07:45.788461+0000","last_became_active":"2024-04-25T00:50:33.319198+0000","last_became_peered":"2024-04-25T00:50:33.319198+0000","last_unstale":"2024-04-25T03:07:45.788461+0000","last_undegraded":"2024-04-25T03:07:45.788461+0000","last_fullsized":"2024-04-25T03:07:45.788461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:01.398188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'409","reported_seq":537,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.056760+0000","last_change":"2024-04-25T00:50:35.883007+0000","last_active":"2024-04-25T03:09:41.056760+0000","last_peered":"2024-04-25T03:09:41.056760+0000","last_clean":"2024-04-25T03:09:41.056760+0000","last_became_active":"2024-04-25T00:50:35.881829+0000","last_became_peered":"2024-04-25T00:50:35.881829+0000","last_unstale":"2024-04-25T03:09:41.056760+0000","last_undegraded":"2024-04-25T03:09:41.056760+0000","last_fullsized":"2024-04-25T03:09:41.056760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:02.444745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":18047,"num_write":372,"num_write_kb":46881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'1205","reported_seq":1291,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:43.888245+0000","last_change":"2024-04-25T00:50:33.384397+0000","last_active":"2024-04-25T03:07:43.888245+0000","last_peered":"2024-04-25T03:07:43.888245+0000","last_clean":"2024-04-25T03:07:43.888245+0000","last_became_active":"2024-04-25T00:50:33.383622+0000","last_became_peered":"2024-04-25T00:50:33.383622+0000","last_unstale":"2024-04-25T03:07:43.888245+0000","last_undegraded":"2024-04-25T03:07:43.888245+0000","last_fullsized":"2024-04-25T03:07:43.888245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1205,"log_dups_size":0,"ondisk_log_size":1205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:31.816914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":8761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'428","reported_seq":553,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.052021+0000","last_change":"2024-04-25T00:50:35.881976+0000","last_active":"2024-04-25T03:09:41.052021+0000","last_peered":"2024-04-25T03:09:41.052021+0000","last_clean":"2024-04-25T03:09:41.052021+0000","last_became_active":"2024-04-25T00:50:35.881269+0000","last_became_peered":"2024-04-25T00:50:35.881269+0000","last_unstale":"2024-04-25T03:09:41.052021+0000","last_undegraded":"2024-04-25T03:09:41.052021+0000","last_fullsized":"2024-04-25T03:09:41.052021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:54.302741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19611,"num_write":396,"num_write_kb":67446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1399","reported_seq":1483,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:07.562053+0000","last_change":"2024-04-25T00:50:33.390041+0000","last_active":"2024-04-25T03:08:07.562053+0000","last_peered":"2024-04-25T03:08:07.562053+0000","last_clean":"2024-04-25T03:08:07.562053+0000","last_became_active":"2024-04-25T00:50:33.389095+0000","last_became_peered":"2024-04-25T00:50:33.389095+0000","last_unstale":"2024-04-25T03:08:07.562053+0000","last_undegraded":"2024-04-25T03:08:07.562053+0000","last_fullsized":"2024-04-25T03:08:07.562053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1399,"log_dups_size":0,"ondisk_log_size":1399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:00.569613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1344,"num_write_kb":12923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'449","reported_seq":610,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.070319+0000","last_change":"2024-04-25T00:50:35.812195+0000","last_active":"2024-04-25T03:09:41.070319+0000","last_peered":"2024-04-25T03:09:41.070319+0000","last_clean":"2024-04-25T03:09:41.070319+0000","last_became_active":"2024-04-25T00:50:35.811410+0000","last_became_peered":"2024-04-25T00:50:35.811410+0000","last_unstale":"2024-04-25T03:09:41.070319+0000","last_undegraded":"2024-04-25T03:09:41.070319+0000","last_fullsized":"2024-04-25T03:09:41.070319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:06.596770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42516,"num_write":419,"num_write_kb":125381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"28'392","reported_seq":512,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.722040+0000","last_change":"2024-04-25T00:50:35.821808+0000","last_active":"2024-04-25T03:09:40.722040+0000","last_peered":"2024-04-25T03:09:40.722040+0000","last_clean":"2024-04-25T03:09:40.722040+0000","last_became_active":"2024-04-25T00:50:35.821062+0000","last_became_peered":"2024-04-25T00:50:35.821062+0000","last_unstale":"2024-04-25T03:09:40.722040+0000","last_undegraded":"2024-04-25T03:09:40.722040+0000","last_fullsized":"2024-04-25T03:09:40.722040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":28880,"num_write":348,"num_write_kb":60862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"28'845","reported_seq":923,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:40.321237+0000","last_change":"2024-04-25T00:50:33.319853+0000","last_active":"2024-04-25T03:08:40.321237+0000","last_peered":"2024-04-25T03:08:40.321237+0000","last_clean":"2024-04-25T03:08:40.321237+0000","last_became_active":"2024-04-25T00:50:33.319197+0000","last_became_peered":"2024-04-25T00:50:33.319197+0000","last_unstale":"2024-04-25T03:08:40.321237+0000","last_undegraded":"2024-04-25T03:08:40.321237+0000","last_fullsized":"2024-04-25T03:08:40.321237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:24.834556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":4488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'367","reported_seq":495,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.726212+0000","last_change":"2024-04-25T00:50:35.812044+0000","last_active":"2024-04-25T03:09:40.726212+0000","last_peered":"2024-04-25T03:09:40.726212+0000","last_clean":"2024-04-25T03:09:40.726212+0000","last_became_active":"2024-04-25T00:50:35.811281+0000","last_became_peered":"2024-04-25T00:50:35.811281+0000","last_unstale":"2024-04-25T03:09:40.726212+0000","last_undegraded":"2024-04-25T03:09:40.726212+0000","last_fullsized":"2024-04-25T03:09:40.726212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:28.655307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":25463,"num_write":336,"num_write_kb":42887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1943","reported_seq":2021,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:09.463635+0000","last_change":"2024-04-25T00:50:33.382775+0000","last_active":"2024-04-25T03:09:09.463635+0000","last_peered":"2024-04-25T03:09:09.463635+0000","last_clean":"2024-04-25T03:09:09.463635+0000","last_became_active":"2024-04-25T00:50:33.382218+0000","last_became_peered":"2024-04-25T00:50:33.382218+0000","last_unstale":"2024-04-25T03:09:09.463635+0000","last_undegraded":"2024-04-25T03:09:09.463635+0000","last_fullsized":"2024-04-25T03:09:09.463635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:52.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1878,"num_write_kb":17269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"28'382","reported_seq":539,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.902056+0000","last_change":"2024-04-25T00:50:35.802543+0000","last_active":"2024-04-25T03:09:40.902056+0000","last_peered":"2024-04-25T03:09:40.902056+0000","last_clean":"2024-04-25T03:09:40.902056+0000","last_became_active":"2024-04-25T00:50:35.801799+0000","last_became_peered":"2024-04-25T00:50:35.801799+0000","last_unstale":"2024-04-25T03:09:40.902056+0000","last_undegraded":"2024-04-25T03:09:40.902056+0000","last_fullsized":"2024-04-25T03:09:40.902056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:15.875347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":38798,"num_write":356,"num_write_kb":55918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"28'667","reported_seq":759,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:44.643827+0000","last_change":"2024-04-25T00:50:33.389565+0000","last_active":"2024-04-25T03:07:44.643827+0000","last_peered":"2024-04-25T03:07:44.643827+0000","last_clean":"2024-04-25T03:07:44.643827+0000","last_became_active":"2024-04-25T00:50:33.388773+0000","last_became_peered":"2024-04-25T00:50:33.388773+0000","last_unstale":"2024-04-25T03:07:44.643827+0000","last_undegraded":"2024-04-25T03:07:44.643827+0000","last_fullsized":"2024-04-25T03:07:44.643827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:42.721375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"28'435","reported_seq":551,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.030287+0000","last_change":"2024-04-25T00:50:35.877410+0000","last_active":"2024-04-25T03:09:41.030287+0000","last_peered":"2024-04-25T03:09:41.030287+0000","last_clean":"2024-04-25T03:09:41.030287+0000","last_became_active":"2024-04-25T00:50:35.876576+0000","last_became_peered":"2024-04-25T00:50:35.876576+0000","last_unstale":"2024-04-25T03:09:41.030287+0000","last_undegraded":"2024-04-25T03:09:41.030287+0000","last_fullsized":"2024-04-25T03:09:41.030287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:15.762503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17268,"num_write":403,"num_write_kb":121594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"28'723","reported_seq":812,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:31.807513+0000","last_change":"2024-04-25T00:50:33.319601+0000","last_active":"2024-04-25T03:08:31.807513+0000","last_peered":"2024-04-25T03:08:31.807513+0000","last_clean":"2024-04-25T03:08:31.807513+0000","last_became_active":"2024-04-25T00:50:33.318940+0000","last_became_peered":"2024-04-25T00:50:33.318940+0000","last_unstale":"2024-04-25T03:08:31.807513+0000","last_undegraded":"2024-04-25T03:08:31.807513+0000","last_fullsized":"2024-04-25T03:08:31.807513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:41.175588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":687,"num_write_kb":8496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2646,"num_read_kb":1386903,"num_write":24369,"num_write_kb":4205310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26395,"ondisk_log_size":26395,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":213073620,"num_objects":149,"num_object_clones":0,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":0,"num_read":4395,"num_read_kb":4765,"num_write":47715,"num_write_kb":231672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":426393600,"data_stored":426147240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38437,"ondisk_log_size":38437,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719478420,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177932,"kb_used_data":78724,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94193908,"statfs":{"total":96636764160,"available":96454561792,"internally_reserved":0,"allocated":80613376,"data_stored":80393199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":101579210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719478420,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":162792,"kb_used_data":63584,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94209048,"statfs":{"total":96636764160,"available":96470065152,"internally_reserved":0,"allocated":65110016,"data_stored":64903593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719478420,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150528,"kb_used_data":51320,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94221312,"statfs":{"total":96636764160,"available":96482623488,"internally_reserved":0,"allocated":52551680,"data_stored":52323151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719478418,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147132,"kb_used_data":57652,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94224708,"statfs":{"total":96636764160,"available":96486100992,"internally_reserved":0,"allocated":59035648,"data_stored":58830541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719478419,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97828,"kb_used_data":22236,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94274012,"statfs":{"total":96636764160,"available":96536588288,"internally_reserved":0,"allocated":22769664,"data_stored":22552901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424511123,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150240,"kb_used_data":42712,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94221600,"statfs":{"total":96636764160,"available":96482918400,"internally_reserved":0,"allocated":43737088,"data_stored":43524455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110098887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424511124,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109060,"kb_used_data":45948,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94262780,"statfs":{"total":96636764160,"available":96525086720,"internally_reserved":0,"allocated":47050752,"data_stored":46836959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543827,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":156864,"kb_used_data":57656,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94214976,"statfs":{"total":96636764160,"available":96476135424,"internally_reserved":0,"allocated":59039744,"data_stored":58830161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46166016,"data_stored":46138218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":58748928,"data_stored":58721788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22478848,"data_stored":22444528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":43446272,"data_stored":43416082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":58744832,"data_stored":58722168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":52260864,"data_stored":52214778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":64819200,"data_stored":64795220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":79728640,"data_stored":79694458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T03:09:48.116 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T03:09:48.116 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T03:09:48.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.273+0000 7fe17332d640 1 Processor -- start 2024-04-25T03:09:48.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.273+0000 7fe17332d640 1 -- start start 2024-04-25T03:09:48.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.273+0000 7fe17332d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe16c154650 0x7fe16c0cf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:48.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.273+0000 7fe17332d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe16c0cf550 0x7fe16c15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:48.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.273+0000 7fe17332d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe16c15c490 con 0x7fe16c15c000 2024-04-25T03:09:48.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.273+0000 7fe17332d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe16c0cd9e0 con 0x7fe16c0cf550 2024-04-25T03:09:48.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.273+0000 7fe17332d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fe16c0cdcc0 con 0x7fe16c154650 2024-04-25T03:09:48.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.273+0000 7fe1708c8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe16c0cf550 0x7fe16c15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:48.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.273+0000 7fe1708c8640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe16c0cf550 0x7fe16c15bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46730/0 (socket says 172.21.15.162:46730) 2024-04-25T03:09:48.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.273+0000 7fe1708c8640 1 -- 172.21.15.162:0/3004384116 learned_addr learned my addr 172.21.15.162:0/3004384116 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:48.276 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.273+0000 7fe1710c9640 1 --2- 172.21.15.162:0/3004384116 >> v2:172.21.15.179:3300/0 conn(0x7fe16c154650 0x7fe16c0cf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:48.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.277+0000 7fe1708c8640 1 -- 172.21.15.162:0/3004384116 >> v2:172.21.15.179:3300/0 conn(0x7fe16c154650 msgr2=0x7fe16c0cf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:48.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.277+0000 7fe1708c8640 1 --2- 172.21.15.162:0/3004384116 >> v2:172.21.15.179:3300/0 conn(0x7fe16c154650 0x7fe16c0cf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:48.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.277+0000 7fe1708c8640 1 -- 172.21.15.162:0/3004384116 >> v1:172.21.15.179:6789/0 conn(0x7fe16c15c000 legacy=0x7fe16c06c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:48.278 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.277+0000 7fe1708c8640 1 -- 172.21.15.162:0/3004384116 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16c0cdfa0 con 0x7fe16c0cf550 2024-04-25T03:09:48.281 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.281+0000 7fe1708c8640 1 --2- 172.21.15.162:0/3004384116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe16c0cf550 0x7fe16c15bac0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe16c08d990 tx=0x7fe16801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a6f69e6878c957 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:48.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.285+0000 7fe163fff640 1 -- 172.21.15.162:0/3004384116 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1680b5070 con 0x7fe16c0cf550 2024-04-25T03:09:48.286 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.285+0000 7fe163fff640 1 -- 172.21.15.162:0/3004384116 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1680a89d0 con 0x7fe16c0cf550 2024-04-25T03:09:48.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.285+0000 7fe163fff640 1 -- 172.21.15.162:0/3004384116 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1680a8da0 con 0x7fe16c0cf550 2024-04-25T03:09:48.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.285+0000 7fe17332d640 1 -- 172.21.15.162:0/3004384116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe16c0cf550 msgr2=0x7fe16c15bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:48.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.285+0000 7fe17332d640 1 --2- 172.21.15.162:0/3004384116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe16c0cf550 0x7fe16c15bac0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe16c08d990 tx=0x7fe16801ecd0 comp rx=0 tx=0).stop 2024-04-25T03:09:48.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.285+0000 7fe17332d640 1 -- 172.21.15.162:0/3004384116 shutdown_connections 2024-04-25T03:09:48.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.285+0000 7fe17332d640 1 --2- 172.21.15.162:0/3004384116 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe16c0cf550 0x7fe16c15bac0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:48.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.285+0000 7fe17332d640 1 --2- 172.21.15.162:0/3004384116 >> v2:172.21.15.179:3300/0 conn(0x7fe16c154650 0x7fe16c0cf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:48.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.285+0000 7fe17332d640 1 -- 172.21.15.162:0/3004384116 >> 172.21.15.162:0/3004384116 conn(0x7fe16c0b1710 msgr2=0x7fe16c0b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:48.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.285+0000 7fe17332d640 1 -- 172.21.15.162:0/3004384116 shutdown_connections 2024-04-25T03:09:48.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.285+0000 7fe17332d640 1 -- 172.21.15.162:0/3004384116 wait complete. 2024-04-25T03:09:48.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.285+0000 7fe17332d640 1 Processor -- start 2024-04-25T03:09:48.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.285+0000 7fe17332d640 1 -- start start 2024-04-25T03:09:48.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.289+0000 7fe17332d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe16c0cf550 0x7fe16c1e3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:48.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.289+0000 7fe17332d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe16c154650 0x7fe16c1e7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:48.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.289+0000 7fe17332d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe16c15c000 0x7fe16c1e5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:48.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.289+0000 7fe17332d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c0ce840 con 0x7fe16c0cf550 2024-04-25T03:09:48.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.289+0000 7fe17332d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe16c0ce560 con 0x7fe16c154650 2024-04-25T03:09:48.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.289+0000 7fe17332d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe16c154a30 con 0x7fe16c15c000 2024-04-25T03:09:48.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.289+0000 7fe1710c9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe16c0cf550 0x7fe16c1e3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:48.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.289+0000 7fe1710c9640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe16c0cf550 0x7fe16c1e3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46736/0 (socket says 172.21.15.162:46736) 2024-04-25T03:09:48.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.289+0000 7fe1710c9640 1 -- 172.21.15.162:0/2605145280 learned_addr learned my addr 172.21.15.162:0/2605145280 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:48.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.289+0000 7fe1718ca640 1 --2- 172.21.15.162:0/2605145280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe16c15c000 0x7fe16c1e5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:48.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.289+0000 7fe1708c8640 1 --2- 172.21.15.162:0/2605145280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe16c154650 0x7fe16c1e7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:48.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.293+0000 7fe1710c9640 1 -- 172.21.15.162:0/2605145280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe16c15c000 msgr2=0x7fe16c1e5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:48.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.293+0000 7fe1710c9640 1 --2- 172.21.15.162:0/2605145280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe16c15c000 0x7fe16c1e5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:48.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.293+0000 7fe1710c9640 1 -- 172.21.15.162:0/2605145280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe16c154650 msgr2=0x7fe16c1e7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:48.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.293+0000 7fe1710c9640 1 --2- 172.21.15.162:0/2605145280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe16c154650 0x7fe16c1e7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:48.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.293+0000 7fe1710c9640 1 -- 172.21.15.162:0/2605145280 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe16c158550 con 0x7fe16c0cf550 2024-04-25T03:09:48.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.293+0000 7fe1710c9640 1 --2- 172.21.15.162:0/2605145280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe16c0cf550 0x7fe16c1e3be0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe15c00d830 tx=0x7fe15c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:48.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.297+0000 7fe161ffb640 1 -- 172.21.15.162:0/2605145280 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c00b6c0 con 0x7fe16c0cf550 2024-04-25T03:09:48.300 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.297+0000 7fe161ffb640 1 -- 172.21.15.162:0/2605145280 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe15c019070 con 0x7fe16c0cf550 2024-04-25T03:09:48.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.297+0000 7fe17332d640 1 -- 172.21.15.162:0/2605145280 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe16c1533f0 con 0x7fe16c0cf550 2024-04-25T03:09:48.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.297+0000 7fe161ffb640 1 -- 172.21.15.162:0/2605145280 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe15c00ba60 con 0x7fe16c0cf550 2024-04-25T03:09:48.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.297+0000 7fe17332d640 1 -- 172.21.15.162:0/2605145280 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe16c1539b0 con 0x7fe16c0cf550 2024-04-25T03:09:48.301 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.301+0000 7fe17332d640 1 -- 172.21.15.162:0/2605145280 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe16c068a20 con 0x7fe16c0cf550 2024-04-25T03:09:48.589 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.589+0000 7fe161ffb640 1 -- 172.21.15.162:0/2605145280 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe15c01e460 con 0x7fe16c0cf550 2024-04-25T03:09:48.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.589+0000 7fe161ffb640 1 --2- 172.21.15.162:0/2605145280 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe150067910 0x7fe150069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:48.590 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.589+0000 7fe1708c8640 1 --2- 172.21.15.162:0/2605145280 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe150067910 0x7fe150069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:48.591 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.589+0000 7fe1708c8640 1 --2- 172.21.15.162:0/2605145280 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe150067910 0x7fe150069dd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe1680b2000 tx=0x7fe168009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:48.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.633+0000 7fe161ffb640 1 -- 172.21.15.162:0/2605145280 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7fe15c055240 con 0x7fe16c0cf550 2024-04-25T03:09:48.659 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.657+0000 7fe161ffb640 1 -- 172.21.15.162:0/2605145280 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fe15c0571a0 con 0x7fe16c0cf550 2024-04-25T03:09:48.834 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.833+0000 7fe17332d640 1 -- 172.21.15.162:0/2605145280 --> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe16c1e3520 con 0x7fe150067910 2024-04-25T03:09:48.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.849+0000 7fe161ffb640 1 -- 172.21.15.162:0/2605145280 <== mgr.4100 v2:172.21.15.162:6800/3960394531 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254000 (secure 0 0 0) 0x7fe16c1e3520 con 0x7fe150067910 2024-04-25T03:09:48.853 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T03:09:48.855 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-04-25T03:09:48.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.853+0000 7fe17332d640 1 -- 172.21.15.162:0/2605145280 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe150067910 msgr2=0x7fe150069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:48.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.853+0000 7fe17332d640 1 --2- 172.21.15.162:0/2605145280 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe150067910 0x7fe150069dd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fe1680b2000 tx=0x7fe168009040 comp rx=0 tx=0).stop 2024-04-25T03:09:48.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.853+0000 7fe17332d640 1 -- 172.21.15.162:0/2605145280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe16c0cf550 msgr2=0x7fe16c1e3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:48.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.853+0000 7fe17332d640 1 --2- 172.21.15.162:0/2605145280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe16c0cf550 0x7fe16c1e3be0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe15c00d830 tx=0x7fe15c00dcf0 comp rx=0 tx=0).stop 2024-04-25T03:09:48.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.853+0000 7fe17332d640 1 -- 172.21.15.162:0/2605145280 shutdown_connections 2024-04-25T03:09:48.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.853+0000 7fe17332d640 1 --2- 172.21.15.162:0/2605145280 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe16c15c000 0x7fe16c1e5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:48.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.853+0000 7fe17332d640 1 --2- 172.21.15.162:0/2605145280 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe16c154650 0x7fe16c1e7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:48.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.853+0000 7fe17332d640 1 --2- 172.21.15.162:0/2605145280 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe150067910 0x7fe150069dd0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:48.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.853+0000 7fe17332d640 1 --2- 172.21.15.162:0/2605145280 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe16c0cf550 0x7fe16c1e3be0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:48.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.853+0000 7fe17332d640 1 -- 172.21.15.162:0/2605145280 >> 172.21.15.162:0/2605145280 conn(0x7fe16c0b1710 msgr2=0x7fe16c0b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:48.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.853+0000 7fe17332d640 1 -- 172.21.15.162:0/2605145280 shutdown_connections 2024-04-25T03:09:48.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:48.853+0000 7fe17332d640 1 -- 172.21.15.162:0/2605145280 wait complete. 2024-04-25T03:09:48.876 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":4221,"stamp":"2024-04-25T03:09:47.096161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":213663988,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":7157,"num_read_kb":1391768,"num_write":72243,"num_write_kb":4439398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64949,"ondisk_log_size":64949,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1152376,"kb_used_data":419832,"kb_used_omap":12,"kb_used_meta":732467,"kb_avail":753822344,"statfs":{"total":773094113280,"available":771914080256,"internally_reserved":0,"allocated":429907968,"data_stored":428194960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":750046769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":790,"num_objects":-5,"num_object_clones":0,"num_object_copies":-10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-5,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":30,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004164"},"pg_stats":[{"pgid":"3.3f","version":"28'428","reported_seq":558,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.658545+0000","last_change":"2024-04-25T00:50:35.761428+0000","last_active":"2024-04-25T03:09:40.658545+0000","last_peered":"2024-04-25T03:09:40.658545+0000","last_clean":"2024-04-25T03:09:40.658545+0000","last_became_active":"2024-04-25T00:50:35.760579+0000","last_became_peered":"2024-04-25T00:50:35.760579+0000","last_unstale":"2024-04-25T03:09:40.658545+0000","last_undegraded":"2024-04-25T03:09:40.658545+0000","last_fullsized":"2024-04-25T03:09:40.658545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:06.236972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25441,"num_write":394,"num_write_kb":67715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'447","reported_seq":651,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.902399+0000","last_change":"2024-04-25T00:50:35.798137+0000","last_active":"2024-04-25T03:09:40.902399+0000","last_peered":"2024-04-25T03:09:40.902399+0000","last_clean":"2024-04-25T03:09:40.902399+0000","last_became_active":"2024-04-25T00:50:35.797354+0000","last_became_peered":"2024-04-25T00:50:35.797354+0000","last_unstale":"2024-04-25T03:09:40.902399+0000","last_undegraded":"2024-04-25T03:09:40.902399+0000","last_fullsized":"2024-04-25T03:09:40.902399+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:29:18.970287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":59186,"num_write":421,"num_write_kb":88627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'383","reported_seq":484,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.900038+0000","last_change":"2024-04-25T00:50:35.799370+0000","last_active":"2024-04-25T03:09:40.900038+0000","last_peered":"2024-04-25T03:09:40.900038+0000","last_clean":"2024-04-25T03:09:40.900038+0000","last_became_active":"2024-04-25T00:50:35.798268+0000","last_became_peered":"2024-04-25T00:50:35.798268+0000","last_unstale":"2024-04-25T03:09:40.900038+0000","last_undegraded":"2024-04-25T03:09:40.900038+0000","last_fullsized":"2024-04-25T03:09:40.900038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:27.176441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8918,"num_write":356,"num_write_kb":42288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'378","reported_seq":485,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.726379+0000","last_change":"2024-04-25T00:50:35.877965+0000","last_active":"2024-04-25T03:09:40.726379+0000","last_peered":"2024-04-25T03:09:40.726379+0000","last_clean":"2024-04-25T03:09:40.726379+0000","last_became_active":"2024-04-25T00:50:35.877114+0000","last_became_peered":"2024-04-25T00:50:35.877114+0000","last_unstale":"2024-04-25T03:09:40.726379+0000","last_undegraded":"2024-04-25T03:09:40.726379+0000","last_fullsized":"2024-04-25T03:09:40.726379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:20.857588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":5983,"num_write":348,"num_write_kb":38519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'398","reported_seq":495,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.655255+0000","last_change":"2024-04-25T00:50:35.730647+0000","last_active":"2024-04-25T03:09:40.655255+0000","last_peered":"2024-04-25T03:09:40.655255+0000","last_clean":"2024-04-25T03:09:40.655255+0000","last_became_active":"2024-04-25T00:50:35.729785+0000","last_became_peered":"2024-04-25T00:50:35.729785+0000","last_unstale":"2024-04-25T03:09:40.655255+0000","last_undegraded":"2024-04-25T03:09:40.655255+0000","last_fullsized":"2024-04-25T03:09:40.655255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:02.888747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12535,"num_write":367,"num_write_kb":34849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'384","reported_seq":469,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.058722+0000","last_change":"2024-04-25T00:51:40.324509+0000","last_active":"2024-04-25T03:09:41.058722+0000","last_peered":"2024-04-25T03:09:41.058722+0000","last_clean":"2024-04-25T03:09:41.058722+0000","last_became_active":"2024-04-25T00:51:40.323657+0000","last_became_peered":"2024-04-25T00:51:40.323657+0000","last_unstale":"2024-04-25T03:09:41.058722+0000","last_undegraded":"2024-04-25T03:09:41.058722+0000","last_fullsized":"2024-04-25T03:09:41.058722+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:46:58.981295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9183,"num_write":360,"num_write_kb":42897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"28'423","reported_seq":516,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.632470+0000","last_change":"2024-04-25T00:50:35.797990+0000","last_active":"2024-04-25T03:09:40.632470+0000","last_peered":"2024-04-25T03:09:40.632470+0000","last_clean":"2024-04-25T03:09:40.632470+0000","last_became_active":"2024-04-25T00:50:35.797328+0000","last_became_peered":"2024-04-25T00:50:35.797328+0000","last_unstale":"2024-04-25T03:09:40.632470+0000","last_undegraded":"2024-04-25T03:09:40.632470+0000","last_fullsized":"2024-04-25T03:09:40.632470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:59.565909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6445,"num_write":396,"num_write_kb":56628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'391","reported_seq":537,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.064728+0000","last_change":"2024-04-25T00:50:35.878367+0000","last_active":"2024-04-25T03:09:41.064728+0000","last_peered":"2024-04-25T03:09:41.064728+0000","last_clean":"2024-04-25T03:09:41.064728+0000","last_became_active":"2024-04-25T00:50:35.877581+0000","last_became_peered":"2024-04-25T00:50:35.877581+0000","last_unstale":"2024-04-25T03:09:41.064728+0000","last_undegraded":"2024-04-25T03:09:41.064728+0000","last_fullsized":"2024-04-25T03:09:41.064728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:53.695907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":40559,"num_write":354,"num_write_kb":84336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'417","reported_seq":510,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.066086+0000","last_change":"2024-04-25T00:51:40.608818+0000","last_active":"2024-04-25T03:09:41.066086+0000","last_peered":"2024-04-25T03:09:41.066086+0000","last_clean":"2024-04-25T03:09:41.066086+0000","last_became_active":"2024-04-25T00:51:40.608071+0000","last_became_peered":"2024-04-25T00:51:40.608071+0000","last_unstale":"2024-04-25T03:09:41.066086+0000","last_undegraded":"2024-04-25T03:09:41.066086+0000","last_fullsized":"2024-04-25T03:09:41.066086+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:48:27.210535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14358,"num_write":383,"num_write_kb":47358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"28'402","reported_seq":520,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.088602+0000","last_change":"2024-04-25T00:50:35.765173+0000","last_active":"2024-04-25T03:09:41.088602+0000","last_peered":"2024-04-25T03:09:41.088602+0000","last_clean":"2024-04-25T03:09:41.088602+0000","last_became_active":"2024-04-25T00:50:35.764412+0000","last_became_peered":"2024-04-25T00:50:35.764412+0000","last_unstale":"2024-04-25T03:09:41.088602+0000","last_undegraded":"2024-04-25T03:09:41.088602+0000","last_fullsized":"2024-04-25T03:09:41.088602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:54.948867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":23778,"num_write":367,"num_write_kb":71174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'383","reported_seq":491,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.067336+0000","last_change":"2024-04-25T00:50:35.764526+0000","last_active":"2024-04-25T03:09:41.067336+0000","last_peered":"2024-04-25T03:09:41.067336+0000","last_clean":"2024-04-25T03:09:41.067336+0000","last_became_active":"2024-04-25T00:50:35.763770+0000","last_became_peered":"2024-04-25T00:50:35.763770+0000","last_unstale":"2024-04-25T03:09:41.067336+0000","last_undegraded":"2024-04-25T03:09:41.067336+0000","last_fullsized":"2024-04-25T03:09:41.067336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:15.698294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20604,"num_write":365,"num_write_kb":74840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'373","reported_seq":489,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.657926+0000","last_change":"2024-04-25T00:50:35.822113+0000","last_active":"2024-04-25T03:09:40.657926+0000","last_peered":"2024-04-25T03:09:40.657926+0000","last_clean":"2024-04-25T03:09:40.657926+0000","last_became_active":"2024-04-25T00:50:35.821524+0000","last_became_peered":"2024-04-25T00:50:35.821524+0000","last_unstale":"2024-04-25T03:09:40.657926+0000","last_undegraded":"2024-04-25T03:09:40.657926+0000","last_fullsized":"2024-04-25T03:09:40.657926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:43.722114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22834,"num_write":346,"num_write_kb":67125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'376","reported_seq":454,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.066166+0000","last_change":"2024-04-25T00:50:35.881637+0000","last_active":"2024-04-25T03:09:41.066166+0000","last_peered":"2024-04-25T03:09:41.066166+0000","last_clean":"2024-04-25T03:09:41.066166+0000","last_became_active":"2024-04-25T00:50:35.880661+0000","last_became_peered":"2024-04-25T00:50:35.880661+0000","last_unstale":"2024-04-25T03:09:41.066166+0000","last_undegraded":"2024-04-25T03:09:41.066166+0000","last_fullsized":"2024-04-25T03:09:41.066166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:26:39.862610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":168,"num_write":340,"num_write_kb":38232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'401","reported_seq":479,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.905393+0000","last_change":"2024-04-25T00:50:35.796996+0000","last_active":"2024-04-25T03:09:40.905393+0000","last_peered":"2024-04-25T03:09:40.905393+0000","last_clean":"2024-04-25T03:09:40.905393+0000","last_became_active":"2024-04-25T00:50:35.795295+0000","last_became_peered":"2024-04-25T00:50:35.795295+0000","last_unstale":"2024-04-25T03:09:40.905393+0000","last_undegraded":"2024-04-25T03:09:40.905393+0000","last_fullsized":"2024-04-25T03:09:40.905393+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:29.858476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":22306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'418","reported_seq":579,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.884949+0000","last_change":"2024-04-25T00:50:35.818291+0000","last_active":"2024-04-25T03:09:40.884949+0000","last_peered":"2024-04-25T03:09:40.884949+0000","last_clean":"2024-04-25T03:09:40.884949+0000","last_became_active":"2024-04-25T00:50:35.817575+0000","last_became_peered":"2024-04-25T00:50:35.817575+0000","last_unstale":"2024-04-25T03:09:40.884949+0000","last_undegraded":"2024-04-25T03:09:40.884949+0000","last_fullsized":"2024-04-25T03:09:40.884949+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:25:51.142494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":52039,"num_write":380,"num_write_kb":55267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'423","reported_seq":512,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.662177+0000","last_change":"2024-04-25T00:50:35.797194+0000","last_active":"2024-04-25T03:09:40.662177+0000","last_peered":"2024-04-25T03:09:40.662177+0000","last_clean":"2024-04-25T03:09:40.662177+0000","last_became_active":"2024-04-25T00:50:35.796536+0000","last_became_peered":"2024-04-25T00:50:35.796536+0000","last_unstale":"2024-04-25T03:09:40.662177+0000","last_undegraded":"2024-04-25T03:09:40.662177+0000","last_fullsized":"2024-04-25T03:09:40.662177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:48:27.210535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4763,"num_write":382,"num_write_kb":21763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'399","reported_seq":507,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.655166+0000","last_change":"2024-04-25T00:50:35.729648+0000","last_active":"2024-04-25T03:09:40.655166+0000","last_peered":"2024-04-25T03:09:40.655166+0000","last_clean":"2024-04-25T03:09:40.655166+0000","last_became_active":"2024-04-25T00:50:35.728875+0000","last_became_peered":"2024-04-25T00:50:35.728875+0000","last_unstale":"2024-04-25T03:09:40.655166+0000","last_undegraded":"2024-04-25T03:09:40.655166+0000","last_fullsized":"2024-04-25T03:09:40.655166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:46.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10229,"num_write":366,"num_write_kb":22657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'400","reported_seq":498,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.071871+0000","last_change":"2024-04-25T00:50:35.760953+0000","last_active":"2024-04-25T03:09:41.071871+0000","last_peered":"2024-04-25T03:09:41.071871+0000","last_clean":"2024-04-25T03:09:41.071871+0000","last_became_active":"2024-04-25T00:50:35.760286+0000","last_became_peered":"2024-04-25T00:50:35.760286+0000","last_unstale":"2024-04-25T03:09:41.071871+0000","last_undegraded":"2024-04-25T03:09:41.071871+0000","last_fullsized":"2024-04-25T03:09:41.071871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:57.466393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9641,"num_write":360,"num_write_kb":34623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'447","reported_seq":591,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.651462+0000","last_change":"2024-04-25T00:50:35.732837+0000","last_active":"2024-04-25T03:09:40.651462+0000","last_peered":"2024-04-25T03:09:40.651462+0000","last_clean":"2024-04-25T03:09:40.651462+0000","last_became_active":"2024-04-25T00:50:35.732134+0000","last_became_peered":"2024-04-25T00:50:35.732134+0000","last_unstale":"2024-04-25T03:09:40.651462+0000","last_undegraded":"2024-04-25T03:09:40.651462+0000","last_fullsized":"2024-04-25T03:09:40.651462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:46.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":29174,"num_write":415,"num_write_kb":129675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"28'442","reported_seq":544,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.067632+0000","last_change":"2024-04-25T00:50:35.818607+0000","last_active":"2024-04-25T03:09:41.067632+0000","last_peered":"2024-04-25T03:09:41.067632+0000","last_clean":"2024-04-25T03:09:41.067632+0000","last_became_active":"2024-04-25T00:50:35.818063+0000","last_became_peered":"2024-04-25T00:50:35.818063+0000","last_unstale":"2024-04-25T03:09:41.067632+0000","last_undegraded":"2024-04-25T03:09:41.067632+0000","last_fullsized":"2024-04-25T03:09:41.067632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:15.875347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20728,"num_write":411,"num_write_kb":42636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"28'443","reported_seq":581,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.907106+0000","last_change":"2024-04-25T00:50:35.798297+0000","last_active":"2024-04-25T03:09:40.907106+0000","last_peered":"2024-04-25T03:09:40.907106+0000","last_clean":"2024-04-25T03:09:40.907106+0000","last_became_active":"2024-04-25T00:50:35.797580+0000","last_became_peered":"2024-04-25T00:50:35.797580+0000","last_unstale":"2024-04-25T03:09:40.907106+0000","last_undegraded":"2024-04-25T03:09:40.907106+0000","last_fullsized":"2024-04-25T03:09:40.907106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:06.596770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28574,"num_write":419,"num_write_kb":125045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"28'422","reported_seq":523,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.063896+0000","last_change":"2024-04-25T00:51:40.408412+0000","last_active":"2024-04-25T03:09:41.063896+0000","last_peered":"2024-04-25T03:09:41.063896+0000","last_clean":"2024-04-25T03:09:41.063896+0000","last_became_active":"2024-04-25T00:51:40.407614+0000","last_became_peered":"2024-04-25T00:51:40.407614+0000","last_unstale":"2024-04-25T03:09:41.063896+0000","last_undegraded":"2024-04-25T03:09:41.063896+0000","last_fullsized":"2024-04-25T03:09:41.063896+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:10.742578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":17978,"num_write":385,"num_write_kb":59372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"28'409","reported_seq":522,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.036825+0000","last_change":"2024-04-25T00:50:35.877261+0000","last_active":"2024-04-25T03:09:41.036825+0000","last_peered":"2024-04-25T03:09:41.036825+0000","last_clean":"2024-04-25T03:09:41.036825+0000","last_became_active":"2024-04-25T00:50:35.876489+0000","last_became_peered":"2024-04-25T00:50:35.876489+0000","last_unstale":"2024-04-25T03:09:41.036825+0000","last_undegraded":"2024-04-25T03:09:41.036825+0000","last_fullsized":"2024-04-25T03:09:41.036825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:14:31.440563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":9083,"num_write":379,"num_write_kb":55476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'437","reported_seq":561,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.651386+0000","last_change":"2024-04-25T00:50:35.877693+0000","last_active":"2024-04-25T03:09:40.651386+0000","last_peered":"2024-04-25T03:09:40.651386+0000","last_clean":"2024-04-25T03:09:40.651386+0000","last_became_active":"2024-04-25T00:50:35.876870+0000","last_became_peered":"2024-04-25T00:50:35.876870+0000","last_unstale":"2024-04-25T03:09:40.651386+0000","last_undegraded":"2024-04-25T03:09:40.651386+0000","last_fullsized":"2024-04-25T03:09:40.651386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:53.474315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":19659,"num_write":409,"num_write_kb":79764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"28'386","reported_seq":490,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.030696+0000","last_change":"2024-04-25T00:50:35.881027+0000","last_active":"2024-04-25T03:09:41.030696+0000","last_peered":"2024-04-25T03:09:41.030696+0000","last_clean":"2024-04-25T03:09:41.030696+0000","last_became_active":"2024-04-25T00:50:35.880477+0000","last_became_peered":"2024-04-25T00:50:35.880477+0000","last_unstale":"2024-04-25T03:09:41.030696+0000","last_undegraded":"2024-04-25T03:09:41.030696+0000","last_fullsized":"2024-04-25T03:09:41.030696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:55:59.176935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12882,"num_write":369,"num_write_kb":38131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"28'477","reported_seq":598,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.088090+0000","last_change":"2024-04-25T00:50:35.765295+0000","last_active":"2024-04-25T03:09:41.088090+0000","last_peered":"2024-04-25T03:09:41.088090+0000","last_clean":"2024-04-25T03:09:41.088090+0000","last_became_active":"2024-04-25T00:50:35.764358+0000","last_became_peered":"2024-04-25T00:50:35.764358+0000","last_unstale":"2024-04-25T03:09:41.088090+0000","last_undegraded":"2024-04-25T03:09:41.088090+0000","last_fullsized":"2024-04-25T03:09:41.088090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:15.104631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":19569,"num_write":439,"num_write_kb":84809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'424","reported_seq":585,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.888427+0000","last_change":"2024-04-25T00:50:35.869695+0000","last_active":"2024-04-25T03:09:40.888427+0000","last_peered":"2024-04-25T03:09:40.888427+0000","last_clean":"2024-04-25T03:09:40.888427+0000","last_became_active":"2024-04-25T00:50:35.868857+0000","last_became_peered":"2024-04-25T00:50:35.868857+0000","last_unstale":"2024-04-25T03:09:40.888427+0000","last_undegraded":"2024-04-25T03:09:40.888427+0000","last_fullsized":"2024-04-25T03:09:40.888427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:35:38.295580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50759,"num_write":394,"num_write_kb":108657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"28'403","reported_seq":563,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.033206+0000","last_change":"2024-04-25T00:50:35.884507+0000","last_active":"2024-04-25T03:09:41.033206+0000","last_peered":"2024-04-25T03:09:41.033206+0000","last_clean":"2024-04-25T03:09:41.033206+0000","last_became_active":"2024-04-25T00:50:35.883901+0000","last_became_peered":"2024-04-25T00:50:35.883901+0000","last_unstale":"2024-04-25T03:09:41.033206+0000","last_undegraded":"2024-04-25T03:09:41.033206+0000","last_fullsized":"2024-04-25T03:09:41.033206+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:40.533818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":36518,"num_write":378,"num_write_kb":108957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'386","reported_seq":490,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.906940+0000","last_change":"2024-04-25T00:50:35.878649+0000","last_active":"2024-04-25T03:09:40.906940+0000","last_peered":"2024-04-25T03:09:40.906940+0000","last_clean":"2024-04-25T03:09:40.906940+0000","last_became_active":"2024-04-25T00:50:35.877870+0000","last_became_peered":"2024-04-25T00:50:35.877870+0000","last_unstale":"2024-04-25T03:09:40.906940+0000","last_undegraded":"2024-04-25T03:09:40.906940+0000","last_fullsized":"2024-04-25T03:09:40.906940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12325,"num_write":357,"num_write_kb":37847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"28'487","reported_seq":632,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.644401+0000","last_change":"2024-04-25T00:50:35.869614+0000","last_active":"2024-04-25T03:09:40.644401+0000","last_peered":"2024-04-25T03:09:40.644401+0000","last_clean":"2024-04-25T03:09:40.644401+0000","last_became_active":"2024-04-25T00:50:35.869016+0000","last_became_peered":"2024-04-25T00:50:35.869016+0000","last_unstale":"2024-04-25T03:09:40.644401+0000","last_undegraded":"2024-04-25T03:09:40.644401+0000","last_fullsized":"2024-04-25T03:09:40.644401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:02.888747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33246,"num_write":457,"num_write_kb":117202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"28'457","reported_seq":577,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.066664+0000","last_change":"2024-04-25T00:50:35.728757+0000","last_active":"2024-04-25T03:09:41.066664+0000","last_peered":"2024-04-25T03:09:41.066664+0000","last_clean":"2024-04-25T03:09:41.066664+0000","last_became_active":"2024-04-25T00:50:35.728271+0000","last_became_peered":"2024-04-25T00:50:35.728271+0000","last_unstale":"2024-04-25T03:09:41.066664+0000","last_undegraded":"2024-04-25T03:09:41.066664+0000","last_fullsized":"2024-04-25T03:09:41.066664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:43.722114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18149,"num_write":425,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"28'412","reported_seq":509,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.071602+0000","last_change":"2024-04-25T00:50:35.802347+0000","last_active":"2024-04-25T03:09:41.071602+0000","last_peered":"2024-04-25T03:09:41.071602+0000","last_clean":"2024-04-25T03:09:41.071602+0000","last_became_active":"2024-04-25T00:50:35.801389+0000","last_became_peered":"2024-04-25T00:50:35.801389+0000","last_unstale":"2024-04-25T03:09:41.071602+0000","last_undegraded":"2024-04-25T03:09:41.071602+0000","last_fullsized":"2024-04-25T03:09:41.071602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:27.176441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4792,"num_write":381,"num_write_kb":30347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"28'401","reported_seq":506,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.654605+0000","last_change":"2024-04-25T00:50:35.822222+0000","last_active":"2024-04-25T03:09:40.654605+0000","last_peered":"2024-04-25T03:09:40.654605+0000","last_clean":"2024-04-25T03:09:40.654605+0000","last_became_active":"2024-04-25T00:50:35.821484+0000","last_became_peered":"2024-04-25T00:50:35.821484+0000","last_unstale":"2024-04-25T03:09:40.654605+0000","last_undegraded":"2024-04-25T03:09:40.654605+0000","last_fullsized":"2024-04-25T03:09:40.654605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:59.921295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18401,"num_write":362,"num_write_kb":62496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'364","reported_seq":442,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:06.145410+0000","last_change":"2024-04-25T00:50:33.391742+0000","last_active":"2024-04-25T03:08:06.145410+0000","last_peered":"2024-04-25T03:08:06.145410+0000","last_clean":"2024-04-25T03:08:06.145410+0000","last_became_active":"2024-04-25T00:50:33.390901+0000","last_became_peered":"2024-04-25T00:50:33.390901+0000","last_unstale":"2024-04-25T03:08:06.145410+0000","last_undegraded":"2024-04-25T03:08:06.145410+0000","last_fullsized":"2024-04-25T03:08:06.145410+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:27.804469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":4231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'355","reported_seq":433,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.907459+0000","last_change":"2024-04-25T00:50:35.821496+0000","last_active":"2024-04-25T03:09:40.907459+0000","last_peered":"2024-04-25T03:09:40.907459+0000","last_clean":"2024-04-25T03:09:40.907459+0000","last_became_active":"2024-04-25T00:50:35.820763+0000","last_became_peered":"2024-04-25T00:50:35.820763+0000","last_unstale":"2024-04-25T03:09:40.907459+0000","last_undegraded":"2024-04-25T03:09:40.907459+0000","last_fullsized":"2024-04-25T03:09:40.907459+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:15.698294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":529,"num_write":324,"num_write_kb":17419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"28'2226","reported_seq":2304,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:58.865093+0000","last_change":"2024-04-25T00:50:33.394753+0000","last_active":"2024-04-25T03:07:58.865093+0000","last_peered":"2024-04-25T03:07:58.865093+0000","last_clean":"2024-04-25T03:07:58.865093+0000","last_became_active":"2024-04-25T00:50:33.392951+0000","last_became_peered":"2024-04-25T00:50:33.392951+0000","last_unstale":"2024-04-25T03:07:58.865093+0000","last_undegraded":"2024-04-25T03:07:58.865093+0000","last_fullsized":"2024-04-25T03:07:58.865093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2226,"log_dups_size":0,"ondisk_log_size":2226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:41.175588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2166,"num_write_kb":17433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'819","reported_seq":899,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:06.154833+0000","last_change":"2024-04-25T00:50:33.393229+0000","last_active":"2024-04-25T03:09:06.154833+0000","last_peered":"2024-04-25T03:09:06.154833+0000","last_clean":"2024-04-25T03:09:06.154833+0000","last_became_active":"2024-04-25T00:50:33.392817+0000","last_became_peered":"2024-04-25T00:50:33.392817+0000","last_unstale":"2024-04-25T03:09:06.154833+0000","last_undegraded":"2024-04-25T03:09:06.154833+0000","last_fullsized":"2024-04-25T03:09:06.154833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:31:12.131616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":4477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'429","reported_seq":503,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.898490+0000","last_change":"2024-04-25T00:51:40.320773+0000","last_active":"2024-04-25T03:09:40.898490+0000","last_peered":"2024-04-25T03:09:40.898490+0000","last_clean":"2024-04-25T03:09:40.898490+0000","last_became_active":"2024-04-25T00:51:40.319726+0000","last_became_peered":"2024-04-25T00:51:40.319726+0000","last_unstale":"2024-04-25T03:09:40.898490+0000","last_undegraded":"2024-04-25T03:09:40.898490+0000","last_fullsized":"2024-04-25T03:09:40.898490+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:38:21.556620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4282,"num_write":403,"num_write_kb":55112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'1293","reported_seq":1373,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:22.138872+0000","last_change":"2024-04-25T00:50:33.383755+0000","last_active":"2024-04-25T03:08:22.138872+0000","last_peered":"2024-04-25T03:08:22.138872+0000","last_clean":"2024-04-25T03:08:22.138872+0000","last_became_active":"2024-04-25T00:50:33.382925+0000","last_became_peered":"2024-04-25T00:50:33.382925+0000","last_unstale":"2024-04-25T03:08:22.138872+0000","last_undegraded":"2024-04-25T03:08:22.138872+0000","last_fullsized":"2024-04-25T03:08:22.138872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1293,"log_dups_size":0,"ondisk_log_size":1293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:52.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1222,"num_write_kb":12901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'453","reported_seq":605,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.893325+0000","last_change":"2024-04-25T00:50:35.869794+0000","last_active":"2024-04-25T03:09:40.893325+0000","last_peered":"2024-04-25T03:09:40.893325+0000","last_clean":"2024-04-25T03:09:40.893325+0000","last_became_active":"2024-04-25T00:50:35.869028+0000","last_became_peered":"2024-04-25T00:50:35.869028+0000","last_unstale":"2024-04-25T03:09:40.893325+0000","last_undegraded":"2024-04-25T03:09:40.893325+0000","last_fullsized":"2024-04-25T03:09:40.893325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:49.891966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":36096,"num_write":419,"num_write_kb":96892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'61","reported_seq":141,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.363278+0000","last_change":"2024-04-25T00:50:33.394082+0000","last_active":"2024-04-25T03:09:40.363278+0000","last_peered":"2024-04-25T03:09:40.363278+0000","last_clean":"2024-04-25T03:09:40.363278+0000","last_became_active":"2024-04-25T00:50:33.392792+0000","last_became_peered":"2024-04-25T00:50:33.392792+0000","last_unstale":"2024-04-25T03:09:40.363278+0000","last_undegraded":"2024-04-25T03:09:40.363278+0000","last_fullsized":"2024-04-25T03:09:40.363278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:35:15.441104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'435","reported_seq":547,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.723136+0000","last_change":"2024-04-25T00:50:35.729414+0000","last_active":"2024-04-25T03:09:40.723136+0000","last_peered":"2024-04-25T03:09:40.723136+0000","last_clean":"2024-04-25T03:09:40.723136+0000","last_became_active":"2024-04-25T00:50:35.728725+0000","last_became_peered":"2024-04-25T00:50:35.728725+0000","last_unstale":"2024-04-25T03:09:40.723136+0000","last_undegraded":"2024-04-25T03:09:40.723136+0000","last_fullsized":"2024-04-25T03:09:40.723136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:05.046355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":25476,"num_write":407,"num_write_kb":112477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'1187","reported_seq":1267,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.378202+0000","last_change":"2024-04-25T00:50:33.388191+0000","last_active":"2024-04-25T03:09:40.378202+0000","last_peered":"2024-04-25T03:09:40.378202+0000","last_clean":"2024-04-25T03:09:40.378202+0000","last_became_active":"2024-04-25T00:50:33.387266+0000","last_became_peered":"2024-04-25T00:50:33.387266+0000","last_unstale":"2024-04-25T03:09:40.378202+0000","last_undegraded":"2024-04-25T03:09:40.378202+0000","last_fullsized":"2024-04-25T03:09:40.378202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1187,"log_dups_size":0,"ondisk_log_size":1187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:08.400693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10267224,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1125,"num_write_kb":10596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'390","reported_seq":492,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.900667+0000","last_change":"2024-04-25T00:50:35.799783+0000","last_active":"2024-04-25T03:09:40.900667+0000","last_peered":"2024-04-25T03:09:40.900667+0000","last_clean":"2024-04-25T03:09:40.900667+0000","last_became_active":"2024-04-25T00:50:35.798471+0000","last_became_peered":"2024-04-25T00:50:35.798471+0000","last_unstale":"2024-04-25T03:09:40.900667+0000","last_undegraded":"2024-04-25T03:09:40.900667+0000","last_fullsized":"2024-04-25T03:09:40.900667+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:15.104631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14757,"num_write":355,"num_write_kb":59761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"28'3380","reported_seq":3460,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:34.194188+0000","last_change":"2024-04-25T00:50:33.304731+0000","last_active":"2024-04-25T03:09:34.194188+0000","last_peered":"2024-04-25T03:09:34.194188+0000","last_clean":"2024-04-25T03:09:34.194188+0000","last_became_active":"2024-04-25T00:50:33.303821+0000","last_became_peered":"2024-04-25T00:50:33.303821+0000","last_unstale":"2024-04-25T03:09:34.194188+0000","last_undegraded":"2024-04-25T03:09:34.194188+0000","last_fullsized":"2024-04-25T03:09:34.194188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3380,"log_dups_size":0,"ondisk_log_size":3380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:35:32.196488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3329,"num_write_kb":11127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'419","reported_seq":559,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.663718+0000","last_change":"2024-04-25T00:50:35.828727+0000","last_active":"2024-04-25T03:09:40.663718+0000","last_peered":"2024-04-25T03:09:40.663718+0000","last_clean":"2024-04-25T03:09:40.663718+0000","last_became_active":"2024-04-25T00:50:35.827617+0000","last_became_peered":"2024-04-25T00:50:35.827617+0000","last_unstale":"2024-04-25T03:09:40.663718+0000","last_undegraded":"2024-04-25T03:09:40.663718+0000","last_fullsized":"2024-04-25T03:09:40.663718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:30:10.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":28588,"num_write":390,"num_write_kb":92970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"28'2245","reported_seq":2327,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:19.177513+0000","last_change":"2024-04-25T00:50:33.391005+0000","last_active":"2024-04-25T03:09:19.177513+0000","last_peered":"2024-04-25T03:09:19.177513+0000","last_clean":"2024-04-25T03:09:19.177513+0000","last_became_active":"2024-04-25T00:50:33.390133+0000","last_became_peered":"2024-04-25T00:50:33.390133+0000","last_unstale":"2024-04-25T03:09:19.177513+0000","last_undegraded":"2024-04-25T03:09:19.177513+0000","last_fullsized":"2024-04-25T03:09:19.177513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2245,"log_dups_size":0,"ondisk_log_size":2245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:19.913188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2203,"num_write_kb":13669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'392","reported_seq":516,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.662684+0000","last_change":"2024-04-25T00:50:35.876022+0000","last_active":"2024-04-25T03:09:40.662684+0000","last_peered":"2024-04-25T03:09:40.662684+0000","last_clean":"2024-04-25T03:09:40.662684+0000","last_became_active":"2024-04-25T00:50:35.875322+0000","last_became_peered":"2024-04-25T00:50:35.875322+0000","last_unstale":"2024-04-25T03:09:40.662684+0000","last_undegraded":"2024-04-25T03:09:40.662684+0000","last_fullsized":"2024-04-25T03:09:40.662684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":27925,"num_write":356,"num_write_kb":62573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"28'713","reported_seq":795,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:59.810791+0000","last_change":"2024-04-25T00:50:33.387295+0000","last_active":"2024-04-25T03:07:59.810791+0000","last_peered":"2024-04-25T03:07:59.810791+0000","last_clean":"2024-04-25T03:07:59.810791+0000","last_became_active":"2024-04-25T00:50:33.386297+0000","last_became_peered":"2024-04-25T00:50:33.386297+0000","last_unstale":"2024-04-25T03:07:59.810791+0000","last_undegraded":"2024-04-25T03:07:59.810791+0000","last_fullsized":"2024-04-25T03:07:59.810791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":713,"log_dups_size":0,"ondisk_log_size":713,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:31:57.597514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":8480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'401","reported_seq":490,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.905548+0000","last_change":"2024-04-25T00:50:35.796873+0000","last_active":"2024-04-25T03:09:40.905548+0000","last_peered":"2024-04-25T03:09:40.905548+0000","last_clean":"2024-04-25T03:09:40.905548+0000","last_became_active":"2024-04-25T00:50:35.796012+0000","last_became_peered":"2024-04-25T00:50:35.796012+0000","last_unstale":"2024-04-25T03:09:40.905548+0000","last_undegraded":"2024-04-25T03:09:40.905548+0000","last_fullsized":"2024-04-25T03:09:40.905548+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:22.255073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4846,"num_write":362,"num_write_kb":30162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"28'56","reported_seq":138,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:33.058035+0000","last_change":"2024-04-25T00:50:33.385522+0000","last_active":"2024-04-25T03:09:33.058035+0000","last_peered":"2024-04-25T03:09:33.058035+0000","last_clean":"2024-04-25T03:09:33.058035+0000","last_became_active":"2024-04-25T00:50:33.384620+0000","last_became_peered":"2024-04-25T00:50:33.384620+0000","last_unstale":"2024-04-25T03:09:33.058035+0000","last_undegraded":"2024-04-25T03:09:33.058035+0000","last_fullsized":"2024-04-25T03:09:33.058035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:24.908029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'414","reported_seq":522,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.720638+0000","last_change":"2024-04-25T00:50:35.820565+0000","last_active":"2024-04-25T03:09:40.720638+0000","last_peered":"2024-04-25T03:09:40.720638+0000","last_clean":"2024-04-25T03:09:40.720638+0000","last_became_active":"2024-04-25T00:50:35.819683+0000","last_became_peered":"2024-04-25T00:50:35.819683+0000","last_unstale":"2024-04-25T03:09:40.720638+0000","last_undegraded":"2024-04-25T03:09:40.720638+0000","last_fullsized":"2024-04-25T03:09:40.720638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:28.655307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":8938,"num_write":378,"num_write_kb":68659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'60","reported_seq":142,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:17.098745+0000","last_change":"2024-04-25T00:50:33.390745+0000","last_active":"2024-04-25T03:08:17.098745+0000","last_peered":"2024-04-25T03:08:17.098745+0000","last_clean":"2024-04-25T03:08:17.098745+0000","last_became_active":"2024-04-25T00:50:33.390089+0000","last_became_peered":"2024-04-25T00:50:33.390089+0000","last_unstale":"2024-04-25T03:08:17.098745+0000","last_undegraded":"2024-04-25T03:08:17.098745+0000","last_fullsized":"2024-04-25T03:08:17.098745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:51.294701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'418","reported_seq":511,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.070072+0000","last_change":"2024-04-25T00:50:35.801766+0000","last_active":"2024-04-25T03:09:41.070072+0000","last_peered":"2024-04-25T03:09:41.070072+0000","last_clean":"2024-04-25T03:09:41.070072+0000","last_became_active":"2024-04-25T00:50:35.801060+0000","last_became_peered":"2024-04-25T00:50:35.801060+0000","last_unstale":"2024-04-25T03:09:41.070072+0000","last_undegraded":"2024-04-25T03:09:41.070072+0000","last_fullsized":"2024-04-25T03:09:41.070072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9600,"num_write":393,"num_write_kb":50549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"28'894","reported_seq":976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:31.197675+0000","last_change":"2024-04-25T00:50:33.327283+0000","last_active":"2024-04-25T03:09:31.197675+0000","last_peered":"2024-04-25T03:09:31.197675+0000","last_clean":"2024-04-25T03:09:31.197675+0000","last_became_active":"2024-04-25T00:50:33.326464+0000","last_became_peered":"2024-04-25T00:50:33.326464+0000","last_unstale":"2024-04-25T03:09:31.197675+0000","last_undegraded":"2024-04-25T03:09:31.197675+0000","last_fullsized":"2024-04-25T03:09:31.197675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:26:26.328621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":8609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'491","reported_seq":685,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.662645+0000","last_change":"2024-04-25T00:50:35.825910+0000","last_active":"2024-04-25T03:09:40.662645+0000","last_peered":"2024-04-25T03:09:40.662645+0000","last_clean":"2024-04-25T03:09:40.662645+0000","last_became_active":"2024-04-25T00:50:35.825246+0000","last_became_peered":"2024-04-25T00:50:35.825246+0000","last_unstale":"2024-04-25T03:09:40.662645+0000","last_undegraded":"2024-04-25T03:09:40.662645+0000","last_fullsized":"2024-04-25T03:09:40.662645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:40.106788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":62450,"num_write":458,"num_write_kb":109145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'805","reported_seq":889,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:32.246466+0000","last_change":"2024-04-25T00:50:33.393856+0000","last_active":"2024-04-25T03:08:32.246466+0000","last_peered":"2024-04-25T03:08:32.246466+0000","last_clean":"2024-04-25T03:08:32.246466+0000","last_became_active":"2024-04-25T00:50:33.393153+0000","last_became_peered":"2024-04-25T00:50:33.393153+0000","last_unstale":"2024-04-25T03:08:32.246466+0000","last_undegraded":"2024-04-25T03:08:32.246466+0000","last_fullsized":"2024-04-25T03:08:32.246466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:55.179146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":4477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'357","reported_seq":488,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.665816+0000","last_change":"2024-04-25T00:50:35.811993+0000","last_active":"2024-04-25T03:09:40.665816+0000","last_peered":"2024-04-25T03:09:40.665816+0000","last_clean":"2024-04-25T03:09:40.665816+0000","last_became_active":"2024-04-25T00:50:35.811267+0000","last_became_peered":"2024-04-25T00:50:35.811267+0000","last_unstale":"2024-04-25T03:09:40.665816+0000","last_undegraded":"2024-04-25T03:09:40.665816+0000","last_fullsized":"2024-04-25T03:09:40.665816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:40:20.385617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":21001,"num_write":331,"num_write_kb":38526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'903","reported_seq":987,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:20.853159+0000","last_change":"2024-04-25T00:50:33.383040+0000","last_active":"2024-04-25T03:07:20.853159+0000","last_peered":"2024-04-25T03:07:20.853159+0000","last_clean":"2024-04-25T03:07:20.853159+0000","last_became_active":"2024-04-25T00:50:33.382270+0000","last_became_peered":"2024-04-25T00:50:33.382270+0000","last_unstale":"2024-04-25T03:07:20.853159+0000","last_undegraded":"2024-04-25T03:07:20.853159+0000","last_fullsized":"2024-04-25T03:07:20.853159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:13.866739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":844,"num_write_kb":4518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'401","reported_seq":521,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.707568+0000","last_change":"2024-04-25T00:50:35.818234+0000","last_active":"2024-04-25T03:09:40.707568+0000","last_peered":"2024-04-25T03:09:40.707568+0000","last_clean":"2024-04-25T03:09:40.707568+0000","last_became_active":"2024-04-25T00:50:35.817707+0000","last_became_peered":"2024-04-25T00:50:35.817707+0000","last_unstale":"2024-04-25T03:09:40.707568+0000","last_undegraded":"2024-04-25T03:09:40.707568+0000","last_fullsized":"2024-04-25T03:09:40.707568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:31.998886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16207,"num_write":370,"num_write_kb":59244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"28'326","reported_seq":410,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:46.654107+0000","last_change":"2024-04-25T00:50:33.389774+0000","last_active":"2024-04-25T03:07:46.654107+0000","last_peered":"2024-04-25T03:07:46.654107+0000","last_clean":"2024-04-25T03:07:46.654107+0000","last_became_active":"2024-04-25T00:50:33.389092+0000","last_became_peered":"2024-04-25T00:50:33.389092+0000","last_unstale":"2024-04-25T03:07:46.654107+0000","last_undegraded":"2024-04-25T03:07:46.654107+0000","last_fullsized":"2024-04-25T03:07:46.654107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:05:30.722771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'441","reported_seq":582,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.646651+0000","last_change":"2024-04-25T00:50:35.869211+0000","last_active":"2024-04-25T03:09:40.646651+0000","last_peered":"2024-04-25T03:09:40.646651+0000","last_clean":"2024-04-25T03:09:40.646651+0000","last_became_active":"2024-04-25T00:50:35.868798+0000","last_became_peered":"2024-04-25T00:50:35.868798+0000","last_unstale":"2024-04-25T03:09:40.646651+0000","last_undegraded":"2024-04-25T03:09:40.646651+0000","last_fullsized":"2024-04-25T03:09:40.646651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:40.106788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27029,"num_write":413,"num_write_kb":63857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"28'319","reported_seq":403,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:15.892809+0000","last_change":"2024-04-25T00:50:33.329578+0000","last_active":"2024-04-25T03:09:15.892809+0000","last_peered":"2024-04-25T03:09:15.892809+0000","last_clean":"2024-04-25T03:09:15.892809+0000","last_became_active":"2024-04-25T00:50:33.328950+0000","last_became_peered":"2024-04-25T00:50:33.328950+0000","last_unstale":"2024-04-25T03:09:15.892809+0000","last_undegraded":"2024-04-25T03:09:15.892809+0000","last_fullsized":"2024-04-25T03:09:15.892809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:55.179146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196056,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":254,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'426","reported_seq":560,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.709661+0000","last_change":"2024-04-25T00:50:35.734419+0000","last_active":"2024-04-25T03:09:40.709661+0000","last_peered":"2024-04-25T03:09:40.709661+0000","last_clean":"2024-04-25T03:09:40.709661+0000","last_became_active":"2024-04-25T00:50:35.733696+0000","last_became_peered":"2024-04-25T00:50:35.733696+0000","last_unstale":"2024-04-25T03:09:40.709661+0000","last_undegraded":"2024-04-25T03:09:40.709661+0000","last_fullsized":"2024-04-25T03:09:40.709661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:05.046355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":28368,"num_write":395,"num_write_kb":71042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":248,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:06:32.174332+0000","last_change":"2024-04-25T00:49:55.281216+0000","last_active":"2024-04-25T03:06:32.174332+0000","last_peered":"2024-04-25T03:06:32.174332+0000","last_clean":"2024-04-25T03:06:32.174332+0000","last_became_active":"2024-04-25T00:49:55.278022+0000","last_became_peered":"2024-04-25T00:49:55.278022+0000","last_unstale":"2024-04-25T03:06:32.174332+0000","last_undegraded":"2024-04-25T03:06:32.174332+0000","last_fullsized":"2024-04-25T03:06:32.174332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:49:52.475299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:49:52.475299+0000","last_clean_scrub_stamp":"2024-04-25T00:49:52.475299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:17.046656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"28'385","reported_seq":474,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:11.554423+0000","last_change":"2024-04-25T00:50:33.325228+0000","last_active":"2024-04-25T03:09:11.554423+0000","last_peered":"2024-04-25T03:09:11.554423+0000","last_clean":"2024-04-25T03:09:11.554423+0000","last_became_active":"2024-04-25T00:50:33.324579+0000","last_became_peered":"2024-04-25T00:50:33.324579+0000","last_unstale":"2024-04-25T03:09:11.554423+0000","last_undegraded":"2024-04-25T03:09:11.554423+0000","last_fullsized":"2024-04-25T03:09:11.554423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:12.762746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'354","reported_seq":469,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.039589+0000","last_change":"2024-04-25T00:50:35.880348+0000","last_active":"2024-04-25T03:09:41.039589+0000","last_peered":"2024-04-25T03:09:41.039589+0000","last_clean":"2024-04-25T03:09:41.039589+0000","last_became_active":"2024-04-25T00:50:35.878438+0000","last_became_peered":"2024-04-25T00:50:35.878438+0000","last_unstale":"2024-04-25T03:09:41.039589+0000","last_undegraded":"2024-04-25T03:09:41.039589+0000","last_fullsized":"2024-04-25T03:09:41.039589+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:46:44.093119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20480,"num_write":322,"num_write_kb":49980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"28'1052","reported_seq":1144,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:51.863301+0000","last_change":"2024-04-25T00:50:33.321385+0000","last_active":"2024-04-25T03:08:51.863301+0000","last_peered":"2024-04-25T03:08:51.863301+0000","last_clean":"2024-04-25T03:08:51.863301+0000","last_became_active":"2024-04-25T00:50:33.320800+0000","last_became_peered":"2024-04-25T00:50:33.320800+0000","last_unstale":"2024-04-25T03:08:51.863301+0000","last_undegraded":"2024-04-25T03:08:51.863301+0000","last_fullsized":"2024-04-25T03:08:51.863301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:04.254885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":991,"num_write_kb":12720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"28'420","reported_seq":532,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.894623+0000","last_change":"2024-04-25T00:50:35.815056+0000","last_active":"2024-04-25T03:09:40.894623+0000","last_peered":"2024-04-25T03:09:40.894623+0000","last_clean":"2024-04-25T03:09:40.894623+0000","last_became_active":"2024-04-25T00:50:35.814163+0000","last_became_peered":"2024-04-25T00:50:35.814163+0000","last_unstale":"2024-04-25T03:09:40.894623+0000","last_undegraded":"2024-04-25T03:09:40.894623+0000","last_fullsized":"2024-04-25T03:09:40.894623+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:50:52.289674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14110,"num_write":386,"num_write_kb":112699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"28'4457","reported_seq":8941,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:36.126848+0000","last_change":"2024-04-25T00:50:33.384695+0000","last_active":"2024-04-25T03:09:36.126848+0000","last_peered":"2024-04-25T03:09:36.126848+0000","last_clean":"2024-04-25T03:09:36.126848+0000","last_became_active":"2024-04-25T00:50:33.383692+0000","last_became_peered":"2024-04-25T00:50:33.383692+0000","last_unstale":"2024-04-25T03:09:36.126848+0000","last_undegraded":"2024-04-25T03:09:36.126848+0000","last_fullsized":"2024-04-25T03:09:36.126848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":4457,"log_dups_size":0,"ondisk_log_size":4457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:57.579410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1471076,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4395,"num_read_kb":4765,"num_write":4402,"num_write_kb":4769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'402","reported_seq":517,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.888992+0000","last_change":"2024-04-25T00:50:35.723048+0000","last_active":"2024-04-25T03:09:40.888992+0000","last_peered":"2024-04-25T03:09:40.888992+0000","last_clean":"2024-04-25T03:09:40.888992+0000","last_became_active":"2024-04-25T00:50:35.722500+0000","last_became_peered":"2024-04-25T00:50:35.722500+0000","last_unstale":"2024-04-25T03:09:40.888992+0000","last_undegraded":"2024-04-25T03:09:40.888992+0000","last_fullsized":"2024-04-25T03:09:40.888992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:20:39.082516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13853,"num_write":369,"num_write_kb":30117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"28'1036","reported_seq":1125,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:06:02.117152+0000","last_change":"2024-04-25T00:50:33.305927+0000","last_active":"2024-04-25T03:06:02.117152+0000","last_peered":"2024-04-25T03:06:02.117152+0000","last_clean":"2024-04-25T03:06:02.117152+0000","last_became_active":"2024-04-25T00:50:33.305159+0000","last_became_peered":"2024-04-25T00:50:33.305159+0000","last_unstale":"2024-04-25T03:06:02.117152+0000","last_undegraded":"2024-04-25T03:06:02.117152+0000","last_fullsized":"2024-04-25T03:06:02.117152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1036,"log_dups_size":0,"ondisk_log_size":1036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:46:56.639410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":968,"num_write_kb":8653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'394","reported_seq":551,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.639498+0000","last_change":"2024-04-25T00:50:35.824491+0000","last_active":"2024-04-25T03:09:40.639498+0000","last_peered":"2024-04-25T03:09:40.639498+0000","last_clean":"2024-04-25T03:09:40.639498+0000","last_became_active":"2024-04-25T00:50:35.823320+0000","last_became_peered":"2024-04-25T00:50:35.823320+0000","last_unstale":"2024-04-25T03:09:40.639498+0000","last_undegraded":"2024-04-25T03:09:40.639498+0000","last_fullsized":"2024-04-25T03:09:40.639498+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:57.466393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":47782,"num_write":359,"num_write_kb":62996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"28'368","reported_seq":457,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:04.082610+0000","last_change":"2024-04-25T00:50:33.304490+0000","last_active":"2024-04-25T03:08:04.082610+0000","last_peered":"2024-04-25T03:08:04.082610+0000","last_clean":"2024-04-25T03:08:04.082610+0000","last_became_active":"2024-04-25T00:50:33.303671+0000","last_became_peered":"2024-04-25T00:50:33.303671+0000","last_unstale":"2024-04-25T03:08:04.082610+0000","last_undegraded":"2024-04-25T03:08:04.082610+0000","last_fullsized":"2024-04-25T03:08:04.082610+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:30:30.104572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":4247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'437","reported_seq":572,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.663449+0000","last_change":"2024-04-25T00:50:35.878641+0000","last_active":"2024-04-25T03:09:40.663449+0000","last_peered":"2024-04-25T03:09:40.663449+0000","last_clean":"2024-04-25T03:09:40.663449+0000","last_became_active":"2024-04-25T00:50:35.876958+0000","last_became_peered":"2024-04-25T00:50:35.876958+0000","last_unstale":"2024-04-25T03:09:40.663449+0000","last_undegraded":"2024-04-25T03:09:40.663449+0000","last_fullsized":"2024-04-25T03:09:40.663449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:59.565909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":21227,"num_write":402,"num_write_kb":75746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"28'1039","reported_seq":1128,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:42.196406+0000","last_change":"2024-04-25T00:50:33.319229+0000","last_active":"2024-04-25T03:08:42.196406+0000","last_peered":"2024-04-25T03:08:42.196406+0000","last_clean":"2024-04-25T03:08:42.196406+0000","last_became_active":"2024-04-25T00:50:33.318945+0000","last_became_peered":"2024-04-25T00:50:33.318945+0000","last_unstale":"2024-04-25T03:08:42.196406+0000","last_undegraded":"2024-04-25T03:08:42.196406+0000","last_fullsized":"2024-04-25T03:08:42.196406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:51.132430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":986,"num_write_kb":8683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'399","reported_seq":518,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.885582+0000","last_change":"2024-04-25T00:50:35.722521+0000","last_active":"2024-04-25T03:09:40.885582+0000","last_peered":"2024-04-25T03:09:40.885582+0000","last_clean":"2024-04-25T03:09:40.885582+0000","last_became_active":"2024-04-25T00:50:35.722128+0000","last_became_peered":"2024-04-25T00:50:35.722128+0000","last_unstale":"2024-04-25T03:09:40.885582+0000","last_undegraded":"2024-04-25T03:09:40.885582+0000","last_fullsized":"2024-04-25T03:09:40.885582+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:59:36.793140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19866,"num_write":357,"num_write_kb":75325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"28'6462","reported_seq":6549,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:34.387247+0000","last_change":"2024-04-25T00:50:33.387402+0000","last_active":"2024-04-25T03:09:34.387247+0000","last_peered":"2024-04-25T03:09:34.387247+0000","last_clean":"2024-04-25T03:09:34.387247+0000","last_became_active":"2024-04-25T00:50:33.386631+0000","last_became_peered":"2024-04-25T00:50:33.386631+0000","last_unstale":"2024-04-25T03:09:34.387247+0000","last_undegraded":"2024-04-25T03:09:34.387247+0000","last_fullsized":"2024-04-25T03:09:34.387247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":6462,"log_dups_size":0,"ondisk_log_size":6462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:11:49.105412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17492,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'357","reported_seq":506,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.032804+0000","last_change":"2024-04-25T00:50:35.882715+0000","last_active":"2024-04-25T03:09:41.032804+0000","last_peered":"2024-04-25T03:09:41.032804+0000","last_clean":"2024-04-25T03:09:41.032804+0000","last_became_active":"2024-04-25T00:50:35.878416+0000","last_became_peered":"2024-04-25T00:50:35.878416+0000","last_unstale":"2024-04-25T03:09:41.032804+0000","last_undegraded":"2024-04-25T03:09:41.032804+0000","last_fullsized":"2024-04-25T03:09:41.032804+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:41:35.413796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":29447,"num_write":334,"num_write_kb":70980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"28'373","reported_seq":460,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:17.108484+0000","last_change":"2024-04-25T00:50:33.393211+0000","last_active":"2024-04-25T03:09:17.108484+0000","last_peered":"2024-04-25T03:09:17.108484+0000","last_clean":"2024-04-25T03:09:17.108484+0000","last_became_active":"2024-04-25T00:50:33.392381+0000","last_became_peered":"2024-04-25T00:50:33.392381+0000","last_unstale":"2024-04-25T03:09:17.108484+0000","last_undegraded":"2024-04-25T03:09:17.108484+0000","last_fullsized":"2024-04-25T03:09:17.108484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:18:05.276269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'446","reported_seq":575,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.904553+0000","last_change":"2024-04-25T00:50:35.798491+0000","last_active":"2024-04-25T03:09:40.904553+0000","last_peered":"2024-04-25T03:09:40.904553+0000","last_clean":"2024-04-25T03:09:40.904553+0000","last_became_active":"2024-04-25T00:50:35.796775+0000","last_became_peered":"2024-04-25T00:50:35.796775+0000","last_unstale":"2024-04-25T03:09:40.904553+0000","last_undegraded":"2024-04-25T03:09:40.904553+0000","last_fullsized":"2024-04-25T03:09:40.904553+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:54.948867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":29188,"num_write":413,"num_write_kb":79416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"28'380","reported_seq":467,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:41.219949+0000","last_change":"2024-04-25T00:50:33.321163+0000","last_active":"2024-04-25T03:08:41.219949+0000","last_peered":"2024-04-25T03:08:41.219949+0000","last_clean":"2024-04-25T03:08:41.219949+0000","last_became_active":"2024-04-25T00:50:33.320554+0000","last_became_peered":"2024-04-25T00:50:33.320554+0000","last_unstale":"2024-04-25T03:08:41.219949+0000","last_undegraded":"2024-04-25T03:08:41.219949+0000","last_fullsized":"2024-04-25T03:08:41.219949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:13.533462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":317,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'445","reported_seq":576,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.394213+0000","last_change":"2024-04-25T00:50:35.824154+0000","last_active":"2024-04-25T03:09:40.394213+0000","last_peered":"2024-04-25T03:09:40.394213+0000","last_clean":"2024-04-25T03:09:40.394213+0000","last_became_active":"2024-04-25T00:50:35.823269+0000","last_became_peered":"2024-04-25T00:50:35.823269+0000","last_unstale":"2024-04-25T03:09:40.394213+0000","last_undegraded":"2024-04-25T03:09:40.394213+0000","last_fullsized":"2024-04-25T03:09:40.394213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:16.208624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25774,"num_write":415,"num_write_kb":54462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'452","reported_seq":539,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:45.788461+0000","last_change":"2024-04-25T00:50:33.319985+0000","last_active":"2024-04-25T03:07:45.788461+0000","last_peered":"2024-04-25T03:07:45.788461+0000","last_clean":"2024-04-25T03:07:45.788461+0000","last_became_active":"2024-04-25T00:50:33.319198+0000","last_became_peered":"2024-04-25T00:50:33.319198+0000","last_unstale":"2024-04-25T03:07:45.788461+0000","last_undegraded":"2024-04-25T03:07:45.788461+0000","last_fullsized":"2024-04-25T03:07:45.788461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:14:01.398188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'409","reported_seq":537,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.056760+0000","last_change":"2024-04-25T00:50:35.883007+0000","last_active":"2024-04-25T03:09:41.056760+0000","last_peered":"2024-04-25T03:09:41.056760+0000","last_clean":"2024-04-25T03:09:41.056760+0000","last_became_active":"2024-04-25T00:50:35.881829+0000","last_became_peered":"2024-04-25T00:50:35.881829+0000","last_unstale":"2024-04-25T03:09:41.056760+0000","last_undegraded":"2024-04-25T03:09:41.056760+0000","last_fullsized":"2024-04-25T03:09:41.056760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:52:02.444745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":18047,"num_write":372,"num_write_kb":46881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'1205","reported_seq":1291,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:43.888245+0000","last_change":"2024-04-25T00:50:33.384397+0000","last_active":"2024-04-25T03:07:43.888245+0000","last_peered":"2024-04-25T03:07:43.888245+0000","last_clean":"2024-04-25T03:07:43.888245+0000","last_became_active":"2024-04-25T00:50:33.383622+0000","last_became_peered":"2024-04-25T00:50:33.383622+0000","last_unstale":"2024-04-25T03:07:43.888245+0000","last_undegraded":"2024-04-25T03:07:43.888245+0000","last_fullsized":"2024-04-25T03:07:43.888245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1205,"log_dups_size":0,"ondisk_log_size":1205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:31.816914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":8761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'428","reported_seq":553,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.052021+0000","last_change":"2024-04-25T00:50:35.881976+0000","last_active":"2024-04-25T03:09:41.052021+0000","last_peered":"2024-04-25T03:09:41.052021+0000","last_clean":"2024-04-25T03:09:41.052021+0000","last_became_active":"2024-04-25T00:50:35.881269+0000","last_became_peered":"2024-04-25T00:50:35.881269+0000","last_unstale":"2024-04-25T03:09:41.052021+0000","last_undegraded":"2024-04-25T03:09:41.052021+0000","last_fullsized":"2024-04-25T03:09:41.052021+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:10:54.302741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19611,"num_write":396,"num_write_kb":67446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1399","reported_seq":1483,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:07.562053+0000","last_change":"2024-04-25T00:50:33.390041+0000","last_active":"2024-04-25T03:08:07.562053+0000","last_peered":"2024-04-25T03:08:07.562053+0000","last_clean":"2024-04-25T03:08:07.562053+0000","last_became_active":"2024-04-25T00:50:33.389095+0000","last_became_peered":"2024-04-25T00:50:33.389095+0000","last_unstale":"2024-04-25T03:08:07.562053+0000","last_undegraded":"2024-04-25T03:08:07.562053+0000","last_fullsized":"2024-04-25T03:08:07.562053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1399,"log_dups_size":0,"ondisk_log_size":1399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:00.569613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1344,"num_write_kb":12923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'449","reported_seq":610,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.070319+0000","last_change":"2024-04-25T00:50:35.812195+0000","last_active":"2024-04-25T03:09:41.070319+0000","last_peered":"2024-04-25T03:09:41.070319+0000","last_clean":"2024-04-25T03:09:41.070319+0000","last_became_active":"2024-04-25T00:50:35.811410+0000","last_became_peered":"2024-04-25T00:50:35.811410+0000","last_unstale":"2024-04-25T03:09:41.070319+0000","last_undegraded":"2024-04-25T03:09:41.070319+0000","last_fullsized":"2024-04-25T03:09:41.070319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:06.596770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42516,"num_write":419,"num_write_kb":125381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"28'392","reported_seq":512,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.722040+0000","last_change":"2024-04-25T00:50:35.821808+0000","last_active":"2024-04-25T03:09:40.722040+0000","last_peered":"2024-04-25T03:09:40.722040+0000","last_clean":"2024-04-25T03:09:40.722040+0000","last_became_active":"2024-04-25T00:50:35.821062+0000","last_became_peered":"2024-04-25T00:50:35.821062+0000","last_unstale":"2024-04-25T03:09:40.722040+0000","last_undegraded":"2024-04-25T03:09:40.722040+0000","last_fullsized":"2024-04-25T03:09:40.722040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":28880,"num_write":348,"num_write_kb":60862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"28'845","reported_seq":923,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:40.321237+0000","last_change":"2024-04-25T00:50:33.319853+0000","last_active":"2024-04-25T03:08:40.321237+0000","last_peered":"2024-04-25T03:08:40.321237+0000","last_clean":"2024-04-25T03:08:40.321237+0000","last_became_active":"2024-04-25T00:50:33.319197+0000","last_became_peered":"2024-04-25T00:50:33.319197+0000","last_unstale":"2024-04-25T03:08:40.321237+0000","last_undegraded":"2024-04-25T03:08:40.321237+0000","last_fullsized":"2024-04-25T03:08:40.321237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:24.834556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":4488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'367","reported_seq":495,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.726212+0000","last_change":"2024-04-25T00:50:35.812044+0000","last_active":"2024-04-25T03:09:40.726212+0000","last_peered":"2024-04-25T03:09:40.726212+0000","last_clean":"2024-04-25T03:09:40.726212+0000","last_became_active":"2024-04-25T00:50:35.811281+0000","last_became_peered":"2024-04-25T00:50:35.811281+0000","last_unstale":"2024-04-25T03:09:40.726212+0000","last_undegraded":"2024-04-25T03:09:40.726212+0000","last_fullsized":"2024-04-25T03:09:40.726212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:28.655307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":25463,"num_write":336,"num_write_kb":42887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1943","reported_seq":2021,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:09.463635+0000","last_change":"2024-04-25T00:50:33.382775+0000","last_active":"2024-04-25T03:09:09.463635+0000","last_peered":"2024-04-25T03:09:09.463635+0000","last_clean":"2024-04-25T03:09:09.463635+0000","last_became_active":"2024-04-25T00:50:33.382218+0000","last_became_peered":"2024-04-25T00:50:33.382218+0000","last_unstale":"2024-04-25T03:09:09.463635+0000","last_undegraded":"2024-04-25T03:09:09.463635+0000","last_fullsized":"2024-04-25T03:09:09.463635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:52.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1878,"num_write_kb":17269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"28'382","reported_seq":539,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.902056+0000","last_change":"2024-04-25T00:50:35.802543+0000","last_active":"2024-04-25T03:09:40.902056+0000","last_peered":"2024-04-25T03:09:40.902056+0000","last_clean":"2024-04-25T03:09:40.902056+0000","last_became_active":"2024-04-25T00:50:35.801799+0000","last_became_peered":"2024-04-25T00:50:35.801799+0000","last_unstale":"2024-04-25T03:09:40.902056+0000","last_undegraded":"2024-04-25T03:09:40.902056+0000","last_fullsized":"2024-04-25T03:09:40.902056+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:15.875347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":38798,"num_write":356,"num_write_kb":55918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"28'667","reported_seq":759,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:44.643827+0000","last_change":"2024-04-25T00:50:33.389565+0000","last_active":"2024-04-25T03:07:44.643827+0000","last_peered":"2024-04-25T03:07:44.643827+0000","last_clean":"2024-04-25T03:07:44.643827+0000","last_became_active":"2024-04-25T00:50:33.388773+0000","last_became_peered":"2024-04-25T00:50:33.388773+0000","last_unstale":"2024-04-25T03:07:44.643827+0000","last_undegraded":"2024-04-25T03:07:44.643827+0000","last_fullsized":"2024-04-25T03:07:44.643827+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:03:42.721375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"28'435","reported_seq":551,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.030287+0000","last_change":"2024-04-25T00:50:35.877410+0000","last_active":"2024-04-25T03:09:41.030287+0000","last_peered":"2024-04-25T03:09:41.030287+0000","last_clean":"2024-04-25T03:09:41.030287+0000","last_became_active":"2024-04-25T00:50:35.876576+0000","last_became_peered":"2024-04-25T00:50:35.876576+0000","last_unstale":"2024-04-25T03:09:41.030287+0000","last_undegraded":"2024-04-25T03:09:41.030287+0000","last_fullsized":"2024-04-25T03:09:41.030287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:15.762503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17268,"num_write":403,"num_write_kb":121594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"28'723","reported_seq":812,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:31.807513+0000","last_change":"2024-04-25T00:50:33.319601+0000","last_active":"2024-04-25T03:08:31.807513+0000","last_peered":"2024-04-25T03:08:31.807513+0000","last_clean":"2024-04-25T03:08:31.807513+0000","last_became_active":"2024-04-25T00:50:33.318940+0000","last_became_peered":"2024-04-25T00:50:33.318940+0000","last_unstale":"2024-04-25T03:08:31.807513+0000","last_undegraded":"2024-04-25T03:08:31.807513+0000","last_fullsized":"2024-04-25T03:08:31.807513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:41.175588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":687,"num_write_kb":8496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2646,"num_read_kb":1386903,"num_write":24369,"num_write_kb":4205310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26395,"ondisk_log_size":26395,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":213073620,"num_objects":149,"num_object_clones":0,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":0,"num_read":4395,"num_read_kb":4765,"num_write":47715,"num_write_kb":231672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":426393600,"data_stored":426147240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38437,"ondisk_log_size":38437,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719478420,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177932,"kb_used_data":78724,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94193908,"statfs":{"total":96636764160,"available":96454561792,"internally_reserved":0,"allocated":80613376,"data_stored":80393199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":101579210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":16,"seq":68719478420,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":162792,"kb_used_data":63584,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94209048,"statfs":{"total":96636764160,"available":96470065152,"internally_reserved":0,"allocated":65110016,"data_stored":64903593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":16,"seq":68719478420,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150528,"kb_used_data":51320,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94221312,"statfs":{"total":96636764160,"available":96482623488,"internally_reserved":0,"allocated":52551680,"data_stored":52323151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":16,"seq":68719478418,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147132,"kb_used_data":57652,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94224708,"statfs":{"total":96636764160,"available":96486100992,"internally_reserved":0,"allocated":59035648,"data_stored":58830541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":16,"seq":68719478419,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97828,"kb_used_data":22236,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94274012,"statfs":{"total":96636764160,"available":96536588288,"internally_reserved":0,"allocated":22769664,"data_stored":22552901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424511123,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150240,"kb_used_data":42712,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94221600,"statfs":{"total":96636764160,"available":96482918400,"internally_reserved":0,"allocated":43737088,"data_stored":43524455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110098887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424511124,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109060,"kb_used_data":45948,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94262780,"statfs":{"total":96636764160,"available":96525086720,"internally_reserved":0,"allocated":47050752,"data_stored":46836959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543827,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":156864,"kb_used_data":57656,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94214976,"statfs":{"total":96636764160,"available":96476135424,"internally_reserved":0,"allocated":59039744,"data_stored":58830161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46166016,"data_stored":46138218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":58748928,"data_stored":58721788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22478848,"data_stored":22444528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":43446272,"data_stored":43416082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":58744832,"data_stored":58722168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":52260864,"data_stored":52214778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":64819200,"data_stored":64795220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":79728640,"data_stored":79694458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T03:09:48.880 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T03:09:49.040 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.037+0000 7fc667105640 1 Processor -- start 2024-04-25T03:09:49.041 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.037+0000 7fc667105640 1 -- start start 2024-04-25T03:09:49.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.041+0000 7fc667105640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc66015c310 0x7fc6600c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:49.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.041+0000 7fc667105640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc6600c8ee0 0x7fc6600c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:49.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.041+0000 7fc667105640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6600c5630 con 0x7fc6600c1890 2024-04-25T03:09:49.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.041+0000 7fc667105640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc66015be80 con 0x7fc6600c8ee0 2024-04-25T03:09:49.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.041+0000 7fc667105640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc6600c58f0 con 0x7fc66015c310 2024-04-25T03:09:49.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.041+0000 7fc6656a2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc6600c8ee0 0x7fc6600c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:49.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.041+0000 7fc6656a2640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc6600c8ee0 0x7fc6600c4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46740/0 (socket says 172.21.15.162:46740) 2024-04-25T03:09:49.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.041+0000 7fc65ffff640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc66015c310 0x7fc6600c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:49.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.041+0000 7fc6656a2640 1 -- 172.21.15.162:0/3811555889 learned_addr learned my addr 172.21.15.162:0/3811555889 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:49.045 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.045+0000 7fc6656a2640 1 -- 172.21.15.162:0/3811555889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc66015c310 msgr2=0x7fc6600c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:49.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.045+0000 7fc6656a2640 1 --2- 172.21.15.162:0/3811555889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc66015c310 0x7fc6600c1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:49.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.045+0000 7fc6656a2640 1 -- 172.21.15.162:0/3811555889 >> v1:172.21.15.162:6789/0 conn(0x7fc6600c1890 legacy=0x7fc6601580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:49.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.045+0000 7fc6656a2640 1 -- 172.21.15.162:0/3811555889 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6600c5bd0 con 0x7fc6600c8ee0 2024-04-25T03:09:49.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.049+0000 7fc6656a2640 1 --2- 172.21.15.162:0/3811555889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6600c8ee0 0x7fc6600c4fd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc658009e50 tx=0x7fc65801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4e810830b8a959f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:49.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.061+0000 7fc65f7fe640 1 -- 172.21.15.162:0/3811555889 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6580a58d0 con 0x7fc6600c8ee0 2024-04-25T03:09:49.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.061+0000 7fc65f7fe640 1 -- 172.21.15.162:0/3811555889 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6580a5a70 con 0x7fc6600c8ee0 2024-04-25T03:09:49.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.061+0000 7fc65f7fe640 1 -- 172.21.15.162:0/3811555889 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6580a5e40 con 0x7fc6600c8ee0 2024-04-25T03:09:49.063 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.061+0000 7fc667105640 1 -- 172.21.15.162:0/3811555889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6600c8ee0 msgr2=0x7fc6600c4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:49.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.061+0000 7fc667105640 1 --2- 172.21.15.162:0/3811555889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6600c8ee0 0x7fc6600c4fd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc658009e50 tx=0x7fc65801ca00 comp rx=0 tx=0).stop 2024-04-25T03:09:49.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.061+0000 7fc667105640 1 -- 172.21.15.162:0/3811555889 shutdown_connections 2024-04-25T03:09:49.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.061+0000 7fc667105640 1 --2- 172.21.15.162:0/3811555889 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc66015c310 0x7fc6600c1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:49.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.061+0000 7fc667105640 1 --2- 172.21.15.162:0/3811555889 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6600c8ee0 0x7fc6600c4fd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:49.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.061+0000 7fc667105640 1 -- 172.21.15.162:0/3811555889 >> 172.21.15.162:0/3811555889 conn(0x7fc6600c83c0 msgr2=0x7fc6600c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:49.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.061+0000 7fc667105640 1 -- 172.21.15.162:0/3811555889 shutdown_connections 2024-04-25T03:09:49.064 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.061+0000 7fc667105640 1 -- 172.21.15.162:0/3811555889 wait complete. 2024-04-25T03:09:49.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.061+0000 7fc667105640 1 Processor -- start 2024-04-25T03:09:49.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.061+0000 7fc667105640 1 -- start start 2024-04-25T03:09:49.065 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.065+0000 7fc667105640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6600c1890 0x7fc66013f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:49.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.065+0000 7fc667105640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6600c8ee0 0x7fc660161ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:49.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.065+0000 7fc667105640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc66015c310 0x7fc660140420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:49.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.065+0000 7fc667105640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc6600728d0 con 0x7fc6600c8ee0 2024-04-25T03:09:49.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.065+0000 7fc667105640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc660072750 con 0x7fc66015c310 2024-04-25T03:09:49.066 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.065+0000 7fc667105640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc660072a50 con 0x7fc6600c1890 2024-04-25T03:09:49.067 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.065+0000 7fc664ea1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6600c1890 0x7fc66013f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:49.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.065+0000 7fc6656a2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc66015c310 0x7fc660140420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:49.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.065+0000 7fc664ea1640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6600c1890 0x7fc66013f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:39094/0 (socket says 172.21.15.162:39094) 2024-04-25T03:09:49.068 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.065+0000 7fc664ea1640 1 -- 172.21.15.162:0/131019403 learned_addr learned my addr 172.21.15.162:0/131019403 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:49.070 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.069+0000 7fc65ffff640 1 --2- 172.21.15.162:0/131019403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6600c8ee0 0x7fc660161ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:49.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.077+0000 7fc664ea1640 1 -- 172.21.15.162:0/131019403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc66015c310 msgr2=0x7fc660140420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:49.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.077+0000 7fc664ea1640 1 --2- 172.21.15.162:0/131019403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc66015c310 0x7fc660140420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:49.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.077+0000 7fc664ea1640 1 -- 172.21.15.162:0/131019403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6600c8ee0 msgr2=0x7fc660161ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:49.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.077+0000 7fc664ea1640 1 --2- 172.21.15.162:0/131019403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6600c8ee0 0x7fc660161ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:49.078 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.077+0000 7fc664ea1640 1 -- 172.21.15.162:0/131019403 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6601f2ce0 con 0x7fc6600c1890 2024-04-25T03:09:49.106 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.105+0000 7fc664ea1640 1 --2- 172.21.15.162:0/131019403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6600c1890 0x7fc66013f8f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc65400c3a0 tx=0x7fc65400c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:49.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.229+0000 7fc65d7fa640 1 -- 172.21.15.162:0/131019403 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6540052d0 con 0x7fc6600c1890 2024-04-25T03:09:49.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.229+0000 7fc65d7fa640 1 -- 172.21.15.162:0/131019403 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc654005470 con 0x7fc6600c1890 2024-04-25T03:09:49.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.229+0000 7fc65d7fa640 1 -- 172.21.15.162:0/131019403 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc654007260 con 0x7fc6600c1890 2024-04-25T03:09:49.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.229+0000 7fc667105640 1 -- 172.21.15.162:0/131019403 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6601f2f80 con 0x7fc6600c1890 2024-04-25T03:09:49.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.229+0000 7fc667105640 1 -- 172.21.15.162:0/131019403 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6601f3540 con 0x7fc6600c1890 2024-04-25T03:09:49.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.229+0000 7fc667105640 1 -- 172.21.15.162:0/131019403 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6601f3b50 con 0x7fc6600c1890 2024-04-25T03:09:49.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.509+0000 7fc65d7fa640 1 -- 172.21.15.162:0/131019403 <== mon.2 v2:172.21.15.179:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc654007400 con 0x7fc6600c1890 2024-04-25T03:09:49.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.509+0000 7fc65d7fa640 1 --2- 172.21.15.162:0/131019403 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc64c067940 0x7fc64c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:49.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.509+0000 7fc65ffff640 1 --2- 172.21.15.162:0/131019403 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc64c067940 0x7fc64c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:49.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.513+0000 7fc65ffff640 1 --2- 172.21.15.162:0/131019403 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc64c067940 0x7fc64c069e00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc660074b20 tx=0x7fc650009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:49.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.513+0000 7fc65d7fa640 1 -- 172.21.15.162:0/131019403 <== mon.2 v2:172.21.15.179:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7fc654053b80 con 0x7fc6600c1890 2024-04-25T03:09:49.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.525+0000 7fc65d7fa640 1 -- 172.21.15.162:0/131019403 <== mon.2 v2:172.21.15.179:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc654055ae0 con 0x7fc6600c1890 2024-04-25T03:09:49.712 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.709+0000 7fc667105640 1 -- 172.21.15.162:0/131019403 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc660151ca0 con 0x7fc6600c1890 2024-04-25T03:09:49.812 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.809+0000 7fc65d7fa640 1 -- 172.21.15.162:0/131019403 <== mon.2 v2:172.21.15.179:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+16835 (secure 0 0 0) 0x7fc654059de0 con 0x7fc6600c1890 2024-04-25T03:09:49.813 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T03:09:49.813 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":28,"fsid":"e141deed-4794-4a17-83c9-f6e6e8875f5e","created":"2024-04-25T00:49:29.904605+0000","modified":"2024-04-25T00:51:40.137155+0000","last_up_change":"2024-04-25T00:49:51.119342+0000","last_in_change":"2024-04-25T00:49:39.898293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T00:49:52.297093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T00:50:31.644475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T00:50:33.242786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e20986cc-3664-4988-959c-c0b02e380775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6811","nonce":2734546478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6813","nonce":2734546478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6817","nonce":2734546478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6815","nonce":2734546478}]},"public_addr":"172.21.15.162:6811/2734546478","cluster_addr":"172.21.15.162:6813/2734546478","heartbeat_back_addr":"172.21.15.162:6817/2734546478","heartbeat_front_addr":"172.21.15.162:6815/2734546478","state":["exists","up"]},{"osd":1,"uuid":"60f1608a-ecb7-4978-b816-ce6f419e275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6803","nonce":3488816098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6805","nonce":3488816098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6809","nonce":3488816098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6807","nonce":3488816098}]},"public_addr":"172.21.15.162:6803/3488816098","cluster_addr":"172.21.15.162:6805/3488816098","heartbeat_back_addr":"172.21.15.162:6809/3488816098","heartbeat_front_addr":"172.21.15.162:6807/3488816098","state":["exists","up"]},{"osd":2,"uuid":"77552061-8e19-4f49-bc3f-1300955a07b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6819","nonce":234337516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6821","nonce":234337516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6825","nonce":234337516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6823","nonce":234337516}]},"public_addr":"172.21.15.162:6819/234337516","cluster_addr":"172.21.15.162:6821/234337516","heartbeat_back_addr":"172.21.15.162:6825/234337516","heartbeat_front_addr":"172.21.15.162:6823/234337516","state":["exists","up"]},{"osd":3,"uuid":"5b105720-6e6d-4143-b5c4-0a3b1e4a687c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6827","nonce":1726903362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6829","nonce":1726903362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6833","nonce":1726903362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6831","nonce":1726903362}]},"public_addr":"172.21.15.162:6827/1726903362","cluster_addr":"172.21.15.162:6829/1726903362","heartbeat_back_addr":"172.21.15.162:6833/1726903362","heartbeat_front_addr":"172.21.15.162:6831/1726903362","state":["exists","up"]},{"osd":4,"uuid":"611eafc5-2fe0-4c96-ba8c-b1efc3930de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6817","nonce":3338082657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6819","nonce":3338082657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6823","nonce":3338082657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6821","nonce":3338082657}]},"public_addr":"172.21.15.179:6817/3338082657","cluster_addr":"172.21.15.179:6819/3338082657","heartbeat_back_addr":"172.21.15.179:6823/3338082657","heartbeat_front_addr":"172.21.15.179:6821/3338082657","state":["exists","up"]},{"osd":5,"uuid":"b39487f5-c314-4026-90bd-02e30ecca04f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6825","nonce":4129338239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6827","nonce":4129338239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6831","nonce":4129338239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6829","nonce":4129338239}]},"public_addr":"172.21.15.179:6825/4129338239","cluster_addr":"172.21.15.179:6827/4129338239","heartbeat_back_addr":"172.21.15.179:6831/4129338239","heartbeat_front_addr":"172.21.15.179:6829/4129338239","state":["exists","up"]},{"osd":6,"uuid":"1d902755-f992-4070-b30e-e79f5fb22d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6801","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6802","nonce":823843016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6806","nonce":823843016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6815","nonce":823843016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6810","nonce":823843016}]},"public_addr":"172.21.15.179:6802/823843016","cluster_addr":"172.21.15.179:6806/823843016","heartbeat_back_addr":"172.21.15.179:6815/823843016","heartbeat_front_addr":"172.21.15.179:6810/823843016","state":["exists","up"]},{"osd":7,"uuid":"ea529f85-28fd-4dc3-a584-314e71999061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6803","nonce":3403659125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6807","nonce":3403659125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6814","nonce":3403659125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6811","nonce":3403659125}]},"public_addr":"172.21.15.179:6803/3403659125","cluster_addr":"172.21.15.179:6807/3403659125","heartbeat_back_addr":"172.21.15.179:6814/3403659125","heartbeat_front_addr":"172.21.15.179:6811/3403659125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.684518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.583123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.644576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.815957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.787155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.814409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.657210+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.676697+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T03:09:49.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.813+0000 7fc667105640 1 -- 172.21.15.162:0/131019403 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc64c067940 msgr2=0x7fc64c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:49.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.813+0000 7fc667105640 1 --2- 172.21.15.162:0/131019403 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc64c067940 0x7fc64c069e00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc660074b20 tx=0x7fc650009190 comp rx=0 tx=0).stop 2024-04-25T03:09:49.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.813+0000 7fc667105640 1 -- 172.21.15.162:0/131019403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6600c1890 msgr2=0x7fc66013f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:49.815 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.813+0000 7fc667105640 1 --2- 172.21.15.162:0/131019403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6600c1890 0x7fc66013f8f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc65400c3a0 tx=0x7fc65400c860 comp rx=0 tx=0).stop 2024-04-25T03:09:49.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.813+0000 7fc667105640 1 -- 172.21.15.162:0/131019403 shutdown_connections 2024-04-25T03:09:49.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.813+0000 7fc667105640 1 --2- 172.21.15.162:0/131019403 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc66015c310 0x7fc660140420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:49.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.813+0000 7fc667105640 1 --2- 172.21.15.162:0/131019403 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc64c067940 0x7fc64c069e00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:49.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.813+0000 7fc667105640 1 --2- 172.21.15.162:0/131019403 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc6600c8ee0 0x7fc660161ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:49.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.813+0000 7fc667105640 1 --2- 172.21.15.162:0/131019403 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc6600c1890 0x7fc66013f8f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:49.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.813+0000 7fc667105640 1 -- 172.21.15.162:0/131019403 >> 172.21.15.162:0/131019403 conn(0x7fc6600c83c0 msgr2=0x7fc6600c96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:49.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.813+0000 7fc667105640 1 -- 172.21.15.162:0/131019403 shutdown_connections 2024-04-25T03:09:49.816 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:49.813+0000 7fc667105640 1 -- 172.21.15.162:0/131019403 wait complete. 2024-04-25T03:09:50.836 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T03:09:50.837 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T03:09:50.973 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.969+0000 7f1fc1d13640 1 Processor -- start 2024-04-25T03:09:50.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.973+0000 7f1fc1d13640 1 -- start start 2024-04-25T03:09:50.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.973+0000 7f1fc1d13640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1fbc141760 0x7f1fbc15c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:50.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.973+0000 7f1fc1d13640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fbc06dbd0 0x7f1fbc0c8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:50.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.973+0000 7f1fc1d13640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fbc0c6a80 con 0x7f1fbc141380 2024-04-25T03:09:50.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.973+0000 7f1fc1d13640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f1fbc06e080 con 0x7f1fbc141760 2024-04-25T03:09:50.975 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.973+0000 7f1fc1d13640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1fbc0c7040 con 0x7f1fbc06dbd0 2024-04-25T03:09:50.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.973+0000 7f1fbaffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1fbc141760 0x7f1fbc15c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:50.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.973+0000 7f1fbaffd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f1fbc141760 0x7f1fbc15c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46762/0 (socket says 172.21.15.162:46762) 2024-04-25T03:09:50.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.973+0000 7f1fbaffd640 1 -- 172.21.15.162:0/3222871805 learned_addr learned my addr 172.21.15.162:0/3222871805 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:50.976 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.973+0000 7f1fbbfff640 1 --2- 172.21.15.162:0/3222871805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fbc06dbd0 0x7f1fbc0c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:50.977 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.977+0000 7f1fbaffd640 1 -- 172.21.15.162:0/3222871805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fbc06dbd0 msgr2=0x7f1fbc0c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:50.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.977+0000 7f1fbaffd640 1 --2- 172.21.15.162:0/3222871805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fbc06dbd0 0x7f1fbc0c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:50.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.977+0000 7f1fbaffd640 1 -- 172.21.15.162:0/3222871805 >> v1:172.21.15.179:6789/0 conn(0x7f1fbc141380 legacy=0x7f1fbc0c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:50.978 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.977+0000 7f1fbaffd640 1 -- 172.21.15.162:0/3222871805 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc0c6d60 con 0x7f1fbc141760 2024-04-25T03:09:50.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.981+0000 7f1fbaffd640 1 --2- 172.21.15.162:0/3222871805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fbc141760 0x7f1fbc15c4e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009870 tx=0x7f1fb001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e6e90ff4044ec8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:50.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fba7fc640 1 -- 172.21.15.162:0/3222871805 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00b0070 con 0x7f1fbc141760 2024-04-25T03:09:50.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fba7fc640 1 -- 172.21.15.162:0/3222871805 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb00ab600 con 0x7f1fbc141760 2024-04-25T03:09:50.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fba7fc640 1 -- 172.21.15.162:0/3222871805 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00ab9d0 con 0x7f1fbc141760 2024-04-25T03:09:50.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fc1d13640 1 -- 172.21.15.162:0/3222871805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fbc141760 msgr2=0x7f1fbc15c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:50.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fc1d13640 1 --2- 172.21.15.162:0/3222871805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fbc141760 0x7f1fbc15c4e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1fb0009870 tx=0x7f1fb001c4d0 comp rx=0 tx=0).stop 2024-04-25T03:09:50.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fc1d13640 1 -- 172.21.15.162:0/3222871805 shutdown_connections 2024-04-25T03:09:50.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fc1d13640 1 --2- 172.21.15.162:0/3222871805 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fbc06dbd0 0x7f1fbc0c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:50.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fc1d13640 1 --2- 172.21.15.162:0/3222871805 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fbc141760 0x7f1fbc15c4e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:50.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fc1d13640 1 -- 172.21.15.162:0/3222871805 >> 172.21.15.162:0/3222871805 conn(0x7f1fbc06b210 msgr2=0x7f1fbc06b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:50.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fc1d13640 1 -- 172.21.15.162:0/3222871805 shutdown_connections 2024-04-25T03:09:50.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fc1d13640 1 -- 172.21.15.162:0/3222871805 wait complete. 2024-04-25T03:09:50.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fc1d13640 1 Processor -- start 2024-04-25T03:09:50.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fc1d13640 1 -- start start 2024-04-25T03:09:50.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fc1d13640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fbc06dbd0 0x7f1fbc1f3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:50.990 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fc1d13640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fbc141380 0x7f1fbc15afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:50.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fc1d13640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fbc141760 0x7f1fbc1608f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:50.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fc1d13640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc164df0 con 0x7f1fbc141380 2024-04-25T03:09:50.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fc1d13640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc164c70 con 0x7f1fbc141760 2024-04-25T03:09:50.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fc1d13640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f1fbc164f70 con 0x7f1fbc06dbd0 2024-04-25T03:09:50.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.985+0000 7f1fbaffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fbc141380 0x7f1fbc15afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:50.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.989+0000 7f1fbaffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fbc141380 0x7f1fbc15afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46764/0 (socket says 172.21.15.162:46764) 2024-04-25T03:09:50.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.989+0000 7f1fbaffd640 1 -- 172.21.15.162:0/1763692783 learned_addr learned my addr 172.21.15.162:0/1763692783 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:50.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.989+0000 7f1fbbfff640 1 --2- 172.21.15.162:0/1763692783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fbc141760 0x7f1fbc1608f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:50.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.989+0000 7f1fbb7fe640 1 --2- 172.21.15.162:0/1763692783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fbc06dbd0 0x7f1fbc1f3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:50.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.989+0000 7f1fbaffd640 1 -- 172.21.15.162:0/1763692783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fbc06dbd0 msgr2=0x7f1fbc1f3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:50.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.989+0000 7f1fbaffd640 1 --2- 172.21.15.162:0/1763692783 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f1fbc06dbd0 0x7f1fbc1f3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:50.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.989+0000 7f1fbaffd640 1 -- 172.21.15.162:0/1763692783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fbc141760 msgr2=0x7f1fbc1608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:50.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.989+0000 7f1fbaffd640 1 --2- 172.21.15.162:0/1763692783 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1fbc141760 0x7f1fbc1608f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:50.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.989+0000 7f1fbaffd640 1 -- 172.21.15.162:0/1763692783 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc1f3bd0 con 0x7f1fbc141380 2024-04-25T03:09:50.996 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.993+0000 7f1fbaffd640 1 --2- 172.21.15.162:0/1763692783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fbc141380 0x7f1fbc15afc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1fb001ab80 tx=0x7f1fb0019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:50.999 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.997+0000 7f1fa3fff640 1 -- 172.21.15.162:0/1763692783 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00b0040 con 0x7f1fbc141380 2024-04-25T03:09:51.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.997+0000 7f1fa3fff640 1 -- 172.21.15.162:0/1763692783 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fb00bd070 con 0x7f1fbc141380 2024-04-25T03:09:51.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.997+0000 7f1fa3fff640 1 -- 172.21.15.162:0/1763692783 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb00b66b0 con 0x7f1fbc141380 2024-04-25T03:09:51.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.997+0000 7f1fc1d13640 1 -- 172.21.15.162:0/1763692783 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fbc13a260 con 0x7f1fbc141380 2024-04-25T03:09:51.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.997+0000 7f1fc1d13640 1 -- 172.21.15.162:0/1763692783 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fbc0c31f0 con 0x7f1fbc141380 2024-04-25T03:09:51.000 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:50.997+0000 7f1fc1d13640 1 -- 172.21.15.162:0/1763692783 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1fbc0c2cc0 con 0x7f1fbc141380 2024-04-25T03:09:51.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.021+0000 7f1fa3fff640 1 -- 172.21.15.162:0/1763692783 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1fb00b6850 con 0x7f1fbc141380 2024-04-25T03:09:51.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.021+0000 7f1fa3fff640 1 --2- 172.21.15.162:0/1763692783 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1fa8067940 0x7f1fa8069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:51.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.021+0000 7f1fbb7fe640 1 --2- 172.21.15.162:0/1763692783 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1fa8067940 0x7f1fa8069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:51.023 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.021+0000 7f1fbb7fe640 1 --2- 172.21.15.162:0/1763692783 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1fa8067940 0x7f1fa8069e00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1fac001770 tx=0x7f1fac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:51.027 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.025+0000 7f1fa3fff640 1 -- 172.21.15.162:0/1763692783 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f1fb00ef210 con 0x7f1fbc141380 2024-04-25T03:09:51.027 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.025+0000 7f1fa3fff640 1 --2- 172.21.15.162:0/1763692783 >> [v2:172.21.15.162:6810/2734546478,v1:172.21.15.162:6811/2734546478] conn(0x7f1fa806fcc0 0x7f1fa8072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:51.027 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.025+0000 7f1fa3fff640 1 -- 172.21.15.162:0/1763692783 --> [v2:172.21.15.162:6810/2734546478,v1:172.21.15.162:6811/2734546478] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1fb00c6e50 con 0x7f1fa806fcc0 2024-04-25T03:09:51.027 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.025+0000 7f1fa3fff640 1 -- 172.21.15.162:0/1763692783 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1fb00ed410 con 0x7f1fbc141380 2024-04-25T03:09:51.027 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.025+0000 7f1fbbfff640 1 --2- 172.21.15.162:0/1763692783 >> [v2:172.21.15.162:6810/2734546478,v1:172.21.15.162:6811/2734546478] conn(0x7f1fa806fcc0 0x7f1fa8072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:51.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.025+0000 7f1fbbfff640 1 --2- 172.21.15.162:0/1763692783 >> [v2:172.21.15.162:6810/2734546478,v1:172.21.15.162:6811/2734546478] conn(0x7f1fa806fcc0 0x7f1fa8072140 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:51.028 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.025+0000 7f1fa3fff640 1 -- 172.21.15.162:0/1763692783 <== osd.0 v2:172.21.15.162:6810/2734546478 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1fb00c6e50 con 0x7f1fa806fcc0 2024-04-25T03:09:51.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.041+0000 7f1fc1d13640 1 -- 172.21.15.162:0/1763692783 --> [v2:172.21.15.162:6810/2734546478,v1:172.21.15.162:6811/2734546478] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1fbc068310 con 0x7f1fa806fcc0 2024-04-25T03:09:51.042 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.041+0000 7f1fa3fff640 1 -- 172.21.15.162:0/1763692783 <== osd.0 v2:172.21.15.162:6810/2734546478 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1fbc068310 con 0x7f1fa806fcc0 2024-04-25T03:09:51.042 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-04-25T03:09:51.042 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T03:09:51.042 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-04-25T03:09:51.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.041+0000 7f1fc1d13640 1 -- 172.21.15.162:0/1763692783 >> [v2:172.21.15.162:6810/2734546478,v1:172.21.15.162:6811/2734546478] conn(0x7f1fa806fcc0 msgr2=0x7f1fa8072140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:51.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.041+0000 7f1fc1d13640 1 --2- 172.21.15.162:0/1763692783 >> [v2:172.21.15.162:6810/2734546478,v1:172.21.15.162:6811/2734546478] conn(0x7f1fa806fcc0 0x7f1fa8072140 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.041+0000 7f1fc1d13640 1 -- 172.21.15.162:0/1763692783 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1fa8067940 msgr2=0x7f1fa8069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:51.043 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.041+0000 7f1fc1d13640 1 --2- 172.21.15.162:0/1763692783 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f1fa8067940 0x7f1fa8069e00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1fac001770 tx=0x7f1fac009040 comp rx=0 tx=0).stop 2024-04-25T03:09:51.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.041+0000 7f1fc1d13640 1 -- 172.21.15.162:0/1763692783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fbc141380 msgr2=0x7f1fbc15afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:51.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.041+0000 7f1fc1d13640 1 --2- 172.21.15.162:0/1763692783 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1fbc141380 0x7f1fbc15afc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1fb001ab80 tx=0x7f1fb0019270 comp rx=0 tx=0).stop 2024-04-25T03:09:51.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.041+0000 7f1fbbfff640 1 -- 172.21.15.162:0/1763692783 reap_dead start 2024-04-25T03:09:51.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.041+0000 7f1fc1d13640 1 -- 172.21.15.162:0/1763692783 shutdown_connections 2024-04-25T03:09:51.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.041+0000 7f1fc1d13640 1 -- 172.21.15.162:0/1763692783 >> 172.21.15.162:0/1763692783 conn(0x7f1fbc06b210 msgr2=0x7f1fbc06b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:51.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.041+0000 7f1fc1d13640 1 -- 172.21.15.162:0/1763692783 shutdown_connections 2024-04-25T03:09:51.044 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.041+0000 7f1fc1d13640 1 -- 172.21.15.162:0/1763692783 wait complete. 2024-04-25T03:09:51.062 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T03:09:51.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.181+0000 7ff409eca640 1 Processor -- start 2024-04-25T03:09:51.183 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.181+0000 7ff409eca640 1 -- start start 2024-04-25T03:09:51.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.181+0000 7ff409eca640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7ff404151410 0x7ff4041570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:51.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.181+0000 7ff409eca640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff4040c2cc0 0x7ff404072c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:51.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.181+0000 7ff409eca640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff40415a760 con 0x7ff40415b1d0 2024-04-25T03:09:51.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.181+0000 7ff409eca640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff40415b620 con 0x7ff4040c2cc0 2024-04-25T03:09:51.184 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.181+0000 7ff409eca640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7ff4041517f0 con 0x7ff404151410 2024-04-25T03:09:51.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.181+0000 7ff403fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff4040c2cc0 0x7ff404072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:51.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.185+0000 7ff403fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff4040c2cc0 0x7ff404072c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46780/0 (socket says 172.21.15.162:46780) 2024-04-25T03:09:51.185 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.185+0000 7ff403fff640 1 -- 172.21.15.162:0/3314604491 learned_addr learned my addr 172.21.15.162:0/3314604491 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:51.186 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.185+0000 7ff4037fe640 1 --2- 172.21.15.162:0/3314604491 >> v2:172.21.15.179:3300/0 conn(0x7ff404151410 0x7ff4041570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:51.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.185+0000 7ff403fff640 1 -- 172.21.15.162:0/3314604491 >> v2:172.21.15.179:3300/0 conn(0x7ff404151410 msgr2=0x7ff4041570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:51.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.185+0000 7ff403fff640 1 --2- 172.21.15.162:0/3314604491 >> v2:172.21.15.179:3300/0 conn(0x7ff404151410 0x7ff4041570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.185+0000 7ff403fff640 1 -- 172.21.15.162:0/3314604491 >> v1:172.21.15.179:6789/0 conn(0x7ff40415b1d0 legacy=0x7ff4040c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:51.188 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.185+0000 7ff403fff640 1 -- 172.21.15.162:0/3314604491 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4040c3430 con 0x7ff4040c2cc0 2024-04-25T03:09:51.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.189+0000 7ff403fff640 1 --2- 172.21.15.162:0/3314604491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4040c2cc0 0x7ff404072c80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff4040c9230 tx=0x7ff3fc01c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f60b7450fbdec6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:51.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.193+0000 7ff402ffd640 1 -- 172.21.15.162:0/3314604491 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0a5650 con 0x7ff4040c2cc0 2024-04-25T03:09:51.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.193+0000 7ff402ffd640 1 -- 172.21.15.162:0/3314604491 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3fc0a57f0 con 0x7ff4040c2cc0 2024-04-25T03:09:51.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.193+0000 7ff402ffd640 1 -- 172.21.15.162:0/3314604491 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3fc0a5bc0 con 0x7ff4040c2cc0 2024-04-25T03:09:51.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.193+0000 7ff409eca640 1 -- 172.21.15.162:0/3314604491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4040c2cc0 msgr2=0x7ff404072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:51.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.193+0000 7ff409eca640 1 --2- 172.21.15.162:0/3314604491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4040c2cc0 0x7ff404072c80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ff4040c9230 tx=0x7ff3fc01c980 comp rx=0 tx=0).stop 2024-04-25T03:09:51.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.193+0000 7ff409eca640 1 -- 172.21.15.162:0/3314604491 shutdown_connections 2024-04-25T03:09:51.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.193+0000 7ff409eca640 1 --2- 172.21.15.162:0/3314604491 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4040c2cc0 0x7ff404072c80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.193+0000 7ff409eca640 1 --2- 172.21.15.162:0/3314604491 >> v2:172.21.15.179:3300/0 conn(0x7ff404151410 0x7ff4041570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.193+0000 7ff409eca640 1 -- 172.21.15.162:0/3314604491 >> 172.21.15.162:0/3314604491 conn(0x7ff40406b210 msgr2=0x7ff40406b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:51.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.193+0000 7ff409eca640 1 -- 172.21.15.162:0/3314604491 shutdown_connections 2024-04-25T03:09:51.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.193+0000 7ff409eca640 1 -- 172.21.15.162:0/3314604491 wait complete. 2024-04-25T03:09:51.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.197+0000 7ff409eca640 1 Processor -- start 2024-04-25T03:09:51.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.197+0000 7ff409eca640 1 -- start start 2024-04-25T03:09:51.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.197+0000 7ff409eca640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4040c2cc0 0x7ff40413c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:51.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.197+0000 7ff409eca640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff404151410 0x7ff404158290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:51.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.197+0000 7ff409eca640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff40415b1d0 0x7ff4041475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:51.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.197+0000 7ff409eca640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff4040c3110 con 0x7ff4040c2cc0 2024-04-25T03:09:51.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.197+0000 7ff409eca640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff4040c6cd0 con 0x7ff404151410 2024-04-25T03:09:51.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.197+0000 7ff409eca640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff4040c39f0 con 0x7ff40415b1d0 2024-04-25T03:09:51.199 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.197+0000 7ff4037fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4040c2cc0 0x7ff40413c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:51.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.197+0000 7ff4037fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4040c2cc0 0x7ff40413c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46788/0 (socket says 172.21.15.162:46788) 2024-04-25T03:09:51.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.197+0000 7ff4037fe640 1 -- 172.21.15.162:0/604460730 learned_addr learned my addr 172.21.15.162:0/604460730 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:51.200 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.197+0000 7ff403fff640 1 --2- 172.21.15.162:0/604460730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff40415b1d0 0x7ff4041475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:51.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.201+0000 7ff4037fe640 1 -- 172.21.15.162:0/604460730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff40415b1d0 msgr2=0x7ff4041475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:51.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.201+0000 7ff4037fe640 1 --2- 172.21.15.162:0/604460730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff40415b1d0 0x7ff4041475d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.201+0000 7ff4037fe640 1 -- 172.21.15.162:0/604460730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff404151410 msgr2=0x7ff404158290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:51.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.201+0000 7ff4037fe640 1 --2- 172.21.15.162:0/604460730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff404151410 0x7ff404158290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.201+0000 7ff4037fe640 1 -- 172.21.15.162:0/604460730 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4041587d0 con 0x7ff4040c2cc0 2024-04-25T03:09:51.206 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.205+0000 7ff4037fe640 1 --2- 172.21.15.162:0/604460730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4040c2cc0 0x7ff40413c560 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400e8a0 tx=0x7ff3f400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:51.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.209+0000 7ff400ff9640 1 -- 172.21.15.162:0/604460730 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f4017070 con 0x7ff4040c2cc0 2024-04-25T03:09:51.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.209+0000 7ff400ff9640 1 -- 172.21.15.162:0/604460730 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3f400c940 con 0x7ff4040c2cc0 2024-04-25T03:09:51.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.209+0000 7ff400ff9640 1 -- 172.21.15.162:0/604460730 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3f400ccf0 con 0x7ff4040c2cc0 2024-04-25T03:09:51.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.209+0000 7ff409eca640 1 -- 172.21.15.162:0/604460730 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff404155190 con 0x7ff4040c2cc0 2024-04-25T03:09:51.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.209+0000 7ff409eca640 1 -- 172.21.15.162:0/604460730 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff404155750 con 0x7ff4040c2cc0 2024-04-25T03:09:51.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.209+0000 7ff409eca640 1 -- 172.21.15.162:0/604460730 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff404068310 con 0x7ff4040c2cc0 2024-04-25T03:09:51.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.229+0000 7ff400ff9640 1 -- 172.21.15.162:0/604460730 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff3f401a070 con 0x7ff4040c2cc0 2024-04-25T03:09:51.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.229+0000 7ff400ff9640 1 --2- 172.21.15.162:0/604460730 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ff3e40678c0 0x7ff3e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:51.230 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.229+0000 7ff3faffd640 1 --2- 172.21.15.162:0/604460730 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ff3e40678c0 0x7ff3e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:51.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.229+0000 7ff3faffd640 1 --2- 172.21.15.162:0/604460730 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ff3e40678c0 0x7ff3e4069d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec007fd0 tx=0x7ff3ec0079a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:51.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.501+0000 7ff400ff9640 1 -- 172.21.15.162:0/604460730 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7ff3f40548d0 con 0x7ff4040c2cc0 2024-04-25T03:09:51.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.505+0000 7ff400ff9640 1 -- 172.21.15.162:0/604460730 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7ff3f4056830 con 0x7ff4040c2cc0 2024-04-25T03:09:51.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.689+0000 7ff409eca640 1 -- 172.21.15.162:0/604460730 --> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7ff404154f40 con 0x7ff3e40678c0 2024-04-25T03:09:51.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.689+0000 7ff400ff9640 1 -- 172.21.15.162:0/604460730 <== mgr.4100 v2:172.21.15.162:6800/3960394531 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff404154f40 con 0x7ff3e40678c0 2024-04-25T03:09:51.693 INFO:teuthology.orchestra.run.smithi162.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T03:09:51.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.693+0000 7ff409eca640 1 -- 172.21.15.162:0/604460730 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ff3e40678c0 msgr2=0x7ff3e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:51.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.693+0000 7ff409eca640 1 --2- 172.21.15.162:0/604460730 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ff3e40678c0 0x7ff3e4069d80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff3ec007fd0 tx=0x7ff3ec0079a0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.693+0000 7ff409eca640 1 -- 172.21.15.162:0/604460730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4040c2cc0 msgr2=0x7ff40413c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:51.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.693+0000 7ff409eca640 1 --2- 172.21.15.162:0/604460730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4040c2cc0 0x7ff40413c560 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff3f400e8a0 tx=0x7ff3f400eca0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.693+0000 7ff409eca640 1 -- 172.21.15.162:0/604460730 shutdown_connections 2024-04-25T03:09:51.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.693+0000 7ff409eca640 1 --2- 172.21.15.162:0/604460730 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff40415b1d0 0x7ff4041475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.693+0000 7ff409eca640 1 --2- 172.21.15.162:0/604460730 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff404151410 0x7ff404158290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.693+0000 7ff409eca640 1 --2- 172.21.15.162:0/604460730 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ff3e40678c0 0x7ff3e4069d80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.693+0000 7ff409eca640 1 --2- 172.21.15.162:0/604460730 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff4040c2cc0 0x7ff40413c560 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.693+0000 7ff409eca640 1 -- 172.21.15.162:0/604460730 >> 172.21.15.162:0/604460730 conn(0x7ff40406b210 msgr2=0x7ff404164270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:51.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.693+0000 7ff409eca640 1 -- 172.21.15.162:0/604460730 shutdown_connections 2024-04-25T03:09:51.697 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.693+0000 7ff409eca640 1 -- 172.21.15.162:0/604460730 wait complete. 2024-04-25T03:09:51.714 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T03:09:51.714 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T03:09:51.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.837+0000 7f423d155640 1 Processor -- start 2024-04-25T03:09:51.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.837+0000 7f423d155640 1 -- start start 2024-04-25T03:09:51.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.837+0000 7f423d155640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f42380c5f80 0x7f42380670e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:51.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.837+0000 7f423d155640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f42380c6360 0x7f423813cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:51.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.837+0000 7f423d155640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f423806c390 0x7f423813d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:51.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.837+0000 7f423d155640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f42381581f0 con 0x7f42380c5f80 2024-04-25T03:09:51.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.837+0000 7f423d155640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f4238067620 con 0x7f42380c6360 2024-04-25T03:09:51.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.837+0000 7f423d155640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f42380c38c0 con 0x7f423806c390 2024-04-25T03:09:51.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.837+0000 7f4236d9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f42380c5f80 0x7f42380670e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:51.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.837+0000 7f4236d9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f42380c5f80 0x7f42380670e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46944/0 (socket says 172.21.15.162:46944) 2024-04-25T03:09:51.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.837+0000 7f4236d9d640 1 -- 172.21.15.162:0/3988042993 learned_addr learned my addr 172.21.15.162:0/3988042993 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:51.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.837+0000 7f423659c640 1 --2- 172.21.15.162:0/3988042993 >> v2:172.21.15.179:3300/0 conn(0x7f42380c6360 0x7f423813cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:51.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.837+0000 7f423759e640 1 --2- 172.21.15.162:0/3988042993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f423806c390 0x7f423813d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:51.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.841+0000 7f4236d9d640 1 -- 172.21.15.162:0/3988042993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f423806c390 msgr2=0x7f423813d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:51.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.841+0000 7f4236d9d640 1 --2- 172.21.15.162:0/3988042993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f423806c390 0x7f423813d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.841+0000 7f4236d9d640 1 -- 172.21.15.162:0/3988042993 >> v2:172.21.15.179:3300/0 conn(0x7f42380c6360 msgr2=0x7f423813cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:51.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.841+0000 7f4236d9d640 1 --2- 172.21.15.162:0/3988042993 >> v2:172.21.15.179:3300/0 conn(0x7f42380c6360 0x7f423813cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.841+0000 7f4236d9d640 1 -- 172.21.15.162:0/3988042993 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42380c3ba0 con 0x7f42380c5f80 2024-04-25T03:09:51.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.845+0000 7f4236d9d640 1 --2- 172.21.15.162:0/3988042993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42380c5f80 0x7f42380670e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4238070ee0 tx=0x7f423001ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f16826c013f33d42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:51.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.845+0000 7f4235d9b640 1 -- 172.21.15.162:0/3988042993 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42300b4070 con 0x7f42380c5f80 2024-04-25T03:09:51.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.845+0000 7f4235d9b640 1 -- 172.21.15.162:0/3988042993 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42300a7c50 con 0x7f42380c5f80 2024-04-25T03:09:51.849 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.845+0000 7f4235d9b640 1 -- 172.21.15.162:0/3988042993 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42300af440 con 0x7f42380c5f80 2024-04-25T03:09:51.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f423d155640 1 -- 172.21.15.162:0/3988042993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42380c5f80 msgr2=0x7f42380670e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:51.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f423d155640 1 --2- 172.21.15.162:0/3988042993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42380c5f80 0x7f42380670e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4238070ee0 tx=0x7f423001ebc0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f423d155640 1 -- 172.21.15.162:0/3988042993 shutdown_connections 2024-04-25T03:09:51.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f423d155640 1 --2- 172.21.15.162:0/3988042993 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f423806c390 0x7f423813d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f423d155640 1 --2- 172.21.15.162:0/3988042993 >> v2:172.21.15.179:3300/0 conn(0x7f42380c6360 0x7f423813cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f423d155640 1 --2- 172.21.15.162:0/3988042993 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f42380c5f80 0x7f42380670e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f423d155640 1 -- 172.21.15.162:0/3988042993 >> 172.21.15.162:0/3988042993 conn(0x7f423806fa80 msgr2=0x7f423806fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:51.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f423d155640 1 -- 172.21.15.162:0/3988042993 shutdown_connections 2024-04-25T03:09:51.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f423d155640 1 -- 172.21.15.162:0/3988042993 wait complete. 2024-04-25T03:09:51.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f423d155640 1 Processor -- start 2024-04-25T03:09:51.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f423d155640 1 -- start start 2024-04-25T03:09:51.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f423d155640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f423806c390 0x7f4238138150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:51.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f423d155640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42380c5f80 0x7f42381f65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:51.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f423d155640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42380c6360 0x7f42381f6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:51.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f423d155640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f423815a9a0 con 0x7f423806c390 2024-04-25T03:09:51.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f423d155640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f423815a820 con 0x7f42380c6360 2024-04-25T03:09:51.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f423d155640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f423815ab20 con 0x7f42380c5f80 2024-04-25T03:09:51.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f4236d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f423806c390 0x7f4238138150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:51.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f4236d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f423806c390 0x7f4238138150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46954/0 (socket says 172.21.15.162:46954) 2024-04-25T03:09:51.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f4236d9d640 1 -- 172.21.15.162:0/994858745 learned_addr learned my addr 172.21.15.162:0/994858745 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:51.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.849+0000 7f423759e640 1 --2- 172.21.15.162:0/994858745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42380c6360 0x7f42381f6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:51.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.853+0000 7f423659c640 1 --2- 172.21.15.162:0/994858745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42380c5f80 0x7f42381f65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:51.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.853+0000 7f4236d9d640 1 -- 172.21.15.162:0/994858745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42380c5f80 msgr2=0x7f42381f65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:51.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.853+0000 7f4236d9d640 1 --2- 172.21.15.162:0/994858745 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f42380c5f80 0x7f42381f65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.853+0000 7f4236d9d640 1 -- 172.21.15.162:0/994858745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42380c6360 msgr2=0x7f42381f6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:51.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.853+0000 7f4236d9d640 1 --2- 172.21.15.162:0/994858745 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f42380c6360 0x7f42381f6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.853+0000 7f4236d9d640 1 -- 172.21.15.162:0/994858745 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42381614a0 con 0x7f423806c390 2024-04-25T03:09:51.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.857+0000 7f4236d9d640 1 --2- 172.21.15.162:0/994858745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f423806c390 0x7f4238138150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f423001c7f0 tx=0x7f423001b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:51.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.861+0000 7f422f7fe640 1 -- 172.21.15.162:0/994858745 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42300b4040 con 0x7f423806c390 2024-04-25T03:09:51.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.861+0000 7f422f7fe640 1 -- 172.21.15.162:0/994858745 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42300bd070 con 0x7f423806c390 2024-04-25T03:09:51.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.861+0000 7f422f7fe640 1 -- 172.21.15.162:0/994858745 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42300afbc0 con 0x7f423806c390 2024-04-25T03:09:51.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.861+0000 7f423d155640 1 -- 172.21.15.162:0/994858745 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4238161780 con 0x7f423806c390 2024-04-25T03:09:51.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.861+0000 7f423d155640 1 -- 172.21.15.162:0/994858745 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4238160920 con 0x7f423806c390 2024-04-25T03:09:51.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.861+0000 7f423d155640 1 -- 172.21.15.162:0/994858745 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4238075110 con 0x7f423806c390 2024-04-25T03:09:51.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.881+0000 7f422f7fe640 1 -- 172.21.15.162:0/994858745 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f42300b8440 con 0x7f423806c390 2024-04-25T03:09:51.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.881+0000 7f422f7fe640 1 --2- 172.21.15.162:0/994858745 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4218067940 0x7f4218069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:51.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.881+0000 7f423659c640 1 --2- 172.21.15.162:0/994858745 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4218067940 0x7f4218069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:51.884 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.881+0000 7f423659c640 1 --2- 172.21.15.162:0/994858745 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4218067940 0x7f4218069e00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f42380cd350 tx=0x7f4220008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:51.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.885+0000 7f422f7fe640 1 -- 172.21.15.162:0/994858745 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f42300ef110 con 0x7f423806c390 2024-04-25T03:09:51.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.885+0000 7f422f7fe640 1 --2- 172.21.15.162:0/994858745 >> [v2:172.21.15.162:6802/3488816098,v1:172.21.15.162:6803/3488816098] conn(0x7f421806fc60 0x7f42180720e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:51.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.885+0000 7f422f7fe640 1 -- 172.21.15.162:0/994858745 --> [v2:172.21.15.162:6802/3488816098,v1:172.21.15.162:6803/3488816098] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42300aeec0 con 0x7f421806fc60 2024-04-25T03:09:51.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.885+0000 7f422f7fe640 1 -- 172.21.15.162:0/994858745 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f42300ed310 con 0x7f423806c390 2024-04-25T03:09:51.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.885+0000 7f423759e640 1 --2- 172.21.15.162:0/994858745 >> [v2:172.21.15.162:6802/3488816098,v1:172.21.15.162:6803/3488816098] conn(0x7f421806fc60 0x7f42180720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:51.887 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.885+0000 7f423759e640 1 --2- 172.21.15.162:0/994858745 >> [v2:172.21.15.162:6802/3488816098,v1:172.21.15.162:6803/3488816098] conn(0x7f421806fc60 0x7f42180720e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:51.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.885+0000 7f422f7fe640 1 -- 172.21.15.162:0/994858745 <== osd.1 v2:172.21.15.162:6802/3488816098 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f42300aeec0 con 0x7f421806fc60 2024-04-25T03:09:51.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.905+0000 7f423d155640 1 -- 172.21.15.162:0/994858745 --> [v2:172.21.15.162:6802/3488816098,v1:172.21.15.162:6803/3488816098] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4238159690 con 0x7f421806fc60 2024-04-25T03:09:51.906 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.905+0000 7f422f7fe640 1 -- 172.21.15.162:0/994858745 <== osd.1 v2:172.21.15.162:6802/3488816098 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4238159690 con 0x7f421806fc60 2024-04-25T03:09:51.906 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-04-25T03:09:51.907 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T03:09:51.907 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-04-25T03:09:51.907 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.905+0000 7f423d155640 1 -- 172.21.15.162:0/994858745 >> [v2:172.21.15.162:6802/3488816098,v1:172.21.15.162:6803/3488816098] conn(0x7f421806fc60 msgr2=0x7f42180720e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:51.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.905+0000 7f423d155640 1 --2- 172.21.15.162:0/994858745 >> [v2:172.21.15.162:6802/3488816098,v1:172.21.15.162:6803/3488816098] conn(0x7f421806fc60 0x7f42180720e0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:51.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.905+0000 7f423d155640 1 -- 172.21.15.162:0/994858745 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4218067940 msgr2=0x7f4218069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:51.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.905+0000 7f423d155640 1 --2- 172.21.15.162:0/994858745 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f4218067940 0x7f4218069e00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f42380cd350 tx=0x7f4220008040 comp rx=0 tx=0).stop 2024-04-25T03:09:51.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.905+0000 7f423d155640 1 -- 172.21.15.162:0/994858745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f423806c390 msgr2=0x7f4238138150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:51.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.905+0000 7f423d155640 1 --2- 172.21.15.162:0/994858745 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f423806c390 0x7f4238138150 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f423001c7f0 tx=0x7f423001b960 comp rx=0 tx=0).stop 2024-04-25T03:09:51.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.905+0000 7f423759e640 1 -- 172.21.15.162:0/994858745 reap_dead start 2024-04-25T03:09:51.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.905+0000 7f423d155640 1 -- 172.21.15.162:0/994858745 shutdown_connections 2024-04-25T03:09:51.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.905+0000 7f423d155640 1 -- 172.21.15.162:0/994858745 >> 172.21.15.162:0/994858745 conn(0x7f423806fa80 msgr2=0x7f4238159e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:51.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.905+0000 7f423d155640 1 -- 172.21.15.162:0/994858745 shutdown_connections 2024-04-25T03:09:51.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:51.905+0000 7f423d155640 1 -- 172.21.15.162:0/994858745 wait complete. 2024-04-25T03:09:51.927 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T03:09:52.046 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.045+0000 7f3777fe6640 1 Processor -- start 2024-04-25T03:09:52.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.045+0000 7f3777fe6640 1 -- start start 2024-04-25T03:09:52.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.045+0000 7f3777fe6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3770141760 0x7f377015c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:52.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.045+0000 7f3777fe6640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f377006dbd0 0x7f37700c8190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:52.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.045+0000 7f3777fe6640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37700c6a80 con 0x7f3770141380 2024-04-25T03:09:52.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.045+0000 7f3777fe6640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f377006e080 con 0x7f377006dbd0 2024-04-25T03:09:52.047 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.045+0000 7f3777fe6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f37700c7040 con 0x7f3770141760 2024-04-25T03:09:52.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.045+0000 7f3775d82640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f3770141380 0x7f37700c6240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:54056/0 (socket says 172.21.15.162:54056) 2024-04-25T03:09:52.048 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.045+0000 7f3775d82640 1 -- 172.21.15.162:0/849266921 learned_addr learned my addr 172.21.15.162:0/849266921 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:09:52.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.049+0000 7f3775581640 1 --2- 172.21.15.162:0/849266921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3770141760 0x7f377015c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:52.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.049+0000 7f3776583640 1 --2- 172.21.15.162:0/849266921 >> v2:172.21.15.179:3300/0 conn(0x7f377006dbd0 0x7f37700c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:52.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.049+0000 7f3774d80640 1 -- 172.21.15.162:0/849266921 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2541758323 0 0) 0x7f37700c6a80 con 0x7f3770141380 2024-04-25T03:09:52.051 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.049+0000 7f3774d80640 1 -- 172.21.15.162:0/849266921 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f375c003530 con 0x7f3770141380 2024-04-25T03:09:52.056 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.053+0000 7f3775581640 1 -- 172.21.15.162:0/849266921 >> v2:172.21.15.179:3300/0 conn(0x7f377006dbd0 msgr2=0x7f37700c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:52.056 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.053+0000 7f3775581640 1 --2- 172.21.15.162:0/849266921 >> v2:172.21.15.179:3300/0 conn(0x7f377006dbd0 0x7f37700c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:52.056 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.053+0000 7f3775581640 1 -- 172.21.15.162:0/849266921 >> v1:172.21.15.162:6789/0 conn(0x7f3770141380 legacy=0x7f37700c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.056 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.053+0000 7f3775581640 1 -- 172.21.15.162:0/849266921 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37700c6d60 con 0x7f3770141760 2024-04-25T03:09:52.062 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.061+0000 7f3775581640 1 --2- 172.21.15.162:0/849266921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3770141760 0x7f377015c4e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f37600097c0 tx=0x7f376001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fd90f7177a5c4986 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:52.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.069+0000 7f3774d80640 1 -- 172.21.15.162:0/849266921 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37600b0070 con 0x7f3770141760 2024-04-25T03:09:52.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.069+0000 7f3774d80640 1 -- 172.21.15.162:0/849266921 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37600ab600 con 0x7f3770141760 2024-04-25T03:09:52.075 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.069+0000 7f3774d80640 1 -- 172.21.15.162:0/849266921 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37600ab9d0 con 0x7f3770141760 2024-04-25T03:09:52.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.069+0000 7f3777fe6640 1 -- 172.21.15.162:0/849266921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3770141760 msgr2=0x7f377015c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.069+0000 7f3777fe6640 1 --2- 172.21.15.162:0/849266921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3770141760 0x7f377015c4e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f37600097c0 tx=0x7f376001c410 comp rx=0 tx=0).stop 2024-04-25T03:09:52.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.069+0000 7f3777fe6640 1 -- 172.21.15.162:0/849266921 shutdown_connections 2024-04-25T03:09:52.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.069+0000 7f3777fe6640 1 --2- 172.21.15.162:0/849266921 >> v2:172.21.15.179:3300/0 conn(0x7f377006dbd0 0x7f37700c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:52.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.069+0000 7f3777fe6640 1 --2- 172.21.15.162:0/849266921 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3770141760 0x7f377015c4e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:52.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.069+0000 7f3777fe6640 1 -- 172.21.15.162:0/849266921 >> 172.21.15.162:0/849266921 conn(0x7f377006b210 msgr2=0x7f377006b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:52.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.069+0000 7f3777fe6640 1 -- 172.21.15.162:0/849266921 shutdown_connections 2024-04-25T03:09:52.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.073+0000 7f3777fe6640 1 -- 172.21.15.162:0/849266921 wait complete. 2024-04-25T03:09:52.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.073+0000 7f3777fe6640 1 Processor -- start 2024-04-25T03:09:52.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.073+0000 7f3777fe6640 1 -- start start 2024-04-25T03:09:52.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.073+0000 7f3777fe6640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f377006dbd0 0x7f37701f4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:52.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.073+0000 7f3777fe6640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3770141380 0x7f37701376d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:52.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.073+0000 7f3777fe6640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3770141760 0x7f37701401c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:52.076 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.073+0000 7f3777fe6640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3770164df0 con 0x7f3770141760 2024-04-25T03:09:52.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.073+0000 7f3777fe6640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3770164c70 con 0x7f3770141380 2024-04-25T03:09:52.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.073+0000 7f3777fe6640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3770164f70 con 0x7f377006dbd0 2024-04-25T03:09:52.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.073+0000 7f3776583640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3770141760 0x7f37701401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:52.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.073+0000 7f3776583640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3770141760 0x7f37701401c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46966/0 (socket says 172.21.15.162:46966) 2024-04-25T03:09:52.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.073+0000 7f3776583640 1 -- 172.21.15.162:0/3637326680 learned_addr learned my addr 172.21.15.162:0/3637326680 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:52.077 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.073+0000 7f3775581640 1 --2- 172.21.15.162:0/3637326680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3770141380 0x7f37701376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:52.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.077+0000 7f3775d82640 1 --2- 172.21.15.162:0/3637326680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f377006dbd0 0x7f37701f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:52.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.077+0000 7f3776583640 1 -- 172.21.15.162:0/3637326680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f377006dbd0 msgr2=0x7f37701f4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.077+0000 7f3776583640 1 --2- 172.21.15.162:0/3637326680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f377006dbd0 0x7f37701f4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:52.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.077+0000 7f3776583640 1 -- 172.21.15.162:0/3637326680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3770141380 msgr2=0x7f37701376d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.077+0000 7f3776583640 1 --2- 172.21.15.162:0/3637326680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3770141380 0x7f37701376d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:52.080 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.077+0000 7f3776583640 1 -- 172.21.15.162:0/3637326680 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3770133a10 con 0x7f3770141760 2024-04-25T03:09:52.082 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.081+0000 7f3776583640 1 --2- 172.21.15.162:0/3637326680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3770141760 0x7f37701401c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3768009d30 tx=0x7f376800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:52.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.085+0000 7f37667fc640 1 -- 172.21.15.162:0/3637326680 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3768018020 con 0x7f3770141760 2024-04-25T03:09:52.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.085+0000 7f37667fc640 1 -- 172.21.15.162:0/3637326680 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3768014480 con 0x7f3770141760 2024-04-25T03:09:52.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.085+0000 7f3777fe6640 1 -- 172.21.15.162:0/3637326680 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3770137ff0 con 0x7f3770141760 2024-04-25T03:09:52.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.085+0000 7f37667fc640 1 -- 172.21.15.162:0/3637326680 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3768014870 con 0x7f3770141760 2024-04-25T03:09:52.088 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.085+0000 7f3777fe6640 1 -- 172.21.15.162:0/3637326680 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f377015b630 con 0x7f3770141760 2024-04-25T03:09:52.089 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.089+0000 7f3777fe6640 1 -- 172.21.15.162:0/3637326680 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3770068310 con 0x7f3770141760 2024-04-25T03:09:52.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.105+0000 7f37667fc640 1 -- 172.21.15.162:0/3637326680 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f376801b020 con 0x7f3770141760 2024-04-25T03:09:52.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.109+0000 7f37667fc640 1 --2- 172.21.15.162:0/3637326680 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3754067940 0x7f3754069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:52.109 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.109+0000 7f3775d82640 1 --2- 172.21.15.162:0/3637326680 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3754067940 0x7f3754069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:52.110 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.109+0000 7f3775d82640 1 --2- 172.21.15.162:0/3637326680 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3754067940 0x7f3754069e00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f376c007fd0 tx=0x7f376c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:52.113 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.113+0000 7f37667fc640 1 -- 172.21.15.162:0/3637326680 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f37680552e0 con 0x7f3770141760 2024-04-25T03:09:52.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.381+0000 7f37667fc640 1 -- 172.21.15.162:0/3637326680 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f3768022070 con 0x7f3770141760 2024-04-25T03:09:52.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.549+0000 7f3777fe6640 1 -- 172.21.15.162:0/3637326680 --> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f3770133cf0 con 0x7f3754067940 2024-04-25T03:09:52.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.553+0000 7f37667fc640 1 -- 172.21.15.162:0/3637326680 <== mgr.4100 v2:172.21.15.162:6800/3960394531 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3770133cf0 con 0x7f3754067940 2024-04-25T03:09:52.553 INFO:teuthology.orchestra.run.smithi162.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T03:09:52.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.553+0000 7f3777fe6640 1 -- 172.21.15.162:0/3637326680 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3754067940 msgr2=0x7f3754069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.556 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.553+0000 7f3777fe6640 1 --2- 172.21.15.162:0/3637326680 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3754067940 0x7f3754069e00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f376c007fd0 tx=0x7f376c009040 comp rx=0 tx=0).stop 2024-04-25T03:09:52.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.553+0000 7f3777fe6640 1 -- 172.21.15.162:0/3637326680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3770141760 msgr2=0x7f37701401c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.553+0000 7f3777fe6640 1 --2- 172.21.15.162:0/3637326680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3770141760 0x7f37701401c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3768009d30 tx=0x7f376800c490 comp rx=0 tx=0).stop 2024-04-25T03:09:52.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.553+0000 7f3777fe6640 1 -- 172.21.15.162:0/3637326680 shutdown_connections 2024-04-25T03:09:52.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.553+0000 7f3777fe6640 1 --2- 172.21.15.162:0/3637326680 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3754067940 0x7f3754069e00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:52.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.553+0000 7f3777fe6640 1 --2- 172.21.15.162:0/3637326680 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3770141760 0x7f37701401c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:52.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.553+0000 7f3777fe6640 1 --2- 172.21.15.162:0/3637326680 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3770141380 0x7f37701376d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:52.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.553+0000 7f3777fe6640 1 --2- 172.21.15.162:0/3637326680 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f377006dbd0 0x7f37701f4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:52.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.553+0000 7f3777fe6640 1 -- 172.21.15.162:0/3637326680 >> 172.21.15.162:0/3637326680 conn(0x7f377006b210 msgr2=0x7f377013e950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:52.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.553+0000 7f3777fe6640 1 -- 172.21.15.162:0/3637326680 shutdown_connections 2024-04-25T03:09:52.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.553+0000 7f3777fe6640 1 -- 172.21.15.162:0/3637326680 wait complete. 2024-04-25T03:09:52.576 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T03:09:52.576 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T03:09:52.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.697+0000 7ff1a8beb640 1 Processor -- start 2024-04-25T03:09:52.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.697+0000 7ff1a8beb640 1 -- start start 2024-04-25T03:09:52.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.697+0000 7ff1a8beb640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff1a40cff10 0x7ff1a40d0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:52.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.697+0000 7ff1a8beb640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a415df60 con 0x7ff1a415d8d0 2024-04-25T03:09:52.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.697+0000 7ff1a8beb640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1a415e220 con 0x7ff1a41547e0 2024-04-25T03:09:52.700 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.697+0000 7ff1a8beb640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7ff1a415e7e0 con 0x7ff1a40cff10 2024-04-25T03:09:52.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.701+0000 7ff1a2d9d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7ff1a40cff10 0x7ff1a40d0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:52.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.701+0000 7ff1a259c640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7ff1a41547e0 0x7ff1a415ad00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:42288/0 (socket says 172.21.15.162:42288) 2024-04-25T03:09:52.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.701+0000 7ff1a259c640 1 -- 172.21.15.162:0/2133129072 learned_addr learned my addr 172.21.15.162:0/2133129072 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:09:52.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.705+0000 7ff1a1d9b640 1 -- 172.21.15.162:0/2133129072 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3829499580 0 0) 0x7ff1a415e220 con 0x7ff1a41547e0 2024-04-25T03:09:52.707 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.705+0000 7ff1a1d9b640 1 -- 172.21.15.162:0/2133129072 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff190003530 con 0x7ff1a41547e0 2024-04-25T03:09:52.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.709+0000 7ff1a2d9d640 1 -- 172.21.15.162:0/2133129072 >> v1:172.21.15.179:6789/0 conn(0x7ff1a41547e0 legacy=0x7ff1a415ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.709+0000 7ff1a2d9d640 1 -- 172.21.15.162:0/2133129072 >> v1:172.21.15.162:6789/0 conn(0x7ff1a415d8d0 legacy=0x7ff1a40ca5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.711 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.709+0000 7ff1a2d9d640 1 -- 172.21.15.162:0/2133129072 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a415e500 con 0x7ff1a40cff10 2024-04-25T03:09:52.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.717+0000 7ff1a2d9d640 1 --2- 172.21.15.162:0/2133129072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a40cff10 0x7ff1a40d0320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff19c009d90 tx=0x7ff19c01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec617b12362b8dce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:52.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.725+0000 7ff1a1d9b640 1 -- 172.21.15.162:0/2133129072 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c0b4070 con 0x7ff1a40cff10 2024-04-25T03:09:52.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.725+0000 7ff1a1d9b640 1 -- 172.21.15.162:0/2133129072 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff19c0af600 con 0x7ff1a40cff10 2024-04-25T03:09:52.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.725+0000 7ff1a1d9b640 1 -- 172.21.15.162:0/2133129072 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19c0af9d0 con 0x7ff1a40cff10 2024-04-25T03:09:52.726 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.725+0000 7ff1a8beb640 1 -- 172.21.15.162:0/2133129072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a40cff10 msgr2=0x7ff1a40d0320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.727 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.725+0000 7ff1a8beb640 1 --2- 172.21.15.162:0/2133129072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a40cff10 0x7ff1a40d0320 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff19c009d90 tx=0x7ff19c01f150 comp rx=0 tx=0).stop 2024-04-25T03:09:52.727 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.725+0000 7ff1a8beb640 1 -- 172.21.15.162:0/2133129072 shutdown_connections 2024-04-25T03:09:52.727 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.725+0000 7ff1a8beb640 1 --2- 172.21.15.162:0/2133129072 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a40cff10 0x7ff1a40d0320 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:52.727 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.725+0000 7ff1a8beb640 1 -- 172.21.15.162:0/2133129072 >> 172.21.15.162:0/2133129072 conn(0x7ff1a4067190 msgr2=0x7ff1a40675a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:52.727 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.725+0000 7ff1a8beb640 1 -- 172.21.15.162:0/2133129072 shutdown_connections 2024-04-25T03:09:52.727 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.725+0000 7ff1a8beb640 1 -- 172.21.15.162:0/2133129072 wait complete. 2024-04-25T03:09:52.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.725+0000 7ff1a8beb640 1 Processor -- start 2024-04-25T03:09:52.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.725+0000 7ff1a8beb640 1 -- start start 2024-04-25T03:09:52.728 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.725+0000 7ff1a8beb640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a40cff10 0x7ff1a40cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:52.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.725+0000 7ff1a8beb640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1a41547e0 0x7ff1a40b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:52.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.725+0000 7ff1a8beb640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1a415d8d0 0x7ff1a40b1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:52.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.725+0000 7ff1a8beb640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a415a7e0 con 0x7ff1a40cff10 2024-04-25T03:09:52.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.725+0000 7ff1a8beb640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a415dd00 con 0x7ff1a41547e0 2024-04-25T03:09:52.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.725+0000 7ff1a8beb640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7ff1a40cacd0 con 0x7ff1a415d8d0 2024-04-25T03:09:52.729 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.729+0000 7ff1a259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a40cff10 0x7ff1a40cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:52.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.729+0000 7ff1a259c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a40cff10 0x7ff1a40cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46996/0 (socket says 172.21.15.162:46996) 2024-04-25T03:09:52.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.729+0000 7ff1a259c640 1 -- 172.21.15.162:0/1592392746 learned_addr learned my addr 172.21.15.162:0/1592392746 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:52.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.729+0000 7ff1a2d9d640 1 --2- 172.21.15.162:0/1592392746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1a415d8d0 0x7ff1a40b1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:52.730 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.729+0000 7ff199d9b640 1 --2- 172.21.15.162:0/1592392746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1a41547e0 0x7ff1a40b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:52.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.733+0000 7ff1a259c640 1 -- 172.21.15.162:0/1592392746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1a415d8d0 msgr2=0x7ff1a40b1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.735 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.733+0000 7ff1a259c640 1 --2- 172.21.15.162:0/1592392746 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7ff1a415d8d0 0x7ff1a40b1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:52.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.733+0000 7ff1a259c640 1 -- 172.21.15.162:0/1592392746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1a41547e0 msgr2=0x7ff1a40b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.733+0000 7ff1a259c640 1 --2- 172.21.15.162:0/1592392746 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7ff1a41547e0 0x7ff1a40b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:52.736 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.733+0000 7ff1a259c640 1 -- 172.21.15.162:0/1592392746 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a415d030 con 0x7ff1a40cff10 2024-04-25T03:09:52.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.737+0000 7ff1a259c640 1 --2- 172.21.15.162:0/1592392746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a40cff10 0x7ff1a40cf0d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff19400c4d0 tx=0x7ff19400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:52.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.741+0000 7ff19b7fe640 1 -- 172.21.15.162:0/1592392746 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff194017070 con 0x7ff1a40cff10 2024-04-25T03:09:52.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.741+0000 7ff19b7fe640 1 -- 172.21.15.162:0/1592392746 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff194005cf0 con 0x7ff1a40cff10 2024-04-25T03:09:52.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.741+0000 7ff19b7fe640 1 -- 172.21.15.162:0/1592392746 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff194007270 con 0x7ff1a40cff10 2024-04-25T03:09:52.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.741+0000 7ff1a8beb640 1 -- 172.21.15.162:0/1592392746 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a41f3660 con 0x7ff1a40cff10 2024-04-25T03:09:52.744 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.741+0000 7ff1a8beb640 1 -- 172.21.15.162:0/1592392746 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a41f3c20 con 0x7ff1a40cff10 2024-04-25T03:09:52.744 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.741+0000 7ff1a8beb640 1 -- 172.21.15.162:0/1592392746 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff1a4075110 con 0x7ff1a40cff10 2024-04-25T03:09:52.779 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.777+0000 7ff19b7fe640 1 -- 172.21.15.162:0/1592392746 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff19401a070 con 0x7ff1a40cff10 2024-04-25T03:09:52.780 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.777+0000 7ff19b7fe640 1 --2- 172.21.15.162:0/1592392746 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ff184067910 0x7ff184069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:52.780 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.777+0000 7ff199d9b640 1 --2- 172.21.15.162:0/1592392746 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ff184067910 0x7ff184069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:52.781 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.777+0000 7ff199d9b640 1 --2- 172.21.15.162:0/1592392746 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ff184067910 0x7ff184069dd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4153bd0 tx=0x7ff18c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:52.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.781+0000 7ff19b7fe640 1 -- 172.21.15.162:0/1592392746 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7ff194053d70 con 0x7ff1a40cff10 2024-04-25T03:09:52.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.781+0000 7ff19b7fe640 1 --2- 172.21.15.162:0/1592392746 >> [v2:172.21.15.162:6818/234337516,v1:172.21.15.162:6819/234337516] conn(0x7ff18406fc30 0x7ff1840720b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:52.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.781+0000 7ff19b7fe640 1 -- 172.21.15.162:0/1592392746 --> [v2:172.21.15.162:6818/234337516,v1:172.21.15.162:6819/234337516] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff184072780 con 0x7ff18406fc30 2024-04-25T03:09:52.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.781+0000 7ff19b7fe640 1 -- 172.21.15.162:0/1592392746 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff194051f70 con 0x7ff1a40cff10 2024-04-25T03:09:52.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.781+0000 7ff1a2d9d640 1 --2- 172.21.15.162:0/1592392746 >> [v2:172.21.15.162:6818/234337516,v1:172.21.15.162:6819/234337516] conn(0x7ff18406fc30 0x7ff1840720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:52.785 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.785+0000 7ff1a2d9d640 1 --2- 172.21.15.162:0/1592392746 >> [v2:172.21.15.162:6818/234337516,v1:172.21.15.162:6819/234337516] conn(0x7ff18406fc30 0x7ff1840720b0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:52.786 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.785+0000 7ff19b7fe640 1 -- 172.21.15.162:0/1592392746 <== osd.2 v2:172.21.15.162:6818/234337516 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff184072780 con 0x7ff18406fc30 2024-04-25T03:09:52.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.801+0000 7ff1a8beb640 1 -- 172.21.15.162:0/1592392746 --> [v2:172.21.15.162:6818/234337516,v1:172.21.15.162:6819/234337516] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff1a406def0 con 0x7ff18406fc30 2024-04-25T03:09:52.804 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.801+0000 7ff19b7fe640 1 -- 172.21.15.162:0/1592392746 <== osd.2 v2:172.21.15.162:6818/234337516 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff1a406def0 con 0x7ff18406fc30 2024-04-25T03:09:52.804 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-04-25T03:09:52.804 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T03:09:52.805 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-04-25T03:09:52.805 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.801+0000 7ff1a8beb640 1 -- 172.21.15.162:0/1592392746 >> [v2:172.21.15.162:6818/234337516,v1:172.21.15.162:6819/234337516] conn(0x7ff18406fc30 msgr2=0x7ff1840720b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.801+0000 7ff1a8beb640 1 --2- 172.21.15.162:0/1592392746 >> [v2:172.21.15.162:6818/234337516,v1:172.21.15.162:6819/234337516] conn(0x7ff18406fc30 0x7ff1840720b0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:52.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.801+0000 7ff1a8beb640 1 -- 172.21.15.162:0/1592392746 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ff184067910 msgr2=0x7ff184069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.801+0000 7ff1a8beb640 1 --2- 172.21.15.162:0/1592392746 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7ff184067910 0x7ff184069dd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4153bd0 tx=0x7ff18c009040 comp rx=0 tx=0).stop 2024-04-25T03:09:52.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.801+0000 7ff1a8beb640 1 -- 172.21.15.162:0/1592392746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a40cff10 msgr2=0x7ff1a40cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.801+0000 7ff1a8beb640 1 --2- 172.21.15.162:0/1592392746 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7ff1a40cff10 0x7ff1a40cf0d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff19400c4d0 tx=0x7ff19400c990 comp rx=0 tx=0).stop 2024-04-25T03:09:52.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.801+0000 7ff1a2d9d640 1 -- 172.21.15.162:0/1592392746 reap_dead start 2024-04-25T03:09:52.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.801+0000 7ff1a8beb640 1 -- 172.21.15.162:0/1592392746 shutdown_connections 2024-04-25T03:09:52.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.805+0000 7ff1a8beb640 1 -- 172.21.15.162:0/1592392746 >> 172.21.15.162:0/1592392746 conn(0x7ff1a4067190 msgr2=0x7ff1a40ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:52.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.805+0000 7ff1a8beb640 1 -- 172.21.15.162:0/1592392746 shutdown_connections 2024-04-25T03:09:52.806 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.805+0000 7ff1a8beb640 1 -- 172.21.15.162:0/1592392746 wait complete. 2024-04-25T03:09:52.825 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T03:09:52.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.941+0000 7fd815975640 1 Processor -- start 2024-04-25T03:09:52.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.941+0000 7fd815975640 1 -- start start 2024-04-25T03:09:52.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.941+0000 7fd815975640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd810154660 0x7fd8100c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:52.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.941+0000 7fd815975640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd81015a5d0 con 0x7fd81015e430 2024-04-25T03:09:52.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.941+0000 7fd815975640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd81015a8b0 con 0x7fd810072790 2024-04-25T03:09:52.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.941+0000 7fd815975640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fd81015e970 con 0x7fd810154660 2024-04-25T03:09:52.944 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.941+0000 7fd80effd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd810154660 0x7fd8100c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:52.944 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.941+0000 7fd80effd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fd810154660 0x7fd8100c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:46998/0 (socket says 172.21.15.162:46998) 2024-04-25T03:09:52.944 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.941+0000 7fd80effd640 1 -- 172.21.15.162:0/3289977224 learned_addr learned my addr 172.21.15.162:0/3289977224 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:52.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.945+0000 7fd80effd640 1 -- 172.21.15.162:0/3289977224 >> v1:172.21.15.179:6789/0 conn(0x7fd810072790 legacy=0x7fd8100c5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.945+0000 7fd80effd640 1 -- 172.21.15.162:0/3289977224 >> v1:172.21.15.162:6789/0 conn(0x7fd81015e430 legacy=0x7fd81006b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.948 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.945+0000 7fd80effd640 1 -- 172.21.15.162:0/3289977224 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd81015ab90 con 0x7fd810154660 2024-04-25T03:09:52.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.949+0000 7fd80effd640 1 --2- 172.21.15.162:0/3289977224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd810154660 0x7fd8100c9c70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd800009870 tx=0x7fd80001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3cc8fe4a6c64b2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:52.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.953+0000 7fd80dffb640 1 -- 172.21.15.162:0/3289977224 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8000b0070 con 0x7fd810154660 2024-04-25T03:09:52.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd80dffb640 1 -- 172.21.15.162:0/3289977224 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8000ab600 con 0x7fd810154660 2024-04-25T03:09:52.957 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd80dffb640 1 -- 172.21.15.162:0/3289977224 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8000ab9d0 con 0x7fd810154660 2024-04-25T03:09:52.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd815975640 1 -- 172.21.15.162:0/3289977224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd810154660 msgr2=0x7fd8100c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd815975640 1 --2- 172.21.15.162:0/3289977224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd810154660 0x7fd8100c9c70 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd800009870 tx=0x7fd80001c560 comp rx=0 tx=0).stop 2024-04-25T03:09:52.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd815975640 1 -- 172.21.15.162:0/3289977224 shutdown_connections 2024-04-25T03:09:52.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd815975640 1 --2- 172.21.15.162:0/3289977224 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd810154660 0x7fd8100c9c70 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:52.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd815975640 1 -- 172.21.15.162:0/3289977224 >> 172.21.15.162:0/3289977224 conn(0x7fd810070350 msgr2=0x7fd810070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:52.958 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd815975640 1 -- 172.21.15.162:0/3289977224 shutdown_connections 2024-04-25T03:09:52.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd815975640 1 -- 172.21.15.162:0/3289977224 wait complete. 2024-04-25T03:09:52.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd815975640 1 Processor -- start 2024-04-25T03:09:52.959 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd815975640 1 -- start start 2024-04-25T03:09:52.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd815975640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd810072790 0x7fd8100cd380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:52.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd815975640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd810154660 0x7fd81014d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:52.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd815975640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd81015e430 0x7fd810152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:52.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd815975640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fd810168760 con 0x7fd810072790 2024-04-25T03:09:52.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd815975640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fd8101685e0 con 0x7fd810154660 2024-04-25T03:09:52.960 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd815975640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fd8101688e0 con 0x7fd81015e430 2024-04-25T03:09:52.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd80effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd810072790 0x7fd8100cd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:52.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd80effd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd810072790 0x7fd8100cd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47012/0 (socket says 172.21.15.162:47012) 2024-04-25T03:09:52.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.957+0000 7fd80effd640 1 -- 172.21.15.162:0/92733630 learned_addr learned my addr 172.21.15.162:0/92733630 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:52.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.961+0000 7fd80f7fe640 1 --2- 172.21.15.162:0/92733630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd81015e430 0x7fd810152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:52.962 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.961+0000 7fd80e7fc640 1 --2- 172.21.15.162:0/92733630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd810154660 0x7fd81014d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:52.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.961+0000 7fd80effd640 1 -- 172.21.15.162:0/92733630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd81015e430 msgr2=0x7fd810152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.961+0000 7fd80effd640 1 --2- 172.21.15.162:0/92733630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd81015e430 0x7fd810152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:52.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.961+0000 7fd80effd640 1 -- 172.21.15.162:0/92733630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd810154660 msgr2=0x7fd81014d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:52.964 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.961+0000 7fd80effd640 1 --2- 172.21.15.162:0/92733630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd810154660 0x7fd81014d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:52.965 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.961+0000 7fd80effd640 1 -- 172.21.15.162:0/92733630 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd810150360 con 0x7fd810072790 2024-04-25T03:09:52.966 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.965+0000 7fd80effd640 1 --2- 172.21.15.162:0/92733630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd810072790 0x7fd8100cd380 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd800019170 tx=0x7fd800019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:52.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.969+0000 7fd7f7fff640 1 -- 172.21.15.162:0/92733630 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8000bb070 con 0x7fd810072790 2024-04-25T03:09:52.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.969+0000 7fd7f7fff640 1 -- 172.21.15.162:0/92733630 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8000b1040 con 0x7fd810072790 2024-04-25T03:09:52.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.969+0000 7fd7f7fff640 1 -- 172.21.15.162:0/92733630 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8000b0070 con 0x7fd810072790 2024-04-25T03:09:52.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.969+0000 7fd815975640 1 -- 172.21.15.162:0/92733630 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd810151a40 con 0x7fd810072790 2024-04-25T03:09:52.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.969+0000 7fd815975640 1 -- 172.21.15.162:0/92733630 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd81014ec60 con 0x7fd810072790 2024-04-25T03:09:52.971 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.969+0000 7fd815975640 1 -- 172.21.15.162:0/92733630 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd810068310 con 0x7fd810072790 2024-04-25T03:09:52.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.989+0000 7fd7f7fff640 1 -- 172.21.15.162:0/92733630 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd8000be070 con 0x7fd810072790 2024-04-25T03:09:52.992 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.989+0000 7fd7f7fff640 1 --2- 172.21.15.162:0/92733630 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fd7fc067910 0x7fd7fc069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:52.992 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.989+0000 7fd80e7fc640 1 --2- 172.21.15.162:0/92733630 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fd7fc067910 0x7fd7fc069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:52.992 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:52.989+0000 7fd80e7fc640 1 --2- 172.21.15.162:0/92733630 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fd7fc067910 0x7fd7fc069dd0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd81015dc00 tx=0x7fd804009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:53.274 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.273+0000 7fd7f7fff640 1 -- 172.21.15.162:0/92733630 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7fd8000edb70 con 0x7fd810072790 2024-04-25T03:09:53.275 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.273+0000 7fd7f7fff640 1 -- 172.21.15.162:0/92733630 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fd8000c5020 con 0x7fd810072790 2024-04-25T03:09:53.461 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.461+0000 7fd815975640 1 -- 172.21.15.162:0/92733630 --> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fd810157f40 con 0x7fd7fc067910 2024-04-25T03:09:53.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.461+0000 7fd7f7fff640 1 -- 172.21.15.162:0/92733630 <== mgr.4100 v2:172.21.15.162:6800/3960394531 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd810157f40 con 0x7fd7fc067910 2024-04-25T03:09:53.462 INFO:teuthology.orchestra.run.smithi162.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T03:09:53.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.461+0000 7fd815975640 1 -- 172.21.15.162:0/92733630 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fd7fc067910 msgr2=0x7fd7fc069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:53.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.461+0000 7fd815975640 1 --2- 172.21.15.162:0/92733630 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fd7fc067910 0x7fd7fc069dd0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd81015dc00 tx=0x7fd804009040 comp rx=0 tx=0).stop 2024-04-25T03:09:53.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.461+0000 7fd815975640 1 -- 172.21.15.162:0/92733630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd810072790 msgr2=0x7fd8100cd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:53.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.461+0000 7fd815975640 1 --2- 172.21.15.162:0/92733630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd810072790 0x7fd8100cd380 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd800019170 tx=0x7fd800019300 comp rx=0 tx=0).stop 2024-04-25T03:09:53.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.461+0000 7fd815975640 1 -- 172.21.15.162:0/92733630 shutdown_connections 2024-04-25T03:09:53.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.461+0000 7fd815975640 1 --2- 172.21.15.162:0/92733630 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fd81015e430 0x7fd810152670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:53.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.461+0000 7fd815975640 1 --2- 172.21.15.162:0/92733630 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fd810154660 0x7fd81014d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:53.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.461+0000 7fd815975640 1 --2- 172.21.15.162:0/92733630 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fd7fc067910 0x7fd7fc069dd0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:53.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.461+0000 7fd815975640 1 --2- 172.21.15.162:0/92733630 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fd810072790 0x7fd8100cd380 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:53.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.461+0000 7fd815975640 1 -- 172.21.15.162:0/92733630 >> 172.21.15.162:0/92733630 conn(0x7fd810070350 msgr2=0x7fd8100c66b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:53.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.461+0000 7fd815975640 1 -- 172.21.15.162:0/92733630 shutdown_connections 2024-04-25T03:09:53.465 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.461+0000 7fd815975640 1 -- 172.21.15.162:0/92733630 wait complete. 2024-04-25T03:09:53.482 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T03:09:53.482 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T03:09:53.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.605+0000 7fa8fe6ef640 1 Processor -- start 2024-04-25T03:09:53.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.605+0000 7fa8fe6ef640 1 -- start start 2024-04-25T03:09:53.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.605+0000 7fa8fe6ef640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f8154590 0x7fa8f8066fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:53.607 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.605+0000 7fa8fe6ef640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f806bcc0 con 0x7fa8f815d9e0 2024-04-25T03:09:53.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.605+0000 7fa8fe6ef640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8f806bf80 con 0x7fa8f80c5670 2024-04-25T03:09:53.608 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.605+0000 7fa8fe6ef640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f806c260 con 0x7fa8f8154590 2024-04-25T03:09:53.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.609+0000 7fa8f77fe640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7fa8f80c5670 0x7fa8f80c5ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:42294/0 (socket says 172.21.15.162:42294) 2024-04-25T03:09:53.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.609+0000 7fa8f77fe640 1 -- 172.21.15.162:0/4114801849 learned_addr learned my addr 172.21.15.162:0/4114801849 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:09:53.609 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.609+0000 7fa8f7fff640 1 --2- 172.21.15.162:0/4114801849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f8154590 0x7fa8f8066fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:53.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.613+0000 7fa8f7fff640 1 -- 172.21.15.162:0/4114801849 >> v1:172.21.15.179:6789/0 conn(0x7fa8f80c5670 legacy=0x7fa8f80c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:53.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.613+0000 7fa8f7fff640 1 -- 172.21.15.162:0/4114801849 >> v1:172.21.15.162:6789/0 conn(0x7fa8f815d9e0 legacy=0x7fa8f815de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:53.616 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.613+0000 7fa8f7fff640 1 -- 172.21.15.162:0/4114801849 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f806c540 con 0x7fa8f8154590 2024-04-25T03:09:53.622 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.621+0000 7fa8f7fff640 1 --2- 172.21.15.162:0/4114801849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f8154590 0x7fa8f8066fc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80097f0 tx=0x7fa8e801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ff8a748fb7d25bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:53.631 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.629+0000 7fa8f6ffd640 1 -- 172.21.15.162:0/4114801849 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80b5070 con 0x7fa8f8154590 2024-04-25T03:09:53.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.629+0000 7fa8f6ffd640 1 -- 172.21.15.162:0/4114801849 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e80a8990 con 0x7fa8f8154590 2024-04-25T03:09:53.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.629+0000 7fa8f6ffd640 1 -- 172.21.15.162:0/4114801849 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e80a8d60 con 0x7fa8f8154590 2024-04-25T03:09:53.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.633+0000 7fa8fe6ef640 1 -- 172.21.15.162:0/4114801849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f8154590 msgr2=0x7fa8f8066fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:53.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.633+0000 7fa8fe6ef640 1 --2- 172.21.15.162:0/4114801849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f8154590 0x7fa8f8066fc0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80097f0 tx=0x7fa8e801ec90 comp rx=0 tx=0).stop 2024-04-25T03:09:53.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.633+0000 7fa8fe6ef640 1 -- 172.21.15.162:0/4114801849 shutdown_connections 2024-04-25T03:09:53.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.633+0000 7fa8fe6ef640 1 --2- 172.21.15.162:0/4114801849 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f8154590 0x7fa8f8066fc0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:53.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.633+0000 7fa8fe6ef640 1 -- 172.21.15.162:0/4114801849 >> 172.21.15.162:0/4114801849 conn(0x7fa8f806fa80 msgr2=0x7fa8f806fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:53.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.633+0000 7fa8fe6ef640 1 -- 172.21.15.162:0/4114801849 shutdown_connections 2024-04-25T03:09:53.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.633+0000 7fa8fe6ef640 1 -- 172.21.15.162:0/4114801849 wait complete. 2024-04-25T03:09:53.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.633+0000 7fa8fe6ef640 1 Processor -- start 2024-04-25T03:09:53.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.633+0000 7fa8fe6ef640 1 -- start start 2024-04-25T03:09:53.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.633+0000 7fa8fe6ef640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8f80c5670 0x7fa8f80ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:53.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.633+0000 7fa8fe6ef640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f8154590 0x7fa8f80ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:53.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.633+0000 7fa8fe6ef640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8f815d9e0 0x7fa8f80ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:53.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.633+0000 7fa8fe6ef640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f80c4b70 con 0x7fa8f80c5670 2024-04-25T03:09:53.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.633+0000 7fa8fe6ef640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fa8f80c5150 con 0x7fa8f815d9e0 2024-04-25T03:09:53.636 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.633+0000 7fa8fe6ef640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fa8f8067500 con 0x7fa8f8154590 2024-04-25T03:09:53.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.637+0000 7fa8fcc8c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8f815d9e0 0x7fa8f80ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:53.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.637+0000 7fa8f77fe640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f8154590 0x7fa8f80ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:53.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.637+0000 7fa8fcc8c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8f815d9e0 0x7fa8f80ca900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3300/0 says I am v2:172.21.15.162:35264/0 (socket says 172.21.15.162:35264) 2024-04-25T03:09:53.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.637+0000 7fa8fcc8c640 1 -- 172.21.15.162:0/3373063133 learned_addr learned my addr 172.21.15.162:0/3373063133 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:53.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.645+0000 7fa8fcc8c640 1 -- 172.21.15.162:0/3373063133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f8154590 msgr2=0x7fa8f80ca3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:53.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.645+0000 7fa8fcc8c640 1 --2- 172.21.15.162:0/3373063133 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fa8f8154590 0x7fa8f80ca3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:53.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.645+0000 7fa8fcc8c640 1 -- 172.21.15.162:0/3373063133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8f80c5670 msgr2=0x7fa8f80ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:53.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.645+0000 7fa8fcc8c640 1 --2- 172.21.15.162:0/3373063133 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fa8f80c5670 0x7fa8f80ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:53.648 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.645+0000 7fa8fcc8c640 1 -- 172.21.15.162:0/3373063133 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f81e6320 con 0x7fa8f815d9e0 2024-04-25T03:09:53.655 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.653+0000 7fa8fcc8c640 1 --2- 172.21.15.162:0/3373063133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8f815d9e0 0x7fa8f80ca900 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000c780 tx=0x7fa8f000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:53.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.665+0000 7fa8f4ff9640 1 -- 172.21.15.162:0/3373063133 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0017070 con 0x7fa8f815d9e0 2024-04-25T03:09:53.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.665+0000 7fa8f4ff9640 1 -- 172.21.15.162:0/3373063133 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f0003db0 con 0x7fa8f815d9e0 2024-04-25T03:09:53.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.665+0000 7fa8f4ff9640 1 -- 172.21.15.162:0/3373063133 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f00052b0 con 0x7fa8f815d9e0 2024-04-25T03:09:53.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.665+0000 7fa8fe6ef640 1 -- 172.21.15.162:0/3373063133 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8f81e6600 con 0x7fa8f815d9e0 2024-04-25T03:09:53.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.665+0000 7fa8fe6ef640 1 -- 172.21.15.162:0/3373063133 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8f80c88a0 con 0x7fa8f815d9e0 2024-04-25T03:09:53.667 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.665+0000 7fa8fe6ef640 1 -- 172.21.15.162:0/3373063133 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa8f8075110 con 0x7fa8f815d9e0 2024-04-25T03:09:53.731 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.729+0000 7fa8f4ff9640 1 -- 172.21.15.162:0/3373063133 <== mon.1 v2:172.21.15.179:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa8f001a070 con 0x7fa8f815d9e0 2024-04-25T03:09:53.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.729+0000 7fa8f4ff9640 1 --2- 172.21.15.162:0/3373063133 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa8d8067940 0x7fa8d8069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:53.732 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.729+0000 7fa8f7fff640 1 --2- 172.21.15.162:0/3373063133 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa8d8067940 0x7fa8d8069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:53.733 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.733+0000 7fa8f7fff640 1 --2- 172.21.15.162:0/3373063133 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa8d8067940 0x7fa8d8069e00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80b2000 tx=0x7fa8e8004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:53.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.737+0000 7fa8f4ff9640 1 -- 172.21.15.162:0/3373063133 <== mon.1 v2:172.21.15.179:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7fa8f0053f70 con 0x7fa8f815d9e0 2024-04-25T03:09:53.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.737+0000 7fa8f4ff9640 1 --2- 172.21.15.162:0/3373063133 >> [v2:172.21.15.162:6826/1726903362,v1:172.21.15.162:6827/1726903362] conn(0x7fa8d806fcc0 0x7fa8d8072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:53.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.737+0000 7fa8f4ff9640 1 -- 172.21.15.162:0/3373063133 --> [v2:172.21.15.162:6826/1726903362,v1:172.21.15.162:6827/1726903362] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa8d8072810 con 0x7fa8d806fcc0 2024-04-25T03:09:53.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.737+0000 7fa8f77fe640 1 --2- 172.21.15.162:0/3373063133 >> [v2:172.21.15.162:6826/1726903362,v1:172.21.15.162:6827/1726903362] conn(0x7fa8d806fcc0 0x7fa8d8072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:53.739 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.737+0000 7fa8f77fe640 1 --2- 172.21.15.162:0/3373063133 >> [v2:172.21.15.162:6826/1726903362,v1:172.21.15.162:6827/1726903362] conn(0x7fa8d806fcc0 0x7fa8d8072140 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:53.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.741+0000 7fa8f4ff9640 1 -- 172.21.15.162:0/3373063133 <== osd.3 v2:172.21.15.162:6826/1726903362 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa8d8072810 con 0x7fa8d806fcc0 2024-04-25T03:09:53.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.757+0000 7fa8fe6ef640 1 -- 172.21.15.162:0/3373063133 --> [v2:172.21.15.162:6826/1726903362,v1:172.21.15.162:6827/1726903362] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa8f80ca120 con 0x7fa8d806fcc0 2024-04-25T03:09:53.760 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.757+0000 7fa8f4ff9640 1 -- 172.21.15.162:0/3373063133 <== osd.3 v2:172.21.15.162:6826/1726903362 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa8f80ca120 con 0x7fa8d806fcc0 2024-04-25T03:09:53.761 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-04-25T03:09:53.761 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T03:09:53.761 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-04-25T03:09:53.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.761+0000 7fa8fe6ef640 1 -- 172.21.15.162:0/3373063133 >> [v2:172.21.15.162:6826/1726903362,v1:172.21.15.162:6827/1726903362] conn(0x7fa8d806fcc0 msgr2=0x7fa8d8072140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:53.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.761+0000 7fa8fe6ef640 1 --2- 172.21.15.162:0/3373063133 >> [v2:172.21.15.162:6826/1726903362,v1:172.21.15.162:6827/1726903362] conn(0x7fa8d806fcc0 0x7fa8d8072140 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:53.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.761+0000 7fa8fe6ef640 1 -- 172.21.15.162:0/3373063133 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa8d8067940 msgr2=0x7fa8d8069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:53.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.761+0000 7fa8fe6ef640 1 --2- 172.21.15.162:0/3373063133 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fa8d8067940 0x7fa8d8069e00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa8e80b2000 tx=0x7fa8e8004740 comp rx=0 tx=0).stop 2024-04-25T03:09:53.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.761+0000 7fa8fe6ef640 1 -- 172.21.15.162:0/3373063133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8f815d9e0 msgr2=0x7fa8f80ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:53.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.761+0000 7fa8fe6ef640 1 --2- 172.21.15.162:0/3373063133 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fa8f815d9e0 0x7fa8f80ca900 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa8f000c780 tx=0x7fa8f000cc40 comp rx=0 tx=0).stop 2024-04-25T03:09:53.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.761+0000 7fa8fcc8c640 1 -- 172.21.15.162:0/3373063133 reap_dead start 2024-04-25T03:09:53.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.761+0000 7fa8fe6ef640 1 -- 172.21.15.162:0/3373063133 shutdown_connections 2024-04-25T03:09:53.762 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.761+0000 7fa8fe6ef640 1 -- 172.21.15.162:0/3373063133 >> 172.21.15.162:0/3373063133 conn(0x7fa8f806fa80 msgr2=0x7fa8f8152a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:53.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.761+0000 7fa8fe6ef640 1 -- 172.21.15.162:0/3373063133 shutdown_connections 2024-04-25T03:09:53.763 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.761+0000 7fa8fe6ef640 1 -- 172.21.15.162:0/3373063133 wait complete. 2024-04-25T03:09:53.786 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T03:09:53.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.917+0000 7f2a1ab7e640 1 Processor -- start 2024-04-25T03:09:53.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.917+0000 7f2a1ab7e640 1 -- start start 2024-04-25T03:09:53.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.917+0000 7f2a1ab7e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f2a140cd440 0x7f2a140cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:53.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.917+0000 7f2a1ab7e640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a1415b790 con 0x7f2a1415c230 2024-04-25T03:09:53.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.917+0000 7f2a1ab7e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a14158a60 con 0x7f2a141523e0 2024-04-25T03:09:53.919 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.917+0000 7f2a1ab7e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f2a1415c6a0 con 0x7f2a140cd440 2024-04-25T03:09:53.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.925+0000 7f2a1891a640 1 --1- >> v1:172.21.15.179:6789/0 conn(0x7f2a141523e0 0x7f2a141581a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.179:6789/0 says I am v1:172.21.15.162:42302/0 (socket says 172.21.15.162:42302) 2024-04-25T03:09:53.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.925+0000 7f2a1891a640 1 -- 172.21.15.162:0/3551646672 learned_addr learned my addr 172.21.15.162:0/3551646672 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:09:53.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.937+0000 7f2a137fe640 1 -- 172.21.15.162:0/3551646672 <== mon.1 v1:172.21.15.179:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2275185310 0 0) 0x7f2a14158a60 con 0x7f2a141523e0 2024-04-25T03:09:53.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.937+0000 7f2a137fe640 1 -- 172.21.15.162:0/3551646672 --> v1:172.21.15.179:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a00003530 con 0x7f2a141523e0 2024-04-25T03:09:53.949 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.945+0000 7f2a137fe640 1 -- 172.21.15.162:0/3551646672 <== mon.1 v1:172.21.15.179:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4033258556 0 0) 0x7f2a00003530 con 0x7f2a141523e0 2024-04-25T03:09:53.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.949+0000 7f2a137fe640 1 -- 172.21.15.162:0/3551646672 >> v2:172.21.15.162:3300/0 conn(0x7f2a140cd440 msgr2=0x7f2a140cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:53.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.949+0000 7f2a137fe640 1 --2- 172.21.15.162:0/3551646672 >> v2:172.21.15.162:3300/0 conn(0x7f2a140cd440 0x7f2a140cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:53.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.949+0000 7f2a137fe640 1 -- 172.21.15.162:0/3551646672 >> v1:172.21.15.162:6789/0 conn(0x7f2a1415c230 legacy=0x7f2a14071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:53.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.949+0000 7f2a137fe640 1 -- 172.21.15.162:0/3551646672 --> v1:172.21.15.179:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a14158d40 con 0x7f2a141523e0 2024-04-25T03:09:53.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.949+0000 7f2a137fe640 1 -- 172.21.15.162:0/3551646672 <== mon.1 v1:172.21.15.179:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7f2a0c001680 con 0x7f2a141523e0 2024-04-25T03:09:53.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.949+0000 7f2a137fe640 1 -- 172.21.15.162:0/3551646672 >> v1:172.21.15.179:6789/0 conn(0x7f2a141523e0 legacy=0x7f2a141581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:53.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.949+0000 7f2a137fe640 1 --2- 172.21.15.162:0/3551646672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a00003a10 0x7f2a00003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:53.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.949+0000 7f2a137fe640 1 --2- 172.21.15.162:0/3551646672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a00004810 0x7f2a00004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:53.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.949+0000 7f2a137fe640 1 --2- 172.21.15.162:0/3551646672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a000053d0 0x7f2a0000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:53.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.949+0000 7f2a137fe640 1 -- 172.21.15.162:0/3551646672 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1415c6a0 con 0x7f2a00004810 2024-04-25T03:09:53.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.949+0000 7f2a137fe640 1 -- 172.21.15.162:0/3551646672 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0000c230 con 0x7f2a00003a10 2024-04-25T03:09:53.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.949+0000 7f2a137fe640 1 -- 172.21.15.162:0/3551646672 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2a0000c430 con 0x7f2a000053d0 2024-04-25T03:09:53.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.949+0000 7f2a1911b640 1 --2- 172.21.15.162:0/3551646672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a000053d0 0x7f2a0000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:53.955 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.953+0000 7f2a1891a640 1 --2- 172.21.15.162:0/3551646672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a00003a10 0x7f2a00003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:53.956 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.953+0000 7f2a13fff640 1 --2- 172.21.15.162:0/3551646672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a00004810 0x7f2a00004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:53.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.957+0000 7f2a1911b640 1 -- 172.21.15.162:0/3551646672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a00003a10 msgr2=0x7f2a00003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:53.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.957+0000 7f2a1911b640 1 --2- 172.21.15.162:0/3551646672 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a00003a10 0x7f2a00003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:53.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.957+0000 7f2a1911b640 1 -- 172.21.15.162:0/3551646672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a00004810 msgr2=0x7f2a00004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:53.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.957+0000 7f2a1911b640 1 --2- 172.21.15.162:0/3551646672 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a00004810 0x7f2a00004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:53.961 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.957+0000 7f2a1911b640 1 -- 172.21.15.162:0/3551646672 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a00003530 con 0x7f2a000053d0 2024-04-25T03:09:53.963 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.961+0000 7f2a1911b640 1 -- 172.21.15.162:0/3551646672 reap_dead start 2024-04-25T03:09:53.970 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.969+0000 7f2a1911b640 1 --2- 172.21.15.162:0/3551646672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a000053d0 0x7f2a0000b9d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f29fc001650 tx=0x7f29fc01c300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4bfd9f58c00fbc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:53.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.977+0000 7f2a137fe640 1 -- 172.21.15.162:0/3551646672 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc001250 con 0x7f2a000053d0 2024-04-25T03:09:53.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.977+0000 7f2a137fe640 1 -- 172.21.15.162:0/3551646672 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29fc005270 con 0x7f2a000053d0 2024-04-25T03:09:53.979 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.977+0000 7f2a137fe640 1 -- 172.21.15.162:0/3551646672 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29fc003620 con 0x7f2a000053d0 2024-04-25T03:09:53.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.977+0000 7f2a1ab7e640 1 -- 172.21.15.162:0/3551646672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a000053d0 msgr2=0x7f2a0000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:53.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.977+0000 7f2a1ab7e640 1 --2- 172.21.15.162:0/3551646672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a000053d0 0x7f2a0000b9d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f29fc001650 tx=0x7f29fc01c300 comp rx=0 tx=0).stop 2024-04-25T03:09:53.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.977+0000 7f2a1ab7e640 1 -- 172.21.15.162:0/3551646672 shutdown_connections 2024-04-25T03:09:53.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.977+0000 7f2a1ab7e640 1 --2- 172.21.15.162:0/3551646672 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a000053d0 0x7f2a0000b9d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:53.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.977+0000 7f2a1ab7e640 1 -- 172.21.15.162:0/3551646672 >> 172.21.15.162:0/3551646672 conn(0x7f2a1406b810 msgr2=0x7f2a1406f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:53.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.977+0000 7f2a1ab7e640 1 -- 172.21.15.162:0/3551646672 shutdown_connections 2024-04-25T03:09:53.980 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.977+0000 7f2a1ab7e640 1 -- 172.21.15.162:0/3551646672 wait complete. 2024-04-25T03:09:53.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.981+0000 7f2a1ab7e640 1 Processor -- start 2024-04-25T03:09:53.981 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.981+0000 7f2a1ab7e640 1 -- start start 2024-04-25T03:09:53.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.981+0000 7f2a1ab7e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a000053d0 0x7f2a141540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:53.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.981+0000 7f2a1ab7e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a140c9fc0 0x7f2a140c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:53.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.981+0000 7f2a1ab7e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a1406cb70 0x7f2a140c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:53.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.981+0000 7f2a1ab7e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1415bd10 con 0x7f2a140c9fc0 2024-04-25T03:09:53.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.981+0000 7f2a1ab7e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1415ba30 con 0x7f2a1406cb70 2024-04-25T03:09:53.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.981+0000 7f2a1ab7e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f2a141527c0 con 0x7f2a000053d0 2024-04-25T03:09:53.982 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.981+0000 7f2a13fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a140c9fc0 0x7f2a140c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:53.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.981+0000 7f2a13fff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a140c9fc0 0x7f2a140c51b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47054/0 (socket says 172.21.15.162:47054) 2024-04-25T03:09:53.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.981+0000 7f2a13fff640 1 -- 172.21.15.162:0/3500914261 learned_addr learned my addr 172.21.15.162:0/3500914261 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:53.983 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.981+0000 7f2a1911b640 1 --2- 172.21.15.162:0/3500914261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a1406cb70 0x7f2a140c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:53.984 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.981+0000 7f2a1891a640 1 --2- 172.21.15.162:0/3500914261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a000053d0 0x7f2a141540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:53.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.985+0000 7f2a13fff640 1 -- 172.21.15.162:0/3500914261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a000053d0 msgr2=0x7f2a141540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:53.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.985+0000 7f2a13fff640 1 --2- 172.21.15.162:0/3500914261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a000053d0 0x7f2a141540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:53.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.985+0000 7f2a13fff640 1 -- 172.21.15.162:0/3500914261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a1406cb70 msgr2=0x7f2a140c8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:53.986 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.985+0000 7f2a13fff640 1 --2- 172.21.15.162:0/3500914261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a1406cb70 0x7f2a140c8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:53.987 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.985+0000 7f2a13fff640 1 -- 172.21.15.162:0/3500914261 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a14152b30 con 0x7f2a140c9fc0 2024-04-25T03:09:53.989 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.989+0000 7f2a13fff640 1 --2- 172.21.15.162:0/3500914261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a140c9fc0 0x7f2a140c51b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400edf0 tx=0x7f2a0400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:53.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.993+0000 7f2a117fa640 1 -- 172.21.15.162:0/3500914261 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04006e60 con 0x7f2a140c9fc0 2024-04-25T03:09:53.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.993+0000 7f2a117fa640 1 -- 172.21.15.162:0/3500914261 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a0400cd10 con 0x7f2a140c9fc0 2024-04-25T03:09:53.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.993+0000 7f2a117fa640 1 -- 172.21.15.162:0/3500914261 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a04016650 con 0x7f2a140c9fc0 2024-04-25T03:09:53.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.993+0000 7f2a1ab7e640 1 -- 172.21.15.162:0/3500914261 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a141f0a60 con 0x7f2a140c9fc0 2024-04-25T03:09:53.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.993+0000 7f2a1ab7e640 1 -- 172.21.15.162:0/3500914261 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a141530d0 con 0x7f2a140c9fc0 2024-04-25T03:09:53.994 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:53.993+0000 7f2a1ab7e640 1 -- 172.21.15.162:0/3500914261 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a14075110 con 0x7f2a140c9fc0 2024-04-25T03:09:54.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.013+0000 7f2a117fa640 1 -- 172.21.15.162:0/3500914261 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2a040167f0 con 0x7f2a140c9fc0 2024-04-25T03:09:54.014 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.013+0000 7f2a117fa640 1 --2- 172.21.15.162:0/3500914261 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f29f4067940 0x7f29f4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:54.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.013+0000 7f2a1891a640 1 --2- 172.21.15.162:0/3500914261 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f29f4067940 0x7f29f4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:54.015 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.013+0000 7f2a1891a640 1 --2- 172.21.15.162:0/3500914261 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f29f4067940 0x7f29f4069e00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0017f0 tx=0x7f2a0c0015e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:54.017 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.017+0000 7f2a117fa640 1 -- 172.21.15.162:0/3500914261 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f2a04054d30 con 0x7f2a140c9fc0 2024-04-25T03:09:54.287 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.285+0000 7f2a117fa640 1 -- 172.21.15.162:0/3500914261 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f2a04024070 con 0x7f2a140c9fc0 2024-04-25T03:09:54.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.473+0000 7f2a1ab7e640 1 -- 172.21.15.162:0/3500914261 --> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f2a140b2b10 con 0x7f29f4067940 2024-04-25T03:09:54.474 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.473+0000 7f2a117fa640 1 -- 172.21.15.162:0/3500914261 <== mgr.4100 v2:172.21.15.162:6800/3960394531 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2a140b2b10 con 0x7f29f4067940 2024-04-25T03:09:54.474 INFO:teuthology.orchestra.run.smithi162.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T03:09:54.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.473+0000 7f2a1ab7e640 1 -- 172.21.15.162:0/3500914261 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f29f4067940 msgr2=0x7f29f4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:54.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.473+0000 7f2a1ab7e640 1 --2- 172.21.15.162:0/3500914261 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f29f4067940 0x7f29f4069e00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0017f0 tx=0x7f2a0c0015e0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.473+0000 7f2a1ab7e640 1 -- 172.21.15.162:0/3500914261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a140c9fc0 msgr2=0x7f2a140c51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:54.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.473+0000 7f2a1ab7e640 1 --2- 172.21.15.162:0/3500914261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a140c9fc0 0x7f2a140c51b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400edf0 tx=0x7f2a0400eee0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.477 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.473+0000 7f2a1ab7e640 1 -- 172.21.15.162:0/3500914261 shutdown_connections 2024-04-25T03:09:54.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.473+0000 7f2a1ab7e640 1 --2- 172.21.15.162:0/3500914261 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f2a1406cb70 0x7f2a140c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.473+0000 7f2a1ab7e640 1 --2- 172.21.15.162:0/3500914261 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f29f4067940 0x7f29f4069e00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.473+0000 7f2a1ab7e640 1 --2- 172.21.15.162:0/3500914261 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f2a140c9fc0 0x7f2a140c51b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.473+0000 7f2a1ab7e640 1 --2- 172.21.15.162:0/3500914261 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f2a000053d0 0x7f2a141540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.473+0000 7f2a1ab7e640 1 -- 172.21.15.162:0/3500914261 >> 172.21.15.162:0/3500914261 conn(0x7f2a1406b810 msgr2=0x7f2a140cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:54.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.477+0000 7f2a1ab7e640 1 -- 172.21.15.162:0/3500914261 shutdown_connections 2024-04-25T03:09:54.478 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.477+0000 7f2a1ab7e640 1 -- 172.21.15.162:0/3500914261 wait complete. 2024-04-25T03:09:54.495 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T03:09:54.495 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T03:09:54.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.617+0000 7f04f4b0d640 1 Processor -- start 2024-04-25T03:09:54.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.617+0000 7f04f4b0d640 1 -- start start 2024-04-25T03:09:54.619 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.617+0000 7f04f4b0d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f00cc610 0x7f04f00cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:54.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.617+0000 7f04f4b0d640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f04f006c310 0x7f04f00cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:54.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.617+0000 7f04f4b0d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f04f00ca580 0x7f04f015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:54.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.617+0000 7f04f4b0d640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f04f00cf670 con 0x7f04f006c310 2024-04-25T03:09:54.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.617+0000 7f04f4b0d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f04f006c7b0 con 0x7f04f00ca580 2024-04-25T03:09:54.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.617+0000 7f04f4b0d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f04f006ca70 con 0x7f04f00cc610 2024-04-25T03:09:54.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.617+0000 7f04edd9b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f04f006c310 0x7f04f00cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:54.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.617+0000 7f04edd9b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f04f006c310 0x7f04f00cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47066/0 (socket says 172.21.15.162:47066) 2024-04-25T03:09:54.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.617+0000 7f04edd9b640 1 -- 172.21.15.162:0/1167228444 learned_addr learned my addr 172.21.15.162:0/1167228444 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:54.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.621+0000 7f04ee59c640 1 --2- 172.21.15.162:0/1167228444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f00cc610 0x7f04f00cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:54.621 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.621+0000 7f04eed9d640 1 --2- 172.21.15.162:0/1167228444 >> v2:172.21.15.179:3300/0 conn(0x7f04f00ca580 0x7f04f015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:54.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.621+0000 7f04edd9b640 1 -- 172.21.15.162:0/1167228444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f00cc610 msgr2=0x7f04f00cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:54.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.621+0000 7f04edd9b640 1 --2- 172.21.15.162:0/1167228444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f00cc610 0x7f04f00cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.621+0000 7f04edd9b640 1 -- 172.21.15.162:0/1167228444 >> v2:172.21.15.179:3300/0 conn(0x7f04f00ca580 msgr2=0x7f04f015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:54.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.621+0000 7f04edd9b640 1 --2- 172.21.15.162:0/1167228444 >> v2:172.21.15.179:3300/0 conn(0x7f04f00ca580 0x7f04f015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.623 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.621+0000 7f04edd9b640 1 -- 172.21.15.162:0/1167228444 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f006cd50 con 0x7f04f006c310 2024-04-25T03:09:54.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.625+0000 7f04edd9b640 1 --2- 172.21.15.162:0/1167228444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04f006c310 0x7f04f00cda00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f04f008d8b0 tx=0x7f04e401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed0fccc39c6ce69 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:54.629 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.629+0000 7f04ed59a640 1 -- 172.21.15.162:0/1167228444 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e40b5070 con 0x7f04f006c310 2024-04-25T03:09:54.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.629+0000 7f04ed59a640 1 -- 172.21.15.162:0/1167228444 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e40a89d0 con 0x7f04f006c310 2024-04-25T03:09:54.630 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.629+0000 7f04ed59a640 1 -- 172.21.15.162:0/1167228444 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e40a8da0 con 0x7f04f006c310 2024-04-25T03:09:54.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.629+0000 7f04f4b0d640 1 -- 172.21.15.162:0/1167228444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04f006c310 msgr2=0x7f04f00cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:54.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.629+0000 7f04f4b0d640 1 --2- 172.21.15.162:0/1167228444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04f006c310 0x7f04f00cda00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f04f008d8b0 tx=0x7f04e401ed10 comp rx=0 tx=0).stop 2024-04-25T03:09:54.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.629+0000 7f04f4b0d640 1 -- 172.21.15.162:0/1167228444 shutdown_connections 2024-04-25T03:09:54.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.629+0000 7f04f4b0d640 1 --2- 172.21.15.162:0/1167228444 >> v2:172.21.15.179:3300/0 conn(0x7f04f00ca580 0x7f04f015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.629+0000 7f04f4b0d640 1 --2- 172.21.15.162:0/1167228444 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04f006c310 0x7f04f00cda00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.629+0000 7f04f4b0d640 1 --2- 172.21.15.162:0/1167228444 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f00cc610 0x7f04f00cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.629+0000 7f04f4b0d640 1 -- 172.21.15.162:0/1167228444 >> 172.21.15.162:0/1167228444 conn(0x7f04f00b1710 msgr2=0x7f04f00b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:54.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.629+0000 7f04f4b0d640 1 -- 172.21.15.162:0/1167228444 shutdown_connections 2024-04-25T03:09:54.632 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.629+0000 7f04f4b0d640 1 -- 172.21.15.162:0/1167228444 wait complete. 2024-04-25T03:09:54.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.629+0000 7f04f4b0d640 1 Processor -- start 2024-04-25T03:09:54.633 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.629+0000 7f04f4b0d640 1 -- start start 2024-04-25T03:09:54.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.633+0000 7f04f4b0d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f006c310 0x7f04f015cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:54.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.633+0000 7f04f4b0d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04f00ca580 0x7f04f0157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:54.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.633+0000 7f04f4b0d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f00cc610 0x7f04f01f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:54.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.633+0000 7f04f4b0d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f04f015e010 con 0x7f04f00ca580 2024-04-25T03:09:54.634 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.633+0000 7f04f4b0d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f04f015dd30 con 0x7f04f006c310 2024-04-25T03:09:54.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.633+0000 7f04f4b0d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f04f015e2f0 con 0x7f04f00cc610 2024-04-25T03:09:54.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.633+0000 7f04edd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04f00ca580 0x7f04f0157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:54.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.633+0000 7f04edd9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04f00ca580 0x7f04f0157580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47082/0 (socket says 172.21.15.162:47082) 2024-04-25T03:09:54.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.633+0000 7f04edd9b640 1 -- 172.21.15.162:0/508977964 learned_addr learned my addr 172.21.15.162:0/508977964 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:54.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.633+0000 7f04eed9d640 1 --2- 172.21.15.162:0/508977964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f00cc610 0x7f04f01f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:54.635 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.633+0000 7f04ee59c640 1 --2- 172.21.15.162:0/508977964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f006c310 0x7f04f015cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:54.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.637+0000 7f04edd9b640 1 -- 172.21.15.162:0/508977964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f00cc610 msgr2=0x7f04f01f2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:54.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.637+0000 7f04edd9b640 1 --2- 172.21.15.162:0/508977964 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f04f00cc610 0x7f04f01f2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.637+0000 7f04edd9b640 1 -- 172.21.15.162:0/508977964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f006c310 msgr2=0x7f04f015cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:54.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.637+0000 7f04edd9b640 1 --2- 172.21.15.162:0/508977964 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f04f006c310 0x7f04f015cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.637+0000 7f04edd9b640 1 -- 172.21.15.162:0/508977964 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f01f1b20 con 0x7f04f00ca580 2024-04-25T03:09:54.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.637+0000 7f04edd9b640 1 --2- 172.21.15.162:0/508977964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04f00ca580 0x7f04f0157580 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f04e40b3040 tx=0x7f04e401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:54.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.641+0000 7f04deffd640 1 -- 172.21.15.162:0/508977964 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e40c0070 con 0x7f04f00ca580 2024-04-25T03:09:54.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.641+0000 7f04f4b0d640 1 -- 172.21.15.162:0/508977964 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f0156200 con 0x7f04f00ca580 2024-04-25T03:09:54.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.641+0000 7f04f4b0d640 1 -- 172.21.15.162:0/508977964 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f01567c0 con 0x7f04f00ca580 2024-04-25T03:09:54.643 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.641+0000 7f04f4b0d640 1 -- 172.21.15.162:0/508977964 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f04f0068310 con 0x7f04f00ca580 2024-04-25T03:09:54.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.641+0000 7f04deffd640 1 -- 172.21.15.162:0/508977964 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04f0068310 con 0x7f04f00ca580 2024-04-25T03:09:54.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.641+0000 7f04deffd640 1 -- 172.21.15.162:0/508977964 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e40b5040 con 0x7f04f00ca580 2024-04-25T03:09:54.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.665+0000 7f04deffd640 1 -- 172.21.15.162:0/508977964 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f04e40c3070 con 0x7f04f00ca580 2024-04-25T03:09:54.665 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.665+0000 7f04deffd640 1 --2- 172.21.15.162:0/508977964 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f04d00678f0 0x7f04d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:54.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.665+0000 7f04ee59c640 1 --2- 172.21.15.162:0/508977964 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f04d00678f0 0x7f04d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:54.666 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.665+0000 7f04ee59c640 1 --2- 172.21.15.162:0/508977964 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f04d00678f0 0x7f04d0069db0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f04e00079e0 tx=0x7f04e0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:54.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.665+0000 7f04deffd640 1 -- 172.21.15.162:0/508977964 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f04e40f1200 con 0x7f04f00ca580 2024-04-25T03:09:54.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.665+0000 7f04deffd640 1 --2- 172.21.15.162:0/508977964 >> [v2:172.21.15.179:6816/3338082657,v1:172.21.15.179:6817/3338082657] conn(0x7f04d006fc70 0x7f04d00720f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:54.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.665+0000 7f04deffd640 1 -- 172.21.15.162:0/508977964 --> [v2:172.21.15.179:6816/3338082657,v1:172.21.15.179:6817/3338082657] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04e40aaea0 con 0x7f04d006fc70 2024-04-25T03:09:54.668 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.665+0000 7f04deffd640 1 -- 172.21.15.162:0/508977964 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f04e40ef400 con 0x7f04f00ca580 2024-04-25T03:09:54.669 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.665+0000 7f04eed9d640 1 --2- 172.21.15.162:0/508977964 >> [v2:172.21.15.179:6816/3338082657,v1:172.21.15.179:6817/3338082657] conn(0x7f04d006fc70 0x7f04d00720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:54.669 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.669+0000 7f04eed9d640 1 --2- 172.21.15.162:0/508977964 >> [v2:172.21.15.179:6816/3338082657,v1:172.21.15.179:6817/3338082657] conn(0x7f04d006fc70 0x7f04d00720f0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:54.671 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.669+0000 7f04deffd640 1 -- 172.21.15.162:0/508977964 <== osd.4 v2:172.21.15.179:6816/3338082657 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f04e40aaea0 con 0x7f04d006fc70 2024-04-25T03:09:54.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.685+0000 7f04f4b0d640 1 -- 172.21.15.162:0/508977964 --> [v2:172.21.15.179:6816/3338082657,v1:172.21.15.179:6817/3338082657] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f04f00cf800 con 0x7f04d006fc70 2024-04-25T03:09:54.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.685+0000 7f04deffd640 1 -- 172.21.15.162:0/508977964 <== osd.4 v2:172.21.15.179:6816/3338082657 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f04f00cf800 con 0x7f04d006fc70 2024-04-25T03:09:54.688 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-04-25T03:09:54.688 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T03:09:54.688 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-04-25T03:09:54.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.685+0000 7f04f4b0d640 1 -- 172.21.15.162:0/508977964 >> [v2:172.21.15.179:6816/3338082657,v1:172.21.15.179:6817/3338082657] conn(0x7f04d006fc70 msgr2=0x7f04d00720f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:54.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.685+0000 7f04f4b0d640 1 --2- 172.21.15.162:0/508977964 >> [v2:172.21.15.179:6816/3338082657,v1:172.21.15.179:6817/3338082657] conn(0x7f04d006fc70 0x7f04d00720f0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.685+0000 7f04f4b0d640 1 -- 172.21.15.162:0/508977964 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f04d00678f0 msgr2=0x7f04d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:54.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.685+0000 7f04f4b0d640 1 --2- 172.21.15.162:0/508977964 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f04d00678f0 0x7f04d0069db0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f04e00079e0 tx=0x7f04e0008040 comp rx=0 tx=0).stop 2024-04-25T03:09:54.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.685+0000 7f04f4b0d640 1 -- 172.21.15.162:0/508977964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04f00ca580 msgr2=0x7f04f0157580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:54.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.685+0000 7f04f4b0d640 1 --2- 172.21.15.162:0/508977964 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f04f00ca580 0x7f04f0157580 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f04e40b3040 tx=0x7f04e401bab0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.685+0000 7f04eed9d640 1 -- 172.21.15.162:0/508977964 reap_dead start 2024-04-25T03:09:54.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.685+0000 7f04f4b0d640 1 -- 172.21.15.162:0/508977964 shutdown_connections 2024-04-25T03:09:54.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.685+0000 7f04f4b0d640 1 -- 172.21.15.162:0/508977964 >> 172.21.15.162:0/508977964 conn(0x7f04f00b1710 msgr2=0x7f04f015b800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:54.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.685+0000 7f04f4b0d640 1 -- 172.21.15.162:0/508977964 shutdown_connections 2024-04-25T03:09:54.689 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.685+0000 7f04f4b0d640 1 -- 172.21.15.162:0/508977964 wait complete. 2024-04-25T03:09:54.706 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T03:09:54.822 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.821+0000 7f527e460640 1 Processor -- start 2024-04-25T03:09:54.822 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.821+0000 7f527e460640 1 -- start start 2024-04-25T03:09:54.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.821+0000 7f527e460640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5278162960 0x7f52780c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:54.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.821+0000 7f527e460640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f527815f1f0 0x7f52780cc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:54.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.821+0000 7f527e460640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5278072dc0 con 0x7f5278158a30 2024-04-25T03:09:54.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.821+0000 7f527e460640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f52780c8010 con 0x7f5278162960 2024-04-25T03:09:54.823 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.821+0000 7f527e460640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f52781624d0 con 0x7f527815f1f0 2024-04-25T03:09:54.824 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.821+0000 7f52777fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5278162960 0x7f52780c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:54.824 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.821+0000 7f52777fe640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f5278162960 0x7f52780c7ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47088/0 (socket says 172.21.15.162:47088) 2024-04-25T03:09:54.824 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.821+0000 7f52777fe640 1 -- 172.21.15.162:0/3663365417 learned_addr learned my addr 172.21.15.162:0/3663365417 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:54.824 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.821+0000 7f527c9fd640 1 --2- 172.21.15.162:0/3663365417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f527815f1f0 0x7f52780cc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:54.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.825+0000 7f52777fe640 1 -- 172.21.15.162:0/3663365417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f527815f1f0 msgr2=0x7f52780cc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:54.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.825+0000 7f52777fe640 1 --2- 172.21.15.162:0/3663365417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f527815f1f0 0x7f52780cc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.825+0000 7f52777fe640 1 -- 172.21.15.162:0/3663365417 >> v1:172.21.15.162:6789/0 conn(0x7f5278158a30 legacy=0x7f527806b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:54.827 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.825+0000 7f52777fe640 1 -- 172.21.15.162:0/3663365417 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5278073080 con 0x7f5278162960 2024-04-25T03:09:54.831 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.829+0000 7f52777fe640 1 --2- 172.21.15.162:0/3663365417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5278162960 0x7f52780c7ad0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f526c009870 tx=0x7f526c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19fc46c39b24e89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:54.833 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.833+0000 7f5276ffd640 1 -- 172.21.15.162:0/3663365417 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c0b2070 con 0x7f5278162960 2024-04-25T03:09:54.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.833+0000 7f5276ffd640 1 -- 172.21.15.162:0/3663365417 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f526c0a9070 con 0x7f5278162960 2024-04-25T03:09:54.835 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.833+0000 7f5276ffd640 1 -- 172.21.15.162:0/3663365417 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c0ad880 con 0x7f5278162960 2024-04-25T03:09:54.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.833+0000 7f527e460640 1 -- 172.21.15.162:0/3663365417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5278162960 msgr2=0x7f52780c7ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:54.836 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.833+0000 7f527e460640 1 --2- 172.21.15.162:0/3663365417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5278162960 0x7f52780c7ad0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f526c009870 tx=0x7f526c01c560 comp rx=0 tx=0).stop 2024-04-25T03:09:54.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.833+0000 7f527e460640 1 -- 172.21.15.162:0/3663365417 shutdown_connections 2024-04-25T03:09:54.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.833+0000 7f527e460640 1 --2- 172.21.15.162:0/3663365417 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f527815f1f0 0x7f52780cc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.833+0000 7f527e460640 1 --2- 172.21.15.162:0/3663365417 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5278162960 0x7f52780c7ad0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.833+0000 7f527e460640 1 -- 172.21.15.162:0/3663365417 >> 172.21.15.162:0/3663365417 conn(0x7f52780703c0 msgr2=0x7f52780707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:54.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.833+0000 7f527e460640 1 -- 172.21.15.162:0/3663365417 shutdown_connections 2024-04-25T03:09:54.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.833+0000 7f527e460640 1 -- 172.21.15.162:0/3663365417 wait complete. 2024-04-25T03:09:54.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.837+0000 7f527e460640 1 Processor -- start 2024-04-25T03:09:54.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.837+0000 7f527e460640 1 -- start start 2024-04-25T03:09:54.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.837+0000 7f527e460640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5278158a30 0x7f52781fbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:54.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.837+0000 7f527e460640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f527815f1f0 0x7f5278155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:54.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.837+0000 7f527e460640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5278158350 0x7f52781f8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:54.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.837+0000 7f527e460640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f527816b890 con 0x7f5278158350 2024-04-25T03:09:54.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.837+0000 7f527e460640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f527815f600 con 0x7f5278158a30 2024-04-25T03:09:54.839 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.837+0000 7f527e460640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f527816ba10 con 0x7f527815f1f0 2024-04-25T03:09:54.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.837+0000 7f527c9fd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5278158350 0x7f52781f8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:54.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.837+0000 7f527c9fd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5278158350 0x7f52781f8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47104/0 (socket says 172.21.15.162:47104) 2024-04-25T03:09:54.840 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.837+0000 7f527c9fd640 1 -- 172.21.15.162:0/2546023706 learned_addr learned my addr 172.21.15.162:0/2546023706 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:54.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.837+0000 7f5277fff640 1 --2- 172.21.15.162:0/2546023706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5278158a30 0x7f52781fbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:54.841 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.841+0000 7f52777fe640 1 --2- 172.21.15.162:0/2546023706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f527815f1f0 0x7f5278155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:54.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.841+0000 7f527c9fd640 1 -- 172.21.15.162:0/2546023706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f527815f1f0 msgr2=0x7f5278155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:54.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.841+0000 7f527c9fd640 1 --2- 172.21.15.162:0/2546023706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f527815f1f0 0x7f5278155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.841+0000 7f527c9fd640 1 -- 172.21.15.162:0/2546023706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5278158a30 msgr2=0x7f52781fbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:54.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.841+0000 7f527c9fd640 1 --2- 172.21.15.162:0/2546023706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5278158a30 0x7f52781fbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:54.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.841+0000 7f527c9fd640 1 -- 172.21.15.162:0/2546023706 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52781548f0 con 0x7f5278158350 2024-04-25T03:09:54.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.849+0000 7f527c9fd640 1 --2- 172.21.15.162:0/2546023706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5278158350 0x7f52781f8430 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5270009d30 tx=0x7f527000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:54.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.853+0000 7f5274ff9640 1 -- 172.21.15.162:0/2546023706 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5270018020 con 0x7f5278158350 2024-04-25T03:09:54.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.853+0000 7f5274ff9640 1 -- 172.21.15.162:0/2546023706 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5270014480 con 0x7f5278158350 2024-04-25T03:09:54.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.853+0000 7f5274ff9640 1 -- 172.21.15.162:0/2546023706 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5270014870 con 0x7f5278158350 2024-04-25T03:09:54.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.853+0000 7f527e460640 1 -- 172.21.15.162:0/2546023706 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52781573e0 con 0x7f5278158350 2024-04-25T03:09:54.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.853+0000 7f527e460640 1 -- 172.21.15.162:0/2546023706 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52781579a0 con 0x7f5278158350 2024-04-25T03:09:54.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.857+0000 7f527e460640 1 -- 172.21.15.162:0/2546023706 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52781f7d00 con 0x7f5278158350 2024-04-25T03:09:54.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.877+0000 7f5274ff9640 1 -- 172.21.15.162:0/2546023706 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f527001b020 con 0x7f5278158350 2024-04-25T03:09:54.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.877+0000 7f5274ff9640 1 --2- 172.21.15.162:0/2546023706 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f52640678f0 0x7f5264069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:54.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.877+0000 7f5277fff640 1 --2- 172.21.15.162:0/2546023706 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f52640678f0 0x7f5264069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:54.879 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:54.877+0000 7f5277fff640 1 --2- 172.21.15.162:0/2546023706 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f52640678f0 0x7f5264069db0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5268001810 tx=0x7f5268009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:55.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.165+0000 7f5274ff9640 1 -- 172.21.15.162:0/2546023706 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f5270055200 con 0x7f5278158350 2024-04-25T03:09:55.167 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.165+0000 7f5274ff9640 1 -- 172.21.15.162:0/2546023706 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f5270022070 con 0x7f5278158350 2024-04-25T03:09:55.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.333+0000 7f527e460640 1 -- 172.21.15.162:0/2546023706 --> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f5278075110 con 0x7f52640678f0 2024-04-25T03:09:55.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.333+0000 7f5274ff9640 1 -- 172.21.15.162:0/2546023706 <== mgr.4100 v2:172.21.15.162:6800/3960394531 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5278075110 con 0x7f52640678f0 2024-04-25T03:09:55.336 INFO:teuthology.orchestra.run.smithi162.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T03:09:55.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.337+0000 7f527e460640 1 -- 172.21.15.162:0/2546023706 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f52640678f0 msgr2=0x7f5264069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:55.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.337+0000 7f527e460640 1 --2- 172.21.15.162:0/2546023706 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f52640678f0 0x7f5264069db0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5268001810 tx=0x7f5268009040 comp rx=0 tx=0).stop 2024-04-25T03:09:55.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.337+0000 7f527e460640 1 -- 172.21.15.162:0/2546023706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5278158350 msgr2=0x7f52781f8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:55.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.337+0000 7f527e460640 1 --2- 172.21.15.162:0/2546023706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5278158350 0x7f52781f8430 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5270009d30 tx=0x7f527000c490 comp rx=0 tx=0).stop 2024-04-25T03:09:55.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.337+0000 7f527e460640 1 -- 172.21.15.162:0/2546023706 shutdown_connections 2024-04-25T03:09:55.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.337+0000 7f527e460640 1 --2- 172.21.15.162:0/2546023706 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f52640678f0 0x7f5264069db0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:55.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.337+0000 7f527e460640 1 --2- 172.21.15.162:0/2546023706 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f5278158350 0x7f52781f8430 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:55.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.337+0000 7f527e460640 1 --2- 172.21.15.162:0/2546023706 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f527815f1f0 0x7f5278155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:55.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.337+0000 7f527e460640 1 --2- 172.21.15.162:0/2546023706 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f5278158a30 0x7f52781fbc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:55.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.337+0000 7f527e460640 1 -- 172.21.15.162:0/2546023706 >> 172.21.15.162:0/2546023706 conn(0x7f52780703c0 msgr2=0x7f52780c5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:55.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.337+0000 7f527e460640 1 -- 172.21.15.162:0/2546023706 shutdown_connections 2024-04-25T03:09:55.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.337+0000 7f527e460640 1 -- 172.21.15.162:0/2546023706 wait complete. 2024-04-25T03:09:55.358 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T03:09:55.358 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T03:09:55.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.485+0000 7fe88ce5b640 1 Processor -- start 2024-04-25T03:09:55.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.485+0000 7fe88ce5b640 1 -- start start 2024-04-25T03:09:55.488 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.485+0000 7fe88ce5b640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe8880ce9e0 0x7fe88806dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:55.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.485+0000 7fe88ce5b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8880ca830 con 0x7fe888154800 2024-04-25T03:09:55.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.485+0000 7fe88ce5b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8880cab10 con 0x7fe8880ce490 2024-04-25T03:09:55.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.485+0000 7fe88ce5b640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fe88815e1e0 con 0x7fe8880ce9e0 2024-04-25T03:09:55.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.489+0000 7fe88659c640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe888154800 0x7fe88815dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:54106/0 (socket says 172.21.15.162:54106) 2024-04-25T03:09:55.489 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.489+0000 7fe88659c640 1 -- 172.21.15.162:0/2560545601 learned_addr learned my addr 172.21.15.162:0/2560545601 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:09:55.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.489+0000 7fe88559a640 1 -- 172.21.15.162:0/2560545601 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3550340390 0 0) 0x7fe8880ca830 con 0x7fe888154800 2024-04-25T03:09:55.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.489+0000 7fe88559a640 1 -- 172.21.15.162:0/2560545601 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe874003530 con 0x7fe888154800 2024-04-25T03:09:55.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.489+0000 7fe886d9d640 1 --2- 172.21.15.162:0/2560545601 >> v2:172.21.15.179:3300/0 conn(0x7fe8880ce9e0 0x7fe88806dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:55.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.493+0000 7fe886d9d640 1 -- 172.21.15.162:0/2560545601 >> v1:172.21.15.179:6789/0 conn(0x7fe8880ce490 legacy=0x7fe88806d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:55.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.493+0000 7fe886d9d640 1 -- 172.21.15.162:0/2560545601 >> v1:172.21.15.162:6789/0 conn(0x7fe888154800 legacy=0x7fe88815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:55.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.493+0000 7fe886d9d640 1 -- 172.21.15.162:0/2560545601 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8880cf0d0 con 0x7fe8880ce9e0 2024-04-25T03:09:55.505 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.505+0000 7fe886d9d640 1 --2- 172.21.15.162:0/2560545601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8880ce9e0 0x7fe88806dca0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe880009d90 tx=0x7fe88001c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f344e24311b57c09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:55.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.513+0000 7fe88559a640 1 -- 172.21.15.162:0/2560545601 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8800b2070 con 0x7fe8880ce9e0 2024-04-25T03:09:55.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.513+0000 7fe88559a640 1 -- 172.21.15.162:0/2560545601 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8800a57a0 con 0x7fe8880ce9e0 2024-04-25T03:09:55.516 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.513+0000 7fe88559a640 1 -- 172.21.15.162:0/2560545601 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8800a5b70 con 0x7fe8880ce9e0 2024-04-25T03:09:55.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.513+0000 7fe88ce5b640 1 -- 172.21.15.162:0/2560545601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8880ce9e0 msgr2=0x7fe88806dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:55.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.513+0000 7fe88ce5b640 1 --2- 172.21.15.162:0/2560545601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8880ce9e0 0x7fe88806dca0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe880009d90 tx=0x7fe88001c8e0 comp rx=0 tx=0).stop 2024-04-25T03:09:55.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.513+0000 7fe88ce5b640 1 -- 172.21.15.162:0/2560545601 shutdown_connections 2024-04-25T03:09:55.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.513+0000 7fe88ce5b640 1 --2- 172.21.15.162:0/2560545601 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8880ce9e0 0x7fe88806dca0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:55.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.513+0000 7fe88ce5b640 1 -- 172.21.15.162:0/2560545601 >> 172.21.15.162:0/2560545601 conn(0x7fe8880671c0 msgr2=0x7fe8880675d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:55.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.517+0000 7fe88ce5b640 1 -- 172.21.15.162:0/2560545601 shutdown_connections 2024-04-25T03:09:55.517 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.517+0000 7fe88ce5b640 1 -- 172.21.15.162:0/2560545601 wait complete. 2024-04-25T03:09:55.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.517+0000 7fe88ce5b640 1 Processor -- start 2024-04-25T03:09:55.518 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.517+0000 7fe88ce5b640 1 -- start start 2024-04-25T03:09:55.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.517+0000 7fe88ce5b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8880ce490 0x7fe8881f3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:55.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.517+0000 7fe88ce5b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8880ce9e0 0x7fe888155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:55.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.517+0000 7fe88ce5b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe888154800 0x7fe888152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:55.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.517+0000 7fe88ce5b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe888168630 con 0x7fe8880ce9e0 2024-04-25T03:09:55.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.517+0000 7fe88ce5b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe8880cf440 con 0x7fe8880ce490 2024-04-25T03:09:55.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.517+0000 7fe88ce5b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe8881687b0 con 0x7fe888154800 2024-04-25T03:09:55.520 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.517+0000 7fe885d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8880ce9e0 0x7fe888155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:55.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.517+0000 7fe88659c640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8880ce490 0x7fe8881f3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:55.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.517+0000 7fe885d9b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8880ce9e0 0x7fe888155110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47110/0 (socket says 172.21.15.162:47110) 2024-04-25T03:09:55.521 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.517+0000 7fe885d9b640 1 -- 172.21.15.162:0/1179919302 learned_addr learned my addr 172.21.15.162:0/1179919302 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:55.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.521+0000 7fe885d9b640 1 -- 172.21.15.162:0/1179919302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe888154800 msgr2=0x7fe888152430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:55.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.521+0000 7fe885d9b640 1 --2- 172.21.15.162:0/1179919302 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe888154800 0x7fe888152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:55.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.521+0000 7fe885d9b640 1 -- 172.21.15.162:0/1179919302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8880ce490 msgr2=0x7fe8881f3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:55.524 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.521+0000 7fe885d9b640 1 --2- 172.21.15.162:0/1179919302 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe8880ce490 0x7fe8881f3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:55.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.521+0000 7fe885d9b640 1 -- 172.21.15.162:0/1179919302 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8880c9bd0 con 0x7fe8880ce9e0 2024-04-25T03:09:55.527 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.525+0000 7fe885d9b640 1 --2- 172.21.15.162:0/1179919302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8880ce9e0 0x7fe888155110 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe87000c3a0 tx=0x7fe87000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:55.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.529+0000 7fe87effd640 1 -- 172.21.15.162:0/1179919302 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8700052d0 con 0x7fe8880ce9e0 2024-04-25T03:09:55.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.529+0000 7fe87effd640 1 -- 172.21.15.162:0/1179919302 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe870005470 con 0x7fe8880ce9e0 2024-04-25T03:09:55.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.529+0000 7fe87effd640 1 -- 172.21.15.162:0/1179919302 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe870007260 con 0x7fe8880ce9e0 2024-04-25T03:09:55.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.529+0000 7fe88ce5b640 1 -- 172.21.15.162:0/1179919302 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe888151670 con 0x7fe8880ce9e0 2024-04-25T03:09:55.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.529+0000 7fe88ce5b640 1 -- 172.21.15.162:0/1179919302 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe888151c30 con 0x7fe8880ce9e0 2024-04-25T03:09:55.532 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.529+0000 7fe88ce5b640 1 -- 172.21.15.162:0/1179919302 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe888068310 con 0x7fe8880ce9e0 2024-04-25T03:09:55.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.549+0000 7fe87effd640 1 -- 172.21.15.162:0/1179919302 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe870007400 con 0x7fe8880ce9e0 2024-04-25T03:09:55.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.549+0000 7fe87effd640 1 --2- 172.21.15.162:0/1179919302 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe868067940 0x7fe868069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:55.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.553+0000 7fe88659c640 1 --2- 172.21.15.162:0/1179919302 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe868067940 0x7fe868069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:55.553 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.553+0000 7fe88659c640 1 --2- 172.21.15.162:0/1179919302 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe868067940 0x7fe868069e00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe878007fd0 tx=0x7fe878009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:55.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.557+0000 7fe87effd640 1 -- 172.21.15.162:0/1179919302 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7fe870053de0 con 0x7fe8880ce9e0 2024-04-25T03:09:55.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.557+0000 7fe87effd640 1 --2- 172.21.15.162:0/1179919302 >> [v2:172.21.15.179:6824/4129338239,v1:172.21.15.179:6825/4129338239] conn(0x7fe86806fc60 0x7fe8680720e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:55.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.557+0000 7fe87effd640 1 -- 172.21.15.162:0/1179919302 --> [v2:172.21.15.179:6824/4129338239,v1:172.21.15.179:6825/4129338239] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8680727b0 con 0x7fe86806fc60 2024-04-25T03:09:55.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.557+0000 7fe87effd640 1 -- 172.21.15.162:0/1179919302 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe870051fe0 con 0x7fe8880ce9e0 2024-04-25T03:09:55.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.557+0000 7fe886d9d640 1 --2- 172.21.15.162:0/1179919302 >> [v2:172.21.15.179:6824/4129338239,v1:172.21.15.179:6825/4129338239] conn(0x7fe86806fc60 0x7fe8680720e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:55.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.557+0000 7fe886d9d640 1 --2- 172.21.15.162:0/1179919302 >> [v2:172.21.15.179:6824/4129338239,v1:172.21.15.179:6825/4129338239] conn(0x7fe86806fc60 0x7fe8680720e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:55.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.557+0000 7fe87effd640 1 -- 172.21.15.162:0/1179919302 <== osd.5 v2:172.21.15.179:6824/4129338239 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe8680727b0 con 0x7fe86806fc60 2024-04-25T03:09:55.576 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.573+0000 7fe88ce5b640 1 -- 172.21.15.162:0/1179919302 --> [v2:172.21.15.179:6824/4129338239,v1:172.21.15.179:6825/4129338239] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe8880b5be0 con 0x7fe86806fc60 2024-04-25T03:09:55.577 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.573+0000 7fe87effd640 1 -- 172.21.15.162:0/1179919302 <== osd.5 v2:172.21.15.179:6824/4129338239 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe8880b5be0 con 0x7fe86806fc60 2024-04-25T03:09:55.577 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-04-25T03:09:55.577 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T03:09:55.577 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-04-25T03:09:55.578 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.577+0000 7fe88ce5b640 1 -- 172.21.15.162:0/1179919302 >> [v2:172.21.15.179:6824/4129338239,v1:172.21.15.179:6825/4129338239] conn(0x7fe86806fc60 msgr2=0x7fe8680720e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:55.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.577+0000 7fe88ce5b640 1 --2- 172.21.15.162:0/1179919302 >> [v2:172.21.15.179:6824/4129338239,v1:172.21.15.179:6825/4129338239] conn(0x7fe86806fc60 0x7fe8680720e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:55.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.577+0000 7fe88ce5b640 1 -- 172.21.15.162:0/1179919302 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe868067940 msgr2=0x7fe868069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:55.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.577+0000 7fe88ce5b640 1 --2- 172.21.15.162:0/1179919302 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe868067940 0x7fe868069e00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fe878007fd0 tx=0x7fe878009040 comp rx=0 tx=0).stop 2024-04-25T03:09:55.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.577+0000 7fe88ce5b640 1 -- 172.21.15.162:0/1179919302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8880ce9e0 msgr2=0x7fe888155110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:55.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.577+0000 7fe88ce5b640 1 --2- 172.21.15.162:0/1179919302 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe8880ce9e0 0x7fe888155110 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe87000c3a0 tx=0x7fe87000c860 comp rx=0 tx=0).stop 2024-04-25T03:09:55.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.577+0000 7fe886d9d640 1 -- 172.21.15.162:0/1179919302 reap_dead start 2024-04-25T03:09:55.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.577+0000 7fe88ce5b640 1 -- 172.21.15.162:0/1179919302 shutdown_connections 2024-04-25T03:09:55.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.577+0000 7fe88ce5b640 1 -- 172.21.15.162:0/1179919302 >> 172.21.15.162:0/1179919302 conn(0x7fe8880671c0 msgr2=0x7fe8880c5710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:55.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.577+0000 7fe88ce5b640 1 -- 172.21.15.162:0/1179919302 shutdown_connections 2024-04-25T03:09:55.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.577+0000 7fe88ce5b640 1 -- 172.21.15.162:0/1179919302 wait complete. 2024-04-25T03:09:55.598 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T03:09:55.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.721+0000 7f3ec816b640 1 Processor -- start 2024-04-25T03:09:55.722 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.721+0000 7f3ec816b640 1 -- start start 2024-04-25T03:09:55.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.721+0000 7f3ec816b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3ec00cb9c0 0x7f3ec0071380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:55.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.721+0000 7f3ec816b640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec00cd380 con 0x7f3ec0154400 2024-04-25T03:09:55.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.721+0000 7f3ec816b640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ec00caef0 con 0x7f3ec00718c0 2024-04-25T03:09:55.723 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.721+0000 7f3ec816b640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f3ec006c550 con 0x7f3ec00cb9c0 2024-04-25T03:09:55.724 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.721+0000 7f3ec5706640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3ec00cb9c0 0x7f3ec0071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:55.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.721+0000 7f3ec5706640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f3ec00cb9c0 0x7f3ec0071380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47112/0 (socket says 172.21.15.162:47112) 2024-04-25T03:09:55.725 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.721+0000 7f3ec5706640 1 -- 172.21.15.162:0/958241547 learned_addr learned my addr 172.21.15.162:0/958241547 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:55.727 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.725+0000 7f3ec5706640 1 -- 172.21.15.162:0/958241547 >> v1:172.21.15.179:6789/0 conn(0x7f3ec00718c0 legacy=0x7f3ec006c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:55.727 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.725+0000 7f3ec5706640 1 -- 172.21.15.162:0/958241547 >> v1:172.21.15.162:6789/0 conn(0x7f3ec0154400 legacy=0x7f3ec015ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:55.727 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.725+0000 7f3ec5706640 1 -- 172.21.15.162:0/958241547 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec00ccc20 con 0x7f3ec00cb9c0 2024-04-25T03:09:55.734 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.733+0000 7f3ec5706640 1 --2- 172.21.15.162:0/958241547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec00cb9c0 0x7f3ec0071380 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009870 tx=0x7f3eb001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f00839eb980ca6a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:55.737 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.733+0000 7f3ec4f05640 1 -- 172.21.15.162:0/958241547 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00b5070 con 0x7f3ec00cb9c0 2024-04-25T03:09:55.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.737+0000 7f3ec4f05640 1 -- 172.21.15.162:0/958241547 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb00a8a50 con 0x7f3ec00cb9c0 2024-04-25T03:09:55.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.737+0000 7f3ec4f05640 1 -- 172.21.15.162:0/958241547 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00a8e20 con 0x7f3ec00cb9c0 2024-04-25T03:09:55.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.737+0000 7f3ec816b640 1 -- 172.21.15.162:0/958241547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec00cb9c0 msgr2=0x7f3ec0071380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:55.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.737+0000 7f3ec816b640 1 --2- 172.21.15.162:0/958241547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec00cb9c0 0x7f3ec0071380 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009870 tx=0x7f3eb001ed50 comp rx=0 tx=0).stop 2024-04-25T03:09:55.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.737+0000 7f3ec816b640 1 -- 172.21.15.162:0/958241547 shutdown_connections 2024-04-25T03:09:55.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.737+0000 7f3ec816b640 1 --2- 172.21.15.162:0/958241547 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec00cb9c0 0x7f3ec0071380 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:55.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.737+0000 7f3ec816b640 1 -- 172.21.15.162:0/958241547 >> 172.21.15.162:0/958241547 conn(0x7f3ec006b810 msgr2=0x7f3ec006f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:55.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.737+0000 7f3ec816b640 1 -- 172.21.15.162:0/958241547 shutdown_connections 2024-04-25T03:09:55.740 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.737+0000 7f3ec816b640 1 -- 172.21.15.162:0/958241547 wait complete. 2024-04-25T03:09:55.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.737+0000 7f3ec816b640 1 Processor -- start 2024-04-25T03:09:55.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.741+0000 7f3ec816b640 1 -- start start 2024-04-25T03:09:55.741 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.741+0000 7f3ec816b640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ec00718c0 0x7f3ec014c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:55.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.741+0000 7f3ec816b640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec00cb9c0 0x7f3ec0158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:55.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.741+0000 7f3ec816b640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ec0154400 0x7f3ec014afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:55.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.741+0000 7f3ec816b640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec01547e0 con 0x7f3ec00cb9c0 2024-04-25T03:09:55.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.741+0000 7f3ec816b640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec00cc8e0 con 0x7f3ec0154400 2024-04-25T03:09:55.742 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.741+0000 7f3ec816b640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3ec0154960 con 0x7f3ec00718c0 2024-04-25T03:09:55.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.741+0000 7f3ec5706640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec00cb9c0 0x7f3ec0158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:55.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.741+0000 7f3ec5706640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec00cb9c0 0x7f3ec0158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47118/0 (socket says 172.21.15.162:47118) 2024-04-25T03:09:55.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.741+0000 7f3ec5706640 1 -- 172.21.15.162:0/2326960597 learned_addr learned my addr 172.21.15.162:0/2326960597 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:55.743 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.741+0000 7f3ec6708640 1 --2- 172.21.15.162:0/2326960597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ec0154400 0x7f3ec014afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:55.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.745+0000 7f3ec5706640 1 -- 172.21.15.162:0/2326960597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ec00718c0 msgr2=0x7f3ec014c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:55.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.745+0000 7f3ec5706640 1 --2- 172.21.15.162:0/2326960597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ec00718c0 0x7f3ec014c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:55.746 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.745+0000 7f3ec5706640 1 -- 172.21.15.162:0/2326960597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ec0154400 msgr2=0x7f3ec014afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:55.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.745+0000 7f3ec5706640 1 --2- 172.21.15.162:0/2326960597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ec0154400 0x7f3ec014afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:55.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.745+0000 7f3ec5706640 1 -- 172.21.15.162:0/2326960597 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec0155610 con 0x7f3ec00cb9c0 2024-04-25T03:09:55.748 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.745+0000 7f3ec5706640 1 --2- 172.21.15.162:0/2326960597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec00cb9c0 0x7f3ec0158f20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00b3040 tx=0x7f3eb001baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:55.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.749+0000 7f3eb67fc640 1 -- 172.21.15.162:0/2326960597 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00c0070 con 0x7f3ec00cb9c0 2024-04-25T03:09:55.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.749+0000 7f3eb67fc640 1 -- 172.21.15.162:0/2326960597 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3eb00ae790 con 0x7f3ec00cb9c0 2024-04-25T03:09:55.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.749+0000 7f3eb67fc640 1 -- 172.21.15.162:0/2326960597 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3eb00b5070 con 0x7f3ec00cb9c0 2024-04-25T03:09:55.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.749+0000 7f3ec816b640 1 -- 172.21.15.162:0/2326960597 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec01551d0 con 0x7f3ec00cb9c0 2024-04-25T03:09:55.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.749+0000 7f3ec816b640 1 -- 172.21.15.162:0/2326960597 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec0154ef0 con 0x7f3ec00cb9c0 2024-04-25T03:09:55.754 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.753+0000 7f3ec816b640 1 -- 172.21.15.162:0/2326960597 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec0075110 con 0x7f3ec00cb9c0 2024-04-25T03:09:55.772 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.769+0000 7f3eb67fc640 1 -- 172.21.15.162:0/2326960597 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3eb00c3070 con 0x7f3ec00cb9c0 2024-04-25T03:09:55.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.773+0000 7f3eb67fc640 1 --2- 172.21.15.162:0/2326960597 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3ea4067940 0x7f3ea4069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:55.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.773+0000 7f3ec5f07640 1 --2- 172.21.15.162:0/2326960597 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3ea4067940 0x7f3ea4069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:55.773 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.773+0000 7f3ec5f07640 1 --2- 172.21.15.162:0/2326960597 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3ea4067940 0x7f3ea4069e00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc000f70 tx=0x7f3ebc0079e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:55.776 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:55.773+0000 7f3eb67fc640 1 -- 172.21.15.162:0/2326960597 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f3eb00f1f50 con 0x7f3ec00cb9c0 2024-04-25T03:09:56.054 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.053+0000 7f3eb67fc640 1 -- 172.21.15.162:0/2326960597 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f3eb00cb080 con 0x7f3ec00cb9c0 2024-04-25T03:09:56.226 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.225+0000 7f3ec816b640 1 -- 172.21.15.162:0/2326960597 --> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f3ec006dd90 con 0x7f3ea4067940 2024-04-25T03:09:56.226 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.225+0000 7f3eb67fc640 1 -- 172.21.15.162:0/2326960597 <== mgr.4100 v2:172.21.15.162:6800/3960394531 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3ec006dd90 con 0x7f3ea4067940 2024-04-25T03:09:56.226 INFO:teuthology.orchestra.run.smithi162.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T03:09:56.228 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.225+0000 7f3ec816b640 1 -- 172.21.15.162:0/2326960597 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3ea4067940 msgr2=0x7f3ea4069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:56.228 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.225+0000 7f3ec816b640 1 --2- 172.21.15.162:0/2326960597 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3ea4067940 0x7f3ea4069e00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc000f70 tx=0x7f3ebc0079e0 comp rx=0 tx=0).stop 2024-04-25T03:09:56.228 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.225+0000 7f3ec816b640 1 -- 172.21.15.162:0/2326960597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec00cb9c0 msgr2=0x7f3ec0158f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:56.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.225+0000 7f3ec816b640 1 --2- 172.21.15.162:0/2326960597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec00cb9c0 0x7f3ec0158f20 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00b3040 tx=0x7f3eb001baf0 comp rx=0 tx=0).stop 2024-04-25T03:09:56.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.225+0000 7f3ec816b640 1 -- 172.21.15.162:0/2326960597 shutdown_connections 2024-04-25T03:09:56.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.225+0000 7f3ec816b640 1 --2- 172.21.15.162:0/2326960597 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3ec0154400 0x7f3ec014afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:56.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.225+0000 7f3ec816b640 1 --2- 172.21.15.162:0/2326960597 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3ea4067940 0x7f3ea4069e00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:56.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.225+0000 7f3ec816b640 1 --2- 172.21.15.162:0/2326960597 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3ec00cb9c0 0x7f3ec0158f20 secure :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3eb00b3040 tx=0x7f3eb001baf0 comp rx=0 tx=0).stop 2024-04-25T03:09:56.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.225+0000 7f3ec816b640 1 --2- 172.21.15.162:0/2326960597 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3ec00718c0 0x7f3ec014c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:56.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.225+0000 7f3ec816b640 1 -- 172.21.15.162:0/2326960597 >> 172.21.15.162:0/2326960597 conn(0x7f3ec006b810 msgr2=0x7f3ec0152920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:56.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.225+0000 7f3ec816b640 1 -- 172.21.15.162:0/2326960597 shutdown_connections 2024-04-25T03:09:56.229 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.225+0000 7f3ec816b640 1 -- 172.21.15.162:0/2326960597 wait complete. 2024-04-25T03:09:56.245 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T03:09:56.246 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T03:09:56.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.381+0000 7f7a9bad7640 1 Processor -- start 2024-04-25T03:09:56.382 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.381+0000 7f7a9bad7640 1 -- start start 2024-04-25T03:09:56.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.381+0000 7f7a9bad7640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7a940cc610 0x7f7a940cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:56.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.381+0000 7f7a9bad7640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7a9406c310 0x7f7a940cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:56.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.381+0000 7f7a9bad7640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a9406c7b0 con 0x7f7a940ca580 2024-04-25T03:09:56.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.381+0000 7f7a9bad7640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7f7a940cf670 con 0x7f7a9406c310 2024-04-25T03:09:56.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.381+0000 7f7a9bad7640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f7a9406ca70 con 0x7f7a940cc610 2024-04-25T03:09:56.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.381+0000 7f7a99072640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7a9406c310 0x7f7a940cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:56.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.381+0000 7f7a99072640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7f7a9406c310 0x7f7a940cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47122/0 (socket says 172.21.15.162:47122) 2024-04-25T03:09:56.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.381+0000 7f7a99072640 1 -- 172.21.15.162:0/1204365538 learned_addr learned my addr 172.21.15.162:0/1204365538 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:56.384 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.381+0000 7f7a99873640 1 --2- 172.21.15.162:0/1204365538 >> v2:172.21.15.179:3300/0 conn(0x7f7a940cc610 0x7f7a940cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:56.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.385+0000 7f7a99072640 1 -- 172.21.15.162:0/1204365538 >> v2:172.21.15.179:3300/0 conn(0x7f7a940cc610 msgr2=0x7f7a940cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:56.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.385+0000 7f7a99072640 1 --2- 172.21.15.162:0/1204365538 >> v2:172.21.15.179:3300/0 conn(0x7f7a940cc610 0x7f7a940cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:56.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.385+0000 7f7a99072640 1 -- 172.21.15.162:0/1204365538 >> v1:172.21.15.162:6789/0 conn(0x7f7a940ca580 legacy=0x7f7a9415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:56.387 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.385+0000 7f7a99072640 1 -- 172.21.15.162:0/1204365538 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a9406cd50 con 0x7f7a9406c310 2024-04-25T03:09:56.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.389+0000 7f7a99072640 1 --2- 172.21.15.162:0/1204365538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a9406c310 0x7f7a940cda00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7a940cd5c0 tx=0x7f7a8401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468ffcac13ec5cb2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:56.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.393+0000 7f7a98871640 1 -- 172.21.15.162:0/1204365538 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a840b5070 con 0x7f7a9406c310 2024-04-25T03:09:56.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.393+0000 7f7a98871640 1 -- 172.21.15.162:0/1204365538 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a840a8a10 con 0x7f7a9406c310 2024-04-25T03:09:56.396 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.393+0000 7f7a98871640 1 -- 172.21.15.162:0/1204365538 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a840a8de0 con 0x7f7a9406c310 2024-04-25T03:09:56.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9bad7640 1 -- 172.21.15.162:0/1204365538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a9406c310 msgr2=0x7f7a940cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:56.397 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9bad7640 1 --2- 172.21.15.162:0/1204365538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a9406c310 0x7f7a940cda00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7a940cd5c0 tx=0x7f7a8401ed10 comp rx=0 tx=0).stop 2024-04-25T03:09:56.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9bad7640 1 -- 172.21.15.162:0/1204365538 shutdown_connections 2024-04-25T03:09:56.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9bad7640 1 --2- 172.21.15.162:0/1204365538 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a9406c310 0x7f7a940cda00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:56.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9bad7640 1 --2- 172.21.15.162:0/1204365538 >> v2:172.21.15.179:3300/0 conn(0x7f7a940cc610 0x7f7a940cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:56.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9bad7640 1 -- 172.21.15.162:0/1204365538 >> 172.21.15.162:0/1204365538 conn(0x7f7a940b1710 msgr2=0x7f7a940b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:56.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9bad7640 1 -- 172.21.15.162:0/1204365538 shutdown_connections 2024-04-25T03:09:56.398 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9bad7640 1 -- 172.21.15.162:0/1204365538 wait complete. 2024-04-25T03:09:56.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9bad7640 1 Processor -- start 2024-04-25T03:09:56.399 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9bad7640 1 -- start start 2024-04-25T03:09:56.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9bad7640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a9406c310 0x7f7a9415cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:56.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9bad7640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a940ca580 0x7f7a941f3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:56.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9bad7640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a940cc610 0x7f7a941e5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:56.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9bad7640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9415e010 con 0x7f7a940cc610 2024-04-25T03:09:56.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9bad7640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7a9415dd30 con 0x7f7a9406c310 2024-04-25T03:09:56.400 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9bad7640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7a9415e2f0 con 0x7f7a940ca580 2024-04-25T03:09:56.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9a074640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a940cc610 0x7f7a941e5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:56.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9a074640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a940cc610 0x7f7a941e5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47136/0 (socket says 172.21.15.162:47136) 2024-04-25T03:09:56.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.397+0000 7f7a9a074640 1 -- 172.21.15.162:0/1771741256 learned_addr learned my addr 172.21.15.162:0/1771741256 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:56.401 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.401+0000 7f7a99873640 1 --2- 172.21.15.162:0/1771741256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a9406c310 0x7f7a9415cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:56.402 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.401+0000 7f7a99072640 1 --2- 172.21.15.162:0/1771741256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a940ca580 0x7f7a941f3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:56.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.401+0000 7f7a9a074640 1 -- 172.21.15.162:0/1771741256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a940ca580 msgr2=0x7f7a941f3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:56.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.401+0000 7f7a9a074640 1 --2- 172.21.15.162:0/1771741256 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7a940ca580 0x7f7a941f3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:56.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.401+0000 7f7a9a074640 1 -- 172.21.15.162:0/1771741256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a9406c310 msgr2=0x7f7a9415cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:56.404 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.401+0000 7f7a9a074640 1 --2- 172.21.15.162:0/1771741256 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7a9406c310 0x7f7a9415cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:56.405 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.401+0000 7f7a9a074640 1 -- 172.21.15.162:0/1771741256 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a941e43c0 con 0x7f7a940cc610 2024-04-25T03:09:56.410 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.409+0000 7f7a9a074640 1 --2- 172.21.15.162:0/1771741256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a940cc610 0x7f7a941e5730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c00c770 tx=0x7f7a8c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:56.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.413+0000 7f7a8a7fc640 1 -- 172.21.15.162:0/1771741256 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c003b80 con 0x7f7a940cc610 2024-04-25T03:09:56.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.413+0000 7f7a8a7fc640 1 -- 172.21.15.162:0/1771741256 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a8c003d20 con 0x7f7a940cc610 2024-04-25T03:09:56.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.413+0000 7f7a8a7fc640 1 -- 172.21.15.162:0/1771741256 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c00aa90 con 0x7f7a940cc610 2024-04-25T03:09:56.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.413+0000 7f7a9bad7640 1 -- 172.21.15.162:0/1771741256 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a94152240 con 0x7f7a940cc610 2024-04-25T03:09:56.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.413+0000 7f7a9bad7640 1 -- 172.21.15.162:0/1771741256 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a940c91f0 con 0x7f7a940cc610 2024-04-25T03:09:56.418 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.417+0000 7f7a9bad7640 1 -- 172.21.15.162:0/1771741256 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7a94068310 con 0x7f7a940cc610 2024-04-25T03:09:56.437 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.437+0000 7f7a8a7fc640 1 -- 172.21.15.162:0/1771741256 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7a8c00ac30 con 0x7f7a940cc610 2024-04-25T03:09:56.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.437+0000 7f7a8a7fc640 1 --2- 172.21.15.162:0/1771741256 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f7a78067910 0x7f7a78069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:56.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.437+0000 7f7a99873640 1 --2- 172.21.15.162:0/1771741256 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f7a78067910 0x7f7a78069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:56.438 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.437+0000 7f7a99873640 1 --2- 172.21.15.162:0/1771741256 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f7a78067910 0x7f7a78069dd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009b60 tx=0x7f7a90009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:56.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.441+0000 7f7a8a7fc640 1 -- 172.21.15.162:0/1771741256 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f7a8c054a60 con 0x7f7a940cc610 2024-04-25T03:09:56.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.441+0000 7f7a8a7fc640 1 --2- 172.21.15.162:0/1771741256 >> [v2:172.21.15.179:6801/823843016,v1:172.21.15.179:6802/823843016] conn(0x7f7a7806fc90 0x7f7a78072110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:56.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.441+0000 7f7a8a7fc640 1 -- 172.21.15.162:0/1771741256 --> [v2:172.21.15.179:6801/823843016,v1:172.21.15.179:6802/823843016] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a780727e0 con 0x7f7a7806fc90 2024-04-25T03:09:56.442 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.441+0000 7f7a99072640 1 --2- 172.21.15.162:0/1771741256 >> [v2:172.21.15.179:6801/823843016,v1:172.21.15.179:6802/823843016] conn(0x7f7a7806fc90 0x7f7a78072110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:56.443 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.441+0000 7f7a99072640 1 --2- 172.21.15.162:0/1771741256 >> [v2:172.21.15.179:6801/823843016,v1:172.21.15.179:6802/823843016] conn(0x7f7a7806fc90 0x7f7a78072110 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:56.445 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.445+0000 7f7a8a7fc640 1 -- 172.21.15.162:0/1771741256 <== osd.6 v2:172.21.15.179:6801/823843016 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7a780727e0 con 0x7f7a7806fc90 2024-04-25T03:09:56.447 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.445+0000 7f7a8a7fc640 1 -- 172.21.15.162:0/1771741256 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7a8c052c60 con 0x7f7a940cc610 2024-04-25T03:09:56.468 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.465+0000 7f7a9bad7640 1 -- 172.21.15.162:0/1771741256 --> [v2:172.21.15.179:6801/823843016,v1:172.21.15.179:6802/823843016] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7a940cf800 con 0x7f7a7806fc90 2024-04-25T03:09:56.469 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.465+0000 7f7a8a7fc640 1 -- 172.21.15.162:0/1771741256 <== osd.6 v2:172.21.15.179:6801/823843016 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7a940cf800 con 0x7f7a7806fc90 2024-04-25T03:09:56.469 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-04-25T03:09:56.469 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T03:09:56.469 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-04-25T03:09:56.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.469+0000 7f7a9bad7640 1 -- 172.21.15.162:0/1771741256 >> [v2:172.21.15.179:6801/823843016,v1:172.21.15.179:6802/823843016] conn(0x7f7a7806fc90 msgr2=0x7f7a78072110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:56.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.469+0000 7f7a9bad7640 1 --2- 172.21.15.162:0/1771741256 >> [v2:172.21.15.179:6801/823843016,v1:172.21.15.179:6802/823843016] conn(0x7f7a7806fc90 0x7f7a78072110 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:56.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.469+0000 7f7a9bad7640 1 -- 172.21.15.162:0/1771741256 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f7a78067910 msgr2=0x7f7a78069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:56.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.469+0000 7f7a9bad7640 1 --2- 172.21.15.162:0/1771741256 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f7a78067910 0x7f7a78069dd0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f7a90009b60 tx=0x7f7a90009190 comp rx=0 tx=0).stop 2024-04-25T03:09:56.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.469+0000 7f7a9bad7640 1 -- 172.21.15.162:0/1771741256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a940cc610 msgr2=0x7f7a941e5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:56.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.469+0000 7f7a9bad7640 1 --2- 172.21.15.162:0/1771741256 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7a940cc610 0x7f7a941e5730 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c00c770 tx=0x7f7a8c00cc30 comp rx=0 tx=0).stop 2024-04-25T03:09:56.470 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.469+0000 7f7a9a074640 1 -- 172.21.15.162:0/1771741256 reap_dead start 2024-04-25T03:09:56.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.469+0000 7f7a9bad7640 1 -- 172.21.15.162:0/1771741256 shutdown_connections 2024-04-25T03:09:56.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.469+0000 7f7a9bad7640 1 -- 172.21.15.162:0/1771741256 >> 172.21.15.162:0/1771741256 conn(0x7f7a940b1710 msgr2=0x7f7a9415b790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:56.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.469+0000 7f7a9bad7640 1 -- 172.21.15.162:0/1771741256 shutdown_connections 2024-04-25T03:09:56.471 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.469+0000 7f7a9bad7640 1 -- 172.21.15.162:0/1771741256 wait complete. 2024-04-25T03:09:56.492 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T03:09:56.610 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.609+0000 7f1236a1d640 1 Processor -- start 2024-04-25T03:09:56.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.609+0000 7f1236a1d640 1 -- start start 2024-04-25T03:09:56.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.609+0000 7f1236a1d640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f1230157e00 0x7f12300c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:56.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.609+0000 7f1236a1d640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f123015a750 con 0x7f12301515b0 2024-04-25T03:09:56.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.609+0000 7f1236a1d640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f123015a9f0 con 0x7f12300c65b0 2024-04-25T03:09:56.611 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.609+0000 7f1236a1d640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f123015acd0 con 0x7f1230157e00 2024-04-25T03:09:56.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.609+0000 7f122ffff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f12301515b0 0x7f123013fd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:54142/0 (socket says 172.21.15.162:54142) 2024-04-25T03:09:56.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.609+0000 7f122ffff640 1 -- 172.21.15.162:0/2056761298 learned_addr learned my addr 172.21.15.162:0/2056761298 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:09:56.613 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.609+0000 7f1234fba640 1 --2- 172.21.15.162:0/2056761298 >> v2:172.21.15.179:3300/0 conn(0x7f1230157e00 0x7f12300c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:56.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.617+0000 7f122effd640 1 -- 172.21.15.162:0/2056761298 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2823800587 0 0) 0x7f123015a750 con 0x7f12301515b0 2024-04-25T03:09:56.617 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.617+0000 7f122effd640 1 -- 172.21.15.162:0/2056761298 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1218003530 con 0x7f12301515b0 2024-04-25T03:09:56.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.617+0000 7f1234fba640 1 -- 172.21.15.162:0/2056761298 >> v1:172.21.15.179:6789/0 conn(0x7f12300c65b0 legacy=0x7f12301576f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:56.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.617+0000 7f1234fba640 1 -- 172.21.15.162:0/2056761298 >> v1:172.21.15.162:6789/0 conn(0x7f12301515b0 legacy=0x7f123013fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:56.620 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.617+0000 7f1234fba640 1 -- 172.21.15.162:0/2056761298 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f123015afb0 con 0x7f1230157e00 2024-04-25T03:09:56.627 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.625+0000 7f1234fba640 1 --2- 172.21.15.162:0/2056761298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1230157e00 0x7f12300c6a20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f123006dd00 tx=0x7f122801c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf7d6fcc8a7b09df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:56.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.633+0000 7f122effd640 1 -- 172.21.15.162:0/2056761298 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12280b2070 con 0x7f1230157e00 2024-04-25T03:09:56.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.633+0000 7f122effd640 1 -- 172.21.15.162:0/2056761298 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12280a57b0 con 0x7f1230157e00 2024-04-25T03:09:56.637 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.633+0000 7f122effd640 1 -- 172.21.15.162:0/2056761298 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12280a5b80 con 0x7f1230157e00 2024-04-25T03:09:56.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.637+0000 7f1236a1d640 1 -- 172.21.15.162:0/2056761298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1230157e00 msgr2=0x7f12300c6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:56.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.637+0000 7f1236a1d640 1 --2- 172.21.15.162:0/2056761298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1230157e00 0x7f12300c6a20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f123006dd00 tx=0x7f122801c8f0 comp rx=0 tx=0).stop 2024-04-25T03:09:56.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.637+0000 7f1236a1d640 1 -- 172.21.15.162:0/2056761298 shutdown_connections 2024-04-25T03:09:56.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.637+0000 7f1236a1d640 1 --2- 172.21.15.162:0/2056761298 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f1230157e00 0x7f12300c6a20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:56.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.637+0000 7f1236a1d640 1 -- 172.21.15.162:0/2056761298 >> 172.21.15.162:0/2056761298 conn(0x7f1230070280 msgr2=0x7f1230070690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:56.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.637+0000 7f1236a1d640 1 -- 172.21.15.162:0/2056761298 shutdown_connections 2024-04-25T03:09:56.638 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.637+0000 7f1236a1d640 1 -- 172.21.15.162:0/2056761298 wait complete. 2024-04-25T03:09:56.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.637+0000 7f1236a1d640 1 Processor -- start 2024-04-25T03:09:56.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.637+0000 7f1236a1d640 1 -- start start 2024-04-25T03:09:56.639 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.637+0000 7f1236a1d640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12300c65b0 0x7f123013d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:56.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.637+0000 7f1236a1d640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12301515b0 0x7f1230132100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:56.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.637+0000 7f1236a1d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1230157e00 0x7f1230132640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:56.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.637+0000 7f1236a1d640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f1230140610 con 0x7f1230157e00 2024-04-25T03:09:56.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.637+0000 7f1236a1d640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f1230140490 con 0x7f12300c65b0 2024-04-25T03:09:56.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.637+0000 7f1236a1d640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f123013d070 con 0x7f12301515b0 2024-04-25T03:09:56.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.637+0000 7f1234fba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1230157e00 0x7f1230132640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:56.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.637+0000 7f1234fba640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1230157e00 0x7f1230132640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47150/0 (socket says 172.21.15.162:47150) 2024-04-25T03:09:56.640 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.637+0000 7f1234fba640 1 -- 172.21.15.162:0/3597228910 learned_addr learned my addr 172.21.15.162:0/3597228910 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:56.641 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.641+0000 7f122f7fe640 1 --2- 172.21.15.162:0/3597228910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12301515b0 0x7f1230132100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:56.642 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.641+0000 7f122ffff640 1 --2- 172.21.15.162:0/3597228910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12300c65b0 0x7f123013d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:56.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.641+0000 7f1234fba640 1 -- 172.21.15.162:0/3597228910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12301515b0 msgr2=0x7f1230132100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:56.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.641+0000 7f1234fba640 1 --2- 172.21.15.162:0/3597228910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12301515b0 0x7f1230132100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:56.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.641+0000 7f1234fba640 1 -- 172.21.15.162:0/3597228910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12300c65b0 msgr2=0x7f123013d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:56.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.641+0000 7f1234fba640 1 --2- 172.21.15.162:0/3597228910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12300c65b0 0x7f123013d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:56.644 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.641+0000 7f1234fba640 1 -- 172.21.15.162:0/3597228910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1230154dc0 con 0x7f1230157e00 2024-04-25T03:09:56.646 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.645+0000 7f1234fba640 1 --2- 172.21.15.162:0/3597228910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1230157e00 0x7f1230132640 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f12280b0040 tx=0x7f1228019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:56.651 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.649+0000 7f122cff9640 1 -- 172.21.15.162:0/3597228910 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12280b2050 con 0x7f1230157e00 2024-04-25T03:09:56.651 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.649+0000 7f122cff9640 1 -- 172.21.15.162:0/3597228910 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12280be070 con 0x7f1230157e00 2024-04-25T03:09:56.651 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.649+0000 7f122cff9640 1 -- 172.21.15.162:0/3597228910 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12280ad890 con 0x7f1230157e00 2024-04-25T03:09:56.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.649+0000 7f1236a1d640 1 -- 172.21.15.162:0/3597228910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f123013ff60 con 0x7f1230157e00 2024-04-25T03:09:56.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.649+0000 7f1236a1d640 1 -- 172.21.15.162:0/3597228910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f123013d920 con 0x7f1230157e00 2024-04-25T03:09:56.652 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.649+0000 7f1236a1d640 1 -- 172.21.15.162:0/3597228910 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1230131750 con 0x7f1230157e00 2024-04-25T03:09:56.944 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.941+0000 7f122cff9640 1 -- 172.21.15.162:0/3597228910 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f12280ada30 con 0x7f1230157e00 2024-04-25T03:09:56.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.941+0000 7f122cff9640 1 --2- 172.21.15.162:0/3597228910 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f121c067910 0x7f121c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:56.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.945+0000 7f122ffff640 1 --2- 172.21.15.162:0/3597228910 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f121c067910 0x7f121c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:56.946 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.945+0000 7f122ffff640 1 --2- 172.21.15.162:0/3597228910 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f121c067910 0x7f121c069dd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1224005890 tx=0x7f1224009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:56.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.973+0000 7f122cff9640 1 -- 172.21.15.162:0/3597228910 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f12280efb90 con 0x7f1230157e00 2024-04-25T03:09:56.974 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:56.973+0000 7f122cff9640 1 -- 172.21.15.162:0/3597228910 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f12280164e0 con 0x7f1230157e00 2024-04-25T03:09:57.148 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.145+0000 7f1236a1d640 1 -- 172.21.15.162:0/3597228910 --> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f1230131cd0 con 0x7f121c067910 2024-04-25T03:09:57.149 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.145+0000 7f122cff9640 1 -- 172.21.15.162:0/3597228910 <== mgr.4100 v2:172.21.15.162:6800/3960394531 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1230131cd0 con 0x7f121c067910 2024-04-25T03:09:57.149 INFO:teuthology.orchestra.run.smithi162.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T03:09:57.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.149+0000 7f1236a1d640 1 -- 172.21.15.162:0/3597228910 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f121c067910 msgr2=0x7f121c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:57.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.149+0000 7f1236a1d640 1 --2- 172.21.15.162:0/3597228910 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f121c067910 0x7f121c069dd0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1224005890 tx=0x7f1224009040 comp rx=0 tx=0).stop 2024-04-25T03:09:57.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.149+0000 7f1236a1d640 1 -- 172.21.15.162:0/3597228910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1230157e00 msgr2=0x7f1230132640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:57.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.149+0000 7f1236a1d640 1 --2- 172.21.15.162:0/3597228910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1230157e00 0x7f1230132640 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f12280b0040 tx=0x7f1228019690 comp rx=0 tx=0).stop 2024-04-25T03:09:57.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.149+0000 7f1236a1d640 1 -- 172.21.15.162:0/3597228910 shutdown_connections 2024-04-25T03:09:57.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.149+0000 7f1236a1d640 1 --2- 172.21.15.162:0/3597228910 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f121c067910 0x7f121c069dd0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:57.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.149+0000 7f1236a1d640 1 --2- 172.21.15.162:0/3597228910 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f1230157e00 0x7f1230132640 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:57.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.149+0000 7f1236a1d640 1 --2- 172.21.15.162:0/3597228910 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f12301515b0 0x7f1230132100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:57.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.149+0000 7f1236a1d640 1 --2- 172.21.15.162:0/3597228910 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f12300c65b0 0x7f123013d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:57.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.149+0000 7f1236a1d640 1 -- 172.21.15.162:0/3597228910 >> 172.21.15.162:0/3597228910 conn(0x7f1230070280 msgr2=0x7f12300c8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:57.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.149+0000 7f1236a1d640 1 -- 172.21.15.162:0/3597228910 shutdown_connections 2024-04-25T03:09:57.152 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.149+0000 7f1236a1d640 1 -- 172.21.15.162:0/3597228910 wait complete. 2024-04-25T03:09:57.170 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T03:09:57.171 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T03:09:57.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.309+0000 7f8995c80640 1 Processor -- start 2024-04-25T03:09:57.310 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.309+0000 7f8995c80640 1 -- start start 2024-04-25T03:09:57.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.309+0000 7f8995c80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f899006bee0 0x7f8990162180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:57.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.309+0000 7f8995c80640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8990150ce0 con 0x7f89900c63b0 2024-04-25T03:09:57.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.309+0000 7f8995c80640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8990156ba0 con 0x7f8990150900 2024-04-25T03:09:57.311 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.309+0000 7f8995c80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f899006b340 con 0x7f899006bee0 2024-04-25T03:09:57.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.309+0000 7f8987fff640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f89900c63b0 0x7f899006b7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:54156/0 (socket says 172.21.15.162:54156) 2024-04-25T03:09:57.312 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.309+0000 7f8987fff640 1 -- 172.21.15.162:0/1096730858 learned_addr learned my addr 172.21.15.162:0/1096730858 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:09:57.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.313+0000 7f898effd640 1 -- 172.21.15.162:0/1096730858 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3609626960 0 0) 0x7f8990150ce0 con 0x7f89900c63b0 2024-04-25T03:09:57.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.313+0000 7f898effd640 1 -- 172.21.15.162:0/1096730858 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f897c004640 con 0x7f89900c63b0 2024-04-25T03:09:57.315 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.313+0000 7f898ffff640 1 --2- 172.21.15.162:0/1096730858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f899006bee0 0x7f8990162180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:57.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.317+0000 7f898effd640 1 -- 172.21.15.162:0/1096730858 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 201475945 0 0) 0x7f897c004640 con 0x7f89900c63b0 2024-04-25T03:09:57.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.317+0000 7f898effd640 1 -- 172.21.15.162:0/1096730858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f899006bee0 msgr2=0x7f8990162180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:57.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.317+0000 7f898effd640 1 --2- 172.21.15.162:0/1096730858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f899006bee0 0x7f8990162180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:57.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.317+0000 7f898effd640 1 -- 172.21.15.162:0/1096730858 >> v1:172.21.15.179:6789/0 conn(0x7f8990150900 legacy=0x7f899006e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:57.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.317+0000 7f898effd640 1 -- 172.21.15.162:0/1096730858 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8990156e80 con 0x7f89900c63b0 2024-04-25T03:09:57.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.317+0000 7f898effd640 1 -- 172.21.15.162:0/1096730858 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7f8978001680 con 0x7f89900c63b0 2024-04-25T03:09:57.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.317+0000 7f898effd640 1 -- 172.21.15.162:0/1096730858 >> v1:172.21.15.162:6789/0 conn(0x7f89900c63b0 legacy=0x7f899006b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:57.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.317+0000 7f898effd640 1 --2- 172.21.15.162:0/1096730858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f897c004b00 0x7f897c004f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:57.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.317+0000 7f898effd640 1 --2- 172.21.15.162:0/1096730858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f899006bee0 0x7f897c005920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:57.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.317+0000 7f898effd640 1 --2- 172.21.15.162:0/1096730858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f897c005e60 0x7f897c0062e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:57.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.317+0000 7f898effd640 1 -- 172.21.15.162:0/1096730858 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f899006b340 con 0x7f897c005e60 2024-04-25T03:09:57.319 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.317+0000 7f898effd640 1 -- 172.21.15.162:0/1096730858 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f897c00cc50 con 0x7f897c004b00 2024-04-25T03:09:57.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.317+0000 7f898effd640 1 -- 172.21.15.162:0/1096730858 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f897c00ce50 con 0x7f899006bee0 2024-04-25T03:09:57.320 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.317+0000 7f898ffff640 1 --2- 172.21.15.162:0/1096730858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f897c005e60 0x7f897c0062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:57.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.321+0000 7f898ffff640 1 -- 172.21.15.162:0/1096730858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f899006bee0 msgr2=0x7f897c005920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:57.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.321+0000 7f898ffff640 1 --2- 172.21.15.162:0/1096730858 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f899006bee0 0x7f897c005920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:57.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.321+0000 7f898ffff640 1 -- 172.21.15.162:0/1096730858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f897c004b00 msgr2=0x7f897c004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:57.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.321+0000 7f898ffff640 1 --2- 172.21.15.162:0/1096730858 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f897c004b00 0x7f897c004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:57.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.321+0000 7f898ffff640 1 -- 172.21.15.162:0/1096730858 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f897c004640 con 0x7f897c005e60 2024-04-25T03:09:57.327 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.325+0000 7f898ffff640 1 --2- 172.21.15.162:0/1096730858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f897c005e60 0x7f897c0062e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8988009f90 tx=0x7f898801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700548e195d430d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:57.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.329+0000 7f898effd640 1 -- 172.21.15.162:0/1096730858 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89880b2070 con 0x7f897c005e60 2024-04-25T03:09:57.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.329+0000 7f898effd640 1 -- 172.21.15.162:0/1096730858 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89880a5c90 con 0x7f897c005e60 2024-04-25T03:09:57.331 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.329+0000 7f898effd640 1 -- 172.21.15.162:0/1096730858 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8988009c10 con 0x7f897c005e60 2024-04-25T03:09:57.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.329+0000 7f8995c80640 1 -- 172.21.15.162:0/1096730858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f897c005e60 msgr2=0x7f897c0062e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:57.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.329+0000 7f8995c80640 1 --2- 172.21.15.162:0/1096730858 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f897c005e60 0x7f897c0062e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8988009f90 tx=0x7f898801cc80 comp rx=0 tx=0).stop 2024-04-25T03:09:57.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.329+0000 7f898ffff640 1 -- 172.21.15.162:0/1096730858 reap_dead start 2024-04-25T03:09:57.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.329+0000 7f8995c80640 1 -- 172.21.15.162:0/1096730858 shutdown_connections 2024-04-25T03:09:57.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.329+0000 7f8995c80640 1 -- 172.21.15.162:0/1096730858 >> 172.21.15.162:0/1096730858 conn(0x7f8990070290 msgr2=0x7f89900c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:57.332 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.329+0000 7f8995c80640 1 -- 172.21.15.162:0/1096730858 shutdown_connections 2024-04-25T03:09:57.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.329+0000 7f8995c80640 1 -- 172.21.15.162:0/1096730858 wait complete. 2024-04-25T03:09:57.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.333+0000 7f8995c80640 1 Processor -- start 2024-04-25T03:09:57.333 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.333+0000 7f8995c80640 1 -- start start 2024-04-25T03:09:57.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.333+0000 7f8995c80640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89901e01f0 0x7f89901eff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:57.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.333+0000 7f8995c80640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89901e05d0 0x7f89900c7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:57.334 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.333+0000 7f8995c80640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89900c7200 0x7f89900c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:57.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.333+0000 7f8995c80640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f8990157720 con 0x7f89901e01f0 2024-04-25T03:09:57.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.333+0000 7f8995c80640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f8990157440 con 0x7f89900c7200 2024-04-25T03:09:57.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.333+0000 7f8995c80640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f89901567f0 con 0x7f89901e05d0 2024-04-25T03:09:57.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.333+0000 7f898f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89901e01f0 0x7f89901eff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:57.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.333+0000 7f898f7fe640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89901e01f0 0x7f89901eff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47164/0 (socket says 172.21.15.162:47164) 2024-04-25T03:09:57.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.333+0000 7f898f7fe640 1 -- 172.21.15.162:0/66760941 learned_addr learned my addr 172.21.15.162:0/66760941 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:57.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.333+0000 7f898ffff640 1 --2- 172.21.15.162:0/66760941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89900c7200 0x7f89900c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:57.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.337+0000 7f8987fff640 1 --2- 172.21.15.162:0/66760941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89901e05d0 0x7f89900c7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:57.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.337+0000 7f898f7fe640 1 -- 172.21.15.162:0/66760941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89901e05d0 msgr2=0x7f89900c7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:57.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.337+0000 7f898f7fe640 1 --2- 172.21.15.162:0/66760941 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f89901e05d0 0x7f89900c7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:57.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.337+0000 7f898f7fe640 1 -- 172.21.15.162:0/66760941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89900c7200 msgr2=0x7f89900c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:57.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.337+0000 7f898f7fe640 1 --2- 172.21.15.162:0/66760941 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f89900c7200 0x7f89900c8090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:57.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.337+0000 7f898f7fe640 1 -- 172.21.15.162:0/66760941 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89901f35c0 con 0x7f89901e01f0 2024-04-25T03:09:57.341 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.341+0000 7f898f7fe640 1 --2- 172.21.15.162:0/66760941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89901e01f0 0x7f89901eff00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f898000c530 tx=0x7f898000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:57.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.345+0000 7f898cff9640 1 -- 172.21.15.162:0/66760941 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89800052d0 con 0x7f89901e01f0 2024-04-25T03:09:57.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.345+0000 7f898cff9640 1 -- 172.21.15.162:0/66760941 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8980005470 con 0x7f89901e01f0 2024-04-25T03:09:57.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.345+0000 7f898cff9640 1 -- 172.21.15.162:0/66760941 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8980012870 con 0x7f89901e01f0 2024-04-25T03:09:57.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.345+0000 7f8995c80640 1 -- 172.21.15.162:0/66760941 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89901f3880 con 0x7f89901e01f0 2024-04-25T03:09:57.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.345+0000 7f8995c80640 1 -- 172.21.15.162:0/66760941 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89901f3e40 con 0x7f89901e01f0 2024-04-25T03:09:57.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.345+0000 7f8995c80640 1 -- 172.21.15.162:0/66760941 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8990075110 con 0x7f89901e01f0 2024-04-25T03:09:57.370 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.369+0000 7f898cff9640 1 -- 172.21.15.162:0/66760941 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8980012a10 con 0x7f89901e01f0 2024-04-25T03:09:57.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.369+0000 7f898cff9640 1 --2- 172.21.15.162:0/66760941 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8970067940 0x7f8970069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:57.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.369+0000 7f8987fff640 1 --2- 172.21.15.162:0/66760941 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8970067940 0x7f8970069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:57.371 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.369+0000 7f8987fff640 1 --2- 172.21.15.162:0/66760941 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8970067940 0x7f8970069e00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f899006f280 tx=0x7f8978009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:57.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.373+0000 7f898cff9640 1 -- 172.21.15.162:0/66760941 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f8980054790 con 0x7f89901e01f0 2024-04-25T03:09:57.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.373+0000 7f898cff9640 1 --2- 172.21.15.162:0/66760941 >> [v2:172.21.15.179:6800/3403659125,v1:172.21.15.179:6803/3403659125] conn(0x7f897006fcc0 0x7f8970072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:57.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.373+0000 7f898cff9640 1 -- 172.21.15.162:0/66760941 --> [v2:172.21.15.179:6800/3403659125,v1:172.21.15.179:6803/3403659125] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8980010e50 con 0x7f897006fcc0 2024-04-25T03:09:57.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.373+0000 7f898cff9640 1 -- 172.21.15.162:0/66760941 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f8980052990 con 0x7f89901e01f0 2024-04-25T03:09:57.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.373+0000 7f898ffff640 1 --2- 172.21.15.162:0/66760941 >> [v2:172.21.15.179:6800/3403659125,v1:172.21.15.179:6803/3403659125] conn(0x7f897006fcc0 0x7f8970072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:57.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.377+0000 7f898ffff640 1 --2- 172.21.15.162:0/66760941 >> [v2:172.21.15.179:6800/3403659125,v1:172.21.15.179:6803/3403659125] conn(0x7f897006fcc0 0x7f8970072140 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:57.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.377+0000 7f898cff9640 1 -- 172.21.15.162:0/66760941 <== osd.7 v2:172.21.15.179:6800/3403659125 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8980010e50 con 0x7f897006fcc0 2024-04-25T03:09:57.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.389+0000 7f8995c80640 1 -- 172.21.15.162:0/66760941 --> [v2:172.21.15.179:6800/3403659125,v1:172.21.15.179:6803/3403659125] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f899006db90 con 0x7f897006fcc0 2024-04-25T03:09:57.392 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.389+0000 7f898cff9640 1 -- 172.21.15.162:0/66760941 <== osd.7 v2:172.21.15.179:6800/3403659125 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f899006db90 con 0x7f897006fcc0 2024-04-25T03:09:57.393 INFO:teuthology.orchestra.run.smithi162.stdout:{ 2024-04-25T03:09:57.393 INFO:teuthology.orchestra.run.smithi162.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T03:09:57.393 INFO:teuthology.orchestra.run.smithi162.stdout:} 2024-04-25T03:09:57.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.393+0000 7f8995c80640 1 -- 172.21.15.162:0/66760941 >> [v2:172.21.15.179:6800/3403659125,v1:172.21.15.179:6803/3403659125] conn(0x7f897006fcc0 msgr2=0x7f8970072140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:57.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.393+0000 7f8995c80640 1 --2- 172.21.15.162:0/66760941 >> [v2:172.21.15.179:6800/3403659125,v1:172.21.15.179:6803/3403659125] conn(0x7f897006fcc0 0x7f8970072140 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:57.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.393+0000 7f8995c80640 1 -- 172.21.15.162:0/66760941 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8970067940 msgr2=0x7f8970069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:57.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.393+0000 7f8995c80640 1 --2- 172.21.15.162:0/66760941 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f8970067940 0x7f8970069e00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f899006f280 tx=0x7f8978009040 comp rx=0 tx=0).stop 2024-04-25T03:09:57.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.393+0000 7f8995c80640 1 -- 172.21.15.162:0/66760941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89901e01f0 msgr2=0x7f89901eff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:57.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.393+0000 7f8995c80640 1 --2- 172.21.15.162:0/66760941 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f89901e01f0 0x7f89901eff00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f898000c530 tx=0x7f898000c9f0 comp rx=0 tx=0).stop 2024-04-25T03:09:57.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.393+0000 7f898ffff640 1 -- 172.21.15.162:0/66760941 reap_dead start 2024-04-25T03:09:57.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.393+0000 7f8995c80640 1 -- 172.21.15.162:0/66760941 shutdown_connections 2024-04-25T03:09:57.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.393+0000 7f8995c80640 1 -- 172.21.15.162:0/66760941 >> 172.21.15.162:0/66760941 conn(0x7f8990070290 msgr2=0x7f8990147e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:57.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.393+0000 7f8995c80640 1 -- 172.21.15.162:0/66760941 shutdown_connections 2024-04-25T03:09:57.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.393+0000 7f8995c80640 1 -- 172.21.15.162:0/66760941 wait complete. 2024-04-25T03:09:57.410 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T03:09:57.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.525+0000 7fcacbfa4640 1 Processor -- start 2024-04-25T03:09:57.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.525+0000 7fcacbfa4640 1 -- start start 2024-04-25T03:09:57.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.525+0000 7fcacbfa4640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcac40c4730 0x7fcac415af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:57.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.525+0000 7fcacbfa4640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcac4072100 con 0x7fcac41549c0 2024-04-25T03:09:57.529 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.525+0000 7fcacbfa4640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcac406cdf0 con 0x7fcac41545e0 2024-04-25T03:09:57.530 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.525+0000 7fcacbfa4640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fcac406d0b0 con 0x7fcac40c4730 2024-04-25T03:09:57.531 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.529+0000 7fcaca541640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcac40c4730 0x7fcac415af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:57.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.533+0000 7fcaca541640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fcac40c4730 0x7fcac415af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47170/0 (socket says 172.21.15.162:47170) 2024-04-25T03:09:57.533 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.533+0000 7fcaca541640 1 -- 172.21.15.162:0/3385257869 learned_addr learned my addr 172.21.15.162:0/3385257869 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:57.535 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.533+0000 7fcaca541640 1 -- 172.21.15.162:0/3385257869 >> v1:172.21.15.179:6789/0 conn(0x7fcac41545e0 legacy=0x7fcac40c4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:57.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.533+0000 7fcaca541640 1 -- 172.21.15.162:0/3385257869 >> v1:172.21.15.162:6789/0 conn(0x7fcac41549c0 legacy=0x7fcac40c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:57.536 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.533+0000 7fcaca541640 1 -- 172.21.15.162:0/3385257869 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac406d390 con 0x7fcac40c4730 2024-04-25T03:09:57.540 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.537+0000 7fcaca541640 1 --2- 172.21.15.162:0/3385257869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac40c4730 0x7fcac415af10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcac4070720 tx=0x7fcabc01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c039db192be1a41 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:57.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.541+0000 7fcac8d3e640 1 -- 172.21.15.162:0/3385257869 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc0a55a0 con 0x7fcac40c4730 2024-04-25T03:09:57.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.541+0000 7fcac8d3e640 1 -- 172.21.15.162:0/3385257869 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcabc0a5740 con 0x7fcac40c4730 2024-04-25T03:09:57.544 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.541+0000 7fcac8d3e640 1 -- 172.21.15.162:0/3385257869 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc0a5b10 con 0x7fcac40c4730 2024-04-25T03:09:57.545 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.545+0000 7fcacbfa4640 1 -- 172.21.15.162:0/3385257869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac40c4730 msgr2=0x7fcac415af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:57.545 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.545+0000 7fcacbfa4640 1 --2- 172.21.15.162:0/3385257869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac40c4730 0x7fcac415af10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcac4070720 tx=0x7fcabc01c8e0 comp rx=0 tx=0).stop 2024-04-25T03:09:57.545 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.545+0000 7fcacbfa4640 1 -- 172.21.15.162:0/3385257869 shutdown_connections 2024-04-25T03:09:57.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.545+0000 7fcacbfa4640 1 --2- 172.21.15.162:0/3385257869 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac40c4730 0x7fcac415af10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:57.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.545+0000 7fcacbfa4640 1 -- 172.21.15.162:0/3385257869 >> 172.21.15.162:0/3385257869 conn(0x7fcac406b210 msgr2=0x7fcac406b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:57.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.545+0000 7fcacbfa4640 1 -- 172.21.15.162:0/3385257869 shutdown_connections 2024-04-25T03:09:57.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.545+0000 7fcacbfa4640 1 -- 172.21.15.162:0/3385257869 wait complete. 2024-04-25T03:09:57.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.545+0000 7fcacbfa4640 1 Processor -- start 2024-04-25T03:09:57.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.545+0000 7fcacbfa4640 1 -- start start 2024-04-25T03:09:57.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.545+0000 7fcacbfa4640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac40c4730 0x7fcac41f4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:57.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.545+0000 7fcacbfa4640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac41545e0 0x7fcac414bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:57.547 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.545+0000 7fcacbfa4640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcac41549c0 0x7fcac414c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:57.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.545+0000 7fcacbfa4640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fcac41689d0 con 0x7fcac41545e0 2024-04-25T03:09:57.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.545+0000 7fcacbfa4640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fcac4168850 con 0x7fcac41549c0 2024-04-25T03:09:57.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.545+0000 7fcacbfa4640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fcac4168b50 con 0x7fcac40c4730 2024-04-25T03:09:57.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.545+0000 7fcac953f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac41545e0 0x7fcac414bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:57.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.545+0000 7fcac953f640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac41545e0 0x7fcac414bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47176/0 (socket says 172.21.15.162:47176) 2024-04-25T03:09:57.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.545+0000 7fcac953f640 1 -- 172.21.15.162:0/3333325457 learned_addr learned my addr 172.21.15.162:0/3333325457 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:57.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.549+0000 7fcac953f640 1 -- 172.21.15.162:0/3333325457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac40c4730 msgr2=0x7fcac41f4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:57.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.549+0000 7fcac953f640 1 --2- 172.21.15.162:0/3333325457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac40c4730 0x7fcac41f4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:57.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.549+0000 7fcac953f640 1 -- 172.21.15.162:0/3333325457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcac41549c0 msgr2=0x7fcac414c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:57.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.549+0000 7fcac953f640 1 --2- 172.21.15.162:0/3333325457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcac41549c0 0x7fcac414c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:57.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.549+0000 7fcac953f640 1 -- 172.21.15.162:0/3333325457 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac414ef10 con 0x7fcac41545e0 2024-04-25T03:09:57.554 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.553+0000 7fcac953f640 1 --2- 172.21.15.162:0/3333325457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac41545e0 0x7fcac414bb00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcac000b410 tx=0x7fcac000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:57.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.557+0000 7fcab67fc640 1 -- 172.21.15.162:0/3333325457 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac0015020 con 0x7fcac41545e0 2024-04-25T03:09:57.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.557+0000 7fcab67fc640 1 -- 172.21.15.162:0/3333325457 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcac0011830 con 0x7fcac41545e0 2024-04-25T03:09:57.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.557+0000 7fcab67fc640 1 -- 172.21.15.162:0/3333325457 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac0011c20 con 0x7fcac41545e0 2024-04-25T03:09:57.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.557+0000 7fcacbfa4640 1 -- 172.21.15.162:0/3333325457 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac414e390 con 0x7fcac41545e0 2024-04-25T03:09:57.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.557+0000 7fcacbfa4640 1 -- 172.21.15.162:0/3333325457 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac414e950 con 0x7fcac41545e0 2024-04-25T03:09:57.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.557+0000 7fcacbfa4640 1 -- 172.21.15.162:0/3333325457 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcac4068310 con 0x7fcac41545e0 2024-04-25T03:09:57.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.849+0000 7fcab67fc640 1 -- 172.21.15.162:0/3333325457 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcac0018020 con 0x7fcac41545e0 2024-04-25T03:09:57.850 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.849+0000 7fcab67fc640 1 --2- 172.21.15.162:0/3333325457 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fcaa8067910 0x7fcaa8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:57.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.849+0000 7fcac9d40640 1 --2- 172.21.15.162:0/3333325457 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fcaa8067910 0x7fcaa8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:57.852 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.849+0000 7fcac9d40640 1 --2- 172.21.15.162:0/3333325457 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fcaa8067910 0x7fcaa8069dd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcab8007fd0 tx=0x7fcab80079a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:57.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.881+0000 7fcab67fc640 1 -- 172.21.15.162:0/3333325457 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7fcac0054270 con 0x7fcac41545e0 2024-04-25T03:09:57.883 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:57.881+0000 7fcab67fc640 1 -- 172.21.15.162:0/3333325457 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fcac001f030 con 0x7fcac41545e0 2024-04-25T03:09:58.049 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.049+0000 7fcacbfa4640 1 -- 172.21.15.162:0/3333325457 --> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fcac415e920 con 0x7fcaa8067910 2024-04-25T03:09:58.050 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.049+0000 7fcab67fc640 1 -- 172.21.15.162:0/3333325457 <== mgr.4100 v2:172.21.15.162:6800/3960394531 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcac415e920 con 0x7fcaa8067910 2024-04-25T03:09:58.050 INFO:teuthology.orchestra.run.smithi162.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T03:09:58.052 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.049+0000 7fcacbfa4640 1 -- 172.21.15.162:0/3333325457 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fcaa8067910 msgr2=0x7fcaa8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:58.052 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.049+0000 7fcacbfa4640 1 --2- 172.21.15.162:0/3333325457 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fcaa8067910 0x7fcaa8069dd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcab8007fd0 tx=0x7fcab80079a0 comp rx=0 tx=0).stop 2024-04-25T03:09:58.052 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.049+0000 7fcacbfa4640 1 -- 172.21.15.162:0/3333325457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac41545e0 msgr2=0x7fcac414bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:58.052 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.049+0000 7fcacbfa4640 1 --2- 172.21.15.162:0/3333325457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac41545e0 0x7fcac414bb00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcac000b410 tx=0x7fcac000b8d0 comp rx=0 tx=0).stop 2024-04-25T03:09:58.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.049+0000 7fcacbfa4640 1 -- 172.21.15.162:0/3333325457 shutdown_connections 2024-04-25T03:09:58.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.049+0000 7fcacbfa4640 1 --2- 172.21.15.162:0/3333325457 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fcac41549c0 0x7fcac414c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:58.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.049+0000 7fcacbfa4640 1 --2- 172.21.15.162:0/3333325457 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fcaa8067910 0x7fcaa8069dd0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:58.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.049+0000 7fcacbfa4640 1 --2- 172.21.15.162:0/3333325457 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fcac41545e0 0x7fcac414bb00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:58.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.049+0000 7fcacbfa4640 1 --2- 172.21.15.162:0/3333325457 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fcac40c4730 0x7fcac41f4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:58.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.049+0000 7fcacbfa4640 1 -- 172.21.15.162:0/3333325457 >> 172.21.15.162:0/3333325457 conn(0x7fcac406b210 msgr2=0x7fcac414f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:58.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.049+0000 7fcacbfa4640 1 -- 172.21.15.162:0/3333325457 shutdown_connections 2024-04-25T03:09:58.053 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.049+0000 7fcacbfa4640 1 -- 172.21.15.162:0/3333325457 wait complete. 2024-04-25T03:09:58.072 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T03:09:58.194 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.189+0000 7f3b814e8640 1 Processor -- start 2024-04-25T03:09:58.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.193+0000 7f3b814e8640 1 -- start start 2024-04-25T03:09:58.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.193+0000 7f3b814e8640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f3b7c0c8ee0 0x7f3b7c15a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:58.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.193+0000 7f3b814e8640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b7c072f60 con 0x7f3b7c1515e0 2024-04-25T03:09:58.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.193+0000 7f3b814e8640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b7c073200 con 0x7f3b7c151200 2024-04-25T03:09:58.195 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.193+0000 7f3b814e8640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f3b7c0c2f60 con 0x7f3b7c0c8ee0 2024-04-25T03:09:58.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.193+0000 7f3b727fc640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f3b7c1515e0 0x7f3b7c0c62c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:54168/0 (socket says 172.21.15.162:54168) 2024-04-25T03:09:58.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.193+0000 7f3b727fc640 1 -- 172.21.15.162:0/2812696752 learned_addr learned my addr 172.21.15.162:0/2812696752 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:09:58.196 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.193+0000 7f3b7b7fe640 1 --2- 172.21.15.162:0/2812696752 >> v2:172.21.15.179:3300/0 conn(0x7f3b7c0c8ee0 0x7f3b7c15a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:58.197 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.197+0000 7f3b7a7fc640 1 -- 172.21.15.162:0/2812696752 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3627837913 0 0) 0x7f3b7c072f60 con 0x7f3b7c1515e0 2024-04-25T03:09:58.198 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.197+0000 7f3b7a7fc640 1 -- 172.21.15.162:0/2812696752 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b68003530 con 0x7f3b7c1515e0 2024-04-25T03:09:58.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.201+0000 7f3b7a7fc640 1 -- 172.21.15.162:0/2812696752 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2685216714 0 0) 0x7f3b68003530 con 0x7f3b7c1515e0 2024-04-25T03:09:58.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.201+0000 7f3b7a7fc640 1 -- 172.21.15.162:0/2812696752 >> v2:172.21.15.179:3300/0 conn(0x7f3b7c0c8ee0 msgr2=0x7f3b7c15a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:58.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.201+0000 7f3b7a7fc640 1 --2- 172.21.15.162:0/2812696752 >> v2:172.21.15.179:3300/0 conn(0x7f3b7c0c8ee0 0x7f3b7c15a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:58.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.201+0000 7f3b7a7fc640 1 -- 172.21.15.162:0/2812696752 >> v1:172.21.15.179:6789/0 conn(0x7f3b7c151200 legacy=0x7f3b7c072850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:58.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.201+0000 7f3b7a7fc640 1 -- 172.21.15.162:0/2812696752 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c0c3240 con 0x7f3b7c1515e0 2024-04-25T03:09:58.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.201+0000 7f3b7a7fc640 1 -- 172.21.15.162:0/2812696752 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7f3b640016a0 con 0x7f3b7c1515e0 2024-04-25T03:09:58.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.201+0000 7f3b7a7fc640 1 -- 172.21.15.162:0/2812696752 >> v1:172.21.15.162:6789/0 conn(0x7f3b7c1515e0 legacy=0x7f3b7c0c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:58.202 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.201+0000 7f3b7a7fc640 1 --2- 172.21.15.162:0/2812696752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b680039c0 0x7f3b68003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:58.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.201+0000 7f3b7a7fc640 1 --2- 172.21.15.162:0/2812696752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b68004810 0x7f3b68004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:58.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.201+0000 7f3b7a7fc640 1 --2- 172.21.15.162:0/2812696752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b680051d0 0x7f3b6800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:58.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.201+0000 7f3b7a7fc640 1 -- 172.21.15.162:0/2812696752 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c0c2f60 con 0x7f3b680039c0 2024-04-25T03:09:58.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.201+0000 7f3b7a7fc640 1 -- 172.21.15.162:0/2812696752 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6800c050 con 0x7f3b68004810 2024-04-25T03:09:58.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.201+0000 7f3b7a7fc640 1 -- 172.21.15.162:0/2812696752 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3b6800c250 con 0x7f3b680051d0 2024-04-25T03:09:58.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.201+0000 7f3b7b7fe640 1 --2- 172.21.15.162:0/2812696752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b680051d0 0x7f3b6800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:58.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.205+0000 7f3b7affd640 1 --2- 172.21.15.162:0/2812696752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b680039c0 0x7f3b68003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:58.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.205+0000 7f3b7affd640 1 -- 172.21.15.162:0/2812696752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b680051d0 msgr2=0x7f3b6800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:58.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.205+0000 7f3b7affd640 1 --2- 172.21.15.162:0/2812696752 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b680051d0 0x7f3b6800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:58.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.205+0000 7f3b7affd640 1 -- 172.21.15.162:0/2812696752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b68004810 msgr2=0x7f3b68004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:09:58.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.205+0000 7f3b7affd640 1 --2- 172.21.15.162:0/2812696752 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b68004810 0x7f3b68004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:58.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.205+0000 7f3b7affd640 1 -- 172.21.15.162:0/2812696752 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b68003530 con 0x7f3b680039c0 2024-04-25T03:09:58.209 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.205+0000 7f3b7b7fe640 1 -- 172.21.15.162:0/2812696752 reap_dead start 2024-04-25T03:09:58.212 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.209+0000 7f3b7affd640 1 --2- 172.21.15.162:0/2812696752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b680039c0 0x7f3b68003dc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c001650 tx=0x7f3b6c01c2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b2c8e48e7c4b97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:58.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.213+0000 7f3b7a7fc640 1 -- 172.21.15.162:0/2812696752 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c001250 con 0x7f3b680039c0 2024-04-25T03:09:58.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.213+0000 7f3b7a7fc640 1 -- 172.21.15.162:0/2812696752 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b6c005270 con 0x7f3b680039c0 2024-04-25T03:09:58.216 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.213+0000 7f3b7a7fc640 1 -- 172.21.15.162:0/2812696752 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c003860 con 0x7f3b680039c0 2024-04-25T03:09:58.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.217+0000 7f3b814e8640 1 -- 172.21.15.162:0/2812696752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b680039c0 msgr2=0x7f3b68003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:58.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.217+0000 7f3b814e8640 1 --2- 172.21.15.162:0/2812696752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b680039c0 0x7f3b68003dc0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c001650 tx=0x7f3b6c01c2e0 comp rx=0 tx=0).stop 2024-04-25T03:09:58.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.217+0000 7f3b814e8640 1 -- 172.21.15.162:0/2812696752 shutdown_connections 2024-04-25T03:09:58.217 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.217+0000 7f3b814e8640 1 --2- 172.21.15.162:0/2812696752 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b680039c0 0x7f3b68003dc0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:58.218 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.217+0000 7f3b814e8640 1 -- 172.21.15.162:0/2812696752 >> 172.21.15.162:0/2812696752 conn(0x7f3b7c0c83c0 msgr2=0x7f3b7c0c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:58.218 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.217+0000 7f3b814e8640 1 -- 172.21.15.162:0/2812696752 shutdown_connections 2024-04-25T03:09:58.218 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.217+0000 7f3b814e8640 1 -- 172.21.15.162:0/2812696752 wait complete. 2024-04-25T03:09:58.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.217+0000 7f3b814e8640 1 Processor -- start 2024-04-25T03:09:58.219 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.217+0000 7f3b814e8640 1 -- start start 2024-04-25T03:09:58.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.217+0000 7f3b814e8640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b680039c0 0x7f3b7c14fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:58.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.217+0000 7f3b814e8640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b7c1568b0 0x7f3b7c155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:58.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.217+0000 7f3b814e8640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b7c155890 0x7f3b7c161ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:58.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.217+0000 7f3b814e8640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c15a950 con 0x7f3b680039c0 2024-04-25T03:09:58.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.217+0000 7f3b814e8640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f3b7c15a7d0 con 0x7f3b7c1568b0 2024-04-25T03:09:58.220 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.217+0000 7f3b814e8640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f3b7c15aad0 con 0x7f3b7c155890 2024-04-25T03:09:58.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.217+0000 7f3b7affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b680039c0 0x7f3b7c14fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:58.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.217+0000 7f3b7affd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b680039c0 0x7f3b7c14fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:47188/0 (socket says 172.21.15.162:47188) 2024-04-25T03:09:58.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.217+0000 7f3b7affd640 1 -- 172.21.15.162:0/44394553 learned_addr learned my addr 172.21.15.162:0/44394553 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:09:58.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.221+0000 7f3b7b7fe640 1 --2- 172.21.15.162:0/44394553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b7c155890 0x7f3b7c161ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:58.221 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.221+0000 7f3b727fc640 1 --2- 172.21.15.162:0/44394553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b7c1568b0 0x7f3b7c155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:58.225 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.221+0000 7f3b7affd640 1 -- 172.21.15.162:0/44394553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b7c155890 msgr2=0x7f3b7c161ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:58.225 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.221+0000 7f3b7affd640 1 --2- 172.21.15.162:0/44394553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b7c155890 0x7f3b7c161ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:58.225 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.221+0000 7f3b7affd640 1 -- 172.21.15.162:0/44394553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b7c1568b0 msgr2=0x7f3b7c155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:58.225 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.221+0000 7f3b7affd640 1 --2- 172.21.15.162:0/44394553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b7c1568b0 0x7f3b7c155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:58.225 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.221+0000 7f3b7affd640 1 -- 172.21.15.162:0/44394553 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b7c1633b0 con 0x7f3b680039c0 2024-04-25T03:09:58.227 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.225+0000 7f3b7affd640 1 --2- 172.21.15.162:0/44394553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b680039c0 0x7f3b7c14fe10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c001650 tx=0x7f3b68005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:58.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.229+0000 7f3b73fff640 1 -- 172.21.15.162:0/44394553 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c0bb070 con 0x7f3b680039c0 2024-04-25T03:09:58.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.229+0000 7f3b73fff640 1 -- 172.21.15.162:0/44394553 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b6c0050c0 con 0x7f3b680039c0 2024-04-25T03:09:58.231 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.229+0000 7f3b73fff640 1 -- 172.21.15.162:0/44394553 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c007a60 con 0x7f3b680039c0 2024-04-25T03:09:58.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.229+0000 7f3b814e8640 1 -- 172.21.15.162:0/44394553 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b7c1f7a00 con 0x7f3b680039c0 2024-04-25T03:09:58.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.229+0000 7f3b814e8640 1 -- 172.21.15.162:0/44394553 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b7c163650 con 0x7f3b680039c0 2024-04-25T03:09:58.232 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.229+0000 7f3b814e8640 1 -- 172.21.15.162:0/44394553 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b7c0c8b40 con 0x7f3b680039c0 2024-04-25T03:09:58.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.521+0000 7f3b73fff640 1 -- 172.21.15.162:0/44394553 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3b6c0be070 con 0x7f3b680039c0 2024-04-25T03:09:58.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.525+0000 7f3b73fff640 1 --2- 172.21.15.162:0/44394553 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3b5c067940 0x7f3b5c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:09:58.525 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.525+0000 7f3b727fc640 1 --2- 172.21.15.162:0/44394553 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3b5c067940 0x7f3b5c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:09:58.526 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.525+0000 7f3b727fc640 1 --2- 172.21.15.162:0/44394553 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3b5c067940 0x7f3b5c069e00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0c4340 tx=0x7f3b64001820 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:09:58.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.557+0000 7f3b73fff640 1 -- 172.21.15.162:0/44394553 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f3b6c0edac0 con 0x7f3b680039c0 2024-04-25T03:09:58.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.557+0000 7f3b73fff640 1 -- 172.21.15.162:0/44394553 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f3b6c0c5020 con 0x7f3b680039c0 2024-04-25T03:09:58.738 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.737+0000 7f3b814e8640 1 -- 172.21.15.162:0/44394553 --> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3b7c0c27c0 con 0x7f3b5c067940 2024-04-25T03:09:58.747 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.745+0000 7f3b73fff640 1 -- 172.21.15.162:0/44394553 <== mgr.4100 v2:172.21.15.162:6800/3960394531 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252863 (secure 0 0 0) 0x7f3b7c0c27c0 con 0x7f3b5c067940 2024-04-25T03:09:58.749 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T03:09:58.751 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-04-25T03:09:58.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.749+0000 7f3b814e8640 1 -- 172.21.15.162:0/44394553 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3b5c067940 msgr2=0x7f3b5c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:58.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.749+0000 7f3b814e8640 1 --2- 172.21.15.162:0/44394553 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3b5c067940 0x7f3b5c069e00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0c4340 tx=0x7f3b64001820 comp rx=0 tx=0).stop 2024-04-25T03:09:58.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.749+0000 7f3b814e8640 1 -- 172.21.15.162:0/44394553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b680039c0 msgr2=0x7f3b7c14fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:09:58.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.749+0000 7f3b814e8640 1 --2- 172.21.15.162:0/44394553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b680039c0 0x7f3b7c14fe10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c001650 tx=0x7f3b68005840 comp rx=0 tx=0).stop 2024-04-25T03:09:58.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.749+0000 7f3b814e8640 1 -- 172.21.15.162:0/44394553 shutdown_connections 2024-04-25T03:09:58.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.749+0000 7f3b814e8640 1 --2- 172.21.15.162:0/44394553 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f3b7c155890 0x7f3b7c161ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:58.752 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.749+0000 7f3b814e8640 1 --2- 172.21.15.162:0/44394553 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f3b7c1568b0 0x7f3b7c155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:58.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.749+0000 7f3b814e8640 1 --2- 172.21.15.162:0/44394553 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f3b5c067940 0x7f3b5c069e00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:58.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.749+0000 7f3b814e8640 1 --2- 172.21.15.162:0/44394553 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f3b680039c0 0x7f3b7c14fe10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:09:58.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.749+0000 7f3b814e8640 1 -- 172.21.15.162:0/44394553 >> 172.21.15.162:0/44394553 conn(0x7f3b7c0c83c0 msgr2=0x7f3b7c0c4c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:09:58.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.749+0000 7f3b814e8640 1 -- 172.21.15.162:0/44394553 shutdown_connections 2024-04-25T03:09:58.753 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:09:58.749+0000 7f3b814e8640 1 -- 172.21.15.162:0/44394553 wait complete. 2024-04-25T03:09:58.769 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":4226,"stamp":"2024-04-25T03:09:57.099054+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":213663988,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":7157,"num_read_kb":1391768,"num_write":72243,"num_write_kb":4439398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64970,"ondisk_log_size":64970,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1152376,"kb_used_data":419832,"kb_used_omap":12,"kb_used_meta":732467,"kb_avail":753822344,"statfs":{"total":773094113280,"available":771914080256,"internally_reserved":0,"allocated":429907968,"data_stored":428194960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":750046769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003566"},"pg_stats":[{"pgid":"3.3f","version":"28'428","reported_seq":558,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.658545+0000","last_change":"2024-04-25T00:50:35.761428+0000","last_active":"2024-04-25T03:09:40.658545+0000","last_peered":"2024-04-25T03:09:40.658545+0000","last_clean":"2024-04-25T03:09:40.658545+0000","last_became_active":"2024-04-25T00:50:35.760579+0000","last_became_peered":"2024-04-25T00:50:35.760579+0000","last_unstale":"2024-04-25T03:09:40.658545+0000","last_undegraded":"2024-04-25T03:09:40.658545+0000","last_fullsized":"2024-04-25T03:09:40.658545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:13:06.236972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25441,"num_write":394,"num_write_kb":67715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'447","reported_seq":652,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.903438+0000","last_change":"2024-04-25T00:50:35.798137+0000","last_active":"2024-04-25T03:09:40.903438+0000","last_peered":"2024-04-25T03:09:40.903438+0000","last_clean":"2024-04-25T03:09:40.903438+0000","last_became_active":"2024-04-25T00:50:35.797354+0000","last_became_peered":"2024-04-25T00:50:35.797354+0000","last_unstale":"2024-04-25T03:09:40.903438+0000","last_undegraded":"2024-04-25T03:09:40.903438+0000","last_fullsized":"2024-04-25T03:09:40.903438+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":59186,"num_write":421,"num_write_kb":88627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'383","reported_seq":485,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.900792+0000","last_change":"2024-04-25T00:50:35.799370+0000","last_active":"2024-04-25T03:09:40.900792+0000","last_peered":"2024-04-25T03:09:40.900792+0000","last_clean":"2024-04-25T03:09:40.900792+0000","last_became_active":"2024-04-25T00:50:35.798268+0000","last_became_peered":"2024-04-25T00:50:35.798268+0000","last_unstale":"2024-04-25T03:09:40.900792+0000","last_undegraded":"2024-04-25T03:09:40.900792+0000","last_fullsized":"2024-04-25T03:09:40.900792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8918,"num_write":356,"num_write_kb":42288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'378","reported_seq":485,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.726379+0000","last_change":"2024-04-25T00:50:35.877965+0000","last_active":"2024-04-25T03:09:40.726379+0000","last_peered":"2024-04-25T03:09:40.726379+0000","last_clean":"2024-04-25T03:09:40.726379+0000","last_became_active":"2024-04-25T00:50:35.877114+0000","last_became_peered":"2024-04-25T00:50:35.877114+0000","last_unstale":"2024-04-25T03:09:40.726379+0000","last_undegraded":"2024-04-25T03:09:40.726379+0000","last_fullsized":"2024-04-25T03:09:40.726379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:28:20.857588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":5983,"num_write":348,"num_write_kb":38519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'398","reported_seq":495,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.655255+0000","last_change":"2024-04-25T00:50:35.730647+0000","last_active":"2024-04-25T03:09:40.655255+0000","last_peered":"2024-04-25T03:09:40.655255+0000","last_clean":"2024-04-25T03:09:40.655255+0000","last_became_active":"2024-04-25T00:50:35.729785+0000","last_became_peered":"2024-04-25T00:50:35.729785+0000","last_unstale":"2024-04-25T03:09:40.655255+0000","last_undegraded":"2024-04-25T03:09:40.655255+0000","last_fullsized":"2024-04-25T03:09:40.655255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:02.888747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12535,"num_write":367,"num_write_kb":34849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'384","reported_seq":469,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.058722+0000","last_change":"2024-04-25T00:51:40.324509+0000","last_active":"2024-04-25T03:09:41.058722+0000","last_peered":"2024-04-25T03:09:41.058722+0000","last_clean":"2024-04-25T03:09:41.058722+0000","last_became_active":"2024-04-25T00:51:40.323657+0000","last_became_peered":"2024-04-25T00:51:40.323657+0000","last_unstale":"2024-04-25T03:09:41.058722+0000","last_undegraded":"2024-04-25T03:09:41.058722+0000","last_fullsized":"2024-04-25T03:09:41.058722+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:46:58.981295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9183,"num_write":360,"num_write_kb":42897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"28'423","reported_seq":516,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.632470+0000","last_change":"2024-04-25T00:50:35.797990+0000","last_active":"2024-04-25T03:09:40.632470+0000","last_peered":"2024-04-25T03:09:40.632470+0000","last_clean":"2024-04-25T03:09:40.632470+0000","last_became_active":"2024-04-25T00:50:35.797328+0000","last_became_peered":"2024-04-25T00:50:35.797328+0000","last_unstale":"2024-04-25T03:09:40.632470+0000","last_undegraded":"2024-04-25T03:09:40.632470+0000","last_fullsized":"2024-04-25T03:09:40.632470+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:59.565909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6445,"num_write":396,"num_write_kb":56628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'391","reported_seq":538,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.065080+0000","last_change":"2024-04-25T00:50:35.878367+0000","last_active":"2024-04-25T03:09:41.065080+0000","last_peered":"2024-04-25T03:09:41.065080+0000","last_clean":"2024-04-25T03:09:41.065080+0000","last_became_active":"2024-04-25T00:50:35.877581+0000","last_became_peered":"2024-04-25T00:50:35.877581+0000","last_unstale":"2024-04-25T03:09:41.065080+0000","last_undegraded":"2024-04-25T03:09:41.065080+0000","last_fullsized":"2024-04-25T03:09:41.065080+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":40559,"num_write":354,"num_write_kb":84336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'417","reported_seq":510,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.066086+0000","last_change":"2024-04-25T00:51:40.608818+0000","last_active":"2024-04-25T03:09:41.066086+0000","last_peered":"2024-04-25T03:09:41.066086+0000","last_clean":"2024-04-25T03:09:41.066086+0000","last_became_active":"2024-04-25T00:51:40.608071+0000","last_became_peered":"2024-04-25T00:51:40.608071+0000","last_unstale":"2024-04-25T03:09:41.066086+0000","last_undegraded":"2024-04-25T03:09:41.066086+0000","last_fullsized":"2024-04-25T03:09:41.066086+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:48:27.210535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14358,"num_write":383,"num_write_kb":47358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"28'402","reported_seq":520,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.088602+0000","last_change":"2024-04-25T00:50:35.765173+0000","last_active":"2024-04-25T03:09:41.088602+0000","last_peered":"2024-04-25T03:09:41.088602+0000","last_clean":"2024-04-25T03:09:41.088602+0000","last_became_active":"2024-04-25T00:50:35.764412+0000","last_became_peered":"2024-04-25T00:50:35.764412+0000","last_unstale":"2024-04-25T03:09:41.088602+0000","last_undegraded":"2024-04-25T03:09:41.088602+0000","last_fullsized":"2024-04-25T03:09:41.088602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:54.948867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":23778,"num_write":367,"num_write_kb":71174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'383","reported_seq":491,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.067336+0000","last_change":"2024-04-25T00:50:35.764526+0000","last_active":"2024-04-25T03:09:41.067336+0000","last_peered":"2024-04-25T03:09:41.067336+0000","last_clean":"2024-04-25T03:09:41.067336+0000","last_became_active":"2024-04-25T00:50:35.763770+0000","last_became_peered":"2024-04-25T00:50:35.763770+0000","last_unstale":"2024-04-25T03:09:41.067336+0000","last_undegraded":"2024-04-25T03:09:41.067336+0000","last_fullsized":"2024-04-25T03:09:41.067336+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:57:15.698294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20604,"num_write":365,"num_write_kb":74840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'373","reported_seq":489,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.657926+0000","last_change":"2024-04-25T00:50:35.822113+0000","last_active":"2024-04-25T03:09:40.657926+0000","last_peered":"2024-04-25T03:09:40.657926+0000","last_clean":"2024-04-25T03:09:40.657926+0000","last_became_active":"2024-04-25T00:50:35.821524+0000","last_became_peered":"2024-04-25T00:50:35.821524+0000","last_unstale":"2024-04-25T03:09:40.657926+0000","last_undegraded":"2024-04-25T03:09:40.657926+0000","last_fullsized":"2024-04-25T03:09:40.657926+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:43.722114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22834,"num_write":346,"num_write_kb":67125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'376","reported_seq":455,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.066295+0000","last_change":"2024-04-25T00:50:35.881637+0000","last_active":"2024-04-25T03:09:41.066295+0000","last_peered":"2024-04-25T03:09:41.066295+0000","last_clean":"2024-04-25T03:09:41.066295+0000","last_became_active":"2024-04-25T00:50:35.880661+0000","last_became_peered":"2024-04-25T00:50:35.880661+0000","last_unstale":"2024-04-25T03:09:41.066295+0000","last_undegraded":"2024-04-25T03:09:41.066295+0000","last_fullsized":"2024-04-25T03:09:41.066295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":168,"num_write":340,"num_write_kb":38232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'401","reported_seq":488,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:54.788693+0000","last_change":"2024-04-25T03:09:54.788755+0000","last_active":"2024-04-25T03:09:54.788693+0000","last_peered":"2024-04-25T03:09:54.788693+0000","last_clean":"2024-04-25T03:09:54.788693+0000","last_became_active":"2024-04-25T00:50:35.795295+0000","last_became_peered":"2024-04-25T00:50:35.795295+0000","last_unstale":"2024-04-25T03:09:54.788693+0000","last_undegraded":"2024-04-25T03:09:54.788693+0000","last_fullsized":"2024-04-25T03:09:54.788693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'401","last_scrub_stamp":"2024-04-25T03:09:54.788476+0000","last_deep_scrub":"28'401","last_deep_scrub_stamp":"2024-04-25T03:09:54.788476+0000","last_clean_scrub_stamp":"2024-04-25T03:09:54.788476+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:57.168091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":22306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'418","reported_seq":580,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.891506+0000","last_change":"2024-04-25T00:50:35.818291+0000","last_active":"2024-04-25T03:09:40.891506+0000","last_peered":"2024-04-25T03:09:40.891506+0000","last_clean":"2024-04-25T03:09:40.891506+0000","last_became_active":"2024-04-25T00:50:35.817575+0000","last_became_peered":"2024-04-25T00:50:35.817575+0000","last_unstale":"2024-04-25T03:09:40.891506+0000","last_undegraded":"2024-04-25T03:09:40.891506+0000","last_fullsized":"2024-04-25T03:09:40.891506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":52039,"num_write":380,"num_write_kb":55267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'423","reported_seq":512,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.662177+0000","last_change":"2024-04-25T00:50:35.797194+0000","last_active":"2024-04-25T03:09:40.662177+0000","last_peered":"2024-04-25T03:09:40.662177+0000","last_clean":"2024-04-25T03:09:40.662177+0000","last_became_active":"2024-04-25T00:50:35.796536+0000","last_became_peered":"2024-04-25T00:50:35.796536+0000","last_unstale":"2024-04-25T03:09:40.662177+0000","last_undegraded":"2024-04-25T03:09:40.662177+0000","last_fullsized":"2024-04-25T03:09:40.662177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:48:27.210535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4763,"num_write":382,"num_write_kb":21763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'399","reported_seq":507,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.655166+0000","last_change":"2024-04-25T00:50:35.729648+0000","last_active":"2024-04-25T03:09:40.655166+0000","last_peered":"2024-04-25T03:09:40.655166+0000","last_clean":"2024-04-25T03:09:40.655166+0000","last_became_active":"2024-04-25T00:50:35.728875+0000","last_became_peered":"2024-04-25T00:50:35.728875+0000","last_unstale":"2024-04-25T03:09:40.655166+0000","last_undegraded":"2024-04-25T03:09:40.655166+0000","last_fullsized":"2024-04-25T03:09:40.655166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:46.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10229,"num_write":366,"num_write_kb":22657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'400","reported_seq":498,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.071871+0000","last_change":"2024-04-25T00:50:35.760953+0000","last_active":"2024-04-25T03:09:41.071871+0000","last_peered":"2024-04-25T03:09:41.071871+0000","last_clean":"2024-04-25T03:09:41.071871+0000","last_became_active":"2024-04-25T00:50:35.760286+0000","last_became_peered":"2024-04-25T00:50:35.760286+0000","last_unstale":"2024-04-25T03:09:41.071871+0000","last_undegraded":"2024-04-25T03:09:41.071871+0000","last_fullsized":"2024-04-25T03:09:41.071871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:57.466393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9641,"num_write":360,"num_write_kb":34623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'447","reported_seq":591,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.651462+0000","last_change":"2024-04-25T00:50:35.732837+0000","last_active":"2024-04-25T03:09:40.651462+0000","last_peered":"2024-04-25T03:09:40.651462+0000","last_clean":"2024-04-25T03:09:40.651462+0000","last_became_active":"2024-04-25T00:50:35.732134+0000","last_became_peered":"2024-04-25T00:50:35.732134+0000","last_unstale":"2024-04-25T03:09:40.651462+0000","last_undegraded":"2024-04-25T03:09:40.651462+0000","last_fullsized":"2024-04-25T03:09:40.651462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:46.944929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":29174,"num_write":415,"num_write_kb":129675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"28'442","reported_seq":544,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.067632+0000","last_change":"2024-04-25T00:50:35.818607+0000","last_active":"2024-04-25T03:09:41.067632+0000","last_peered":"2024-04-25T03:09:41.067632+0000","last_clean":"2024-04-25T03:09:41.067632+0000","last_became_active":"2024-04-25T00:50:35.818063+0000","last_became_peered":"2024-04-25T00:50:35.818063+0000","last_unstale":"2024-04-25T03:09:41.067632+0000","last_undegraded":"2024-04-25T03:09:41.067632+0000","last_fullsized":"2024-04-25T03:09:41.067632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:15.875347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20728,"num_write":411,"num_write_kb":42636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"28'443","reported_seq":590,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:55.829871+0000","last_change":"2024-04-25T03:09:55.829914+0000","last_active":"2024-04-25T03:09:55.829871+0000","last_peered":"2024-04-25T03:09:55.829871+0000","last_clean":"2024-04-25T03:09:55.829871+0000","last_became_active":"2024-04-25T00:50:35.797580+0000","last_became_peered":"2024-04-25T00:50:35.797580+0000","last_unstale":"2024-04-25T03:09:55.829871+0000","last_undegraded":"2024-04-25T03:09:55.829871+0000","last_fullsized":"2024-04-25T03:09:55.829871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'443","last_scrub_stamp":"2024-04-25T03:09:55.829755+0000","last_deep_scrub":"28'443","last_deep_scrub_stamp":"2024-04-25T03:09:55.829755+0000","last_clean_scrub_stamp":"2024-04-25T03:09:55.829755+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:25:29.657388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28574,"num_write":419,"num_write_kb":125045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"28'422","reported_seq":523,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.063896+0000","last_change":"2024-04-25T00:51:40.408412+0000","last_active":"2024-04-25T03:09:41.063896+0000","last_peered":"2024-04-25T03:09:41.063896+0000","last_clean":"2024-04-25T03:09:41.063896+0000","last_became_active":"2024-04-25T00:51:40.407614+0000","last_became_peered":"2024-04-25T00:51:40.407614+0000","last_unstale":"2024-04-25T03:09:41.063896+0000","last_undegraded":"2024-04-25T03:09:41.063896+0000","last_fullsized":"2024-04-25T03:09:41.063896+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:10.742578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":17978,"num_write":385,"num_write_kb":59372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"28'409","reported_seq":523,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.039677+0000","last_change":"2024-04-25T00:50:35.877261+0000","last_active":"2024-04-25T03:09:41.039677+0000","last_peered":"2024-04-25T03:09:41.039677+0000","last_clean":"2024-04-25T03:09:41.039677+0000","last_became_active":"2024-04-25T00:50:35.876489+0000","last_became_peered":"2024-04-25T00:50:35.876489+0000","last_unstale":"2024-04-25T03:09:41.039677+0000","last_undegraded":"2024-04-25T03:09:41.039677+0000","last_fullsized":"2024-04-25T03:09:41.039677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":9083,"num_write":379,"num_write_kb":55476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'437","reported_seq":561,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.651386+0000","last_change":"2024-04-25T00:50:35.877693+0000","last_active":"2024-04-25T03:09:40.651386+0000","last_peered":"2024-04-25T03:09:40.651386+0000","last_clean":"2024-04-25T03:09:40.651386+0000","last_became_active":"2024-04-25T00:50:35.876870+0000","last_became_peered":"2024-04-25T00:50:35.876870+0000","last_unstale":"2024-04-25T03:09:40.651386+0000","last_undegraded":"2024-04-25T03:09:40.651386+0000","last_fullsized":"2024-04-25T03:09:40.651386+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:53.474315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":19659,"num_write":409,"num_write_kb":79764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"28'386","reported_seq":491,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.032568+0000","last_change":"2024-04-25T00:50:35.881027+0000","last_active":"2024-04-25T03:09:41.032568+0000","last_peered":"2024-04-25T03:09:41.032568+0000","last_clean":"2024-04-25T03:09:41.032568+0000","last_became_active":"2024-04-25T00:50:35.880477+0000","last_became_peered":"2024-04-25T00:50:35.880477+0000","last_unstale":"2024-04-25T03:09:41.032568+0000","last_undegraded":"2024-04-25T03:09:41.032568+0000","last_fullsized":"2024-04-25T03:09:41.032568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12882,"num_write":369,"num_write_kb":38131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"28'477","reported_seq":598,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.088090+0000","last_change":"2024-04-25T00:50:35.765295+0000","last_active":"2024-04-25T03:09:41.088090+0000","last_peered":"2024-04-25T03:09:41.088090+0000","last_clean":"2024-04-25T03:09:41.088090+0000","last_became_active":"2024-04-25T00:50:35.764358+0000","last_became_peered":"2024-04-25T00:50:35.764358+0000","last_unstale":"2024-04-25T03:09:41.088090+0000","last_undegraded":"2024-04-25T03:09:41.088090+0000","last_fullsized":"2024-04-25T03:09:41.088090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:15.104631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":19569,"num_write":439,"num_write_kb":84809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'424","reported_seq":586,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.888720+0000","last_change":"2024-04-25T00:50:35.869695+0000","last_active":"2024-04-25T03:09:40.888720+0000","last_peered":"2024-04-25T03:09:40.888720+0000","last_clean":"2024-04-25T03:09:40.888720+0000","last_became_active":"2024-04-25T00:50:35.868857+0000","last_became_peered":"2024-04-25T00:50:35.868857+0000","last_unstale":"2024-04-25T03:09:40.888720+0000","last_undegraded":"2024-04-25T03:09:40.888720+0000","last_fullsized":"2024-04-25T03:09:40.888720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50759,"num_write":394,"num_write_kb":108657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"28'403","reported_seq":564,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.035866+0000","last_change":"2024-04-25T00:50:35.884507+0000","last_active":"2024-04-25T03:09:41.035866+0000","last_peered":"2024-04-25T03:09:41.035866+0000","last_clean":"2024-04-25T03:09:41.035866+0000","last_became_active":"2024-04-25T00:50:35.883901+0000","last_became_peered":"2024-04-25T00:50:35.883901+0000","last_unstale":"2024-04-25T03:09:41.035866+0000","last_undegraded":"2024-04-25T03:09:41.035866+0000","last_fullsized":"2024-04-25T03:09:41.035866+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":36518,"num_write":378,"num_write_kb":108957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'386","reported_seq":491,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.907032+0000","last_change":"2024-04-25T00:50:35.878649+0000","last_active":"2024-04-25T03:09:40.907032+0000","last_peered":"2024-04-25T03:09:40.907032+0000","last_clean":"2024-04-25T03:09:40.907032+0000","last_became_active":"2024-04-25T00:50:35.877870+0000","last_became_peered":"2024-04-25T00:50:35.877870+0000","last_unstale":"2024-04-25T03:09:40.907032+0000","last_undegraded":"2024-04-25T03:09:40.907032+0000","last_fullsized":"2024-04-25T03:09:40.907032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12325,"num_write":357,"num_write_kb":37847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"28'487","reported_seq":632,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.644401+0000","last_change":"2024-04-25T00:50:35.869614+0000","last_active":"2024-04-25T03:09:40.644401+0000","last_peered":"2024-04-25T03:09:40.644401+0000","last_clean":"2024-04-25T03:09:40.644401+0000","last_became_active":"2024-04-25T00:50:35.869016+0000","last_became_peered":"2024-04-25T00:50:35.869016+0000","last_unstale":"2024-04-25T03:09:40.644401+0000","last_undegraded":"2024-04-25T03:09:40.644401+0000","last_fullsized":"2024-04-25T03:09:40.644401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:02.888747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33246,"num_write":457,"num_write_kb":117202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"28'457","reported_seq":577,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.066664+0000","last_change":"2024-04-25T00:50:35.728757+0000","last_active":"2024-04-25T03:09:41.066664+0000","last_peered":"2024-04-25T03:09:41.066664+0000","last_clean":"2024-04-25T03:09:41.066664+0000","last_became_active":"2024-04-25T00:50:35.728271+0000","last_became_peered":"2024-04-25T00:50:35.728271+0000","last_unstale":"2024-04-25T03:09:41.066664+0000","last_undegraded":"2024-04-25T03:09:41.066664+0000","last_fullsized":"2024-04-25T03:09:41.066664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:00:43.722114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18149,"num_write":425,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"28'412","reported_seq":509,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.071602+0000","last_change":"2024-04-25T00:50:35.802347+0000","last_active":"2024-04-25T03:09:41.071602+0000","last_peered":"2024-04-25T03:09:41.071602+0000","last_clean":"2024-04-25T03:09:41.071602+0000","last_became_active":"2024-04-25T00:50:35.801389+0000","last_became_peered":"2024-04-25T00:50:35.801389+0000","last_unstale":"2024-04-25T03:09:41.071602+0000","last_undegraded":"2024-04-25T03:09:41.071602+0000","last_fullsized":"2024-04-25T03:09:41.071602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:27.176441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4792,"num_write":381,"num_write_kb":30347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"28'401","reported_seq":506,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.654605+0000","last_change":"2024-04-25T00:50:35.822222+0000","last_active":"2024-04-25T03:09:40.654605+0000","last_peered":"2024-04-25T03:09:40.654605+0000","last_clean":"2024-04-25T03:09:40.654605+0000","last_became_active":"2024-04-25T00:50:35.821484+0000","last_became_peered":"2024-04-25T00:50:35.821484+0000","last_unstale":"2024-04-25T03:09:40.654605+0000","last_undegraded":"2024-04-25T03:09:40.654605+0000","last_fullsized":"2024-04-25T03:09:40.654605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:59.921295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18401,"num_write":362,"num_write_kb":62496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'366","reported_seq":453,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:55.986928+0000","last_change":"2024-04-25T03:09:55.986977+0000","last_active":"2024-04-25T03:09:55.986928+0000","last_peered":"2024-04-25T03:09:55.986928+0000","last_clean":"2024-04-25T03:09:55.986928+0000","last_became_active":"2024-04-25T00:50:33.390901+0000","last_became_peered":"2024-04-25T00:50:33.390901+0000","last_unstale":"2024-04-25T03:09:55.986928+0000","last_undegraded":"2024-04-25T03:09:55.986928+0000","last_fullsized":"2024-04-25T03:09:55.986928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'366","last_scrub_stamp":"2024-04-25T03:09:55.986816+0000","last_deep_scrub":"28'366","last_deep_scrub_stamp":"2024-04-25T03:09:55.986816+0000","last_clean_scrub_stamp":"2024-04-25T03:09:55.986816+0000","objects_scrubbed":3,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:14:35.219405+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":4231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'355","reported_seq":434,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.907688+0000","last_change":"2024-04-25T00:50:35.821496+0000","last_active":"2024-04-25T03:09:40.907688+0000","last_peered":"2024-04-25T03:09:40.907688+0000","last_clean":"2024-04-25T03:09:40.907688+0000","last_became_active":"2024-04-25T00:50:35.820763+0000","last_became_peered":"2024-04-25T00:50:35.820763+0000","last_unstale":"2024-04-25T03:09:40.907688+0000","last_undegraded":"2024-04-25T03:09:40.907688+0000","last_fullsized":"2024-04-25T03:09:40.907688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":529,"num_write":324,"num_write_kb":17419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"28'2226","reported_seq":2304,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:58.865093+0000","last_change":"2024-04-25T00:50:33.394753+0000","last_active":"2024-04-25T03:07:58.865093+0000","last_peered":"2024-04-25T03:07:58.865093+0000","last_clean":"2024-04-25T03:07:58.865093+0000","last_became_active":"2024-04-25T00:50:33.392951+0000","last_became_peered":"2024-04-25T00:50:33.392951+0000","last_unstale":"2024-04-25T03:07:58.865093+0000","last_undegraded":"2024-04-25T03:07:58.865093+0000","last_fullsized":"2024-04-25T03:07:58.865093+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2226,"log_dups_size":0,"ondisk_log_size":2226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:26:41.175588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2166,"num_write_kb":17433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'819","reported_seq":900,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:33.047044+0000","last_change":"2024-04-25T00:50:33.393229+0000","last_active":"2024-04-25T03:09:33.047044+0000","last_peered":"2024-04-25T03:09:33.047044+0000","last_clean":"2024-04-25T03:09:33.047044+0000","last_became_active":"2024-04-25T00:50:33.392817+0000","last_became_peered":"2024-04-25T00:50:33.392817+0000","last_unstale":"2024-04-25T03:09:33.047044+0000","last_undegraded":"2024-04-25T03:09:33.047044+0000","last_fullsized":"2024-04-25T03:09:33.047044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":819,"log_dups_size":0,"ondisk_log_size":819,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":4477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'429","reported_seq":504,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.898624+0000","last_change":"2024-04-25T00:51:40.320773+0000","last_active":"2024-04-25T03:09:40.898624+0000","last_peered":"2024-04-25T03:09:40.898624+0000","last_clean":"2024-04-25T03:09:40.898624+0000","last_became_active":"2024-04-25T00:51:40.319726+0000","last_became_peered":"2024-04-25T00:51:40.319726+0000","last_unstale":"2024-04-25T03:09:40.898624+0000","last_undegraded":"2024-04-25T03:09:40.898624+0000","last_fullsized":"2024-04-25T03:09:40.898624+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4282,"num_write":403,"num_write_kb":55112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'1293","reported_seq":1373,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:22.138872+0000","last_change":"2024-04-25T00:50:33.383755+0000","last_active":"2024-04-25T03:08:22.138872+0000","last_peered":"2024-04-25T03:08:22.138872+0000","last_clean":"2024-04-25T03:08:22.138872+0000","last_became_active":"2024-04-25T00:50:33.382925+0000","last_became_peered":"2024-04-25T00:50:33.382925+0000","last_unstale":"2024-04-25T03:08:22.138872+0000","last_undegraded":"2024-04-25T03:08:22.138872+0000","last_fullsized":"2024-04-25T03:08:22.138872+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1293,"log_dups_size":0,"ondisk_log_size":1293,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:52.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1222,"num_write_kb":12901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'453","reported_seq":606,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.895986+0000","last_change":"2024-04-25T00:50:35.869794+0000","last_active":"2024-04-25T03:09:40.895986+0000","last_peered":"2024-04-25T03:09:40.895986+0000","last_clean":"2024-04-25T03:09:40.895986+0000","last_became_active":"2024-04-25T00:50:35.869028+0000","last_became_peered":"2024-04-25T00:50:35.869028+0000","last_unstale":"2024-04-25T03:09:40.895986+0000","last_undegraded":"2024-04-25T03:09:40.895986+0000","last_fullsized":"2024-04-25T03:09:40.895986+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":36096,"num_write":419,"num_write_kb":96892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'61","reported_seq":141,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.363278+0000","last_change":"2024-04-25T00:50:33.394082+0000","last_active":"2024-04-25T03:09:40.363278+0000","last_peered":"2024-04-25T03:09:40.363278+0000","last_clean":"2024-04-25T03:09:40.363278+0000","last_became_active":"2024-04-25T00:50:33.392792+0000","last_became_peered":"2024-04-25T00:50:33.392792+0000","last_unstale":"2024-04-25T03:09:40.363278+0000","last_undegraded":"2024-04-25T03:09:40.363278+0000","last_fullsized":"2024-04-25T03:09:40.363278+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:35:15.441104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'435","reported_seq":547,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.723136+0000","last_change":"2024-04-25T00:50:35.729414+0000","last_active":"2024-04-25T03:09:40.723136+0000","last_peered":"2024-04-25T03:09:40.723136+0000","last_clean":"2024-04-25T03:09:40.723136+0000","last_became_active":"2024-04-25T00:50:35.728725+0000","last_became_peered":"2024-04-25T00:50:35.728725+0000","last_unstale":"2024-04-25T03:09:40.723136+0000","last_undegraded":"2024-04-25T03:09:40.723136+0000","last_fullsized":"2024-04-25T03:09:40.723136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:05.046355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":25476,"num_write":407,"num_write_kb":112477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'1187","reported_seq":1267,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.378202+0000","last_change":"2024-04-25T00:50:33.388191+0000","last_active":"2024-04-25T03:09:40.378202+0000","last_peered":"2024-04-25T03:09:40.378202+0000","last_clean":"2024-04-25T03:09:40.378202+0000","last_became_active":"2024-04-25T00:50:33.387266+0000","last_became_peered":"2024-04-25T00:50:33.387266+0000","last_unstale":"2024-04-25T03:09:40.378202+0000","last_undegraded":"2024-04-25T03:09:40.378202+0000","last_fullsized":"2024-04-25T03:09:40.378202+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1187,"log_dups_size":0,"ondisk_log_size":1187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:56:08.400693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10267224,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1125,"num_write_kb":10596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'390","reported_seq":493,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.903514+0000","last_change":"2024-04-25T00:50:35.799783+0000","last_active":"2024-04-25T03:09:40.903514+0000","last_peered":"2024-04-25T03:09:40.903514+0000","last_clean":"2024-04-25T03:09:40.903514+0000","last_became_active":"2024-04-25T00:50:35.798471+0000","last_became_peered":"2024-04-25T00:50:35.798471+0000","last_unstale":"2024-04-25T03:09:40.903514+0000","last_undegraded":"2024-04-25T03:09:40.903514+0000","last_fullsized":"2024-04-25T03:09:40.903514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14757,"num_write":355,"num_write_kb":59761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"28'3380","reported_seq":3461,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:36.146052+0000","last_change":"2024-04-25T00:50:33.304731+0000","last_active":"2024-04-25T03:09:36.146052+0000","last_peered":"2024-04-25T03:09:36.146052+0000","last_clean":"2024-04-25T03:09:36.146052+0000","last_became_active":"2024-04-25T00:50:33.303821+0000","last_became_peered":"2024-04-25T00:50:33.303821+0000","last_unstale":"2024-04-25T03:09:36.146052+0000","last_undegraded":"2024-04-25T03:09:36.146052+0000","last_fullsized":"2024-04-25T03:09:36.146052+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":3380,"log_dups_size":0,"ondisk_log_size":3380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3329,"num_write_kb":11127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'419","reported_seq":559,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.663718+0000","last_change":"2024-04-25T00:50:35.828727+0000","last_active":"2024-04-25T03:09:40.663718+0000","last_peered":"2024-04-25T03:09:40.663718+0000","last_clean":"2024-04-25T03:09:40.663718+0000","last_became_active":"2024-04-25T00:50:35.827617+0000","last_became_peered":"2024-04-25T00:50:35.827617+0000","last_unstale":"2024-04-25T03:09:40.663718+0000","last_undegraded":"2024-04-25T03:09:40.663718+0000","last_fullsized":"2024-04-25T03:09:40.663718+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:30:10.568533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":28588,"num_write":390,"num_write_kb":92970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"28'2245","reported_seq":2327,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:19.177513+0000","last_change":"2024-04-25T00:50:33.391005+0000","last_active":"2024-04-25T03:09:19.177513+0000","last_peered":"2024-04-25T03:09:19.177513+0000","last_clean":"2024-04-25T03:09:19.177513+0000","last_became_active":"2024-04-25T00:50:33.390133+0000","last_became_peered":"2024-04-25T00:50:33.390133+0000","last_unstale":"2024-04-25T03:09:19.177513+0000","last_undegraded":"2024-04-25T03:09:19.177513+0000","last_fullsized":"2024-04-25T03:09:19.177513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":2245,"log_dups_size":0,"ondisk_log_size":2245,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:53:19.913188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2203,"num_write_kb":13669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'392","reported_seq":516,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.662684+0000","last_change":"2024-04-25T00:50:35.876022+0000","last_active":"2024-04-25T03:09:40.662684+0000","last_peered":"2024-04-25T03:09:40.662684+0000","last_clean":"2024-04-25T03:09:40.662684+0000","last_became_active":"2024-04-25T00:50:35.875322+0000","last_became_peered":"2024-04-25T00:50:35.875322+0000","last_unstale":"2024-04-25T03:09:40.662684+0000","last_undegraded":"2024-04-25T03:09:40.662684+0000","last_fullsized":"2024-04-25T03:09:40.662684+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":27925,"num_write":356,"num_write_kb":62573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"28'721","reported_seq":812,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:52.811375+0000","last_change":"2024-04-25T03:09:52.811428+0000","last_active":"2024-04-25T03:09:52.811375+0000","last_peered":"2024-04-25T03:09:52.811375+0000","last_clean":"2024-04-25T03:09:52.811375+0000","last_became_active":"2024-04-25T00:50:33.386297+0000","last_became_peered":"2024-04-25T00:50:33.386297+0000","last_unstale":"2024-04-25T03:09:52.811375+0000","last_undegraded":"2024-04-25T03:09:52.811375+0000","last_fullsized":"2024-04-25T03:09:52.811375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'721","last_scrub_stamp":"2024-04-25T03:09:52.811260+0000","last_deep_scrub":"28'721","last_deep_scrub_stamp":"2024-04-25T03:09:52.811260+0000","last_clean_scrub_stamp":"2024-04-25T03:09:52.811260+0000","objects_scrubbed":8,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:27:34.897840+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":8480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'401","reported_seq":499,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:53.769603+0000","last_change":"2024-04-25T03:09:53.769636+0000","last_active":"2024-04-25T03:09:53.769603+0000","last_peered":"2024-04-25T03:09:53.769603+0000","last_clean":"2024-04-25T03:09:53.769603+0000","last_became_active":"2024-04-25T00:50:35.796012+0000","last_became_peered":"2024-04-25T00:50:35.796012+0000","last_unstale":"2024-04-25T03:09:53.769603+0000","last_undegraded":"2024-04-25T03:09:53.769603+0000","last_fullsized":"2024-04-25T03:09:53.769603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'401","last_scrub_stamp":"2024-04-25T03:09:53.769481+0000","last_deep_scrub":"28'401","last_deep_scrub_stamp":"2024-04-25T03:09:53.769481+0000","last_clean_scrub_stamp":"2024-04-25T03:09:53.769481+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:22.100999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4846,"num_write":362,"num_write_kb":30162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"28'56","reported_seq":138,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:33.058035+0000","last_change":"2024-04-25T00:50:33.385522+0000","last_active":"2024-04-25T03:09:33.058035+0000","last_peered":"2024-04-25T03:09:33.058035+0000","last_clean":"2024-04-25T03:09:33.058035+0000","last_became_active":"2024-04-25T00:50:33.384620+0000","last_became_peered":"2024-04-25T00:50:33.384620+0000","last_unstale":"2024-04-25T03:09:33.058035+0000","last_undegraded":"2024-04-25T03:09:33.058035+0000","last_fullsized":"2024-04-25T03:09:33.058035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:24.908029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'414","reported_seq":522,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.720638+0000","last_change":"2024-04-25T00:50:35.820565+0000","last_active":"2024-04-25T03:09:40.720638+0000","last_peered":"2024-04-25T03:09:40.720638+0000","last_clean":"2024-04-25T03:09:40.720638+0000","last_became_active":"2024-04-25T00:50:35.819683+0000","last_became_peered":"2024-04-25T00:50:35.819683+0000","last_unstale":"2024-04-25T03:09:40.720638+0000","last_undegraded":"2024-04-25T03:09:40.720638+0000","last_fullsized":"2024-04-25T03:09:40.720638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:28.655307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":8938,"num_write":378,"num_write_kb":68659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'60","reported_seq":142,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:17.098745+0000","last_change":"2024-04-25T00:50:33.390745+0000","last_active":"2024-04-25T03:08:17.098745+0000","last_peered":"2024-04-25T03:08:17.098745+0000","last_clean":"2024-04-25T03:08:17.098745+0000","last_became_active":"2024-04-25T00:50:33.390089+0000","last_became_peered":"2024-04-25T00:50:33.390089+0000","last_unstale":"2024-04-25T03:08:17.098745+0000","last_undegraded":"2024-04-25T03:08:17.098745+0000","last_fullsized":"2024-04-25T03:08:17.098745+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:51.294701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'418","reported_seq":511,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.070072+0000","last_change":"2024-04-25T00:50:35.801766+0000","last_active":"2024-04-25T03:09:41.070072+0000","last_peered":"2024-04-25T03:09:41.070072+0000","last_clean":"2024-04-25T03:09:41.070072+0000","last_became_active":"2024-04-25T00:50:35.801060+0000","last_became_peered":"2024-04-25T00:50:35.801060+0000","last_unstale":"2024-04-25T03:09:41.070072+0000","last_undegraded":"2024-04-25T03:09:41.070072+0000","last_fullsized":"2024-04-25T03:09:41.070072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:28:41.287394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9600,"num_write":393,"num_write_kb":50549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"28'894","reported_seq":976,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:31.197675+0000","last_change":"2024-04-25T00:50:33.327283+0000","last_active":"2024-04-25T03:09:31.197675+0000","last_peered":"2024-04-25T03:09:31.197675+0000","last_clean":"2024-04-25T03:09:31.197675+0000","last_became_active":"2024-04-25T00:50:33.326464+0000","last_became_peered":"2024-04-25T00:50:33.326464+0000","last_unstale":"2024-04-25T03:09:31.197675+0000","last_undegraded":"2024-04-25T03:09:31.197675+0000","last_fullsized":"2024-04-25T03:09:31.197675+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:26:26.328621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":8609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'491","reported_seq":685,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.662645+0000","last_change":"2024-04-25T00:50:35.825910+0000","last_active":"2024-04-25T03:09:40.662645+0000","last_peered":"2024-04-25T03:09:40.662645+0000","last_clean":"2024-04-25T03:09:40.662645+0000","last_became_active":"2024-04-25T00:50:35.825246+0000","last_became_peered":"2024-04-25T00:50:35.825246+0000","last_unstale":"2024-04-25T03:09:40.662645+0000","last_undegraded":"2024-04-25T03:09:40.662645+0000","last_fullsized":"2024-04-25T03:09:40.662645+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:40.106788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":62450,"num_write":458,"num_write_kb":109145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'805","reported_seq":889,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:32.246466+0000","last_change":"2024-04-25T00:50:33.393856+0000","last_active":"2024-04-25T03:08:32.246466+0000","last_peered":"2024-04-25T03:08:32.246466+0000","last_clean":"2024-04-25T03:08:32.246466+0000","last_became_active":"2024-04-25T00:50:33.393153+0000","last_became_peered":"2024-04-25T00:50:33.393153+0000","last_unstale":"2024-04-25T03:08:32.246466+0000","last_undegraded":"2024-04-25T03:08:32.246466+0000","last_fullsized":"2024-04-25T03:08:32.246466+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":805,"log_dups_size":0,"ondisk_log_size":805,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:55.179146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":4477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'357","reported_seq":488,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.665816+0000","last_change":"2024-04-25T00:50:35.811993+0000","last_active":"2024-04-25T03:09:40.665816+0000","last_peered":"2024-04-25T03:09:40.665816+0000","last_clean":"2024-04-25T03:09:40.665816+0000","last_became_active":"2024-04-25T00:50:35.811267+0000","last_became_peered":"2024-04-25T00:50:35.811267+0000","last_unstale":"2024-04-25T03:09:40.665816+0000","last_undegraded":"2024-04-25T03:09:40.665816+0000","last_fullsized":"2024-04-25T03:09:40.665816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:40:20.385617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":21001,"num_write":331,"num_write_kb":38526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'903","reported_seq":987,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:20.853159+0000","last_change":"2024-04-25T00:50:33.383040+0000","last_active":"2024-04-25T03:07:20.853159+0000","last_peered":"2024-04-25T03:07:20.853159+0000","last_clean":"2024-04-25T03:07:20.853159+0000","last_became_active":"2024-04-25T00:50:33.382270+0000","last_became_peered":"2024-04-25T00:50:33.382270+0000","last_unstale":"2024-04-25T03:07:20.853159+0000","last_undegraded":"2024-04-25T03:07:20.853159+0000","last_fullsized":"2024-04-25T03:07:20.853159+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":903,"log_dups_size":0,"ondisk_log_size":903,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:13.866739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":844,"num_write_kb":4518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'401","reported_seq":521,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.707568+0000","last_change":"2024-04-25T00:50:35.818234+0000","last_active":"2024-04-25T03:09:40.707568+0000","last_peered":"2024-04-25T03:09:40.707568+0000","last_clean":"2024-04-25T03:09:40.707568+0000","last_became_active":"2024-04-25T00:50:35.817707+0000","last_became_peered":"2024-04-25T00:50:35.817707+0000","last_unstale":"2024-04-25T03:09:40.707568+0000","last_undegraded":"2024-04-25T03:09:40.707568+0000","last_fullsized":"2024-04-25T03:09:40.707568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:31.998886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16207,"num_write":370,"num_write_kb":59244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"28'326","reported_seq":411,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:07:49.080232+0000","last_change":"2024-04-25T00:50:33.389774+0000","last_active":"2024-04-25T03:07:49.080232+0000","last_peered":"2024-04-25T03:07:49.080232+0000","last_clean":"2024-04-25T03:07:49.080232+0000","last_became_active":"2024-04-25T00:50:33.389092+0000","last_became_peered":"2024-04-25T00:50:33.389092+0000","last_unstale":"2024-04-25T03:07:49.080232+0000","last_undegraded":"2024-04-25T03:07:49.080232+0000","last_fullsized":"2024-04-25T03:07:49.080232+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":326,"log_dups_size":0,"ondisk_log_size":326,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'441","reported_seq":582,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.646651+0000","last_change":"2024-04-25T00:50:35.869211+0000","last_active":"2024-04-25T03:09:40.646651+0000","last_peered":"2024-04-25T03:09:40.646651+0000","last_clean":"2024-04-25T03:09:40.646651+0000","last_became_active":"2024-04-25T00:50:35.868798+0000","last_became_peered":"2024-04-25T00:50:35.868798+0000","last_unstale":"2024-04-25T03:09:40.646651+0000","last_undegraded":"2024-04-25T03:09:40.646651+0000","last_fullsized":"2024-04-25T03:09:40.646651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:00:40.106788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27029,"num_write":413,"num_write_kb":63857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"28'319","reported_seq":403,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:15.892809+0000","last_change":"2024-04-25T00:50:33.329578+0000","last_active":"2024-04-25T03:09:15.892809+0000","last_peered":"2024-04-25T03:09:15.892809+0000","last_clean":"2024-04-25T03:09:15.892809+0000","last_became_active":"2024-04-25T00:50:33.328950+0000","last_became_peered":"2024-04-25T00:50:33.328950+0000","last_unstale":"2024-04-25T03:09:15.892809+0000","last_undegraded":"2024-04-25T03:09:15.892809+0000","last_fullsized":"2024-04-25T03:09:15.892809+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":319,"log_dups_size":0,"ondisk_log_size":319,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:06:55.179146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196056,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":254,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'426","reported_seq":560,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.709661+0000","last_change":"2024-04-25T00:50:35.734419+0000","last_active":"2024-04-25T03:09:40.709661+0000","last_peered":"2024-04-25T03:09:40.709661+0000","last_clean":"2024-04-25T03:09:40.709661+0000","last_became_active":"2024-04-25T00:50:35.733696+0000","last_became_peered":"2024-04-25T00:50:35.733696+0000","last_unstale":"2024-04-25T03:09:40.709661+0000","last_undegraded":"2024-04-25T03:09:40.709661+0000","last_fullsized":"2024-04-25T03:09:40.709661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:05.046355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":28368,"num_write":395,"num_write_kb":71042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":248,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:06:32.174332+0000","last_change":"2024-04-25T00:49:55.281216+0000","last_active":"2024-04-25T03:06:32.174332+0000","last_peered":"2024-04-25T03:06:32.174332+0000","last_clean":"2024-04-25T03:06:32.174332+0000","last_became_active":"2024-04-25T00:49:55.278022+0000","last_became_peered":"2024-04-25T00:49:55.278022+0000","last_unstale":"2024-04-25T03:06:32.174332+0000","last_undegraded":"2024-04-25T03:06:32.174332+0000","last_fullsized":"2024-04-25T03:06:32.174332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:49:52.475299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:49:52.475299+0000","last_clean_scrub_stamp":"2024-04-25T00:49:52.475299+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:10:17.046656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"28'385","reported_seq":474,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:11.554423+0000","last_change":"2024-04-25T00:50:33.325228+0000","last_active":"2024-04-25T03:09:11.554423+0000","last_peered":"2024-04-25T03:09:11.554423+0000","last_clean":"2024-04-25T03:09:11.554423+0000","last_became_active":"2024-04-25T00:50:33.324579+0000","last_became_peered":"2024-04-25T00:50:33.324579+0000","last_unstale":"2024-04-25T03:09:11.554423+0000","last_undegraded":"2024-04-25T03:09:11.554423+0000","last_fullsized":"2024-04-25T03:09:11.554423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:25:12.762746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'354","reported_seq":470,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.043015+0000","last_change":"2024-04-25T00:50:35.880348+0000","last_active":"2024-04-25T03:09:41.043015+0000","last_peered":"2024-04-25T03:09:41.043015+0000","last_clean":"2024-04-25T03:09:41.043015+0000","last_became_active":"2024-04-25T00:50:35.878438+0000","last_became_peered":"2024-04-25T00:50:35.878438+0000","last_unstale":"2024-04-25T03:09:41.043015+0000","last_undegraded":"2024-04-25T03:09:41.043015+0000","last_fullsized":"2024-04-25T03:09:41.043015+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20480,"num_write":322,"num_write_kb":49980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"28'1052","reported_seq":1144,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:51.863301+0000","last_change":"2024-04-25T00:50:33.321385+0000","last_active":"2024-04-25T03:08:51.863301+0000","last_peered":"2024-04-25T03:08:51.863301+0000","last_clean":"2024-04-25T03:08:51.863301+0000","last_became_active":"2024-04-25T00:50:33.320800+0000","last_became_peered":"2024-04-25T00:50:33.320800+0000","last_unstale":"2024-04-25T03:08:51.863301+0000","last_undegraded":"2024-04-25T03:08:51.863301+0000","last_fullsized":"2024-04-25T03:08:51.863301+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1052,"log_dups_size":0,"ondisk_log_size":1052,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:04.254885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":991,"num_write_kb":12720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"28'420","reported_seq":533,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.894976+0000","last_change":"2024-04-25T00:50:35.815056+0000","last_active":"2024-04-25T03:09:40.894976+0000","last_peered":"2024-04-25T03:09:40.894976+0000","last_clean":"2024-04-25T03:09:40.894976+0000","last_became_active":"2024-04-25T00:50:35.814163+0000","last_became_peered":"2024-04-25T00:50:35.814163+0000","last_unstale":"2024-04-25T03:09:40.894976+0000","last_undegraded":"2024-04-25T03:09:40.894976+0000","last_fullsized":"2024-04-25T03:09:40.894976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14110,"num_write":386,"num_write_kb":112699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"28'4457","reported_seq":8941,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:36.126848+0000","last_change":"2024-04-25T00:50:33.384695+0000","last_active":"2024-04-25T03:09:36.126848+0000","last_peered":"2024-04-25T03:09:36.126848+0000","last_clean":"2024-04-25T03:09:36.126848+0000","last_became_active":"2024-04-25T00:50:33.383692+0000","last_became_peered":"2024-04-25T00:50:33.383692+0000","last_unstale":"2024-04-25T03:09:36.126848+0000","last_undegraded":"2024-04-25T03:09:36.126848+0000","last_fullsized":"2024-04-25T03:09:36.126848+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":4457,"log_dups_size":0,"ondisk_log_size":4457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:57.579410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1471076,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4395,"num_read_kb":4765,"num_write":4402,"num_write_kb":4769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'402","reported_seq":518,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.890857+0000","last_change":"2024-04-25T00:50:35.723048+0000","last_active":"2024-04-25T03:09:40.890857+0000","last_peered":"2024-04-25T03:09:40.890857+0000","last_clean":"2024-04-25T03:09:40.890857+0000","last_became_active":"2024-04-25T00:50:35.722500+0000","last_became_peered":"2024-04-25T00:50:35.722500+0000","last_unstale":"2024-04-25T03:09:40.890857+0000","last_undegraded":"2024-04-25T03:09:40.890857+0000","last_fullsized":"2024-04-25T03:09:40.890857+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13853,"num_write":369,"num_write_kb":30117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"28'1036","reported_seq":1125,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:06:02.117152+0000","last_change":"2024-04-25T00:50:33.305927+0000","last_active":"2024-04-25T03:06:02.117152+0000","last_peered":"2024-04-25T03:06:02.117152+0000","last_clean":"2024-04-25T03:06:02.117152+0000","last_became_active":"2024-04-25T00:50:33.305159+0000","last_became_peered":"2024-04-25T00:50:33.305159+0000","last_unstale":"2024-04-25T03:06:02.117152+0000","last_undegraded":"2024-04-25T03:06:02.117152+0000","last_fullsized":"2024-04-25T03:06:02.117152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1036,"log_dups_size":0,"ondisk_log_size":1036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:46:56.639410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":968,"num_write_kb":8653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'394","reported_seq":551,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.639498+0000","last_change":"2024-04-25T00:50:35.824491+0000","last_active":"2024-04-25T03:09:40.639498+0000","last_peered":"2024-04-25T03:09:40.639498+0000","last_clean":"2024-04-25T03:09:40.639498+0000","last_became_active":"2024-04-25T00:50:35.823320+0000","last_became_peered":"2024-04-25T00:50:35.823320+0000","last_unstale":"2024-04-25T03:09:40.639498+0000","last_undegraded":"2024-04-25T03:09:40.639498+0000","last_fullsized":"2024-04-25T03:09:40.639498+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:57.466393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":47782,"num_write":359,"num_write_kb":62996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"28'369","reported_seq":467,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:53.358862+0000","last_change":"2024-04-25T03:09:53.358932+0000","last_active":"2024-04-25T03:09:53.358862+0000","last_peered":"2024-04-25T03:09:53.358862+0000","last_clean":"2024-04-25T03:09:53.358862+0000","last_became_active":"2024-04-25T00:50:33.303671+0000","last_became_peered":"2024-04-25T00:50:33.303671+0000","last_unstale":"2024-04-25T03:09:53.358862+0000","last_undegraded":"2024-04-25T03:09:53.358862+0000","last_fullsized":"2024-04-25T03:09:53.358862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'369","last_scrub_stamp":"2024-04-25T03:09:53.358661+0000","last_deep_scrub":"28'369","last_deep_scrub_stamp":"2024-04-25T03:09:53.358661+0000","last_clean_scrub_stamp":"2024-04-25T03:09:53.358661+0000","objects_scrubbed":1,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:14.437053+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":4247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'437","reported_seq":572,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.663449+0000","last_change":"2024-04-25T00:50:35.878641+0000","last_active":"2024-04-25T03:09:40.663449+0000","last_peered":"2024-04-25T03:09:40.663449+0000","last_clean":"2024-04-25T03:09:40.663449+0000","last_became_active":"2024-04-25T00:50:35.876958+0000","last_became_peered":"2024-04-25T00:50:35.876958+0000","last_unstale":"2024-04-25T03:09:40.663449+0000","last_undegraded":"2024-04-25T03:09:40.663449+0000","last_fullsized":"2024-04-25T03:09:40.663449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:39:59.565909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":21227,"num_write":402,"num_write_kb":75746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"28'1039","reported_seq":1128,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:42.196406+0000","last_change":"2024-04-25T00:50:33.319229+0000","last_active":"2024-04-25T03:08:42.196406+0000","last_peered":"2024-04-25T03:08:42.196406+0000","last_clean":"2024-04-25T03:08:42.196406+0000","last_became_active":"2024-04-25T00:50:33.318945+0000","last_became_peered":"2024-04-25T00:50:33.318945+0000","last_unstale":"2024-04-25T03:08:42.196406+0000","last_undegraded":"2024-04-25T03:08:42.196406+0000","last_fullsized":"2024-04-25T03:08:42.196406+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1039,"log_dups_size":0,"ondisk_log_size":1039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:22:51.132430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":986,"num_write_kb":8683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'399","reported_seq":519,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.885928+0000","last_change":"2024-04-25T00:50:35.722521+0000","last_active":"2024-04-25T03:09:40.885928+0000","last_peered":"2024-04-25T03:09:40.885928+0000","last_clean":"2024-04-25T03:09:40.885928+0000","last_became_active":"2024-04-25T00:50:35.722128+0000","last_became_peered":"2024-04-25T00:50:35.722128+0000","last_unstale":"2024-04-25T03:09:40.885928+0000","last_undegraded":"2024-04-25T03:09:40.885928+0000","last_fullsized":"2024-04-25T03:09:40.885928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19866,"num_write":357,"num_write_kb":75325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"28'6462","reported_seq":6550,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:36.390611+0000","last_change":"2024-04-25T00:50:33.387402+0000","last_active":"2024-04-25T03:09:36.390611+0000","last_peered":"2024-04-25T03:09:36.390611+0000","last_clean":"2024-04-25T03:09:36.390611+0000","last_became_active":"2024-04-25T00:50:33.386631+0000","last_became_peered":"2024-04-25T00:50:33.386631+0000","last_unstale":"2024-04-25T03:09:36.390611+0000","last_undegraded":"2024-04-25T03:09:36.390611+0000","last_fullsized":"2024-04-25T03:09:36.390611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":6462,"log_dups_size":0,"ondisk_log_size":6462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17492,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'357","reported_seq":507,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.035672+0000","last_change":"2024-04-25T00:50:35.882715+0000","last_active":"2024-04-25T03:09:41.035672+0000","last_peered":"2024-04-25T03:09:41.035672+0000","last_clean":"2024-04-25T03:09:41.035672+0000","last_became_active":"2024-04-25T00:50:35.878416+0000","last_became_peered":"2024-04-25T00:50:35.878416+0000","last_unstale":"2024-04-25T03:09:41.035672+0000","last_undegraded":"2024-04-25T03:09:41.035672+0000","last_fullsized":"2024-04-25T03:09:41.035672+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":29447,"num_write":334,"num_write_kb":70980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"28'373","reported_seq":460,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:17.108484+0000","last_change":"2024-04-25T00:50:33.393211+0000","last_active":"2024-04-25T03:09:17.108484+0000","last_peered":"2024-04-25T03:09:17.108484+0000","last_clean":"2024-04-25T03:09:17.108484+0000","last_became_active":"2024-04-25T00:50:33.392381+0000","last_became_peered":"2024-04-25T00:50:33.392381+0000","last_unstale":"2024-04-25T03:09:17.108484+0000","last_undegraded":"2024-04-25T03:09:17.108484+0000","last_fullsized":"2024-04-25T03:09:17.108484+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:18:05.276269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'446","reported_seq":576,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.904706+0000","last_change":"2024-04-25T00:50:35.798491+0000","last_active":"2024-04-25T03:09:40.904706+0000","last_peered":"2024-04-25T03:09:40.904706+0000","last_clean":"2024-04-25T03:09:40.904706+0000","last_became_active":"2024-04-25T00:50:35.796775+0000","last_became_peered":"2024-04-25T00:50:35.796775+0000","last_unstale":"2024-04-25T03:09:40.904706+0000","last_undegraded":"2024-04-25T03:09:40.904706+0000","last_fullsized":"2024-04-25T03:09:40.904706+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":29188,"num_write":413,"num_write_kb":79416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"28'380","reported_seq":467,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:41.219949+0000","last_change":"2024-04-25T00:50:33.321163+0000","last_active":"2024-04-25T03:08:41.219949+0000","last_peered":"2024-04-25T03:08:41.219949+0000","last_clean":"2024-04-25T03:08:41.219949+0000","last_became_active":"2024-04-25T00:50:33.320554+0000","last_became_peered":"2024-04-25T00:50:33.320554+0000","last_unstale":"2024-04-25T03:08:41.219949+0000","last_undegraded":"2024-04-25T03:08:41.219949+0000","last_fullsized":"2024-04-25T03:08:41.219949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:13.533462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":317,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'445","reported_seq":576,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.394213+0000","last_change":"2024-04-25T00:50:35.824154+0000","last_active":"2024-04-25T03:09:40.394213+0000","last_peered":"2024-04-25T03:09:40.394213+0000","last_clean":"2024-04-25T03:09:40.394213+0000","last_became_active":"2024-04-25T00:50:35.823269+0000","last_became_peered":"2024-04-25T00:50:35.823269+0000","last_unstale":"2024-04-25T03:09:40.394213+0000","last_undegraded":"2024-04-25T03:09:40.394213+0000","last_fullsized":"2024-04-25T03:09:40.394213+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:34:16.208624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25774,"num_write":415,"num_write_kb":54462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'452","reported_seq":540,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:14.093888+0000","last_change":"2024-04-25T00:50:33.319985+0000","last_active":"2024-04-25T03:09:14.093888+0000","last_peered":"2024-04-25T03:09:14.093888+0000","last_clean":"2024-04-25T03:09:14.093888+0000","last_became_active":"2024-04-25T00:50:33.319198+0000","last_became_peered":"2024-04-25T00:50:33.319198+0000","last_unstale":"2024-04-25T03:09:14.093888+0000","last_undegraded":"2024-04-25T03:09:14.093888+0000","last_fullsized":"2024-04-25T03:09:14.093888+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'409","reported_seq":538,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.058207+0000","last_change":"2024-04-25T00:50:35.883007+0000","last_active":"2024-04-25T03:09:41.058207+0000","last_peered":"2024-04-25T03:09:41.058207+0000","last_clean":"2024-04-25T03:09:41.058207+0000","last_became_active":"2024-04-25T00:50:35.881829+0000","last_became_peered":"2024-04-25T00:50:35.881829+0000","last_unstale":"2024-04-25T03:09:41.058207+0000","last_undegraded":"2024-04-25T03:09:41.058207+0000","last_fullsized":"2024-04-25T03:09:41.058207+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":18047,"num_write":372,"num_write_kb":46881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'1205","reported_seq":1293,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:52.556504+0000","last_change":"2024-04-25T00:50:33.384397+0000","last_active":"2024-04-25T03:09:52.556504+0000","last_peered":"2024-04-25T03:09:52.556504+0000","last_clean":"2024-04-25T03:09:52.556504+0000","last_became_active":"2024-04-25T00:50:33.383622+0000","last_became_peered":"2024-04-25T00:50:33.383622+0000","last_unstale":"2024-04-25T03:09:52.556504+0000","last_undegraded":"2024-04-25T03:09:52.556504+0000","last_fullsized":"2024-04-25T03:09:52.556504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1205,"log_dups_size":0,"ondisk_log_size":1205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":8761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'428","reported_seq":554,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.052188+0000","last_change":"2024-04-25T00:50:35.881976+0000","last_active":"2024-04-25T03:09:41.052188+0000","last_peered":"2024-04-25T03:09:41.052188+0000","last_clean":"2024-04-25T03:09:41.052188+0000","last_became_active":"2024-04-25T00:50:35.881269+0000","last_became_peered":"2024-04-25T00:50:35.881269+0000","last_unstale":"2024-04-25T03:09:41.052188+0000","last_undegraded":"2024-04-25T03:09:41.052188+0000","last_fullsized":"2024-04-25T03:09:41.052188+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19611,"num_write":396,"num_write_kb":67446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1399","reported_seq":1483,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:07.562053+0000","last_change":"2024-04-25T00:50:33.390041+0000","last_active":"2024-04-25T03:08:07.562053+0000","last_peered":"2024-04-25T03:08:07.562053+0000","last_clean":"2024-04-25T03:08:07.562053+0000","last_became_active":"2024-04-25T00:50:33.389095+0000","last_became_peered":"2024-04-25T00:50:33.389095+0000","last_unstale":"2024-04-25T03:08:07.562053+0000","last_undegraded":"2024-04-25T03:08:07.562053+0000","last_fullsized":"2024-04-25T03:08:07.562053+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1399,"log_dups_size":0,"ondisk_log_size":1399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:07:00.569613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1344,"num_write_kb":12923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'449","reported_seq":610,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.070319+0000","last_change":"2024-04-25T00:50:35.812195+0000","last_active":"2024-04-25T03:09:41.070319+0000","last_peered":"2024-04-25T03:09:41.070319+0000","last_clean":"2024-04-25T03:09:41.070319+0000","last_became_active":"2024-04-25T00:50:35.811410+0000","last_became_peered":"2024-04-25T00:50:35.811410+0000","last_unstale":"2024-04-25T03:09:41.070319+0000","last_undegraded":"2024-04-25T03:09:41.070319+0000","last_fullsized":"2024-04-25T03:09:41.070319+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:06.596770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42516,"num_write":419,"num_write_kb":125381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"28'392","reported_seq":512,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.722040+0000","last_change":"2024-04-25T00:50:35.821808+0000","last_active":"2024-04-25T03:09:40.722040+0000","last_peered":"2024-04-25T03:09:40.722040+0000","last_clean":"2024-04-25T03:09:40.722040+0000","last_became_active":"2024-04-25T00:50:35.821062+0000","last_became_peered":"2024-04-25T00:50:35.821062+0000","last_unstale":"2024-04-25T03:09:40.722040+0000","last_undegraded":"2024-04-25T03:09:40.722040+0000","last_fullsized":"2024-04-25T03:09:40.722040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:22:12.433416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":28880,"num_write":348,"num_write_kb":60862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"28'845","reported_seq":923,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:08:40.321237+0000","last_change":"2024-04-25T00:50:33.319853+0000","last_active":"2024-04-25T03:08:40.321237+0000","last_peered":"2024-04-25T03:08:40.321237+0000","last_clean":"2024-04-25T03:08:40.321237+0000","last_became_active":"2024-04-25T00:50:33.319197+0000","last_became_peered":"2024-04-25T00:50:33.319197+0000","last_unstale":"2024-04-25T03:08:40.321237+0000","last_undegraded":"2024-04-25T03:08:40.321237+0000","last_fullsized":"2024-04-25T03:08:40.321237+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":845,"log_dups_size":0,"ondisk_log_size":845,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:31:24.834556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":4488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'367","reported_seq":495,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.726212+0000","last_change":"2024-04-25T00:50:35.812044+0000","last_active":"2024-04-25T03:09:40.726212+0000","last_peered":"2024-04-25T03:09:40.726212+0000","last_clean":"2024-04-25T03:09:40.726212+0000","last_became_active":"2024-04-25T00:50:35.811281+0000","last_became_peered":"2024-04-25T00:50:35.811281+0000","last_unstale":"2024-04-25T03:09:40.726212+0000","last_undegraded":"2024-04-25T03:09:40.726212+0000","last_fullsized":"2024-04-25T03:09:40.726212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:12:28.655307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":25463,"num_write":336,"num_write_kb":42887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1943","reported_seq":2021,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:09.463635+0000","last_change":"2024-04-25T00:50:33.382775+0000","last_active":"2024-04-25T03:09:09.463635+0000","last_peered":"2024-04-25T03:09:09.463635+0000","last_clean":"2024-04-25T03:09:09.463635+0000","last_became_active":"2024-04-25T00:50:33.382218+0000","last_became_peered":"2024-04-25T00:50:33.382218+0000","last_unstale":"2024-04-25T03:09:09.463635+0000","last_undegraded":"2024-04-25T03:09:09.463635+0000","last_fullsized":"2024-04-25T03:09:09.463635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:31.835580+0000","last_clean_scrub_stamp":"2024-04-25T00:50:31.835580+0000","objects_scrubbed":0,"log_size":1943,"log_dups_size":0,"ondisk_log_size":1943,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:01:52.606982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1878,"num_write_kb":17269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"28'382","reported_seq":540,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:40.903991+0000","last_change":"2024-04-25T00:50:35.802543+0000","last_active":"2024-04-25T03:09:40.903991+0000","last_peered":"2024-04-25T03:09:40.903991+0000","last_clean":"2024-04-25T03:09:40.903991+0000","last_became_active":"2024-04-25T00:50:35.801799+0000","last_became_peered":"2024-04-25T00:50:35.801799+0000","last_unstale":"2024-04-25T03:09:40.903991+0000","last_undegraded":"2024-04-25T03:09:40.903991+0000","last_fullsized":"2024-04-25T03:09:40.903991+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":38798,"num_write":356,"num_write_kb":55918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"28'669","reported_seq":770,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:55.001624+0000","last_change":"2024-04-25T03:09:55.001810+0000","last_active":"2024-04-25T03:09:55.001624+0000","last_peered":"2024-04-25T03:09:55.001624+0000","last_clean":"2024-04-25T03:09:55.001624+0000","last_became_active":"2024-04-25T00:50:33.388773+0000","last_became_peered":"2024-04-25T00:50:33.388773+0000","last_unstale":"2024-04-25T03:09:55.001624+0000","last_undegraded":"2024-04-25T03:09:55.001624+0000","last_fullsized":"2024-04-25T03:09:55.001624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'669","last_scrub_stamp":"2024-04-25T03:09:55.001381+0000","last_deep_scrub":"28'669","last_deep_scrub_stamp":"2024-04-25T03:09:55.001381+0000","last_clean_scrub_stamp":"2024-04-25T03:09:55.001381+0000","objects_scrubbed":2,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:02:17.194825+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"28'435","reported_seq":552,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:41.031906+0000","last_change":"2024-04-25T00:50:35.877410+0000","last_active":"2024-04-25T03:09:41.031906+0000","last_peered":"2024-04-25T03:09:41.031906+0000","last_clean":"2024-04-25T03:09:41.031906+0000","last_became_active":"2024-04-25T00:50:35.876576+0000","last_became_peered":"2024-04-25T00:50:35.876576+0000","last_unstale":"2024-04-25T03:09:41.031906+0000","last_undegraded":"2024-04-25T03:09:41.031906+0000","last_fullsized":"2024-04-25T03:09:41.031906+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T00:50:34.177465+0000","last_clean_scrub_stamp":"2024-04-25T00:50:34.177465+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17268,"num_write":403,"num_write_kb":121594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"28'731","reported_seq":829,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:51.819171+0000","last_change":"2024-04-25T03:09:51.819247+0000","last_active":"2024-04-25T03:09:51.819171+0000","last_peered":"2024-04-25T03:09:51.819171+0000","last_clean":"2024-04-25T03:09:51.819171+0000","last_became_active":"2024-04-25T00:50:33.318940+0000","last_became_peered":"2024-04-25T00:50:33.318940+0000","last_unstale":"2024-04-25T03:09:51.819171+0000","last_undegraded":"2024-04-25T03:09:51.819171+0000","last_fullsized":"2024-04-25T03:09:51.819171+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'731","last_scrub_stamp":"2024-04-25T03:09:51.819036+0000","last_deep_scrub":"28'731","last_deep_scrub_stamp":"2024-04-25T03:09:51.819036+0000","last_clean_scrub_stamp":"2024-04-25T03:09:51.819036+0000","objects_scrubbed":8,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:34.874948+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":687,"num_write_kb":8496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2646,"num_read_kb":1386903,"num_write":24369,"num_write_kb":4205310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26395,"ondisk_log_size":26395,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":213073620,"num_objects":149,"num_object_clones":0,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":0,"num_read":4395,"num_read_kb":4765,"num_write":47715,"num_write_kb":231672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":426393600,"data_stored":426147240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38458,"ondisk_log_size":38458,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719478422,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177932,"kb_used_data":78724,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94193908,"statfs":{"total":96636764160,"available":96454561792,"internally_reserved":0,"allocated":80613376,"data_stored":80393199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":101579210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719478422,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":162792,"kb_used_data":63584,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94209048,"statfs":{"total":96636764160,"available":96470065152,"internally_reserved":0,"allocated":65110016,"data_stored":64903593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719478422,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150528,"kb_used_data":51320,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94221312,"statfs":{"total":96636764160,"available":96482623488,"internally_reserved":0,"allocated":52551680,"data_stored":52323151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719478420,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147132,"kb_used_data":57652,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94224708,"statfs":{"total":96636764160,"available":96486100992,"internally_reserved":0,"allocated":59035648,"data_stored":58830541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719478421,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97828,"kb_used_data":22236,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94274012,"statfs":{"total":96636764160,"available":96536588288,"internally_reserved":0,"allocated":22769664,"data_stored":22552901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424511125,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150240,"kb_used_data":42712,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94221600,"statfs":{"total":96636764160,"available":96482918400,"internally_reserved":0,"allocated":43737088,"data_stored":43524455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110098887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424511126,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":109060,"kb_used_data":45948,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94262780,"statfs":{"total":96636764160,"available":96525086720,"internally_reserved":0,"allocated":47050752,"data_stored":46836959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543829,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":156864,"kb_used_data":57656,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94214976,"statfs":{"total":96636764160,"available":96476135424,"internally_reserved":0,"allocated":59039744,"data_stored":58830161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46166016,"data_stored":46138218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":58748928,"data_stored":58721788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22478848,"data_stored":22444528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":43446272,"data_stored":43416082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":58744832,"data_stored":58722168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":52260864,"data_stored":52214778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":64819200,"data_stored":64795220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":79728640,"data_stored":79694458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T03:09:58.776 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.776 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.776 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.776 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.776 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.776 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.776 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.776 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.777 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.777 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.777 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.777 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.777 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.777 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.777 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.777 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.778 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.778 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.778 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.778 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.778 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.778 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.778 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.778 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.778 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.779 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.779 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.779 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.779 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.779 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.779 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.779 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.779 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.779 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.780 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.780 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.780 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.780 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.780 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.780 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.780 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.780 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.780 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.780 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.781 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.781 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.781 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.781 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.781 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.781 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.781 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.781 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.781 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.782 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.782 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.782 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.782 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.782 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.782 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.782 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T00:49:52.475299+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=49, tm_sec=52, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.782 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.785 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.785 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.785 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.786 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.786 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.786 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.786 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.786 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.786 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.786 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.786 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.786 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.787 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.787 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.787 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.787 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.787 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.787 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.787 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.787 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.787 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.788 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.788 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.788 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.788 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.788 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-25T00:50:31.835580+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=31, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.788 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.788 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T00:50:34.177465+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=0, tm_min=50, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=3, tm_min=9, tm_sec=49, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T03:09:58.788 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T03:10:08.563 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:10:08.566 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:10:18.790 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T03:10:18.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.917+0000 7fb418fcd640 1 Processor -- start 2024-04-25T03:10:18.920 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.917+0000 7fb418fcd640 1 -- start start 2024-04-25T03:10:18.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.917+0000 7fb418fcd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4140ccc40 0x7fb4141570c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:18.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.921+0000 7fb418fcd640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb4140cd020 0x7fb4140c7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:18.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.921+0000 7fb418fcd640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb414073260 con 0x7fb4140c7ba0 2024-04-25T03:10:18.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.921+0000 7fb418fcd640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb4140737a0 con 0x7fb4140cd020 2024-04-25T03:10:18.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.921+0000 7fb418fcd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb414073500 con 0x7fb4140ccc40 2024-04-25T03:10:18.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.921+0000 7fb40bfff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb4140cd020 0x7fb4140c7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:18.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.921+0000 7fb40bfff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb4140cd020 0x7fb4140c7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42782/0 (socket says 172.21.15.162:42782) 2024-04-25T03:10:18.922 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.921+0000 7fb40bfff640 1 -- 172.21.15.162:0/1917277372 learned_addr learned my addr 172.21.15.162:0/1917277372 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:10:18.923 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.921+0000 7fb41259c640 1 --2- 172.21.15.162:0/1917277372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4140ccc40 0x7fb4141570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:18.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.925+0000 7fb40bfff640 1 -- 172.21.15.162:0/1917277372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4140ccc40 msgr2=0x7fb4141570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:10:18.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.925+0000 7fb40bfff640 1 --2- 172.21.15.162:0/1917277372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4140ccc40 0x7fb4141570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:18.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.925+0000 7fb40bfff640 1 -- 172.21.15.162:0/1917277372 >> v1:172.21.15.179:6789/0 conn(0x7fb4140c7ba0 legacy=0x7fb414150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:18.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.925+0000 7fb40bfff640 1 -- 172.21.15.162:0/1917277372 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4140c4010 con 0x7fb4140cd020 2024-04-25T03:10:18.929 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.929+0000 7fb40bfff640 1 --2- 172.21.15.162:0/1917277372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4140cd020 0x7fb4140c7660 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009870 tx=0x7fb3fc020f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b3d104a5efe9bb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:18.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.933+0000 7fb411d9b640 1 -- 172.21.15.162:0/1917277372 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0b7070 con 0x7fb4140cd020 2024-04-25T03:10:18.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.933+0000 7fb411d9b640 1 -- 172.21.15.162:0/1917277372 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3fc0aac60 con 0x7fb4140cd020 2024-04-25T03:10:18.935 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.933+0000 7fb411d9b640 1 -- 172.21.15.162:0/1917277372 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc0b2660 con 0x7fb4140cd020 2024-04-25T03:10:18.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.933+0000 7fb418fcd640 1 -- 172.21.15.162:0/1917277372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4140cd020 msgr2=0x7fb4140c7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:18.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.933+0000 7fb418fcd640 1 --2- 172.21.15.162:0/1917277372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4140cd020 0x7fb4140c7660 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc009870 tx=0x7fb3fc020f60 comp rx=0 tx=0).stop 2024-04-25T03:10:18.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.933+0000 7fb418fcd640 1 -- 172.21.15.162:0/1917277372 shutdown_connections 2024-04-25T03:10:18.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.933+0000 7fb418fcd640 1 --2- 172.21.15.162:0/1917277372 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb4140cd020 0x7fb4140c7660 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:18.936 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.933+0000 7fb418fcd640 1 --2- 172.21.15.162:0/1917277372 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4140ccc40 0x7fb4141570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:18.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.933+0000 7fb418fcd640 1 -- 172.21.15.162:0/1917277372 >> 172.21.15.162:0/1917277372 conn(0x7fb414070350 msgr2=0x7fb414070760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:10:18.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.933+0000 7fb418fcd640 1 -- 172.21.15.162:0/1917277372 shutdown_connections 2024-04-25T03:10:18.937 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.933+0000 7fb418fcd640 1 -- 172.21.15.162:0/1917277372 wait complete. 2024-04-25T03:10:18.938 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.937+0000 7fb418fcd640 1 Processor -- start 2024-04-25T03:10:18.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.937+0000 7fb418fcd640 1 -- start start 2024-04-25T03:10:18.939 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.937+0000 7fb418fcd640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4140c7ba0 0x7fb4140c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:18.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.937+0000 7fb418fcd640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4140ccc40 0x7fb4140c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:18.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.937+0000 7fb418fcd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41406cf90 0x7fb41406b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:18.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.937+0000 7fb418fcd640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb414072f20 con 0x7fb41406cf90 2024-04-25T03:10:18.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.937+0000 7fb418fcd640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb4140c4590 con 0x7fb4140ccc40 2024-04-25T03:10:18.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.937+0000 7fb418fcd640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb4140c4ab0 con 0x7fb4140c7ba0 2024-04-25T03:10:18.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.937+0000 7fb412d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41406cf90 0x7fb41406b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:18.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.937+0000 7fb412d9d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41406cf90 0x7fb41406b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42798/0 (socket says 172.21.15.162:42798) 2024-04-25T03:10:18.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.937+0000 7fb412d9d640 1 -- 172.21.15.162:0/4071835016 learned_addr learned my addr 172.21.15.162:0/4071835016 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:10:18.941 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.937+0000 7fb41259c640 1 --2- 172.21.15.162:0/4071835016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4140c7ba0 0x7fb4140c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:18.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.937+0000 7fb40bfff640 1 --2- 172.21.15.162:0/4071835016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4140ccc40 0x7fb4140c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:18.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.941+0000 7fb412d9d640 1 -- 172.21.15.162:0/4071835016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4140c7ba0 msgr2=0x7fb4140c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:18.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.941+0000 7fb412d9d640 1 --2- 172.21.15.162:0/4071835016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4140c7ba0 0x7fb4140c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:18.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.941+0000 7fb412d9d640 1 -- 172.21.15.162:0/4071835016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4140ccc40 msgr2=0x7fb4140c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:18.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.941+0000 7fb412d9d640 1 --2- 172.21.15.162:0/4071835016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4140ccc40 0x7fb4140c8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:18.945 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.941+0000 7fb412d9d640 1 -- 172.21.15.162:0/4071835016 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4140c8350 con 0x7fb41406cf90 2024-04-25T03:10:18.950 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.945+0000 7fb412d9d640 1 --2- 172.21.15.162:0/4071835016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41406cf90 0x7fb41406b470 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00c6c0 tx=0x7fb40c00cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:18.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.949+0000 7fb40affd640 1 -- 172.21.15.162:0/4071835016 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c003b80 con 0x7fb41406cf90 2024-04-25T03:10:18.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.949+0000 7fb40affd640 1 -- 172.21.15.162:0/4071835016 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb40c003d40 con 0x7fb41406cf90 2024-04-25T03:10:18.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.949+0000 7fb40affd640 1 -- 172.21.15.162:0/4071835016 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb40c005310 con 0x7fb41406cf90 2024-04-25T03:10:18.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.949+0000 7fb418fcd640 1 -- 172.21.15.162:0/4071835016 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4141f0c70 con 0x7fb41406cf90 2024-04-25T03:10:18.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.949+0000 7fb418fcd640 1 -- 172.21.15.162:0/4071835016 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb41406c460 con 0x7fb41406cf90 2024-04-25T03:10:18.952 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:18.949+0000 7fb418fcd640 1 -- 172.21.15.162:0/4071835016 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4141401c0 con 0x7fb41406cf90 2024-04-25T03:10:19.243 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.241+0000 7fb40affd640 1 -- 172.21.15.162:0/4071835016 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb40c0054b0 con 0x7fb41406cf90 2024-04-25T03:10:19.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.241+0000 7fb40affd640 1 --2- 172.21.15.162:0/4071835016 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb3f4067910 0x7fb3f4069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:19.244 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.241+0000 7fb41259c640 1 --2- 172.21.15.162:0/4071835016 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb3f4067910 0x7fb3f4069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:19.245 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.241+0000 7fb41259c640 1 --2- 172.21.15.162:0/4071835016 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb3f4067910 0x7fb3f4069dd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb404007a60 tx=0x7fb404008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:19.285 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.285+0000 7fb40affd640 1 -- 172.21.15.162:0/4071835016 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7fb40c054990 con 0x7fb41406cf90 2024-04-25T03:10:19.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.289+0000 7fb40affd640 1 -- 172.21.15.162:0/4071835016 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fb40c0568f0 con 0x7fb41406cf90 2024-04-25T03:10:19.462 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.461+0000 7fb418fcd640 1 -- 172.21.15.162:0/4071835016 --> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb41404f5f0 con 0x7fb3f4067910 2024-04-25T03:10:19.480 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.477+0000 7fb40affd640 1 -- 172.21.15.162:0/4071835016 <== mgr.4100 v2:172.21.15.162:6800/3960394531 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+254572 (secure 0 0 0) 0x7fb41404f5f0 con 0x7fb3f4067910 2024-04-25T03:10:19.482 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T03:10:19.484 INFO:teuthology.orchestra.run.smithi162.stderr:dumped all 2024-04-25T03:10:19.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.481+0000 7fb418fcd640 1 -- 172.21.15.162:0/4071835016 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb3f4067910 msgr2=0x7fb3f4069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:19.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.481+0000 7fb418fcd640 1 --2- 172.21.15.162:0/4071835016 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb3f4067910 0x7fb3f4069dd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fb404007a60 tx=0x7fb404008040 comp rx=0 tx=0).stop 2024-04-25T03:10:19.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.481+0000 7fb418fcd640 1 -- 172.21.15.162:0/4071835016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41406cf90 msgr2=0x7fb41406b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:19.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.481+0000 7fb418fcd640 1 --2- 172.21.15.162:0/4071835016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41406cf90 0x7fb41406b470 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fb40c00c6c0 tx=0x7fb40c00cb80 comp rx=0 tx=0).stop 2024-04-25T03:10:19.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.481+0000 7fb418fcd640 1 -- 172.21.15.162:0/4071835016 shutdown_connections 2024-04-25T03:10:19.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.481+0000 7fb418fcd640 1 --2- 172.21.15.162:0/4071835016 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb3f4067910 0x7fb3f4069dd0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:19.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.481+0000 7fb418fcd640 1 --2- 172.21.15.162:0/4071835016 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb41406cf90 0x7fb41406b470 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:19.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.481+0000 7fb418fcd640 1 --2- 172.21.15.162:0/4071835016 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb4140ccc40 0x7fb4140c8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:19.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.481+0000 7fb418fcd640 1 --2- 172.21.15.162:0/4071835016 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb4140c7ba0 0x7fb4140c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:19.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.481+0000 7fb418fcd640 1 -- 172.21.15.162:0/4071835016 >> 172.21.15.162:0/4071835016 conn(0x7fb414070350 msgr2=0x7fb4141431c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:10:19.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.481+0000 7fb418fcd640 1 -- 172.21.15.162:0/4071835016 shutdown_connections 2024-04-25T03:10:19.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.481+0000 7fb418fcd640 1 -- 172.21.15.162:0/4071835016 wait complete. 2024-04-25T03:10:19.503 INFO:teuthology.orchestra.run.smithi162.stdout:{"pg_ready":true,"pg_map":{"version":4237,"stamp":"2024-04-25T03:10:19.107588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":213663988,"num_objects":151,"num_object_clones":0,"num_object_copies":302,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":151,"num_whiteouts":0,"num_read":7157,"num_read_kb":1391768,"num_write":72243,"num_write_kb":4439398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65089,"ondisk_log_size":65089,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1156536,"kb_used_data":419832,"kb_used_omap":12,"kb_used_meta":736627,"kb_avail":753818184,"statfs":{"total":773094113280,"available":771909820416,"internally_reserved":0,"allocated":429907968,"data_stored":428194960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":754306609},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004458"},"pg_stats":[{"pgid":"3.3f","version":"28'428","reported_seq":568,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:08.806288+0000","last_change":"2024-04-25T03:10:08.806288+0000","last_active":"2024-04-25T03:10:08.806288+0000","last_peered":"2024-04-25T03:10:08.806288+0000","last_clean":"2024-04-25T03:10:08.806288+0000","last_became_active":"2024-04-25T00:50:35.760579+0000","last_became_peered":"2024-04-25T00:50:35.760579+0000","last_unstale":"2024-04-25T03:10:08.806288+0000","last_undegraded":"2024-04-25T03:10:08.806288+0000","last_fullsized":"2024-04-25T03:10:08.806288+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'428","last_scrub_stamp":"2024-04-25T03:10:08.805800+0000","last_deep_scrub":"28'428","last_deep_scrub_stamp":"2024-04-25T03:10:08.805800+0000","last_clean_scrub_stamp":"2024-04-25T03:10:08.805800+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:25.267009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":25441,"num_write":394,"num_write_kb":67715,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"28'447","reported_seq":661,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:01.374050+0000","last_change":"2024-04-25T03:10:01.374050+0000","last_active":"2024-04-25T03:10:01.374050+0000","last_peered":"2024-04-25T03:10:01.374050+0000","last_clean":"2024-04-25T03:10:01.374050+0000","last_became_active":"2024-04-25T00:50:35.797354+0000","last_became_peered":"2024-04-25T00:50:35.797354+0000","last_unstale":"2024-04-25T03:10:01.374050+0000","last_undegraded":"2024-04-25T03:10:01.374050+0000","last_fullsized":"2024-04-25T03:10:01.374050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'447","last_scrub_stamp":"2024-04-25T03:10:01.373786+0000","last_deep_scrub":"28'447","last_deep_scrub_stamp":"2024-04-25T03:10:01.373786+0000","last_clean_scrub_stamp":"2024-04-25T03:10:01.373786+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:19:38.510751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":59186,"num_write":421,"num_write_kb":88627,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"28'383","reported_seq":494,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:57.812861+0000","last_change":"2024-04-25T03:09:57.812861+0000","last_active":"2024-04-25T03:09:57.812861+0000","last_peered":"2024-04-25T03:09:57.812861+0000","last_clean":"2024-04-25T03:09:57.812861+0000","last_became_active":"2024-04-25T00:50:35.798268+0000","last_became_peered":"2024-04-25T00:50:35.798268+0000","last_unstale":"2024-04-25T03:09:57.812861+0000","last_undegraded":"2024-04-25T03:09:57.812861+0000","last_fullsized":"2024-04-25T03:09:57.812861+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'383","last_scrub_stamp":"2024-04-25T03:09:57.812615+0000","last_deep_scrub":"28'383","last_deep_scrub_stamp":"2024-04-25T03:09:57.812615+0000","last_clean_scrub_stamp":"2024-04-25T03:09:57.812615+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:04:05.657692+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":8918,"num_write":356,"num_write_kb":42288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"28'378","reported_seq":494,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:10.166091+0000","last_change":"2024-04-25T03:10:10.166211+0000","last_active":"2024-04-25T03:10:10.166091+0000","last_peered":"2024-04-25T03:10:10.166091+0000","last_clean":"2024-04-25T03:10:10.166091+0000","last_became_active":"2024-04-25T00:50:35.877114+0000","last_became_peered":"2024-04-25T00:50:35.877114+0000","last_unstale":"2024-04-25T03:10:10.166091+0000","last_undegraded":"2024-04-25T03:10:10.166091+0000","last_fullsized":"2024-04-25T03:10:10.166091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'378","last_scrub_stamp":"2024-04-25T03:10:10.165831+0000","last_deep_scrub":"28'378","last_deep_scrub_stamp":"2024-04-25T03:10:10.165831+0000","last_clean_scrub_stamp":"2024-04-25T03:10:10.165831+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:50:27.333901+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":5983,"num_write":348,"num_write_kb":38519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"28'398","reported_seq":504,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:06.820244+0000","last_change":"2024-04-25T03:10:06.820304+0000","last_active":"2024-04-25T03:10:06.820244+0000","last_peered":"2024-04-25T03:10:06.820244+0000","last_clean":"2024-04-25T03:10:06.820244+0000","last_became_active":"2024-04-25T00:50:35.729785+0000","last_became_peered":"2024-04-25T00:50:35.729785+0000","last_unstale":"2024-04-25T03:10:06.820244+0000","last_undegraded":"2024-04-25T03:10:06.820244+0000","last_fullsized":"2024-04-25T03:10:06.820244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'398","last_scrub_stamp":"2024-04-25T03:10:06.820054+0000","last_deep_scrub":"28'398","last_deep_scrub_stamp":"2024-04-25T03:10:06.820054+0000","last_clean_scrub_stamp":"2024-04-25T03:10:06.820054+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:12.733240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12535,"num_write":367,"num_write_kb":34849,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"28'384","reported_seq":478,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:00.290149+0000","last_change":"2024-04-25T03:10:00.290292+0000","last_active":"2024-04-25T03:10:00.290149+0000","last_peered":"2024-04-25T03:10:00.290149+0000","last_clean":"2024-04-25T03:10:00.290149+0000","last_became_active":"2024-04-25T00:51:40.323657+0000","last_became_peered":"2024-04-25T00:51:40.323657+0000","last_unstale":"2024-04-25T03:10:00.290149+0000","last_undegraded":"2024-04-25T03:10:00.290149+0000","last_fullsized":"2024-04-25T03:10:00.290149+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'384","last_scrub_stamp":"2024-04-25T03:10:00.289811+0000","last_deep_scrub":"28'384","last_deep_scrub_stamp":"2024-04-25T03:10:00.289811+0000","last_clean_scrub_stamp":"2024-04-25T03:10:00.289811+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:27:42.376392+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9183,"num_write":360,"num_write_kb":42897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"28'423","reported_seq":525,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:09.830701+0000","last_change":"2024-04-25T03:10:09.830767+0000","last_active":"2024-04-25T03:10:09.830701+0000","last_peered":"2024-04-25T03:10:09.830701+0000","last_clean":"2024-04-25T03:10:09.830701+0000","last_became_active":"2024-04-25T00:50:35.797328+0000","last_became_peered":"2024-04-25T00:50:35.797328+0000","last_unstale":"2024-04-25T03:10:09.830701+0000","last_undegraded":"2024-04-25T03:10:09.830701+0000","last_fullsized":"2024-04-25T03:10:09.830701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'423","last_scrub_stamp":"2024-04-25T03:10:09.830447+0000","last_deep_scrub":"28'423","last_deep_scrub_stamp":"2024-04-25T03:10:09.830447+0000","last_clean_scrub_stamp":"2024-04-25T03:10:09.830447+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:07.331255+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":6445,"num_write":396,"num_write_kb":56628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"28'391","reported_seq":546,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:59.021066+0000","last_change":"2024-04-25T03:09:59.021204+0000","last_active":"2024-04-25T03:09:59.021066+0000","last_peered":"2024-04-25T03:09:59.021066+0000","last_clean":"2024-04-25T03:09:59.021066+0000","last_became_active":"2024-04-25T00:50:35.877581+0000","last_became_peered":"2024-04-25T00:50:35.877581+0000","last_unstale":"2024-04-25T03:09:59.021066+0000","last_undegraded":"2024-04-25T03:09:59.021066+0000","last_fullsized":"2024-04-25T03:09:59.021066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'391","last_scrub_stamp":"2024-04-25T03:09:59.020814+0000","last_deep_scrub":"28'391","last_deep_scrub_stamp":"2024-04-25T03:09:59.020814+0000","last_clean_scrub_stamp":"2024-04-25T03:09:59.020814+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:31:29.158306+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":40559,"num_write":354,"num_write_kb":84336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"28'417","reported_seq":520,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:02.272633+0000","last_change":"2024-04-25T03:10:02.272633+0000","last_active":"2024-04-25T03:10:02.272633+0000","last_peered":"2024-04-25T03:10:02.272633+0000","last_clean":"2024-04-25T03:10:02.272633+0000","last_became_active":"2024-04-25T00:51:40.608071+0000","last_became_peered":"2024-04-25T00:51:40.608071+0000","last_unstale":"2024-04-25T03:10:02.272633+0000","last_undegraded":"2024-04-25T03:10:02.272633+0000","last_fullsized":"2024-04-25T03:10:02.272633+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'417","last_scrub_stamp":"2024-04-25T03:10:02.272256+0000","last_deep_scrub":"28'417","last_deep_scrub_stamp":"2024-04-25T03:10:02.272256+0000","last_clean_scrub_stamp":"2024-04-25T03:10:02.272256+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:05:08.854848+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14358,"num_write":383,"num_write_kb":47358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.36","version":"28'402","reported_seq":529,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:03.864923+0000","last_change":"2024-04-25T03:10:03.864983+0000","last_active":"2024-04-25T03:10:03.864923+0000","last_peered":"2024-04-25T03:10:03.864923+0000","last_clean":"2024-04-25T03:10:03.864923+0000","last_became_active":"2024-04-25T00:50:35.764412+0000","last_became_peered":"2024-04-25T00:50:35.764412+0000","last_unstale":"2024-04-25T03:10:03.864923+0000","last_undegraded":"2024-04-25T03:10:03.864923+0000","last_fullsized":"2024-04-25T03:10:03.864923+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'402","last_scrub_stamp":"2024-04-25T03:10:03.864625+0000","last_deep_scrub":"28'402","last_deep_scrub_stamp":"2024-04-25T03:10:03.864625+0000","last_clean_scrub_stamp":"2024-04-25T03:10:03.864625+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:57.628461+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":23778,"num_write":367,"num_write_kb":71174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"28'383","reported_seq":500,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:02.903456+0000","last_change":"2024-04-25T03:10:02.903586+0000","last_active":"2024-04-25T03:10:02.903456+0000","last_peered":"2024-04-25T03:10:02.903456+0000","last_clean":"2024-04-25T03:10:02.903456+0000","last_became_active":"2024-04-25T00:50:35.763770+0000","last_became_peered":"2024-04-25T00:50:35.763770+0000","last_unstale":"2024-04-25T03:10:02.903456+0000","last_undegraded":"2024-04-25T03:10:02.903456+0000","last_fullsized":"2024-04-25T03:10:02.903456+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'383","last_scrub_stamp":"2024-04-25T03:10:02.903228+0000","last_deep_scrub":"28'383","last_deep_scrub_stamp":"2024-04-25T03:10:02.903228+0000","last_clean_scrub_stamp":"2024-04-25T03:10:02.903228+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:04:10.748305+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":20604,"num_write":365,"num_write_kb":74840,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"28'373","reported_seq":498,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:57.200963+0000","last_change":"2024-04-25T03:09:57.201026+0000","last_active":"2024-04-25T03:09:57.200963+0000","last_peered":"2024-04-25T03:09:57.200963+0000","last_clean":"2024-04-25T03:09:57.200963+0000","last_became_active":"2024-04-25T00:50:35.821524+0000","last_became_peered":"2024-04-25T00:50:35.821524+0000","last_unstale":"2024-04-25T03:09:57.200963+0000","last_undegraded":"2024-04-25T03:09:57.200963+0000","last_fullsized":"2024-04-25T03:09:57.200963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'373","last_scrub_stamp":"2024-04-25T03:09:57.200750+0000","last_deep_scrub":"28'373","last_deep_scrub_stamp":"2024-04-25T03:09:57.200750+0000","last_clean_scrub_stamp":"2024-04-25T03:09:57.200750+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:51:41.476968+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22834,"num_write":346,"num_write_kb":67125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"28'376","reported_seq":463,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:02.015837+0000","last_change":"2024-04-25T03:10:02.015929+0000","last_active":"2024-04-25T03:10:02.015837+0000","last_peered":"2024-04-25T03:10:02.015837+0000","last_clean":"2024-04-25T03:10:02.015837+0000","last_became_active":"2024-04-25T00:50:35.880661+0000","last_became_peered":"2024-04-25T00:50:35.880661+0000","last_unstale":"2024-04-25T03:10:02.015837+0000","last_undegraded":"2024-04-25T03:10:02.015837+0000","last_fullsized":"2024-04-25T03:10:02.015837+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'376","last_scrub_stamp":"2024-04-25T03:10:02.015597+0000","last_deep_scrub":"28'376","last_deep_scrub_stamp":"2024-04-25T03:10:02.015597+0000","last_clean_scrub_stamp":"2024-04-25T03:10:02.015597+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:14:24.884501+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":168,"num_write":340,"num_write_kb":38232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"28'401","reported_seq":488,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:54.788693+0000","last_change":"2024-04-25T03:09:54.788755+0000","last_active":"2024-04-25T03:09:54.788693+0000","last_peered":"2024-04-25T03:09:54.788693+0000","last_clean":"2024-04-25T03:09:54.788693+0000","last_became_active":"2024-04-25T00:50:35.795295+0000","last_became_peered":"2024-04-25T00:50:35.795295+0000","last_unstale":"2024-04-25T03:09:54.788693+0000","last_undegraded":"2024-04-25T03:09:54.788693+0000","last_fullsized":"2024-04-25T03:09:54.788693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'401","last_scrub_stamp":"2024-04-25T03:09:54.788476+0000","last_deep_scrub":"28'401","last_deep_scrub_stamp":"2024-04-25T03:09:54.788476+0000","last_clean_scrub_stamp":"2024-04-25T03:09:54.788476+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:49:57.168091+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":363,"num_write_kb":22306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"28'418","reported_seq":588,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:02.418100+0000","last_change":"2024-04-25T03:10:02.418263+0000","last_active":"2024-04-25T03:10:02.418100+0000","last_peered":"2024-04-25T03:10:02.418100+0000","last_clean":"2024-04-25T03:10:02.418100+0000","last_became_active":"2024-04-25T00:50:35.817575+0000","last_became_peered":"2024-04-25T00:50:35.817575+0000","last_unstale":"2024-04-25T03:10:02.418100+0000","last_undegraded":"2024-04-25T03:10:02.418100+0000","last_fullsized":"2024-04-25T03:10:02.418100+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'418","last_scrub_stamp":"2024-04-25T03:10:02.417813+0000","last_deep_scrub":"28'418","last_deep_scrub_stamp":"2024-04-25T03:10:02.417813+0000","last_clean_scrub_stamp":"2024-04-25T03:10:02.417813+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:48:50.331223+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":52039,"num_write":380,"num_write_kb":55267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"28'423","reported_seq":521,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:04.132699+0000","last_change":"2024-04-25T03:10:04.132815+0000","last_active":"2024-04-25T03:10:04.132699+0000","last_peered":"2024-04-25T03:10:04.132699+0000","last_clean":"2024-04-25T03:10:04.132699+0000","last_became_active":"2024-04-25T00:50:35.796536+0000","last_became_peered":"2024-04-25T00:50:35.796536+0000","last_unstale":"2024-04-25T03:10:04.132699+0000","last_undegraded":"2024-04-25T03:10:04.132699+0000","last_fullsized":"2024-04-25T03:10:04.132699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'423","last_scrub_stamp":"2024-04-25T03:10:04.132400+0000","last_deep_scrub":"28'423","last_deep_scrub_stamp":"2024-04-25T03:10:04.132400+0000","last_clean_scrub_stamp":"2024-04-25T03:10:04.132400+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:41.149154+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4763,"num_write":382,"num_write_kb":21763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"28'399","reported_seq":516,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:03.141043+0000","last_change":"2024-04-25T03:10:03.141103+0000","last_active":"2024-04-25T03:10:03.141043+0000","last_peered":"2024-04-25T03:10:03.141043+0000","last_clean":"2024-04-25T03:10:03.141043+0000","last_became_active":"2024-04-25T00:50:35.728875+0000","last_became_peered":"2024-04-25T00:50:35.728875+0000","last_unstale":"2024-04-25T03:10:03.141043+0000","last_undegraded":"2024-04-25T03:10:03.141043+0000","last_fullsized":"2024-04-25T03:10:03.141043+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'399","last_scrub_stamp":"2024-04-25T03:10:03.140838+0000","last_deep_scrub":"28'399","last_deep_scrub_stamp":"2024-04-25T03:10:03.140838+0000","last_clean_scrub_stamp":"2024-04-25T03:10:03.140838+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:32:58.070992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":10229,"num_write":366,"num_write_kb":22657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"28'400","reported_seq":507,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:59.336357+0000","last_change":"2024-04-25T03:09:59.336421+0000","last_active":"2024-04-25T03:09:59.336357+0000","last_peered":"2024-04-25T03:09:59.336357+0000","last_clean":"2024-04-25T03:09:59.336357+0000","last_became_active":"2024-04-25T00:50:35.760286+0000","last_became_peered":"2024-04-25T00:50:35.760286+0000","last_unstale":"2024-04-25T03:09:59.336357+0000","last_undegraded":"2024-04-25T03:09:59.336357+0000","last_fullsized":"2024-04-25T03:09:59.336357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'400","last_scrub_stamp":"2024-04-25T03:09:59.336155+0000","last_deep_scrub":"28'400","last_deep_scrub_stamp":"2024-04-25T03:09:59.336155+0000","last_clean_scrub_stamp":"2024-04-25T03:09:59.336155+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:42.392068+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":9641,"num_write":360,"num_write_kb":34623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"28'447","reported_seq":600,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:58.898615+0000","last_change":"2024-04-25T03:09:58.898673+0000","last_active":"2024-04-25T03:09:58.898615+0000","last_peered":"2024-04-25T03:09:58.898615+0000","last_clean":"2024-04-25T03:09:58.898615+0000","last_became_active":"2024-04-25T00:50:35.732134+0000","last_became_peered":"2024-04-25T00:50:35.732134+0000","last_unstale":"2024-04-25T03:09:58.898615+0000","last_undegraded":"2024-04-25T03:09:58.898615+0000","last_fullsized":"2024-04-25T03:09:58.898615+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'447","last_scrub_stamp":"2024-04-25T03:09:58.898391+0000","last_deep_scrub":"28'447","last_deep_scrub_stamp":"2024-04-25T03:09:58.898391+0000","last_clean_scrub_stamp":"2024-04-25T03:09:58.898391+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:49.500639+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":29174,"num_write":415,"num_write_kb":129675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"28'442","reported_seq":554,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:08.809385+0000","last_change":"2024-04-25T03:10:08.809512+0000","last_active":"2024-04-25T03:10:08.809385+0000","last_peered":"2024-04-25T03:10:08.809385+0000","last_clean":"2024-04-25T03:10:08.809385+0000","last_became_active":"2024-04-25T00:50:35.818063+0000","last_became_peered":"2024-04-25T00:50:35.818063+0000","last_unstale":"2024-04-25T03:10:08.809385+0000","last_undegraded":"2024-04-25T03:10:08.809385+0000","last_fullsized":"2024-04-25T03:10:08.809385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'442","last_scrub_stamp":"2024-04-25T03:10:08.809124+0000","last_deep_scrub":"28'442","last_deep_scrub_stamp":"2024-04-25T03:10:08.809124+0000","last_clean_scrub_stamp":"2024-04-25T03:10:08.809124+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:33.813939+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":20728,"num_write":411,"num_write_kb":42636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"28'443","reported_seq":591,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:55.829914+0000","last_change":"2024-04-25T03:09:55.829914+0000","last_active":"2024-04-25T03:09:55.829914+0000","last_peered":"2024-04-25T03:09:55.829914+0000","last_clean":"2024-04-25T03:09:55.829914+0000","last_became_active":"2024-04-25T00:50:35.797580+0000","last_became_peered":"2024-04-25T00:50:35.797580+0000","last_unstale":"2024-04-25T03:09:55.829914+0000","last_undegraded":"2024-04-25T03:09:55.829914+0000","last_fullsized":"2024-04-25T03:09:55.829914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'443","last_scrub_stamp":"2024-04-25T03:09:55.829755+0000","last_deep_scrub":"28'443","last_deep_scrub_stamp":"2024-04-25T03:09:55.829755+0000","last_clean_scrub_stamp":"2024-04-25T03:09:55.829755+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:25:29.657388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28574,"num_write":419,"num_write_kb":125045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"28'422","reported_seq":532,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:01.318533+0000","last_change":"2024-04-25T03:10:01.318591+0000","last_active":"2024-04-25T03:10:01.318533+0000","last_peered":"2024-04-25T03:10:01.318533+0000","last_clean":"2024-04-25T03:10:01.318533+0000","last_became_active":"2024-04-25T00:51:40.407614+0000","last_became_peered":"2024-04-25T00:51:40.407614+0000","last_unstale":"2024-04-25T03:10:01.318533+0000","last_undegraded":"2024-04-25T03:10:01.318533+0000","last_fullsized":"2024-04-25T03:10:01.318533+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'422","last_scrub_stamp":"2024-04-25T03:10:01.318329+0000","last_deep_scrub":"28'422","last_deep_scrub_stamp":"2024-04-25T03:10:01.318329+0000","last_clean_scrub_stamp":"2024-04-25T03:10:01.318329+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:49:49.908675+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":17978,"num_write":385,"num_write_kb":59372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.29","version":"28'409","reported_seq":532,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:00.024329+0000","last_change":"2024-04-25T03:10:00.024329+0000","last_active":"2024-04-25T03:10:00.024329+0000","last_peered":"2024-04-25T03:10:00.024329+0000","last_clean":"2024-04-25T03:10:00.024329+0000","last_became_active":"2024-04-25T00:50:35.876489+0000","last_became_peered":"2024-04-25T00:50:35.876489+0000","last_unstale":"2024-04-25T03:10:00.024329+0000","last_undegraded":"2024-04-25T03:10:00.024329+0000","last_fullsized":"2024-04-25T03:10:00.024329+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'409","last_scrub_stamp":"2024-04-25T03:10:00.024221+0000","last_deep_scrub":"28'409","last_deep_scrub_stamp":"2024-04-25T03:10:00.024221+0000","last_clean_scrub_stamp":"2024-04-25T03:10:00.024221+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:23:10.417921+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":9083,"num_write":379,"num_write_kb":55476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"28'437","reported_seq":571,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:09.149359+0000","last_change":"2024-04-25T03:10:09.149481+0000","last_active":"2024-04-25T03:10:09.149359+0000","last_peered":"2024-04-25T03:10:09.149359+0000","last_clean":"2024-04-25T03:10:09.149359+0000","last_became_active":"2024-04-25T00:50:35.876870+0000","last_became_peered":"2024-04-25T00:50:35.876870+0000","last_unstale":"2024-04-25T03:10:09.149359+0000","last_undegraded":"2024-04-25T03:10:09.149359+0000","last_fullsized":"2024-04-25T03:10:09.149359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'437","last_scrub_stamp":"2024-04-25T03:10:09.149123+0000","last_deep_scrub":"28'437","last_deep_scrub_stamp":"2024-04-25T03:10:09.149123+0000","last_clean_scrub_stamp":"2024-04-25T03:10:09.149123+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:55:25.610332+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":19659,"num_write":409,"num_write_kb":79764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"28'386","reported_seq":499,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:01.031648+0000","last_change":"2024-04-25T03:10:01.031712+0000","last_active":"2024-04-25T03:10:01.031648+0000","last_peered":"2024-04-25T03:10:01.031648+0000","last_clean":"2024-04-25T03:10:01.031648+0000","last_became_active":"2024-04-25T00:50:35.880477+0000","last_became_peered":"2024-04-25T00:50:35.880477+0000","last_unstale":"2024-04-25T03:10:01.031648+0000","last_undegraded":"2024-04-25T03:10:01.031648+0000","last_fullsized":"2024-04-25T03:10:01.031648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'386","last_scrub_stamp":"2024-04-25T03:10:01.031441+0000","last_deep_scrub":"28'386","last_deep_scrub_stamp":"2024-04-25T03:10:01.031441+0000","last_clean_scrub_stamp":"2024-04-25T03:10:01.031441+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:38.335476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":12882,"num_write":369,"num_write_kb":38131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"28'477","reported_seq":607,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:04.902882+0000","last_change":"2024-04-25T03:10:04.902946+0000","last_active":"2024-04-25T03:10:04.902882+0000","last_peered":"2024-04-25T03:10:04.902882+0000","last_clean":"2024-04-25T03:10:04.902882+0000","last_became_active":"2024-04-25T00:50:35.764358+0000","last_became_peered":"2024-04-25T00:50:35.764358+0000","last_unstale":"2024-04-25T03:10:04.902882+0000","last_undegraded":"2024-04-25T03:10:04.902882+0000","last_fullsized":"2024-04-25T03:10:04.902882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'477","last_scrub_stamp":"2024-04-25T03:10:04.902670+0000","last_deep_scrub":"28'477","last_deep_scrub_stamp":"2024-04-25T03:10:04.902670+0000","last_clean_scrub_stamp":"2024-04-25T03:10:04.902670+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:40:08.004176+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":19569,"num_write":439,"num_write_kb":84809,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"28'424","reported_seq":594,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:03.406398+0000","last_change":"2024-04-25T03:10:03.406461+0000","last_active":"2024-04-25T03:10:03.406398+0000","last_peered":"2024-04-25T03:10:03.406398+0000","last_clean":"2024-04-25T03:10:03.406398+0000","last_became_active":"2024-04-25T00:50:35.868857+0000","last_became_peered":"2024-04-25T00:50:35.868857+0000","last_unstale":"2024-04-25T03:10:03.406398+0000","last_undegraded":"2024-04-25T03:10:03.406398+0000","last_fullsized":"2024-04-25T03:10:03.406398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'424","last_scrub_stamp":"2024-04-25T03:10:03.406171+0000","last_deep_scrub":"28'424","last_deep_scrub_stamp":"2024-04-25T03:10:03.406171+0000","last_clean_scrub_stamp":"2024-04-25T03:10:03.406171+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:29:30.115759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":50759,"num_write":394,"num_write_kb":108657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"28'403","reported_seq":572,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:07.153659+0000","last_change":"2024-04-25T03:10:07.153718+0000","last_active":"2024-04-25T03:10:07.153659+0000","last_peered":"2024-04-25T03:10:07.153659+0000","last_clean":"2024-04-25T03:10:07.153659+0000","last_became_active":"2024-04-25T00:50:35.883901+0000","last_became_peered":"2024-04-25T00:50:35.883901+0000","last_unstale":"2024-04-25T03:10:07.153659+0000","last_undegraded":"2024-04-25T03:10:07.153659+0000","last_fullsized":"2024-04-25T03:10:07.153659+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'403","last_scrub_stamp":"2024-04-25T03:10:07.153428+0000","last_deep_scrub":"28'403","last_deep_scrub_stamp":"2024-04-25T03:10:07.153428+0000","last_clean_scrub_stamp":"2024-04-25T03:10:07.153428+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:15:29.656135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":36518,"num_write":378,"num_write_kb":108957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"28'386","reported_seq":499,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:02.837212+0000","last_change":"2024-04-25T03:10:02.837273+0000","last_active":"2024-04-25T03:10:02.837212+0000","last_peered":"2024-04-25T03:10:02.837212+0000","last_clean":"2024-04-25T03:10:02.837212+0000","last_became_active":"2024-04-25T00:50:35.877870+0000","last_became_peered":"2024-04-25T00:50:35.877870+0000","last_unstale":"2024-04-25T03:10:02.837212+0000","last_undegraded":"2024-04-25T03:10:02.837212+0000","last_fullsized":"2024-04-25T03:10:02.837212+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'386","last_scrub_stamp":"2024-04-25T03:10:02.836967+0000","last_deep_scrub":"28'386","last_deep_scrub_stamp":"2024-04-25T03:10:02.836967+0000","last_clean_scrub_stamp":"2024-04-25T03:10:02.836967+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:48.076612+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":12325,"num_write":357,"num_write_kb":37847,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"28'487","reported_seq":642,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:08.139431+0000","last_change":"2024-04-25T03:10:08.139431+0000","last_active":"2024-04-25T03:10:08.139431+0000","last_peered":"2024-04-25T03:10:08.139431+0000","last_clean":"2024-04-25T03:10:08.139431+0000","last_became_active":"2024-04-25T00:50:35.869016+0000","last_became_peered":"2024-04-25T00:50:35.869016+0000","last_unstale":"2024-04-25T03:10:08.139431+0000","last_undegraded":"2024-04-25T03:10:08.139431+0000","last_fullsized":"2024-04-25T03:10:08.139431+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'487","last_scrub_stamp":"2024-04-25T03:10:08.139315+0000","last_deep_scrub":"28'487","last_deep_scrub_stamp":"2024-04-25T03:10:08.139315+0000","last_clean_scrub_stamp":"2024-04-25T03:10:08.139315+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:03:32.847404+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":33246,"num_write":457,"num_write_kb":117202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"28'457","reported_seq":587,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:58.298677+0000","last_change":"2024-04-25T03:09:58.298677+0000","last_active":"2024-04-25T03:09:58.298677+0000","last_peered":"2024-04-25T03:09:58.298677+0000","last_clean":"2024-04-25T03:09:58.298677+0000","last_became_active":"2024-04-25T00:50:35.728271+0000","last_became_peered":"2024-04-25T00:50:35.728271+0000","last_unstale":"2024-04-25T03:09:58.298677+0000","last_undegraded":"2024-04-25T03:09:58.298677+0000","last_fullsized":"2024-04-25T03:09:58.298677+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'457","last_scrub_stamp":"2024-04-25T03:09:58.298512+0000","last_deep_scrub":"28'457","last_deep_scrub_stamp":"2024-04-25T03:09:58.298512+0000","last_clean_scrub_stamp":"2024-04-25T03:09:58.298512+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:55:06.453320+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":18149,"num_write":425,"num_write_kb":92614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"28'412","reported_seq":519,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:06.899475+0000","last_change":"2024-04-25T03:10:06.899475+0000","last_active":"2024-04-25T03:10:06.899475+0000","last_peered":"2024-04-25T03:10:06.899475+0000","last_clean":"2024-04-25T03:10:06.899475+0000","last_became_active":"2024-04-25T00:50:35.801389+0000","last_became_peered":"2024-04-25T00:50:35.801389+0000","last_unstale":"2024-04-25T03:10:06.899475+0000","last_undegraded":"2024-04-25T03:10:06.899475+0000","last_fullsized":"2024-04-25T03:10:06.899475+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'412","last_scrub_stamp":"2024-04-25T03:10:06.899218+0000","last_deep_scrub":"28'412","last_deep_scrub_stamp":"2024-04-25T03:10:06.899218+0000","last_clean_scrub_stamp":"2024-04-25T03:10:06.899218+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:59.580722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":4792,"num_write":381,"num_write_kb":30347,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"28'401","reported_seq":515,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:58.163668+0000","last_change":"2024-04-25T03:09:58.163725+0000","last_active":"2024-04-25T03:09:58.163668+0000","last_peered":"2024-04-25T03:09:58.163668+0000","last_clean":"2024-04-25T03:09:58.163668+0000","last_became_active":"2024-04-25T00:50:35.821484+0000","last_became_peered":"2024-04-25T00:50:35.821484+0000","last_unstale":"2024-04-25T03:09:58.163668+0000","last_undegraded":"2024-04-25T03:09:58.163668+0000","last_fullsized":"2024-04-25T03:09:58.163668+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'401","last_scrub_stamp":"2024-04-25T03:09:58.163464+0000","last_deep_scrub":"28'401","last_deep_scrub_stamp":"2024-04-25T03:09:58.163464+0000","last_clean_scrub_stamp":"2024-04-25T03:09:58.163464+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:22:03.734395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":18401,"num_write":362,"num_write_kb":62496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"28'366","reported_seq":453,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:55.986928+0000","last_change":"2024-04-25T03:09:55.986977+0000","last_active":"2024-04-25T03:09:55.986928+0000","last_peered":"2024-04-25T03:09:55.986928+0000","last_clean":"2024-04-25T03:09:55.986928+0000","last_became_active":"2024-04-25T00:50:33.390901+0000","last_became_peered":"2024-04-25T00:50:33.390901+0000","last_unstale":"2024-04-25T03:09:55.986928+0000","last_undegraded":"2024-04-25T03:09:55.986928+0000","last_fullsized":"2024-04-25T03:09:55.986928+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'366","last_scrub_stamp":"2024-04-25T03:09:55.986816+0000","last_deep_scrub":"28'366","last_deep_scrub_stamp":"2024-04-25T03:09:55.986816+0000","last_clean_scrub_stamp":"2024-04-25T03:09:55.986816+0000","objects_scrubbed":3,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:14:35.219405+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":305,"num_write_kb":4231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"28'355","reported_seq":442,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:01.873744+0000","last_change":"2024-04-25T03:10:01.873811+0000","last_active":"2024-04-25T03:10:01.873744+0000","last_peered":"2024-04-25T03:10:01.873744+0000","last_clean":"2024-04-25T03:10:01.873744+0000","last_became_active":"2024-04-25T00:50:35.820763+0000","last_became_peered":"2024-04-25T00:50:35.820763+0000","last_unstale":"2024-04-25T03:10:01.873744+0000","last_undegraded":"2024-04-25T03:10:01.873744+0000","last_fullsized":"2024-04-25T03:10:01.873744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'355","last_scrub_stamp":"2024-04-25T03:10:01.873538+0000","last_deep_scrub":"28'355","last_deep_scrub_stamp":"2024-04-25T03:10:01.873538+0000","last_clean_scrub_stamp":"2024-04-25T03:10:01.873538+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:47.404753+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":529,"num_write":324,"num_write_kb":17419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"28'2233","reported_seq":2320,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:02.020063+0000","last_change":"2024-04-25T03:10:02.020220+0000","last_active":"2024-04-25T03:10:02.020063+0000","last_peered":"2024-04-25T03:10:02.020063+0000","last_clean":"2024-04-25T03:10:02.020063+0000","last_became_active":"2024-04-25T00:50:33.392951+0000","last_became_peered":"2024-04-25T00:50:33.392951+0000","last_unstale":"2024-04-25T03:10:02.020063+0000","last_undegraded":"2024-04-25T03:10:02.020063+0000","last_fullsized":"2024-04-25T03:10:02.020063+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2233","last_scrub_stamp":"2024-04-25T03:10:02.019809+0000","last_deep_scrub":"28'2233","last_deep_scrub_stamp":"2024-04-25T03:10:02.019809+0000","last_clean_scrub_stamp":"2024-04-25T03:10:02.019809+0000","objects_scrubbed":7,"log_size":2233,"log_dups_size":0,"ondisk_log_size":2233,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:15:44.811980+0000","scrub_duration":95,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2166,"num_write_kb":17433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"28'822","reported_seq":911,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:57.023184+0000","last_change":"2024-04-25T03:09:57.023247+0000","last_active":"2024-04-25T03:09:57.023184+0000","last_peered":"2024-04-25T03:09:57.023184+0000","last_clean":"2024-04-25T03:09:57.023184+0000","last_became_active":"2024-04-25T00:50:33.392817+0000","last_became_peered":"2024-04-25T00:50:33.392817+0000","last_unstale":"2024-04-25T03:09:57.023184+0000","last_undegraded":"2024-04-25T03:09:57.023184+0000","last_fullsized":"2024-04-25T03:09:57.023184+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'822","last_scrub_stamp":"2024-04-25T03:09:57.023011+0000","last_deep_scrub":"28'822","last_deep_scrub_stamp":"2024-04-25T03:09:57.023011+0000","last_clean_scrub_stamp":"2024-04-25T03:09:57.023011+0000","objects_scrubbed":3,"log_size":822,"log_dups_size":0,"ondisk_log_size":822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:57:05.105929+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":776,"num_write_kb":4477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"28'429","reported_seq":512,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:05.401319+0000","last_change":"2024-04-25T03:10:05.401387+0000","last_active":"2024-04-25T03:10:05.401319+0000","last_peered":"2024-04-25T03:10:05.401319+0000","last_clean":"2024-04-25T03:10:05.401319+0000","last_became_active":"2024-04-25T00:51:40.319726+0000","last_became_peered":"2024-04-25T00:51:40.319726+0000","last_unstale":"2024-04-25T03:10:05.401319+0000","last_undegraded":"2024-04-25T03:10:05.401319+0000","last_fullsized":"2024-04-25T03:10:05.401319+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'429","last_scrub_stamp":"2024-04-25T03:10:05.401095+0000","last_deep_scrub":"28'429","last_deep_scrub_stamp":"2024-04-25T03:10:05.401095+0000","last_clean_scrub_stamp":"2024-04-25T03:10:05.401095+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:50.817581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":4282,"num_write":403,"num_write_kb":55112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"28'1297","reported_seq":1386,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:59.179138+0000","last_change":"2024-04-25T03:09:59.179287+0000","last_active":"2024-04-25T03:09:59.179138+0000","last_peered":"2024-04-25T03:09:59.179138+0000","last_clean":"2024-04-25T03:09:59.179138+0000","last_became_active":"2024-04-25T00:50:33.382925+0000","last_became_peered":"2024-04-25T00:50:33.382925+0000","last_unstale":"2024-04-25T03:09:59.179138+0000","last_undegraded":"2024-04-25T03:09:59.179138+0000","last_fullsized":"2024-04-25T03:09:59.179138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1297","last_scrub_stamp":"2024-04-25T03:09:59.178876+0000","last_deep_scrub":"28'1297","last_deep_scrub_stamp":"2024-04-25T03:09:59.178876+0000","last_clean_scrub_stamp":"2024-04-25T03:09:59.178876+0000","objects_scrubbed":4,"log_size":1297,"log_dups_size":0,"ondisk_log_size":1297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:49.781123+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583494,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1222,"num_write_kb":12901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"28'453","reported_seq":614,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:04.433955+0000","last_change":"2024-04-25T03:10:04.434020+0000","last_active":"2024-04-25T03:10:04.433955+0000","last_peered":"2024-04-25T03:10:04.433955+0000","last_clean":"2024-04-25T03:10:04.433955+0000","last_became_active":"2024-04-25T00:50:35.869028+0000","last_became_peered":"2024-04-25T00:50:35.869028+0000","last_unstale":"2024-04-25T03:10:04.433955+0000","last_undegraded":"2024-04-25T03:10:04.433955+0000","last_fullsized":"2024-04-25T03:10:04.433955+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'453","last_scrub_stamp":"2024-04-25T03:10:04.433747+0000","last_deep_scrub":"28'453","last_deep_scrub_stamp":"2024-04-25T03:10:04.433747+0000","last_clean_scrub_stamp":"2024-04-25T03:10:04.433747+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:21:08.721051+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":36096,"num_write":419,"num_write_kb":96892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"28'62","reported_seq":151,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:00.894472+0000","last_change":"2024-04-25T03:10:00.894574+0000","last_active":"2024-04-25T03:10:00.894472+0000","last_peered":"2024-04-25T03:10:00.894472+0000","last_clean":"2024-04-25T03:10:00.894472+0000","last_became_active":"2024-04-25T00:50:33.392792+0000","last_became_peered":"2024-04-25T00:50:33.392792+0000","last_unstale":"2024-04-25T03:10:00.894472+0000","last_undegraded":"2024-04-25T03:10:00.894472+0000","last_fullsized":"2024-04-25T03:10:00.894472+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'62","last_scrub_stamp":"2024-04-25T03:10:00.894227+0000","last_deep_scrub":"28'62","last_deep_scrub_stamp":"2024-04-25T03:10:00.894227+0000","last_clean_scrub_stamp":"2024-04-25T03:10:00.894227+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:01:51.697166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"28'435","reported_seq":556,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:02.144918+0000","last_change":"2024-04-25T03:10:02.144980+0000","last_active":"2024-04-25T03:10:02.144918+0000","last_peered":"2024-04-25T03:10:02.144918+0000","last_clean":"2024-04-25T03:10:02.144918+0000","last_became_active":"2024-04-25T00:50:35.728725+0000","last_became_peered":"2024-04-25T00:50:35.728725+0000","last_unstale":"2024-04-25T03:10:02.144918+0000","last_undegraded":"2024-04-25T03:10:02.144918+0000","last_fullsized":"2024-04-25T03:10:02.144918+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'435","last_scrub_stamp":"2024-04-25T03:10:02.144713+0000","last_deep_scrub":"28'435","last_deep_scrub_stamp":"2024-04-25T03:10:02.144713+0000","last_clean_scrub_stamp":"2024-04-25T03:10:02.144713+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:44:27.149528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":25476,"num_write":407,"num_write_kb":112477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"28'1191","reported_seq":1280,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:01.150617+0000","last_change":"2024-04-25T03:10:01.150693+0000","last_active":"2024-04-25T03:10:01.150617+0000","last_peered":"2024-04-25T03:10:01.150617+0000","last_clean":"2024-04-25T03:10:01.150617+0000","last_became_active":"2024-04-25T00:50:33.387266+0000","last_became_peered":"2024-04-25T00:50:33.387266+0000","last_unstale":"2024-04-25T03:10:01.150617+0000","last_undegraded":"2024-04-25T03:10:01.150617+0000","last_fullsized":"2024-04-25T03:10:01.150617+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1191","last_scrub_stamp":"2024-04-25T03:10:01.150458+0000","last_deep_scrub":"28'1191","last_deep_scrub_stamp":"2024-04-25T03:10:01.150458+0000","last_clean_scrub_stamp":"2024-04-25T03:10:01.150458+0000","objects_scrubbed":5,"log_size":1191,"log_dups_size":0,"ondisk_log_size":1191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:02:29.033877+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10267224,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1125,"num_write_kb":10596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"28'390","reported_seq":501,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:58.837189+0000","last_change":"2024-04-25T03:09:58.837221+0000","last_active":"2024-04-25T03:09:58.837189+0000","last_peered":"2024-04-25T03:09:58.837189+0000","last_clean":"2024-04-25T03:09:58.837189+0000","last_became_active":"2024-04-25T00:50:35.798471+0000","last_became_peered":"2024-04-25T00:50:35.798471+0000","last_unstale":"2024-04-25T03:09:58.837189+0000","last_undegraded":"2024-04-25T03:09:58.837189+0000","last_fullsized":"2024-04-25T03:09:58.837189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'390","last_scrub_stamp":"2024-04-25T03:09:58.837090+0000","last_deep_scrub":"28'390","last_deep_scrub_stamp":"2024-04-25T03:09:58.837090+0000","last_clean_scrub_stamp":"2024-04-25T03:09:58.837090+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:39.876709+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":14757,"num_write":355,"num_write_kb":59761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"28'3385","reported_seq":3474,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:54.381330+0000","last_change":"2024-04-25T03:09:54.381430+0000","last_active":"2024-04-25T03:09:54.381330+0000","last_peered":"2024-04-25T03:09:54.381330+0000","last_clean":"2024-04-25T03:09:54.381330+0000","last_became_active":"2024-04-25T00:50:33.303821+0000","last_became_peered":"2024-04-25T00:50:33.303821+0000","last_unstale":"2024-04-25T03:09:54.381330+0000","last_undegraded":"2024-04-25T03:09:54.381330+0000","last_fullsized":"2024-04-25T03:09:54.381330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'3385","last_scrub_stamp":"2024-04-25T03:09:54.381060+0000","last_deep_scrub":"28'3385","last_deep_scrub_stamp":"2024-04-25T03:09:54.381060+0000","last_clean_scrub_stamp":"2024-04-25T03:09:54.381060+0000","objects_scrubbed":6,"log_size":3385,"log_dups_size":0,"ondisk_log_size":3385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:17:38.008895+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3329,"num_write_kb":11127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"28'419","reported_seq":568,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:01.225439+0000","last_change":"2024-04-25T03:10:01.225518+0000","last_active":"2024-04-25T03:10:01.225439+0000","last_peered":"2024-04-25T03:10:01.225439+0000","last_clean":"2024-04-25T03:10:01.225439+0000","last_became_active":"2024-04-25T00:50:35.827617+0000","last_became_peered":"2024-04-25T00:50:35.827617+0000","last_unstale":"2024-04-25T03:10:01.225439+0000","last_undegraded":"2024-04-25T03:10:01.225439+0000","last_fullsized":"2024-04-25T03:10:01.225439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'419","last_scrub_stamp":"2024-04-25T03:10:01.225208+0000","last_deep_scrub":"28'419","last_deep_scrub_stamp":"2024-04-25T03:10:01.225208+0000","last_clean_scrub_stamp":"2024-04-25T03:10:01.225208+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:44.984219+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":28588,"num_write":390,"num_write_kb":92970,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"28'2252","reported_seq":2343,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:58.956261+0000","last_change":"2024-04-25T03:09:58.956343+0000","last_active":"2024-04-25T03:09:58.956261+0000","last_peered":"2024-04-25T03:09:58.956261+0000","last_clean":"2024-04-25T03:09:58.956261+0000","last_became_active":"2024-04-25T00:50:33.390133+0000","last_became_peered":"2024-04-25T00:50:33.390133+0000","last_unstale":"2024-04-25T03:09:58.956261+0000","last_undegraded":"2024-04-25T03:09:58.956261+0000","last_fullsized":"2024-04-25T03:09:58.956261+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'2252","last_scrub_stamp":"2024-04-25T03:09:58.956075+0000","last_deep_scrub":"28'2252","last_deep_scrub_stamp":"2024-04-25T03:09:58.956075+0000","last_clean_scrub_stamp":"2024-04-25T03:09:58.956075+0000","objects_scrubbed":8,"log_size":2252,"log_dups_size":0,"ondisk_log_size":2252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:27.287593+0000","scrub_duration":71,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2203,"num_write_kb":13669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"28'392","reported_seq":525,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:14.938214+0000","last_change":"2024-04-25T03:10:14.938269+0000","last_active":"2024-04-25T03:10:14.938214+0000","last_peered":"2024-04-25T03:10:14.938214+0000","last_clean":"2024-04-25T03:10:14.938214+0000","last_became_active":"2024-04-25T00:50:35.875322+0000","last_became_peered":"2024-04-25T00:50:35.875322+0000","last_unstale":"2024-04-25T03:10:14.938214+0000","last_undegraded":"2024-04-25T03:10:14.938214+0000","last_fullsized":"2024-04-25T03:10:14.938214+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'392","last_scrub_stamp":"2024-04-25T03:10:14.938048+0000","last_deep_scrub":"28'392","last_deep_scrub_stamp":"2024-04-25T03:10:14.938048+0000","last_clean_scrub_stamp":"2024-04-25T03:10:14.938048+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:28.134424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":27925,"num_write":356,"num_write_kb":62573,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"28'721","reported_seq":812,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:52.811375+0000","last_change":"2024-04-25T03:09:52.811428+0000","last_active":"2024-04-25T03:09:52.811375+0000","last_peered":"2024-04-25T03:09:52.811375+0000","last_clean":"2024-04-25T03:09:52.811375+0000","last_became_active":"2024-04-25T00:50:33.386297+0000","last_became_peered":"2024-04-25T00:50:33.386297+0000","last_unstale":"2024-04-25T03:09:52.811375+0000","last_undegraded":"2024-04-25T03:09:52.811375+0000","last_fullsized":"2024-04-25T03:09:52.811375+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'721","last_scrub_stamp":"2024-04-25T03:09:52.811260+0000","last_deep_scrub":"28'721","last_deep_scrub_stamp":"2024-04-25T03:09:52.811260+0000","last_clean_scrub_stamp":"2024-04-25T03:09:52.811260+0000","objects_scrubbed":8,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:27:34.897840+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":654,"num_write_kb":8480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"28'401","reported_seq":499,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:53.769603+0000","last_change":"2024-04-25T03:09:53.769636+0000","last_active":"2024-04-25T03:09:53.769603+0000","last_peered":"2024-04-25T03:09:53.769603+0000","last_clean":"2024-04-25T03:09:53.769603+0000","last_became_active":"2024-04-25T00:50:35.796012+0000","last_became_peered":"2024-04-25T00:50:35.796012+0000","last_unstale":"2024-04-25T03:09:53.769603+0000","last_undegraded":"2024-04-25T03:09:53.769603+0000","last_fullsized":"2024-04-25T03:09:53.769603+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'401","last_scrub_stamp":"2024-04-25T03:09:53.769481+0000","last_deep_scrub":"28'401","last_deep_scrub_stamp":"2024-04-25T03:09:53.769481+0000","last_clean_scrub_stamp":"2024-04-25T03:09:53.769481+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:22.100999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":4846,"num_write":362,"num_write_kb":30162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"28'59","reported_seq":150,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:00.134887+0000","last_change":"2024-04-25T03:10:00.134942+0000","last_active":"2024-04-25T03:10:00.134887+0000","last_peered":"2024-04-25T03:10:00.134887+0000","last_clean":"2024-04-25T03:10:00.134887+0000","last_became_active":"2024-04-25T00:50:33.384620+0000","last_became_peered":"2024-04-25T00:50:33.384620+0000","last_unstale":"2024-04-25T03:10:00.134887+0000","last_undegraded":"2024-04-25T03:10:00.134887+0000","last_fullsized":"2024-04-25T03:10:00.134887+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'59","last_scrub_stamp":"2024-04-25T03:10:00.134731+0000","last_deep_scrub":"28'59","last_deep_scrub_stamp":"2024-04-25T03:10:00.134731+0000","last_clean_scrub_stamp":"2024-04-25T03:10:00.134731+0000","objects_scrubbed":3,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:00:52.816235+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"28'414","reported_seq":531,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:12.935157+0000","last_change":"2024-04-25T03:10:12.935221+0000","last_active":"2024-04-25T03:10:12.935157+0000","last_peered":"2024-04-25T03:10:12.935157+0000","last_clean":"2024-04-25T03:10:12.935157+0000","last_became_active":"2024-04-25T00:50:35.819683+0000","last_became_peered":"2024-04-25T00:50:35.819683+0000","last_unstale":"2024-04-25T03:10:12.935157+0000","last_undegraded":"2024-04-25T03:10:12.935157+0000","last_fullsized":"2024-04-25T03:10:12.935157+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'414","last_scrub_stamp":"2024-04-25T03:10:12.934948+0000","last_deep_scrub":"28'414","last_deep_scrub_stamp":"2024-04-25T03:10:12.934948+0000","last_clean_scrub_stamp":"2024-04-25T03:10:12.934948+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:13.260916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":8938,"num_write":378,"num_write_kb":68659,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"28'62","reported_seq":153,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:57.890991+0000","last_change":"2024-04-25T03:09:57.891159+0000","last_active":"2024-04-25T03:09:57.890991+0000","last_peered":"2024-04-25T03:09:57.890991+0000","last_clean":"2024-04-25T03:09:57.890991+0000","last_became_active":"2024-04-25T00:50:33.390089+0000","last_became_peered":"2024-04-25T00:50:33.390089+0000","last_unstale":"2024-04-25T03:09:57.890991+0000","last_undegraded":"2024-04-25T03:09:57.890991+0000","last_fullsized":"2024-04-25T03:09:57.890991+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'62","last_scrub_stamp":"2024-04-25T03:09:57.890730+0000","last_deep_scrub":"28'62","last_deep_scrub_stamp":"2024-04-25T03:09:57.890730+0000","last_clean_scrub_stamp":"2024-04-25T03:09:57.890730+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:28:14.009195+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"28'418","reported_seq":520,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:05.910681+0000","last_change":"2024-04-25T03:10:05.910712+0000","last_active":"2024-04-25T03:10:05.910681+0000","last_peered":"2024-04-25T03:10:05.910681+0000","last_clean":"2024-04-25T03:10:05.910681+0000","last_became_active":"2024-04-25T00:50:35.801060+0000","last_became_peered":"2024-04-25T00:50:35.801060+0000","last_unstale":"2024-04-25T03:10:05.910681+0000","last_undegraded":"2024-04-25T03:10:05.910681+0000","last_fullsized":"2024-04-25T03:10:05.910681+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'418","last_scrub_stamp":"2024-04-25T03:10:05.910572+0000","last_deep_scrub":"28'418","last_deep_scrub_stamp":"2024-04-25T03:10:05.910572+0000","last_clean_scrub_stamp":"2024-04-25T03:10:05.910572+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:56.512819+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":9600,"num_write":393,"num_write_kb":50549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"28'904","reported_seq":995,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:54.430550+0000","last_change":"2024-04-25T03:09:54.430617+0000","last_active":"2024-04-25T03:09:54.430550+0000","last_peered":"2024-04-25T03:09:54.430550+0000","last_clean":"2024-04-25T03:09:54.430550+0000","last_became_active":"2024-04-25T00:50:33.326464+0000","last_became_peered":"2024-04-25T00:50:33.326464+0000","last_unstale":"2024-04-25T03:09:54.430550+0000","last_undegraded":"2024-04-25T03:09:54.430550+0000","last_fullsized":"2024-04-25T03:09:54.430550+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'904","last_scrub_stamp":"2024-04-25T03:09:54.430440+0000","last_deep_scrub":"28'904","last_deep_scrub_stamp":"2024-04-25T03:09:54.430440+0000","last_clean_scrub_stamp":"2024-04-25T03:09:54.430440+0000","objects_scrubbed":10,"log_size":904,"log_dups_size":0,"ondisk_log_size":904,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:41:16.492327+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":841,"num_write_kb":8609,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"28'491","reported_seq":694,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:13.947969+0000","last_change":"2024-04-25T03:10:13.948032+0000","last_active":"2024-04-25T03:10:13.947969+0000","last_peered":"2024-04-25T03:10:13.947969+0000","last_clean":"2024-04-25T03:10:13.947969+0000","last_became_active":"2024-04-25T00:50:35.825246+0000","last_became_peered":"2024-04-25T00:50:35.825246+0000","last_unstale":"2024-04-25T03:10:13.947969+0000","last_undegraded":"2024-04-25T03:10:13.947969+0000","last_fullsized":"2024-04-25T03:10:13.947969+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'491","last_scrub_stamp":"2024-04-25T03:10:13.947753+0000","last_deep_scrub":"28'491","last_deep_scrub_stamp":"2024-04-25T03:10:13.947753+0000","last_clean_scrub_stamp":"2024-04-25T03:10:13.947753+0000","objects_scrubbed":0,"log_size":491,"log_dups_size":0,"ondisk_log_size":491,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:58:51.105903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":62450,"num_write":458,"num_write_kb":109145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"28'808","reported_seq":901,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:56.203177+0000","last_change":"2024-04-25T03:09:56.203248+0000","last_active":"2024-04-25T03:09:56.203177+0000","last_peered":"2024-04-25T03:09:56.203177+0000","last_clean":"2024-04-25T03:09:56.203177+0000","last_became_active":"2024-04-25T00:50:33.393153+0000","last_became_peered":"2024-04-25T00:50:33.393153+0000","last_unstale":"2024-04-25T03:09:56.203177+0000","last_undegraded":"2024-04-25T03:09:56.203177+0000","last_fullsized":"2024-04-25T03:09:56.203177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'808","last_scrub_stamp":"2024-04-25T03:09:56.202975+0000","last_deep_scrub":"28'808","last_deep_scrub_stamp":"2024-04-25T03:09:56.202975+0000","last_clean_scrub_stamp":"2024-04-25T03:09:56.202975+0000","objects_scrubbed":3,"log_size":808,"log_dups_size":0,"ondisk_log_size":808,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:51:20.256797+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":750,"num_write_kb":4477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"28'357","reported_seq":498,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:10.851086+0000","last_change":"2024-04-25T03:10:10.851211+0000","last_active":"2024-04-25T03:10:10.851086+0000","last_peered":"2024-04-25T03:10:10.851086+0000","last_clean":"2024-04-25T03:10:10.851086+0000","last_became_active":"2024-04-25T00:50:35.811267+0000","last_became_peered":"2024-04-25T00:50:35.811267+0000","last_unstale":"2024-04-25T03:10:10.851086+0000","last_undegraded":"2024-04-25T03:10:10.851086+0000","last_fullsized":"2024-04-25T03:10:10.851086+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'357","last_scrub_stamp":"2024-04-25T03:10:10.850788+0000","last_deep_scrub":"28'357","last_deep_scrub_stamp":"2024-04-25T03:10:10.850788+0000","last_clean_scrub_stamp":"2024-04-25T03:10:10.850788+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:03:10.825750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":21001,"num_write":331,"num_write_kb":38526,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"28'906","reported_seq":1000,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:56.363292+0000","last_change":"2024-04-25T03:09:56.363292+0000","last_active":"2024-04-25T03:09:56.363292+0000","last_peered":"2024-04-25T03:09:56.363292+0000","last_clean":"2024-04-25T03:09:56.363292+0000","last_became_active":"2024-04-25T00:50:33.382270+0000","last_became_peered":"2024-04-25T00:50:33.382270+0000","last_unstale":"2024-04-25T03:09:56.363292+0000","last_undegraded":"2024-04-25T03:09:56.363292+0000","last_fullsized":"2024-04-25T03:09:56.363292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'906","last_scrub_stamp":"2024-04-25T03:09:56.363155+0000","last_deep_scrub":"28'906","last_deep_scrub_stamp":"2024-04-25T03:09:56.363155+0000","last_clean_scrub_stamp":"2024-04-25T03:09:56.363155+0000","objects_scrubbed":3,"log_size":906,"log_dups_size":0,"ondisk_log_size":906,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:11.004584+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":844,"num_write_kb":4518,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"28'401","reported_seq":530,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:11.891054+0000","last_change":"2024-04-25T03:10:11.891120+0000","last_active":"2024-04-25T03:10:11.891054+0000","last_peered":"2024-04-25T03:10:11.891054+0000","last_clean":"2024-04-25T03:10:11.891054+0000","last_became_active":"2024-04-25T00:50:35.817707+0000","last_became_peered":"2024-04-25T00:50:35.817707+0000","last_unstale":"2024-04-25T03:10:11.891054+0000","last_undegraded":"2024-04-25T03:10:11.891054+0000","last_fullsized":"2024-04-25T03:10:11.891054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'401","last_scrub_stamp":"2024-04-25T03:10:11.890854+0000","last_deep_scrub":"28'401","last_deep_scrub_stamp":"2024-04-25T03:10:11.890854+0000","last_clean_scrub_stamp":"2024-04-25T03:10:11.890854+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:19.535338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":16207,"num_write":370,"num_write_kb":59244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"28'328","reported_seq":422,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:58.387417+0000","last_change":"2024-04-25T03:09:58.387417+0000","last_active":"2024-04-25T03:09:58.387417+0000","last_peered":"2024-04-25T03:09:58.387417+0000","last_clean":"2024-04-25T03:09:58.387417+0000","last_became_active":"2024-04-25T00:50:33.389092+0000","last_became_peered":"2024-04-25T00:50:33.389092+0000","last_unstale":"2024-04-25T03:09:58.387417+0000","last_undegraded":"2024-04-25T03:09:58.387417+0000","last_fullsized":"2024-04-25T03:09:58.387417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'328","last_scrub_stamp":"2024-04-25T03:09:58.387154+0000","last_deep_scrub":"28'328","last_deep_scrub_stamp":"2024-04-25T03:09:58.387154+0000","last_clean_scrub_stamp":"2024-04-25T03:09:58.387154+0000","objects_scrubbed":2,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:49:55.281110+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":275,"num_write_kb":4225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"28'441","reported_seq":592,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:07.117988+0000","last_change":"2024-04-25T03:10:07.117988+0000","last_active":"2024-04-25T03:10:07.117988+0000","last_peered":"2024-04-25T03:10:07.117988+0000","last_clean":"2024-04-25T03:10:07.117988+0000","last_became_active":"2024-04-25T00:50:35.868798+0000","last_became_peered":"2024-04-25T00:50:35.868798+0000","last_unstale":"2024-04-25T03:10:07.117988+0000","last_undegraded":"2024-04-25T03:10:07.117988+0000","last_fullsized":"2024-04-25T03:10:07.117988+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'441","last_scrub_stamp":"2024-04-25T03:10:07.117722+0000","last_deep_scrub":"28'441","last_deep_scrub_stamp":"2024-04-25T03:10:07.117722+0000","last_clean_scrub_stamp":"2024-04-25T03:10:07.117722+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:00:13.030908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":27029,"num_write":413,"num_write_kb":63857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"28'322","reported_seq":416,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:55.405454+0000","last_change":"2024-04-25T03:09:55.405454+0000","last_active":"2024-04-25T03:09:55.405454+0000","last_peered":"2024-04-25T03:09:55.405454+0000","last_clean":"2024-04-25T03:09:55.405454+0000","last_became_active":"2024-04-25T00:50:33.328950+0000","last_became_peered":"2024-04-25T00:50:33.328950+0000","last_unstale":"2024-04-25T03:09:55.405454+0000","last_undegraded":"2024-04-25T03:09:55.405454+0000","last_fullsized":"2024-04-25T03:09:55.405454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'322","last_scrub_stamp":"2024-04-25T03:09:55.405315+0000","last_deep_scrub":"28'322","last_deep_scrub_stamp":"2024-04-25T03:09:55.405315+0000","last_clean_scrub_stamp":"2024-04-25T03:09:55.405315+0000","objects_scrubbed":4,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:03.200670+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196056,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":254,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"28'426","reported_seq":570,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:07.832277+0000","last_change":"2024-04-25T03:10:07.832341+0000","last_active":"2024-04-25T03:10:07.832277+0000","last_peered":"2024-04-25T03:10:07.832277+0000","last_clean":"2024-04-25T03:10:07.832277+0000","last_became_active":"2024-04-25T00:50:35.733696+0000","last_became_peered":"2024-04-25T00:50:35.733696+0000","last_unstale":"2024-04-25T03:10:07.832277+0000","last_undegraded":"2024-04-25T03:10:07.832277+0000","last_fullsized":"2024-04-25T03:10:07.832277+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'426","last_scrub_stamp":"2024-04-25T03:10:07.832072+0000","last_deep_scrub":"28'426","last_deep_scrub_stamp":"2024-04-25T03:10:07.832072+0000","last_clean_scrub_stamp":"2024-04-25T03:10:07.832072+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:35.827627+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":28368,"num_write":395,"num_write_kb":71042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"28'119","reported_seq":259,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:59.865171+0000","last_change":"2024-04-25T03:09:59.865298+0000","last_active":"2024-04-25T03:09:59.865171+0000","last_peered":"2024-04-25T03:09:59.865171+0000","last_clean":"2024-04-25T03:09:59.865171+0000","last_became_active":"2024-04-25T00:49:55.278022+0000","last_became_peered":"2024-04-25T00:49:55.278022+0000","last_unstale":"2024-04-25T03:09:59.865171+0000","last_undegraded":"2024-04-25T03:09:59.865171+0000","last_fullsized":"2024-04-25T03:09:59.865171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'119","last_scrub_stamp":"2024-04-25T03:09:59.864933+0000","last_deep_scrub":"28'119","last_deep_scrub_stamp":"2024-04-25T03:09:59.864933+0000","last_clean_scrub_stamp":"2024-04-25T03:09:59.864933+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:37:45.396148+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"28'391","reported_seq":490,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:58.123059+0000","last_change":"2024-04-25T03:09:58.123059+0000","last_active":"2024-04-25T03:09:58.123059+0000","last_peered":"2024-04-25T03:09:58.123059+0000","last_clean":"2024-04-25T03:09:58.123059+0000","last_became_active":"2024-04-25T00:50:33.324579+0000","last_became_peered":"2024-04-25T00:50:33.324579+0000","last_unstale":"2024-04-25T03:09:58.123059+0000","last_undegraded":"2024-04-25T03:09:58.123059+0000","last_fullsized":"2024-04-25T03:09:58.123059+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'391","last_scrub_stamp":"2024-04-25T03:09:58.122781+0000","last_deep_scrub":"28'391","last_deep_scrub_stamp":"2024-04-25T03:09:58.122781+0000","last_clean_scrub_stamp":"2024-04-25T03:09:58.122781+0000","objects_scrubbed":6,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:40:01.224287+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194372,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":4246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"28'354","reported_seq":479,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:04.048506+0000","last_change":"2024-04-25T03:10:04.048506+0000","last_active":"2024-04-25T03:10:04.048506+0000","last_peered":"2024-04-25T03:10:04.048506+0000","last_clean":"2024-04-25T03:10:04.048506+0000","last_became_active":"2024-04-25T00:50:35.878438+0000","last_became_peered":"2024-04-25T00:50:35.878438+0000","last_unstale":"2024-04-25T03:10:04.048506+0000","last_undegraded":"2024-04-25T03:10:04.048506+0000","last_fullsized":"2024-04-25T03:10:04.048506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'354","last_scrub_stamp":"2024-04-25T03:10:04.048230+0000","last_deep_scrub":"28'354","last_deep_scrub_stamp":"2024-04-25T03:10:04.048230+0000","last_clean_scrub_stamp":"2024-04-25T03:10:04.048230+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:47.023220+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":20480,"num_write":322,"num_write_kb":49980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"28'1056","reported_seq":1157,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:03.871760+0000","last_change":"2024-04-25T03:10:03.871847+0000","last_active":"2024-04-25T03:10:03.871760+0000","last_peered":"2024-04-25T03:10:03.871760+0000","last_clean":"2024-04-25T03:10:03.871760+0000","last_became_active":"2024-04-25T00:50:33.320800+0000","last_became_peered":"2024-04-25T00:50:33.320800+0000","last_unstale":"2024-04-25T03:10:03.871760+0000","last_undegraded":"2024-04-25T03:10:03.871760+0000","last_fullsized":"2024-04-25T03:10:03.871760+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1056","last_scrub_stamp":"2024-04-25T03:10:03.871526+0000","last_deep_scrub":"28'1056","last_deep_scrub_stamp":"2024-04-25T03:10:03.871526+0000","last_clean_scrub_stamp":"2024-04-25T03:10:03.871526+0000","objects_scrubbed":4,"log_size":1056,"log_dups_size":0,"ondisk_log_size":1056,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:50:40.888281+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":991,"num_write_kb":12720,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"28'420","reported_seq":542,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:00.894810+0000","last_change":"2024-04-25T03:10:00.894810+0000","last_active":"2024-04-25T03:10:00.894810+0000","last_peered":"2024-04-25T03:10:00.894810+0000","last_clean":"2024-04-25T03:10:00.894810+0000","last_became_active":"2024-04-25T00:50:35.814163+0000","last_became_peered":"2024-04-25T00:50:35.814163+0000","last_unstale":"2024-04-25T03:10:00.894810+0000","last_undegraded":"2024-04-25T03:10:00.894810+0000","last_fullsized":"2024-04-25T03:10:00.894810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'420","last_scrub_stamp":"2024-04-25T03:10:00.894455+0000","last_deep_scrub":"28'420","last_deep_scrub_stamp":"2024-04-25T03:10:00.894455+0000","last_clean_scrub_stamp":"2024-04-25T03:10:00.894455+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:34:51.496702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":14110,"num_write":386,"num_write_kb":112699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"28'4459","reported_seq":8953,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:57.314469+0000","last_change":"2024-04-25T03:09:57.314469+0000","last_active":"2024-04-25T03:09:57.314469+0000","last_peered":"2024-04-25T03:09:57.314469+0000","last_clean":"2024-04-25T03:09:57.314469+0000","last_became_active":"2024-04-25T00:50:33.383692+0000","last_became_peered":"2024-04-25T00:50:33.383692+0000","last_unstale":"2024-04-25T03:09:57.314469+0000","last_undegraded":"2024-04-25T03:09:57.314469+0000","last_fullsized":"2024-04-25T03:09:57.314469+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'4459","last_scrub_stamp":"2024-04-25T03:09:57.314359+0000","last_deep_scrub":"28'4459","last_deep_scrub_stamp":"2024-04-25T03:09:57.314359+0000","last_clean_scrub_stamp":"2024-04-25T03:09:57.314359+0000","objects_scrubbed":4,"log_size":4459,"log_dups_size":0,"ondisk_log_size":4459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:20:16.525361+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1471076,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4395,"num_read_kb":4765,"num_write":4402,"num_write_kb":4769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"28'402","reported_seq":526,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:00.376187+0000","last_change":"2024-04-25T03:10:00.376245+0000","last_active":"2024-04-25T03:10:00.376187+0000","last_peered":"2024-04-25T03:10:00.376187+0000","last_clean":"2024-04-25T03:10:00.376187+0000","last_became_active":"2024-04-25T00:50:35.722500+0000","last_became_peered":"2024-04-25T00:50:35.722500+0000","last_unstale":"2024-04-25T03:10:00.376187+0000","last_undegraded":"2024-04-25T03:10:00.376187+0000","last_fullsized":"2024-04-25T03:10:00.376187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'402","last_scrub_stamp":"2024-04-25T03:10:00.375974+0000","last_deep_scrub":"28'402","last_deep_scrub_stamp":"2024-04-25T03:10:00.375974+0000","last_clean_scrub_stamp":"2024-04-25T03:10:00.375974+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:44.615693+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13853,"num_write":369,"num_write_kb":30117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"28'1040","reported_seq":1139,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:57.178548+0000","last_change":"2024-04-25T03:09:57.178710+0000","last_active":"2024-04-25T03:09:57.178548+0000","last_peered":"2024-04-25T03:09:57.178548+0000","last_clean":"2024-04-25T03:09:57.178548+0000","last_became_active":"2024-04-25T00:50:33.305159+0000","last_became_peered":"2024-04-25T00:50:33.305159+0000","last_unstale":"2024-04-25T03:09:57.178548+0000","last_undegraded":"2024-04-25T03:09:57.178548+0000","last_fullsized":"2024-04-25T03:09:57.178548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1040","last_scrub_stamp":"2024-04-25T03:09:57.178300+0000","last_deep_scrub":"28'1040","last_deep_scrub_stamp":"2024-04-25T03:09:57.178300+0000","last_clean_scrub_stamp":"2024-04-25T03:09:57.178300+0000","objects_scrubbed":4,"log_size":1040,"log_dups_size":0,"ondisk_log_size":1040,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:50.942136+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":968,"num_write_kb":8653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"28'394","reported_seq":561,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:00.209625+0000","last_change":"2024-04-25T03:10:00.209625+0000","last_active":"2024-04-25T03:10:00.209625+0000","last_peered":"2024-04-25T03:10:00.209625+0000","last_clean":"2024-04-25T03:10:00.209625+0000","last_became_active":"2024-04-25T00:50:35.823320+0000","last_became_peered":"2024-04-25T00:50:35.823320+0000","last_unstale":"2024-04-25T03:10:00.209625+0000","last_undegraded":"2024-04-25T03:10:00.209625+0000","last_fullsized":"2024-04-25T03:10:00.209625+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'394","last_scrub_stamp":"2024-04-25T03:10:00.209472+0000","last_deep_scrub":"28'394","last_deep_scrub_stamp":"2024-04-25T03:10:00.209472+0000","last_clean_scrub_stamp":"2024-04-25T03:10:00.209472+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:16:39.683071+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":47782,"num_write":359,"num_write_kb":62996,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"28'369","reported_seq":468,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:53.358932+0000","last_change":"2024-04-25T03:09:53.358932+0000","last_active":"2024-04-25T03:09:53.358932+0000","last_peered":"2024-04-25T03:09:53.358932+0000","last_clean":"2024-04-25T03:09:53.358932+0000","last_became_active":"2024-04-25T00:50:33.303671+0000","last_became_peered":"2024-04-25T00:50:33.303671+0000","last_unstale":"2024-04-25T03:09:53.358932+0000","last_undegraded":"2024-04-25T03:09:53.358932+0000","last_fullsized":"2024-04-25T03:09:53.358932+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'369","last_scrub_stamp":"2024-04-25T03:09:53.358661+0000","last_deep_scrub":"28'369","last_deep_scrub_stamp":"2024-04-25T03:09:53.358661+0000","last_clean_scrub_stamp":"2024-04-25T03:09:53.358661+0000","objects_scrubbed":1,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:29:14.437053+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":311,"num_write_kb":4247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"28'437","reported_seq":581,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:11.161658+0000","last_change":"2024-04-25T03:10:11.161718+0000","last_active":"2024-04-25T03:10:11.161658+0000","last_peered":"2024-04-25T03:10:11.161658+0000","last_clean":"2024-04-25T03:10:11.161658+0000","last_became_active":"2024-04-25T00:50:35.876958+0000","last_became_peered":"2024-04-25T00:50:35.876958+0000","last_unstale":"2024-04-25T03:10:11.161658+0000","last_undegraded":"2024-04-25T03:10:11.161658+0000","last_fullsized":"2024-04-25T03:10:11.161658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'437","last_scrub_stamp":"2024-04-25T03:10:11.161458+0000","last_deep_scrub":"28'437","last_deep_scrub_stamp":"2024-04-25T03:10:11.161458+0000","last_clean_scrub_stamp":"2024-04-25T03:10:11.161458+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:40.765906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":21227,"num_write":402,"num_write_kb":75746,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"28'1044","reported_seq":1142,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:00.893645+0000","last_change":"2024-04-25T03:10:00.893754+0000","last_active":"2024-04-25T03:10:00.893645+0000","last_peered":"2024-04-25T03:10:00.893645+0000","last_clean":"2024-04-25T03:10:00.893645+0000","last_became_active":"2024-04-25T00:50:33.318945+0000","last_became_peered":"2024-04-25T00:50:33.318945+0000","last_unstale":"2024-04-25T03:10:00.893645+0000","last_undegraded":"2024-04-25T03:10:00.893645+0000","last_fullsized":"2024-04-25T03:10:00.893645+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1044","last_scrub_stamp":"2024-04-25T03:10:00.893391+0000","last_deep_scrub":"28'1044","last_deep_scrub_stamp":"2024-04-25T03:10:00.893391+0000","last_clean_scrub_stamp":"2024-04-25T03:10:00.893391+0000","objects_scrubbed":5,"log_size":1044,"log_dups_size":0,"ondisk_log_size":1044,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:46.133036+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388720,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":986,"num_write_kb":8683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"28'399","reported_seq":528,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:59.368524+0000","last_change":"2024-04-25T03:09:59.368524+0000","last_active":"2024-04-25T03:09:59.368524+0000","last_peered":"2024-04-25T03:09:59.368524+0000","last_clean":"2024-04-25T03:09:59.368524+0000","last_became_active":"2024-04-25T00:50:35.722128+0000","last_became_peered":"2024-04-25T00:50:35.722128+0000","last_unstale":"2024-04-25T03:09:59.368524+0000","last_undegraded":"2024-04-25T03:09:59.368524+0000","last_fullsized":"2024-04-25T03:09:59.368524+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'399","last_scrub_stamp":"2024-04-25T03:09:59.368209+0000","last_deep_scrub":"28'399","last_deep_scrub_stamp":"2024-04-25T03:09:59.368209+0000","last_clean_scrub_stamp":"2024-04-25T03:09:59.368209+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:08:24.278969+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":19866,"num_write":357,"num_write_kb":75325,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"28'6465","reported_seq":6561,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:57.368773+0000","last_change":"2024-04-25T03:09:57.368818+0000","last_active":"2024-04-25T03:09:57.368773+0000","last_peered":"2024-04-25T03:09:57.368773+0000","last_clean":"2024-04-25T03:09:57.368773+0000","last_became_active":"2024-04-25T00:50:33.386631+0000","last_became_peered":"2024-04-25T00:50:33.386631+0000","last_unstale":"2024-04-25T03:09:57.368773+0000","last_undegraded":"2024-04-25T03:09:57.368773+0000","last_fullsized":"2024-04-25T03:09:57.368773+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'6465","last_scrub_stamp":"2024-04-25T03:09:57.368685+0000","last_deep_scrub":"28'6465","last_deep_scrub_stamp":"2024-04-25T03:09:57.368685+0000","last_clean_scrub_stamp":"2024-04-25T03:09:57.368685+0000","objects_scrubbed":4,"log_size":6465,"log_dups_size":0,"ondisk_log_size":6465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:54:47.069644+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17492,"num_write_kb":6189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"28'357","reported_seq":515,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:05.077880+0000","last_change":"2024-04-25T03:10:05.078030+0000","last_active":"2024-04-25T03:10:05.077880+0000","last_peered":"2024-04-25T03:10:05.077880+0000","last_clean":"2024-04-25T03:10:05.077880+0000","last_became_active":"2024-04-25T00:50:35.878416+0000","last_became_peered":"2024-04-25T00:50:35.878416+0000","last_unstale":"2024-04-25T03:10:05.077880+0000","last_undegraded":"2024-04-25T03:10:05.077880+0000","last_fullsized":"2024-04-25T03:10:05.077880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'357","last_scrub_stamp":"2024-04-25T03:10:05.077643+0000","last_deep_scrub":"28'357","last_deep_scrub_stamp":"2024-04-25T03:10:05.077643+0000","last_clean_scrub_stamp":"2024-04-25T03:10:05.077643+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:22:11.537620+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":29447,"num_write":334,"num_write_kb":70980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"28'378","reported_seq":474,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:59.875462+0000","last_change":"2024-04-25T03:09:59.875541+0000","last_active":"2024-04-25T03:09:59.875462+0000","last_peered":"2024-04-25T03:09:59.875462+0000","last_clean":"2024-04-25T03:09:59.875462+0000","last_became_active":"2024-04-25T00:50:33.392381+0000","last_became_peered":"2024-04-25T00:50:33.392381+0000","last_unstale":"2024-04-25T03:09:59.875462+0000","last_undegraded":"2024-04-25T03:09:59.875462+0000","last_fullsized":"2024-04-25T03:09:59.875462+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'378","last_scrub_stamp":"2024-04-25T03:09:59.875262+0000","last_deep_scrub":"28'378","last_deep_scrub_stamp":"2024-04-25T03:09:59.875262+0000","last_clean_scrub_stamp":"2024-04-25T03:09:59.875262+0000","objects_scrubbed":5,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:00.440177+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":4245,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"28'446","reported_seq":584,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:56.815502+0000","last_change":"2024-04-25T03:09:56.815576+0000","last_active":"2024-04-25T03:09:56.815502+0000","last_peered":"2024-04-25T03:09:56.815502+0000","last_clean":"2024-04-25T03:09:56.815502+0000","last_became_active":"2024-04-25T00:50:35.796775+0000","last_became_peered":"2024-04-25T00:50:35.796775+0000","last_unstale":"2024-04-25T03:09:56.815502+0000","last_undegraded":"2024-04-25T03:09:56.815502+0000","last_fullsized":"2024-04-25T03:09:56.815502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'446","last_scrub_stamp":"2024-04-25T03:09:56.815294+0000","last_deep_scrub":"28'446","last_deep_scrub_stamp":"2024-04-25T03:09:56.815294+0000","last_clean_scrub_stamp":"2024-04-25T03:09:56.815294+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:15:39.607465+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":29188,"num_write":413,"num_write_kb":79416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"28'382","reported_seq":478,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:02.862141+0000","last_change":"2024-04-25T03:10:02.862271+0000","last_active":"2024-04-25T03:10:02.862141+0000","last_peered":"2024-04-25T03:10:02.862141+0000","last_clean":"2024-04-25T03:10:02.862141+0000","last_became_active":"2024-04-25T00:50:33.320554+0000","last_became_peered":"2024-04-25T00:50:33.320554+0000","last_unstale":"2024-04-25T03:10:02.862141+0000","last_undegraded":"2024-04-25T03:10:02.862141+0000","last_fullsized":"2024-04-25T03:10:02.862141+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'382","last_scrub_stamp":"2024-04-25T03:10:02.861896+0000","last_deep_scrub":"28'382","last_deep_scrub_stamp":"2024-04-25T03:10:02.861896+0000","last_clean_scrub_stamp":"2024-04-25T03:10:02.861896+0000","objects_scrubbed":2,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:44:21.956036+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":317,"num_write_kb":4230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"28'445","reported_seq":585,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:59.211999+0000","last_change":"2024-04-25T03:09:59.212056+0000","last_active":"2024-04-25T03:09:59.211999+0000","last_peered":"2024-04-25T03:09:59.211999+0000","last_clean":"2024-04-25T03:09:59.211999+0000","last_became_active":"2024-04-25T00:50:35.823269+0000","last_became_peered":"2024-04-25T00:50:35.823269+0000","last_unstale":"2024-04-25T03:09:59.211999+0000","last_undegraded":"2024-04-25T03:09:59.211999+0000","last_fullsized":"2024-04-25T03:09:59.211999+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'445","last_scrub_stamp":"2024-04-25T03:09:59.211801+0000","last_deep_scrub":"28'445","last_deep_scrub_stamp":"2024-04-25T03:09:59.211801+0000","last_clean_scrub_stamp":"2024-04-25T03:09:59.211801+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:20:18.422803+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":25774,"num_write":415,"num_write_kb":54462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"28'457","reported_seq":553,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:55.365753+0000","last_change":"2024-04-25T03:09:55.365830+0000","last_active":"2024-04-25T03:09:55.365753+0000","last_peered":"2024-04-25T03:09:55.365753+0000","last_clean":"2024-04-25T03:09:55.365753+0000","last_became_active":"2024-04-25T00:50:33.319198+0000","last_became_peered":"2024-04-25T00:50:33.319198+0000","last_unstale":"2024-04-25T03:09:55.365753+0000","last_undegraded":"2024-04-25T03:09:55.365753+0000","last_fullsized":"2024-04-25T03:09:55.365753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'457","last_scrub_stamp":"2024-04-25T03:09:55.365602+0000","last_deep_scrub":"28'457","last_deep_scrub_stamp":"2024-04-25T03:09:55.365602+0000","last_clean_scrub_stamp":"2024-04-25T03:09:55.365602+0000","objects_scrubbed":5,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:37:55.600247+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":406,"num_write_kb":4297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"28'409","reported_seq":546,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:06.109852+0000","last_change":"2024-04-25T03:10:06.110001+0000","last_active":"2024-04-25T03:10:06.109852+0000","last_peered":"2024-04-25T03:10:06.109852+0000","last_clean":"2024-04-25T03:10:06.109852+0000","last_became_active":"2024-04-25T00:50:35.881829+0000","last_became_peered":"2024-04-25T00:50:35.881829+0000","last_unstale":"2024-04-25T03:10:06.109852+0000","last_undegraded":"2024-04-25T03:10:06.109852+0000","last_fullsized":"2024-04-25T03:10:06.109852+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'409","last_scrub_stamp":"2024-04-25T03:10:06.109602+0000","last_deep_scrub":"28'409","last_deep_scrub_stamp":"2024-04-25T03:10:06.109602+0000","last_clean_scrub_stamp":"2024-04-25T03:10:06.109602+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:49.561582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":18047,"num_write":372,"num_write_kb":46881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"28'1209","reported_seq":1305,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:56.320769+0000","last_change":"2024-04-25T03:09:56.320803+0000","last_active":"2024-04-25T03:09:56.320769+0000","last_peered":"2024-04-25T03:09:56.320769+0000","last_clean":"2024-04-25T03:09:56.320769+0000","last_became_active":"2024-04-25T00:50:33.383622+0000","last_became_peered":"2024-04-25T00:50:33.383622+0000","last_unstale":"2024-04-25T03:09:56.320769+0000","last_undegraded":"2024-04-25T03:09:56.320769+0000","last_fullsized":"2024-04-25T03:09:56.320769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1209","last_scrub_stamp":"2024-04-25T03:09:56.320698+0000","last_deep_scrub":"28'1209","last_deep_scrub_stamp":"2024-04-25T03:09:56.320698+0000","last_clean_scrub_stamp":"2024-04-25T03:09:56.320698+0000","objects_scrubbed":4,"log_size":1209,"log_dups_size":0,"ondisk_log_size":1209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:03:23.103480+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1135,"num_write_kb":8761,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"28'428","reported_seq":563,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:03.034284+0000","last_change":"2024-04-25T03:10:03.034284+0000","last_active":"2024-04-25T03:10:03.034284+0000","last_peered":"2024-04-25T03:10:03.034284+0000","last_clean":"2024-04-25T03:10:03.034284+0000","last_became_active":"2024-04-25T00:50:35.881269+0000","last_became_peered":"2024-04-25T00:50:35.881269+0000","last_unstale":"2024-04-25T03:10:03.034284+0000","last_undegraded":"2024-04-25T03:10:03.034284+0000","last_fullsized":"2024-04-25T03:10:03.034284+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'428","last_scrub_stamp":"2024-04-25T03:10:03.034018+0000","last_deep_scrub":"28'428","last_deep_scrub_stamp":"2024-04-25T03:10:03.034018+0000","last_clean_scrub_stamp":"2024-04-25T03:10:03.034018+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:38:10.179699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":19611,"num_write":396,"num_write_kb":67446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"28'1404","reported_seq":1498,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:05.873585+0000","last_change":"2024-04-25T03:10:05.873585+0000","last_active":"2024-04-25T03:10:05.873585+0000","last_peered":"2024-04-25T03:10:05.873585+0000","last_clean":"2024-04-25T03:10:05.873585+0000","last_became_active":"2024-04-25T00:50:33.389095+0000","last_became_peered":"2024-04-25T00:50:33.389095+0000","last_unstale":"2024-04-25T03:10:05.873585+0000","last_undegraded":"2024-04-25T03:10:05.873585+0000","last_fullsized":"2024-04-25T03:10:05.873585+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1404","last_scrub_stamp":"2024-04-25T03:10:05.873465+0000","last_deep_scrub":"28'1404","last_deep_scrub_stamp":"2024-04-25T03:10:05.873465+0000","last_clean_scrub_stamp":"2024-04-25T03:10:05.873465+0000","objects_scrubbed":5,"log_size":1404,"log_dups_size":0,"ondisk_log_size":1404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:47.668661+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1344,"num_write_kb":12923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"28'449","reported_seq":620,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:07.853050+0000","last_change":"2024-04-25T03:10:07.853112+0000","last_active":"2024-04-25T03:10:07.853050+0000","last_peered":"2024-04-25T03:10:07.853050+0000","last_clean":"2024-04-25T03:10:07.853050+0000","last_became_active":"2024-04-25T00:50:35.811410+0000","last_became_peered":"2024-04-25T00:50:35.811410+0000","last_unstale":"2024-04-25T03:10:07.853050+0000","last_undegraded":"2024-04-25T03:10:07.853050+0000","last_fullsized":"2024-04-25T03:10:07.853050+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'449","last_scrub_stamp":"2024-04-25T03:10:07.852817+0000","last_deep_scrub":"28'449","last_deep_scrub_stamp":"2024-04-25T03:10:07.852817+0000","last_clean_scrub_stamp":"2024-04-25T03:10:07.852817+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:02:35.736236+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":42516,"num_write":419,"num_write_kb":125381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"28'392","reported_seq":521,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:06.150907+0000","last_change":"2024-04-25T03:10:06.150970+0000","last_active":"2024-04-25T03:10:06.150907+0000","last_peered":"2024-04-25T03:10:06.150907+0000","last_clean":"2024-04-25T03:10:06.150907+0000","last_became_active":"2024-04-25T00:50:35.821062+0000","last_became_peered":"2024-04-25T00:50:35.821062+0000","last_unstale":"2024-04-25T03:10:06.150907+0000","last_undegraded":"2024-04-25T03:10:06.150907+0000","last_fullsized":"2024-04-25T03:10:06.150907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'392","last_scrub_stamp":"2024-04-25T03:10:06.150702+0000","last_deep_scrub":"28'392","last_deep_scrub_stamp":"2024-04-25T03:10:06.150702+0000","last_clean_scrub_stamp":"2024-04-25T03:10:06.150702+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:47.945898+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":28880,"num_write":348,"num_write_kb":60862,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"28'849","reported_seq":936,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:01.836775+0000","last_change":"2024-04-25T03:10:01.836857+0000","last_active":"2024-04-25T03:10:01.836775+0000","last_peered":"2024-04-25T03:10:01.836775+0000","last_clean":"2024-04-25T03:10:01.836775+0000","last_became_active":"2024-04-25T00:50:33.319197+0000","last_became_peered":"2024-04-25T00:50:33.319197+0000","last_unstale":"2024-04-25T03:10:01.836775+0000","last_undegraded":"2024-04-25T03:10:01.836775+0000","last_fullsized":"2024-04-25T03:10:01.836775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'849","last_scrub_stamp":"2024-04-25T03:10:01.836572+0000","last_deep_scrub":"28'849","last_deep_scrub_stamp":"2024-04-25T03:10:01.836572+0000","last_clean_scrub_stamp":"2024-04-25T03:10:01.836572+0000","objects_scrubbed":4,"log_size":849,"log_dups_size":0,"ondisk_log_size":849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:47:37.874799+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":791,"num_write_kb":4488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"28'367","reported_seq":504,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:05.100561+0000","last_change":"2024-04-25T03:10:05.100627+0000","last_active":"2024-04-25T03:10:05.100561+0000","last_peered":"2024-04-25T03:10:05.100561+0000","last_clean":"2024-04-25T03:10:05.100561+0000","last_became_active":"2024-04-25T00:50:35.811281+0000","last_became_peered":"2024-04-25T00:50:35.811281+0000","last_unstale":"2024-04-25T03:10:05.100561+0000","last_undegraded":"2024-04-25T03:10:05.100561+0000","last_fullsized":"2024-04-25T03:10:05.100561+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'367","last_scrub_stamp":"2024-04-25T03:10:05.100362+0000","last_deep_scrub":"28'367","last_deep_scrub_stamp":"2024-04-25T03:10:05.100362+0000","last_clean_scrub_stamp":"2024-04-25T03:10:05.100362+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:36.625916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":25463,"num_write":336,"num_write_kb":42887,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"28'1954","reported_seq":2041,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:10:04.959002+0000","last_change":"2024-04-25T03:10:04.959075+0000","last_active":"2024-04-25T03:10:04.959002+0000","last_peered":"2024-04-25T03:10:04.959002+0000","last_clean":"2024-04-25T03:10:04.959002+0000","last_became_active":"2024-04-25T00:50:33.382218+0000","last_became_peered":"2024-04-25T00:50:33.382218+0000","last_unstale":"2024-04-25T03:10:04.959002+0000","last_undegraded":"2024-04-25T03:10:04.959002+0000","last_fullsized":"2024-04-25T03:10:04.959002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'1954","last_scrub_stamp":"2024-04-25T03:10:04.958883+0000","last_deep_scrub":"28'1954","last_deep_scrub_stamp":"2024-04-25T03:10:04.958883+0000","last_clean_scrub_stamp":"2024-04-25T03:10:04.958883+0000","objects_scrubbed":11,"log_size":1954,"log_dups_size":0,"ondisk_log_size":1954,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:36.484437+0000","scrub_duration":91,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1878,"num_write_kb":17269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"28'382","reported_seq":549,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:59.841961+0000","last_change":"2024-04-25T03:09:59.841961+0000","last_active":"2024-04-25T03:09:59.841961+0000","last_peered":"2024-04-25T03:09:59.841961+0000","last_clean":"2024-04-25T03:09:59.841961+0000","last_became_active":"2024-04-25T00:50:35.801799+0000","last_became_peered":"2024-04-25T00:50:35.801799+0000","last_unstale":"2024-04-25T03:09:59.841961+0000","last_undegraded":"2024-04-25T03:09:59.841961+0000","last_fullsized":"2024-04-25T03:09:59.841961+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'382","last_scrub_stamp":"2024-04-25T03:09:59.841694+0000","last_deep_scrub":"28'382","last_deep_scrub_stamp":"2024-04-25T03:09:59.841694+0000","last_clean_scrub_stamp":"2024-04-25T03:09:59.841694+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:40:02.943200+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":38798,"num_write":356,"num_write_kb":55918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"28'669","reported_seq":770,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:55.001624+0000","last_change":"2024-04-25T03:09:55.001810+0000","last_active":"2024-04-25T03:09:55.001624+0000","last_peered":"2024-04-25T03:09:55.001624+0000","last_clean":"2024-04-25T03:09:55.001624+0000","last_became_active":"2024-04-25T00:50:33.388773+0000","last_became_peered":"2024-04-25T00:50:33.388773+0000","last_unstale":"2024-04-25T03:09:55.001624+0000","last_undegraded":"2024-04-25T03:09:55.001624+0000","last_fullsized":"2024-04-25T03:09:55.001624+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'669","last_scrub_stamp":"2024-04-25T03:09:55.001381+0000","last_deep_scrub":"28'669","last_deep_scrub_stamp":"2024-04-25T03:09:55.001381+0000","last_clean_scrub_stamp":"2024-04-25T03:09:55.001381+0000","objects_scrubbed":2,"log_size":669,"log_dups_size":0,"ondisk_log_size":669,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:02:17.194825+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":618,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"28'435","reported_seq":560,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:58.010943+0000","last_change":"2024-04-25T03:09:58.010999+0000","last_active":"2024-04-25T03:09:58.010943+0000","last_peered":"2024-04-25T03:09:58.010943+0000","last_clean":"2024-04-25T03:09:58.010943+0000","last_became_active":"2024-04-25T00:50:35.876576+0000","last_became_peered":"2024-04-25T00:50:35.876576+0000","last_unstale":"2024-04-25T03:09:58.010943+0000","last_undegraded":"2024-04-25T03:09:58.010943+0000","last_fullsized":"2024-04-25T03:09:58.010943+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'435","last_scrub_stamp":"2024-04-25T03:09:58.010786+0000","last_deep_scrub":"28'435","last_deep_scrub_stamp":"2024-04-25T03:09:58.010786+0000","last_clean_scrub_stamp":"2024-04-25T03:09:58.010786+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:20:02.082205+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":17268,"num_write":403,"num_write_kb":121594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"28'731","reported_seq":830,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-25T03:09:51.819247+0000","last_change":"2024-04-25T03:09:51.819247+0000","last_active":"2024-04-25T03:09:51.819247+0000","last_peered":"2024-04-25T03:09:51.819247+0000","last_clean":"2024-04-25T03:09:51.819247+0000","last_became_active":"2024-04-25T00:50:33.318940+0000","last_became_peered":"2024-04-25T00:50:33.318940+0000","last_unstale":"2024-04-25T03:09:51.819247+0000","last_undegraded":"2024-04-25T03:09:51.819247+0000","last_fullsized":"2024-04-25T03:09:51.819247+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"28'731","last_scrub_stamp":"2024-04-25T03:09:51.819036+0000","last_deep_scrub":"28'731","last_deep_scrub_stamp":"2024-04-25T03:09:51.819036+0000","last_clean_scrub_stamp":"2024-04-25T03:09:51.819036+0000","objects_scrubbed":8,"log_size":731,"log_dups_size":0,"ondisk_log_size":731,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:06:34.874948+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389280,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":687,"num_write_kb":8496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2646,"num_read_kb":1386903,"num_write":24369,"num_write_kb":4205310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26395,"ondisk_log_size":26395,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":213073620,"num_objects":149,"num_object_clones":0,"num_object_copies":298,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":149,"num_whiteouts":0,"num_read":4395,"num_read_kb":4765,"num_write":47715,"num_write_kb":231672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":426393600,"data_stored":426147240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38575,"ondisk_log_size":38575,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":16,"seq":68719478427,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177932,"kb_used_data":78724,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94193908,"statfs":{"total":96636764160,"available":96454561792,"internally_reserved":0,"allocated":80613376,"data_stored":80393199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":101579210},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":16,"seq":68719478427,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":162792,"kb_used_data":63584,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94209048,"statfs":{"total":96636764160,"available":96470065152,"internally_reserved":0,"allocated":65110016,"data_stored":64903593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":101579206},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":16,"seq":68719478427,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150528,"kb_used_data":51320,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94221312,"statfs":{"total":96636764160,"available":96482623488,"internally_reserved":0,"allocated":52551680,"data_stored":52323151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":16,"seq":68719478425,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":147132,"kb_used_data":57652,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94224708,"statfs":{"total":96636764160,"available":96486100992,"internally_reserved":0,"allocated":59035648,"data_stored":58830541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":16,"seq":68719478426,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":97828,"kb_used_data":22236,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94274012,"statfs":{"total":96636764160,"available":96536588288,"internally_reserved":0,"allocated":22769664,"data_stored":22552901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424511129,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":150240,"kb_used_data":42712,"kb_used_omap":1,"kb_used_meta":107518,"kb_avail":94221600,"statfs":{"total":96636764160,"available":96482918400,"internally_reserved":0,"allocated":43737088,"data_stored":43524455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":110098887},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424511130,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":113220,"kb_used_data":45948,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94258620,"statfs":{"total":96636764160,"available":96520826880,"internally_reserved":0,"allocated":47050752,"data_stored":46836959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":68876741},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129543834,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":156864,"kb_used_data":57656,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94214976,"statfs":{"total":96636764160,"available":96476135424,"internally_reserved":0,"allocated":59039744,"data_stored":58830161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46166016,"data_stored":46138218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":58748928,"data_stored":58721788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":22478848,"data_stored":22444528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":43446272,"data_stored":43416082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":58744832,"data_stored":58722168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":52260864,"data_stored":52214778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":64819200,"data_stored":64795220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":79728640,"data_stored":79694458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T03:10:19.509 DEBUG:teuthology.orchestra.run.smithi162:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T03:10:19.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.673+0000 7fe70bbaa640 1 Processor -- start 2024-04-25T03:10:19.674 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.673+0000 7fe70bbaa640 1 -- start start 2024-04-25T03:10:19.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.673+0000 7fe70bbaa640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe7041523e0 0x7fe7040cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:19.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.673+0000 7fe70bbaa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70415c230 0x7fe704071380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:19.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.673+0000 7fe70bbaa640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe70415b790 con 0x7fe7040cd440 2024-04-25T03:10:19.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.673+0000 7fe70bbaa640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fe70415c6c0 con 0x7fe7041523e0 2024-04-25T03:10:19.675 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.673+0000 7fe70bbaa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe704158a60 con 0x7fe70415c230 2024-04-25T03:10:19.677 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.677+0000 7fe70a147640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70415c230 0x7fe704071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:19.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.677+0000 7fe709946640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fe7041523e0 0x7fe7040cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:19.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.677+0000 7fe709145640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe7040cd440 0x7fe7041581a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:39596/0 (socket says 172.21.15.162:39596) 2024-04-25T03:10:19.678 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.677+0000 7fe709145640 1 -- 172.21.15.162:0/2982107051 learned_addr learned my addr 172.21.15.162:0/2982107051 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:10:19.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.681+0000 7fe709946640 1 -- 172.21.15.162:0/2982107051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70415c230 msgr2=0x7fe704071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:10:19.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.681+0000 7fe709946640 1 --2- 172.21.15.162:0/2982107051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70415c230 0x7fe704071380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:19.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.681+0000 7fe709946640 1 -- 172.21.15.162:0/2982107051 >> v1:172.21.15.162:6789/0 conn(0x7fe7040cd440 legacy=0x7fe7041581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:19.683 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.681+0000 7fe709946640 1 -- 172.21.15.162:0/2982107051 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe704158d40 con 0x7fe7041523e0 2024-04-25T03:10:19.687 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.685+0000 7fe709946640 1 --2- 172.21.15.162:0/2982107051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7041523e0 0x7fe7040cb830 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80097c0 tx=0x7fe6f801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b744bf1da7ae61da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:19.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.689+0000 7fe708944640 1 -- 172.21.15.162:0/2982107051 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f80b5070 con 0x7fe7041523e0 2024-04-25T03:10:19.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.689+0000 7fe708944640 1 -- 172.21.15.162:0/2982107051 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6f80a8990 con 0x7fe7041523e0 2024-04-25T03:10:19.691 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.689+0000 7fe708944640 1 -- 172.21.15.162:0/2982107051 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6f80a8d60 con 0x7fe7041523e0 2024-04-25T03:10:19.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.689+0000 7fe70bbaa640 1 -- 172.21.15.162:0/2982107051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7041523e0 msgr2=0x7fe7040cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:19.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.689+0000 7fe70bbaa640 1 --2- 172.21.15.162:0/2982107051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7041523e0 0x7fe7040cb830 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80097c0 tx=0x7fe6f801ec90 comp rx=0 tx=0).stop 2024-04-25T03:10:19.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.689+0000 7fe70bbaa640 1 -- 172.21.15.162:0/2982107051 shutdown_connections 2024-04-25T03:10:19.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.689+0000 7fe70bbaa640 1 --2- 172.21.15.162:0/2982107051 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70415c230 0x7fe704071380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:19.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.689+0000 7fe70bbaa640 1 --2- 172.21.15.162:0/2982107051 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7041523e0 0x7fe7040cb830 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:19.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.689+0000 7fe70bbaa640 1 -- 172.21.15.162:0/2982107051 >> 172.21.15.162:0/2982107051 conn(0x7fe70406b810 msgr2=0x7fe70406f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:10:19.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.689+0000 7fe70bbaa640 1 -- 172.21.15.162:0/2982107051 shutdown_connections 2024-04-25T03:10:19.692 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.689+0000 7fe70bbaa640 1 -- 172.21.15.162:0/2982107051 wait complete. 2024-04-25T03:10:19.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.693+0000 7fe70bbaa640 1 Processor -- start 2024-04-25T03:10:19.693 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.693+0000 7fe70bbaa640 1 -- start start 2024-04-25T03:10:19.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.693+0000 7fe70bbaa640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7040cd440 0x7fe7041f4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:19.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.693+0000 7fe70bbaa640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7041523e0 0x7fe704071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:19.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.693+0000 7fe70bbaa640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70415c230 0x7fe704071690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:19.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.693+0000 7fe70bbaa640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe70415bd10 con 0x7fe7041523e0 2024-04-25T03:10:19.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.693+0000 7fe70bbaa640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe70415ba30 con 0x7fe7040cd440 2024-04-25T03:10:19.694 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.693+0000 7fe70bbaa640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe7041527c0 con 0x7fe70415c230 2024-04-25T03:10:19.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.693+0000 7fe709145640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7041523e0 0x7fe704071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:19.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.693+0000 7fe709145640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7041523e0 0x7fe704071150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42828/0 (socket says 172.21.15.162:42828) 2024-04-25T03:10:19.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.693+0000 7fe709145640 1 -- 172.21.15.162:0/3772818569 learned_addr learned my addr 172.21.15.162:0/3772818569 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:10:19.695 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.693+0000 7fe709946640 1 --2- 172.21.15.162:0/3772818569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7040cd440 0x7fe7041f4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:19.696 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.693+0000 7fe70a147640 1 --2- 172.21.15.162:0/3772818569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70415c230 0x7fe704071690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:19.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.697+0000 7fe709145640 1 -- 172.21.15.162:0/3772818569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70415c230 msgr2=0x7fe704071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:19.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.697+0000 7fe709145640 1 --2- 172.21.15.162:0/3772818569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70415c230 0x7fe704071690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:19.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.697+0000 7fe709145640 1 -- 172.21.15.162:0/3772818569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7040cd440 msgr2=0x7fe7041f4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:19.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.697+0000 7fe709145640 1 --2- 172.21.15.162:0/3772818569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7040cd440 0x7fe7041f4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:19.699 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.697+0000 7fe709145640 1 -- 172.21.15.162:0/3772818569 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7040c8f20 con 0x7fe7041523e0 2024-04-25T03:10:19.701 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.701+0000 7fe709145640 1 --2- 172.21.15.162:0/3772818569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7041523e0 0x7fe704071150 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c420 tx=0x7fe70000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:19.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.705+0000 7fe6f67fc640 1 -- 172.21.15.162:0/3772818569 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe700017070 con 0x7fe7041523e0 2024-04-25T03:10:19.705 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.705+0000 7fe6f67fc640 1 -- 172.21.15.162:0/3772818569 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe700005cf0 con 0x7fe7041523e0 2024-04-25T03:10:19.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.705+0000 7fe6f67fc640 1 -- 172.21.15.162:0/3772818569 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7000072f0 con 0x7fe7041523e0 2024-04-25T03:10:19.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.705+0000 7fe70bbaa640 1 -- 172.21.15.162:0/3772818569 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7041484c0 con 0x7fe7041523e0 2024-04-25T03:10:19.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.705+0000 7fe70bbaa640 1 -- 172.21.15.162:0/3772818569 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe704148760 con 0x7fe7041523e0 2024-04-25T03:10:19.706 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.705+0000 7fe70bbaa640 1 -- 172.21.15.162:0/3772818569 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe704075110 con 0x7fe7041523e0 2024-04-25T03:10:19.991 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.989+0000 7fe6f67fc640 1 -- 172.21.15.162:0/3772818569 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe70001a070 con 0x7fe7041523e0 2024-04-25T03:10:19.992 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.989+0000 7fe6f67fc640 1 --2- 172.21.15.162:0/3772818569 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe6e8067910 0x7fe6e8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:19.992 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.989+0000 7fe709946640 1 --2- 172.21.15.162:0/3772818569 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe6e8067910 0x7fe6e8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:19.993 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:19.993+0000 7fe709946640 1 --2- 172.21.15.162:0/3772818569 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe6e8067910 0x7fe6e8069dd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80b2000 tx=0x7fe6f80aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:20.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.021+0000 7fe6f67fc640 1 -- 172.21.15.162:0/3772818569 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7fe700053a30 con 0x7fe7041523e0 2024-04-25T03:10:20.021 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.021+0000 7fe6f67fc640 1 -- 172.21.15.162:0/3772818569 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fe700021020 con 0x7fe7041523e0 2024-04-25T03:10:20.210 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.209+0000 7fe70bbaa640 1 -- 172.21.15.162:0/3772818569 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fe7040b2b10 con 0x7fe7041523e0 2024-04-25T03:10:20.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.333+0000 7fe6f67fc640 1 -- 172.21.15.162:0/3772818569 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fe700055990 con 0x7fe7041523e0 2024-04-25T03:10:20.335 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.333+0000 7fe6f67fc640 1 -- 172.21.15.162:0/3772818569 <== mon.0 v2:172.21.15.162:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe700059c90 con 0x7fe7041523e0 2024-04-25T03:10:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.337+0000 7fe70bbaa640 1 -- 172.21.15.162:0/3772818569 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe6e8067910 msgr2=0x7fe6e8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.337+0000 7fe70bbaa640 1 --2- 172.21.15.162:0/3772818569 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe6e8067910 0x7fe6e8069dd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe6f80b2000 tx=0x7fe6f80aa070 comp rx=0 tx=0).stop 2024-04-25T03:10:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.337+0000 7fe70bbaa640 1 -- 172.21.15.162:0/3772818569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7041523e0 msgr2=0x7fe704071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.337+0000 7fe70bbaa640 1 --2- 172.21.15.162:0/3772818569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7041523e0 0x7fe704071150 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe70000c420 tx=0x7fe70000c8e0 comp rx=0 tx=0).stop 2024-04-25T03:10:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.337+0000 7fe70bbaa640 1 -- 172.21.15.162:0/3772818569 shutdown_connections 2024-04-25T03:10:20.338 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.337+0000 7fe70bbaa640 1 --2- 172.21.15.162:0/3772818569 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe70415c230 0x7fe704071690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:20.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.337+0000 7fe70bbaa640 1 --2- 172.21.15.162:0/3772818569 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe6e8067910 0x7fe6e8069dd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:20.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.337+0000 7fe70bbaa640 1 --2- 172.21.15.162:0/3772818569 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7041523e0 0x7fe704071150 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:20.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.337+0000 7fe70bbaa640 1 --2- 172.21.15.162:0/3772818569 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7040cd440 0x7fe7041f4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:20.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.337+0000 7fe70bbaa640 1 -- 172.21.15.162:0/3772818569 >> 172.21.15.162:0/3772818569 conn(0x7fe70406b810 msgr2=0x7fe7040cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:10:20.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.337+0000 7fe70bbaa640 1 -- 172.21.15.162:0/3772818569 shutdown_connections 2024-04-25T03:10:20.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.337+0000 7fe70bbaa640 1 -- 172.21.15.162:0/3772818569 wait complete. 2024-04-25T03:10:20.362 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T03:10:20.362 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T03:10:20.485 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.485+0000 7efea7895640 1 Processor -- start 2024-04-25T03:10:20.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.485+0000 7efea7895640 1 -- start start 2024-04-25T03:10:20.486 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.485+0000 7efea7895640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efea006b210 0x7efea006d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:20.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.485+0000 7efea7895640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efea006df10 0x7efea00c57c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:20.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.485+0000 7efea7895640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efea015b660 con 0x7efea015c140 2024-04-25T03:10:20.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.485+0000 7efea7895640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7efea0158400 con 0x7efea006b210 2024-04-25T03:10:20.487 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.485+0000 7efea7895640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7efea01580b0 con 0x7efea006df10 2024-04-25T03:10:20.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.489+0000 7efea4e30640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efea006b210 0x7efea006d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:20.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.489+0000 7efea4e30640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7efea006b210 0x7efea006d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42832/0 (socket says 172.21.15.162:42832) 2024-04-25T03:10:20.490 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.489+0000 7efea4e30640 1 -- 172.21.15.162:0/2037718196 learned_addr learned my addr 172.21.15.162:0/2037718196 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:10:20.496 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.493+0000 7efea4e30640 1 -- 172.21.15.162:0/2037718196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efea006df10 msgr2=0x7efea00c57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:10:20.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.493+0000 7efea4e30640 1 --2- 172.21.15.162:0/2037718196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efea006df10 0x7efea00c57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:20.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.493+0000 7efea4e30640 1 -- 172.21.15.162:0/2037718196 >> v1:172.21.15.162:6789/0 conn(0x7efea015c140 legacy=0x7efea0158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:10:20.497 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.493+0000 7efea4e30640 1 -- 172.21.15.162:0/2037718196 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea00c6ab0 con 0x7efea006b210 2024-04-25T03:10:20.504 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.501+0000 7efea4e30640 1 --2- 172.21.15.162:0/2037718196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efea006b210 0x7efea006d9d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efea0158580 tx=0x7efe9001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7192399727bea763 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:20.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.509+0000 7efe97fff640 1 -- 172.21.15.162:0/2037718196 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe900b5070 con 0x7efea006b210 2024-04-25T03:10:20.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.509+0000 7efe97fff640 1 -- 172.21.15.162:0/2037718196 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7efe900a89b0 con 0x7efea006b210 2024-04-25T03:10:20.511 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.509+0000 7efe97fff640 1 -- 172.21.15.162:0/2037718196 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe900a8da0 con 0x7efea006b210 2024-04-25T03:10:20.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.509+0000 7efea7895640 1 -- 172.21.15.162:0/2037718196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efea006b210 msgr2=0x7efea006d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:20.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.509+0000 7efea7895640 1 --2- 172.21.15.162:0/2037718196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efea006b210 0x7efea006d9d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7efea0158580 tx=0x7efe9001ecf0 comp rx=0 tx=0).stop 2024-04-25T03:10:20.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.509+0000 7efea7895640 1 -- 172.21.15.162:0/2037718196 shutdown_connections 2024-04-25T03:10:20.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.509+0000 7efea7895640 1 --2- 172.21.15.162:0/2037718196 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efea006df10 0x7efea00c57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:20.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.509+0000 7efea7895640 1 --2- 172.21.15.162:0/2037718196 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efea006b210 0x7efea006d9d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:20.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.509+0000 7efea7895640 1 -- 172.21.15.162:0/2037718196 >> 172.21.15.162:0/2037718196 conn(0x7efea006fab0 msgr2=0x7efea006fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:10:20.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.509+0000 7efea7895640 1 -- 172.21.15.162:0/2037718196 shutdown_connections 2024-04-25T03:10:20.512 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.509+0000 7efea7895640 1 -- 172.21.15.162:0/2037718196 wait complete. 2024-04-25T03:10:20.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.513+0000 7efea7895640 1 Processor -- start 2024-04-25T03:10:20.513 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.513+0000 7efea7895640 1 -- start start 2024-04-25T03:10:20.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.513+0000 7efea7895640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efea006b210 0x7efea01e28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:20.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.513+0000 7efea7895640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efea006df10 0x7efea01403c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:20.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.513+0000 7efea7895640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efea015c140 0x7efea0140900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:20.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.513+0000 7efea7895640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7efea00c7350 con 0x7efea006b210 2024-04-25T03:10:20.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.513+0000 7efea7895640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7efea00c7070 con 0x7efea015c140 2024-04-25T03:10:20.514 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.513+0000 7efea7895640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7efea015c520 con 0x7efea006df10 2024-04-25T03:10:20.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.513+0000 7efea5631640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efea006b210 0x7efea01e28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:20.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.513+0000 7efea5631640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efea006b210 0x7efea01e28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:42844/0 (socket says 172.21.15.162:42844) 2024-04-25T03:10:20.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.513+0000 7efea5631640 1 -- 172.21.15.162:0/1020502797 learned_addr learned my addr 172.21.15.162:0/1020502797 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:10:20.515 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.513+0000 7efea5e32640 1 --2- 172.21.15.162:0/1020502797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efea015c140 0x7efea0140900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:20.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.517+0000 7efea5631640 1 -- 172.21.15.162:0/1020502797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efea006df10 msgr2=0x7efea01403c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:20.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.517+0000 7efea5631640 1 --2- 172.21.15.162:0/1020502797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efea006df10 0x7efea01403c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:20.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.517+0000 7efea5631640 1 -- 172.21.15.162:0/1020502797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efea015c140 msgr2=0x7efea0140900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:20.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.517+0000 7efea5631640 1 --2- 172.21.15.162:0/1020502797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efea015c140 0x7efea0140900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:20.519 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.517+0000 7efea5631640 1 -- 172.21.15.162:0/1020502797 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea0135840 con 0x7efea006b210 2024-04-25T03:10:20.523 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.521+0000 7efea5631640 1 --2- 172.21.15.162:0/1020502797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efea006b210 0x7efea01e28f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00b440 tx=0x7efe9c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:20.538 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.537+0000 7efe95ffb640 1 -- 172.21.15.162:0/1020502797 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c015020 con 0x7efea006b210 2024-04-25T03:10:20.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.537+0000 7efe95ffb640 1 -- 172.21.15.162:0/1020502797 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7efe9c011890 con 0x7efea006b210 2024-04-25T03:10:20.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.537+0000 7efea7895640 1 -- 172.21.15.162:0/1020502797 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea013a9d0 con 0x7efea006b210 2024-04-25T03:10:20.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.537+0000 7efe95ffb640 1 -- 172.21.15.162:0/1020502797 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c011ca0 con 0x7efea006b210 2024-04-25T03:10:20.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.537+0000 7efea7895640 1 -- 172.21.15.162:0/1020502797 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea0135ae0 con 0x7efea006b210 2024-04-25T03:10:20.539 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.537+0000 7efea7895640 1 -- 172.21.15.162:0/1020502797 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efea004f5f0 con 0x7efea006b210 2024-04-25T03:10:20.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.913+0000 7efe95ffb640 1 -- 172.21.15.162:0/1020502797 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe9c018020 con 0x7efea006b210 2024-04-25T03:10:20.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.913+0000 7efe95ffb640 1 --2- 172.21.15.162:0/1020502797 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7efe84067910 0x7efe84069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:20.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.913+0000 7efea4e30640 1 --2- 172.21.15.162:0/1020502797 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7efe84067910 0x7efe84069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:20.916 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.913+0000 7efea4e30640 1 --2- 172.21.15.162:0/1020502797 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7efe84067910 0x7efe84069dd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efe900b2000 tx=0x7efe90004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:20.953 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.953+0000 7efe95ffb640 1 -- 172.21.15.162:0/1020502797 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7efe9c054420 con 0x7efea006b210 2024-04-25T03:10:20.954 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:20.953+0000 7efe95ffb640 1 -- 172.21.15.162:0/1020502797 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7efe9c01f030 con 0x7efea006b210 2024-04-25T03:10:21.181 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.181+0000 7efea7895640 1 -- 172.21.15.162:0/1020502797 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efea0156330 con 0x7efea006b210 2024-04-25T03:10:21.203 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.201+0000 7efe95ffb640 1 -- 172.21.15.162:0/1020502797 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6919 (secure 0 0 0) 0x7efe9c00d040 con 0x7efea006b210 2024-04-25T03:10:21.204 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T03:10:21.204 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/560649188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":560649188},{"type":"v1","addr":"172.21.15.179:6833","nonce":560649188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T00:50:35.645685+0000","modified":"2024-04-25T00:50:58.084533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4246,"mds_1":4244,"mds_2":4241,"mds_3":4240,"mds_4":4233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4233":{"gid":4233,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":11,"addr":"172.21.15.179:6835/1339390327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1339390327},{"type":"v1","addr":"172.21.15.179:6835","nonce":1339390327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4240":{"gid":4240,"name":"e","rank":3,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.162:6835/191105979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":191105979},{"type":"v1","addr":"172.21.15.162:6835","nonce":191105979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4241":{"gid":4241,"name":"c","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2357127318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2357127318},{"type":"v1","addr":"172.21.15.162:6839","nonce":2357127318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4244":{"gid":4244,"name":"f","rank":1,"incarnation":8,"state":"up:active","state_seq":7,"addr":"172.21.15.179:6837/2607965795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2607965795},{"type":"v1","addr":"172.21.15.179:6837","nonce":2607965795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4246":{"gid":4246,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":6,"addr":"172.21.15.162:6837/1743481688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1743481688},{"type":"v1","addr":"172.21.15.162:6837","nonce":1743481688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4233,4246,4240,4241,4244]},"id":1}]} 2024-04-25T03:10:21.204 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 17 2024-04-25T03:10:21.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.205+0000 7efea7895640 1 -- 172.21.15.162:0/1020502797 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7efe84067910 msgr2=0x7efe84069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:21.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.205+0000 7efea7895640 1 --2- 172.21.15.162:0/1020502797 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7efe84067910 0x7efe84069dd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efe900b2000 tx=0x7efe90004740 comp rx=0 tx=0).stop 2024-04-25T03:10:21.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.205+0000 7efea7895640 1 -- 172.21.15.162:0/1020502797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efea006b210 msgr2=0x7efea01e28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:21.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.205+0000 7efea7895640 1 --2- 172.21.15.162:0/1020502797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efea006b210 0x7efea01e28f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00b440 tx=0x7efe9c00b900 comp rx=0 tx=0).stop 2024-04-25T03:10:21.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.205+0000 7efea7895640 1 -- 172.21.15.162:0/1020502797 shutdown_connections 2024-04-25T03:10:21.207 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.205+0000 7efea7895640 1 --2- 172.21.15.162:0/1020502797 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7efea015c140 0x7efea0140900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:21.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.205+0000 7efea7895640 1 --2- 172.21.15.162:0/1020502797 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7efea006df10 0x7efea01403c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:21.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.205+0000 7efea7895640 1 --2- 172.21.15.162:0/1020502797 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7efe84067910 0x7efe84069dd0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:21.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.205+0000 7efea7895640 1 --2- 172.21.15.162:0/1020502797 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7efea006b210 0x7efea01e28f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:21.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.205+0000 7efea7895640 1 -- 172.21.15.162:0/1020502797 >> 172.21.15.162:0/1020502797 conn(0x7efea006fab0 msgr2=0x7efea0136ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:10:21.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.205+0000 7efea7895640 1 -- 172.21.15.162:0/1020502797 shutdown_connections 2024-04-25T03:10:21.208 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.205+0000 7efea7895640 1 -- 172.21.15.162:0/1020502797 wait complete. 2024-04-25T03:10:21.226 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T03:10:21.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.341+0000 7f7c64692640 1 Processor -- start 2024-04-25T03:10:21.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.341+0000 7f7c64692640 1 -- start start 2024-04-25T03:10:21.345 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.345+0000 7f7c64692640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f7c5c151200 0x7f7c5c072850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:21.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.345+0000 7f7c64692640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c5c073200 con 0x7f7c5c1515e0 2024-04-25T03:10:21.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.345+0000 7f7c64692640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c5c0c2f60 con 0x7f7c5c0c8ee0 2024-04-25T03:10:21.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.345+0000 7f7c64692640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f7c5c0c3240 con 0x7f7c5c151200 2024-04-25T03:10:21.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.345+0000 7f7c61c2d640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f7c5c1515e0 0x7f7c5c0c62c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:37868/0 (socket says 172.21.15.162:37868) 2024-04-25T03:10:21.346 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.345+0000 7f7c61c2d640 1 -- 172.21.15.162:0/4093960101 learned_addr learned my addr 172.21.15.162:0/4093960101 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:10:21.347 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.345+0000 7f7c6242e640 1 --2- 172.21.15.162:0/4093960101 >> v2:172.21.15.179:3300/0 conn(0x7f7c5c151200 0x7f7c5c072850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:21.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.349+0000 7f7c6142c640 1 -- 172.21.15.162:0/4093960101 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1024358633 0 0) 0x7f7c5c073200 con 0x7f7c5c1515e0 2024-04-25T03:10:21.349 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.349+0000 7f7c6142c640 1 -- 172.21.15.162:0/4093960101 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c48003530 con 0x7f7c5c1515e0 2024-04-25T03:10:21.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.353+0000 7f7c6242e640 1 -- 172.21.15.162:0/4093960101 >> v1:172.21.15.179:6789/0 conn(0x7f7c5c0c8ee0 legacy=0x7f7c5c15a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:10:21.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.353+0000 7f7c6242e640 1 -- 172.21.15.162:0/4093960101 >> v1:172.21.15.162:6789/0 conn(0x7f7c5c1515e0 legacy=0x7f7c5c0c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:21.354 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.353+0000 7f7c6242e640 1 -- 172.21.15.162:0/4093960101 --> v2:172.21.15.179:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5c0c3520 con 0x7f7c5c151200 2024-04-25T03:10:21.363 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.361+0000 7f7c6242e640 1 --2- 172.21.15.162:0/4093960101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c5c151200 0x7f7c5c072850 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7c580097c0 tx=0x7f7c5801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf651f48123ff5f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:21.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.373+0000 7f7c6142c640 1 -- 172.21.15.162:0/4093960101 <== mon.1 v2:172.21.15.179:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c580b0070 con 0x7f7c5c151200 2024-04-25T03:10:21.374 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.373+0000 7f7c6142c640 1 -- 172.21.15.162:0/4093960101 <== mon.1 v2:172.21.15.179:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7c580ab600 con 0x7f7c5c151200 2024-04-25T03:10:21.375 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.373+0000 7f7c6142c640 1 -- 172.21.15.162:0/4093960101 <== mon.1 v2:172.21.15.179:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c580ab9f0 con 0x7f7c5c151200 2024-04-25T03:10:21.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.373+0000 7f7c64692640 1 -- 172.21.15.162:0/4093960101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c5c151200 msgr2=0x7f7c5c072850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:21.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.373+0000 7f7c64692640 1 --2- 172.21.15.162:0/4093960101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c5c151200 0x7f7c5c072850 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7c580097c0 tx=0x7f7c5801c460 comp rx=0 tx=0).stop 2024-04-25T03:10:21.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.373+0000 7f7c64692640 1 -- 172.21.15.162:0/4093960101 shutdown_connections 2024-04-25T03:10:21.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.373+0000 7f7c64692640 1 --2- 172.21.15.162:0/4093960101 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c5c151200 0x7f7c5c072850 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:21.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.373+0000 7f7c64692640 1 -- 172.21.15.162:0/4093960101 >> 172.21.15.162:0/4093960101 conn(0x7f7c5c0c83c0 msgr2=0x7f7c5c0c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:10:21.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.373+0000 7f7c64692640 1 -- 172.21.15.162:0/4093960101 shutdown_connections 2024-04-25T03:10:21.376 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.373+0000 7f7c64692640 1 -- 172.21.15.162:0/4093960101 wait complete. 2024-04-25T03:10:21.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.377+0000 7f7c64692640 1 Processor -- start 2024-04-25T03:10:21.377 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.377+0000 7f7c64692640 1 -- start start 2024-04-25T03:10:21.378 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.377+0000 7f7c64692640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c5c0c8ee0 0x7f7c5c1550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:21.378 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.377+0000 7f7c64692640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c5c151200 0x7f7c5c159970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:21.378 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.377+0000 7f7c64692640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c5c1515e0 0x7f7c5c13e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:21.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.377+0000 7f7c64692640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c0718c0 con 0x7f7c5c0c8ee0 2024-04-25T03:10:21.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.377+0000 7f7c64692640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f7c5c071740 con 0x7f7c5c151200 2024-04-25T03:10:21.379 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.377+0000 7f7c64692640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f7c5c071a40 con 0x7f7c5c1515e0 2024-04-25T03:10:21.380 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.377+0000 7f7c62c2f640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c5c1515e0 0x7f7c5c13e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:21.380 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.377+0000 7f7c6242e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c5c0c8ee0 0x7f7c5c1550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:21.380 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.377+0000 7f7c6242e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c5c0c8ee0 0x7f7c5c1550d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34264/0 (socket says 172.21.15.162:34264) 2024-04-25T03:10:21.381 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.377+0000 7f7c6242e640 1 -- 172.21.15.162:0/3193552077 learned_addr learned my addr 172.21.15.162:0/3193552077 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:10:21.383 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.381+0000 7f7c61c2d640 1 --2- 172.21.15.162:0/3193552077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c5c151200 0x7f7c5c159970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:21.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.385+0000 7f7c6242e640 1 -- 172.21.15.162:0/3193552077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c5c1515e0 msgr2=0x7f7c5c13e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:21.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.385+0000 7f7c6242e640 1 --2- 172.21.15.162:0/3193552077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c5c1515e0 0x7f7c5c13e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:21.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.385+0000 7f7c6242e640 1 -- 172.21.15.162:0/3193552077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c5c151200 msgr2=0x7f7c5c159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:21.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.385+0000 7f7c6242e640 1 --2- 172.21.15.162:0/3193552077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c5c151200 0x7f7c5c159970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:21.385 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.385+0000 7f7c6242e640 1 -- 172.21.15.162:0/3193552077 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c5c14fa20 con 0x7f7c5c0c8ee0 2024-04-25T03:10:21.388 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.385+0000 7f7c6242e640 1 --2- 172.21.15.162:0/3193552077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c5c0c8ee0 0x7f7c5c1550d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7c58019070 tx=0x7f7c58019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:21.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.393+0000 7f7c52ffd640 1 -- 172.21.15.162:0/3193552077 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c580b0040 con 0x7f7c5c0c8ee0 2024-04-25T03:10:21.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.393+0000 7f7c52ffd640 1 -- 172.21.15.162:0/3193552077 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7c580bb070 con 0x7f7c5c0c8ee0 2024-04-25T03:10:21.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.393+0000 7f7c52ffd640 1 -- 172.21.15.162:0/3193552077 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c580b5920 con 0x7f7c5c0c8ee0 2024-04-25T03:10:21.394 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.393+0000 7f7c64692640 1 -- 172.21.15.162:0/3193552077 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c5c14fc90 con 0x7f7c5c0c8ee0 2024-04-25T03:10:21.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.393+0000 7f7c64692640 1 -- 172.21.15.162:0/3193552077 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c5c150250 con 0x7f7c5c0c8ee0 2024-04-25T03:10:21.395 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.393+0000 7f7c64692640 1 -- 172.21.15.162:0/3193552077 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c5c0c27c0 con 0x7f7c5c0c8ee0 2024-04-25T03:10:21.416 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.413+0000 7f7c52ffd640 1 -- 172.21.15.162:0/3193552077 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7c580b3070 con 0x7f7c5c0c8ee0 2024-04-25T03:10:21.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.413+0000 7f7c52ffd640 1 --2- 172.21.15.162:0/3193552077 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f7c40067940 0x7f7c40069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:21.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.417+0000 7f7c61c2d640 1 --2- 172.21.15.162:0/3193552077 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f7c40067940 0x7f7c40069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:21.417 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.417+0000 7f7c61c2d640 1 --2- 172.21.15.162:0/3193552077 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f7c40067940 0x7f7c40069e00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c14daf0 tx=0x7f7c4c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:21.420 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.417+0000 7f7c52ffd640 1 -- 172.21.15.162:0/3193552077 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7f7c580ef080 con 0x7f7c5c0c8ee0 2024-04-25T03:10:21.702 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.701+0000 7f7c52ffd640 1 -- 172.21.15.162:0/3193552077 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f7c580c5020 con 0x7f7c5c0c8ee0 2024-04-25T03:10:21.911 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.909+0000 7f7c64692640 1 -- 172.21.15.162:0/3193552077 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c5c04f5f0 con 0x7f7c5c0c8ee0 2024-04-25T03:10:21.940 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.937+0000 7f7c52ffd640 1 -- 172.21.15.162:0/3193552077 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+6919 (secure 0 0 0) 0x7f7c58016050 con 0x7f7c5c0c8ee0 2024-04-25T03:10:21.940 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T03:10:21.940 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.179:6833/560649188","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6832","nonce":560649188},{"type":"v1","addr":"172.21.15.179:6833","nonce":560649188}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T00:50:35.645685+0000","modified":"2024-04-25T00:50:58.084533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4246,"mds_1":4244,"mds_2":4241,"mds_3":4240,"mds_4":4233},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4233":{"gid":4233,"name":"b","rank":4,"incarnation":16,"state":"up:active","state_seq":11,"addr":"172.21.15.179:6835/1339390327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6834","nonce":1339390327},{"type":"v1","addr":"172.21.15.179:6835","nonce":1339390327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4240":{"gid":4240,"name":"e","rank":3,"incarnation":14,"state":"up:active","state_seq":10,"addr":"172.21.15.162:6835/191105979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6834","nonce":191105979},{"type":"v1","addr":"172.21.15.162:6835","nonce":191105979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4241":{"gid":4241,"name":"c","rank":2,"incarnation":12,"state":"up:active","state_seq":8,"addr":"172.21.15.162:6839/2357127318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6838","nonce":2357127318},{"type":"v1","addr":"172.21.15.162:6839","nonce":2357127318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4244":{"gid":4244,"name":"f","rank":1,"incarnation":8,"state":"up:active","state_seq":7,"addr":"172.21.15.179:6837/2607965795","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6836","nonce":2607965795},{"type":"v1","addr":"172.21.15.179:6837","nonce":2607965795}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4246":{"gid":4246,"name":"a","rank":0,"incarnation":5,"state":"up:active","state_seq":6,"addr":"172.21.15.162:6837/1743481688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6836","nonce":1743481688},{"type":"v1","addr":"172.21.15.162:6837","nonce":1743481688}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4246,"qdb_cluster":[4233,4246,4240,4241,4244]},"id":1}]} 2024-04-25T03:10:21.940 INFO:teuthology.orchestra.run.smithi162.stderr:dumped fsmap epoch 17 2024-04-25T03:10:21.942 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.941+0000 7f7c64692640 1 -- 172.21.15.162:0/3193552077 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f7c40067940 msgr2=0x7f7c40069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:21.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.941+0000 7f7c64692640 1 --2- 172.21.15.162:0/3193552077 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f7c40067940 0x7f7c40069e00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c14daf0 tx=0x7f7c4c009040 comp rx=0 tx=0).stop 2024-04-25T03:10:21.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.941+0000 7f7c64692640 1 -- 172.21.15.162:0/3193552077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c5c0c8ee0 msgr2=0x7f7c5c1550d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:21.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.941+0000 7f7c64692640 1 --2- 172.21.15.162:0/3193552077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c5c0c8ee0 0x7f7c5c1550d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7c58019070 tx=0x7f7c58019200 comp rx=0 tx=0).stop 2024-04-25T03:10:21.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.941+0000 7f7c64692640 1 -- 172.21.15.162:0/3193552077 shutdown_connections 2024-04-25T03:10:21.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.941+0000 7f7c64692640 1 --2- 172.21.15.162:0/3193552077 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f7c5c1515e0 0x7f7c5c13e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:21.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.941+0000 7f7c64692640 1 --2- 172.21.15.162:0/3193552077 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f7c5c151200 0x7f7c5c159970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:21.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.941+0000 7f7c64692640 1 --2- 172.21.15.162:0/3193552077 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f7c40067940 0x7f7c40069e00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:21.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.941+0000 7f7c64692640 1 --2- 172.21.15.162:0/3193552077 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f7c5c0c8ee0 0x7f7c5c1550d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:21.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.941+0000 7f7c64692640 1 -- 172.21.15.162:0/3193552077 >> 172.21.15.162:0/3193552077 conn(0x7f7c5c0c83c0 msgr2=0x7f7c5c0c6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:10:21.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.941+0000 7f7c64692640 1 -- 172.21.15.162:0/3193552077 shutdown_connections 2024-04-25T03:10:21.943 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:21.941+0000 7f7c64692640 1 -- 172.21.15.162:0/3193552077 wait complete. 2024-04-25T03:10:21.961 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T03:10:22.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.089+0000 7fe7b98b5640 1 Processor -- start 2024-04-25T03:10:22.093 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.093+0000 7fe7b98b5640 1 -- start start 2024-04-25T03:10:22.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.093+0000 7fe7b98b5640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fe7b415c310 0x7fe7b40c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:22.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.093+0000 7fe7b98b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b40c8ee0 0x7fe7b40c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:22.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.093+0000 7fe7b98b5640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7b40c5630 con 0x7fe7b40c1890 2024-04-25T03:10:22.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.093+0000 7fe7b98b5640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fe7b415be80 con 0x7fe7b415c310 2024-04-25T03:10:22.094 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.093+0000 7fe7b98b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe7b40c58f0 con 0x7fe7b40c8ee0 2024-04-25T03:10:22.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.093+0000 7fe7b2ffd640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7fe7b40c1890 0x7fe7b41580a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:37876/0 (socket says 172.21.15.162:37876) 2024-04-25T03:10:22.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.093+0000 7fe7b2ffd640 1 -- 172.21.15.162:0/3851524861 learned_addr learned my addr 172.21.15.162:0/3851524861 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:10:22.095 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.093+0000 7fe7b27fc640 1 --2- 172.21.15.162:0/3851524861 >> v2:172.21.15.179:3300/0 conn(0x7fe7b415c310 0x7fe7b40c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:22.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.093+0000 7fe7b37fe640 1 --2- 172.21.15.162:0/3851524861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b40c8ee0 0x7fe7b40c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:22.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.097+0000 7fe7b1ffb640 1 -- 172.21.15.162:0/3851524861 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 313404454 0 0) 0x7fe7b40c5630 con 0x7fe7b40c1890 2024-04-25T03:10:22.097 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.097+0000 7fe7b1ffb640 1 -- 172.21.15.162:0/3851524861 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe79c003530 con 0x7fe7b40c1890 2024-04-25T03:10:22.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.101+0000 7fe7b1ffb640 1 -- 172.21.15.162:0/3851524861 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 61102107 0 0) 0x7fe79c003530 con 0x7fe7b40c1890 2024-04-25T03:10:22.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.101+0000 7fe7b1ffb640 1 -- 172.21.15.162:0/3851524861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b40c8ee0 msgr2=0x7fe7b40c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:10:22.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.101+0000 7fe7b1ffb640 1 --2- 172.21.15.162:0/3851524861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b40c8ee0 0x7fe7b40c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:22.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.101+0000 7fe7b1ffb640 1 -- 172.21.15.162:0/3851524861 >> v2:172.21.15.179:3300/0 conn(0x7fe7b415c310 msgr2=0x7fe7b40c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:10:22.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.101+0000 7fe7b1ffb640 1 --2- 172.21.15.162:0/3851524861 >> v2:172.21.15.179:3300/0 conn(0x7fe7b415c310 0x7fe7b40c1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:22.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.101+0000 7fe7b1ffb640 1 -- 172.21.15.162:0/3851524861 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b40c5bd0 con 0x7fe7b40c1890 2024-04-25T03:10:22.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.101+0000 7fe7b1ffb640 1 -- 172.21.15.162:0/3851524861 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7fe7a4001680 con 0x7fe7b40c1890 2024-04-25T03:10:22.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.101+0000 7fe7b1ffb640 1 -- 172.21.15.162:0/3851524861 >> v1:172.21.15.162:6789/0 conn(0x7fe7b40c1890 legacy=0x7fe7b41580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:22.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.101+0000 7fe7b1ffb640 1 --2- 172.21.15.162:0/3851524861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe79c0039c0 0x7fe79c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:22.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.101+0000 7fe7b1ffb640 1 --2- 172.21.15.162:0/3851524861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b40c8ee0 0x7fe79c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:22.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.101+0000 7fe7b1ffb640 1 --2- 172.21.15.162:0/3851524861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe79c004d50 0x7fe79c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:22.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.101+0000 7fe7b1ffb640 1 -- 172.21.15.162:0/3851524861 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b415be80 con 0x7fe79c004d50 2024-04-25T03:10:22.103 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.101+0000 7fe7b1ffb640 1 -- 172.21.15.162:0/3851524861 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b40c58f0 con 0x7fe79c0039c0 2024-04-25T03:10:22.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.101+0000 7fe7b1ffb640 1 -- 172.21.15.162:0/3851524861 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe79c00b9d0 con 0x7fe7b40c8ee0 2024-04-25T03:10:22.104 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.101+0000 7fe7b37fe640 1 --2- 172.21.15.162:0/3851524861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe79c004d50 0x7fe79c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:22.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.105+0000 7fe7b37fe640 1 -- 172.21.15.162:0/3851524861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b40c8ee0 msgr2=0x7fe79c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:10:22.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.105+0000 7fe7b37fe640 1 --2- 172.21.15.162:0/3851524861 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b40c8ee0 0x7fe79c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:22.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.105+0000 7fe7b37fe640 1 -- 172.21.15.162:0/3851524861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe79c0039c0 msgr2=0x7fe79c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:10:22.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.105+0000 7fe7b37fe640 1 --2- 172.21.15.162:0/3851524861 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe79c0039c0 0x7fe79c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:22.108 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.105+0000 7fe7b37fe640 1 -- 172.21.15.162:0/3851524861 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79c003530 con 0x7fe79c004d50 2024-04-25T03:10:22.111 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.109+0000 7fe7b37fe640 1 --2- 172.21.15.162:0/3851524861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe79c004d50 0x7fe79c0051d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009fc0 tx=0x7fe7ac01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808703dbbe02bf54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:22.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.113+0000 7fe7b1ffb640 1 -- 172.21.15.162:0/3851524861 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac0b2070 con 0x7fe79c004d50 2024-04-25T03:10:22.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.113+0000 7fe7b1ffb640 1 -- 172.21.15.162:0/3851524861 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe7ac0a5cd0 con 0x7fe79c004d50 2024-04-25T03:10:22.114 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.113+0000 7fe7b1ffb640 1 -- 172.21.15.162:0/3851524861 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac009c10 con 0x7fe79c004d50 2024-04-25T03:10:22.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.113+0000 7fe7b98b5640 1 -- 172.21.15.162:0/3851524861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe79c004d50 msgr2=0x7fe79c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:22.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.113+0000 7fe7b98b5640 1 --2- 172.21.15.162:0/3851524861 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe79c004d50 0x7fe79c0051d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac009fc0 tx=0x7fe7ac01ccc0 comp rx=0 tx=0).stop 2024-04-25T03:10:22.115 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.113+0000 7fe7b37fe640 1 -- 172.21.15.162:0/3851524861 reap_dead start 2024-04-25T03:10:22.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.113+0000 7fe7b98b5640 1 -- 172.21.15.162:0/3851524861 shutdown_connections 2024-04-25T03:10:22.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.113+0000 7fe7b98b5640 1 -- 172.21.15.162:0/3851524861 >> 172.21.15.162:0/3851524861 conn(0x7fe7b40c83c0 msgr2=0x7fe7b40c87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:10:22.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.113+0000 7fe7b98b5640 1 -- 172.21.15.162:0/3851524861 shutdown_connections 2024-04-25T03:10:22.116 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.113+0000 7fe7b98b5640 1 -- 172.21.15.162:0/3851524861 wait complete. 2024-04-25T03:10:22.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.117+0000 7fe7b98b5640 1 Processor -- start 2024-04-25T03:10:22.117 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.117+0000 7fe7b98b5640 1 -- start start 2024-04-25T03:10:22.118 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.117+0000 7fe7b98b5640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7b4154e60 0x7fe7b41ee7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:22.118 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.117+0000 7fe7b98b5640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b4155240 0x7fe7b4159da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:22.118 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.117+0000 7fe7b98b5640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b4155ce0 0x7fe7b413b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:22.118 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.117+0000 7fe7b98b5640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b40c6ee0 con 0x7fe7b4154e60 2024-04-25T03:10:22.118 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.117+0000 7fe7b98b5640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fe7b415bb10 con 0x7fe7b4155240 2024-04-25T03:10:22.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.117+0000 7fe7b98b5640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fe7b40c7060 con 0x7fe7b4155ce0 2024-04-25T03:10:22.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.117+0000 7fe7b2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7b4154e60 0x7fe7b41ee7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:22.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.117+0000 7fe7b2ffd640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7b4154e60 0x7fe7b41ee7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34288/0 (socket says 172.21.15.162:34288) 2024-04-25T03:10:22.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.117+0000 7fe7b2ffd640 1 -- 172.21.15.162:0/2585582631 learned_addr learned my addr 172.21.15.162:0/2585582631 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:10:22.119 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.117+0000 7fe7b27fc640 1 --2- 172.21.15.162:0/2585582631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b4155240 0x7fe7b4159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:22.120 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.117+0000 7fe7b37fe640 1 --2- 172.21.15.162:0/2585582631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b4155ce0 0x7fe7b413b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:22.123 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.121+0000 7fe7b2ffd640 1 -- 172.21.15.162:0/2585582631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b4155ce0 msgr2=0x7fe7b413b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:22.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.121+0000 7fe7b2ffd640 1 --2- 172.21.15.162:0/2585582631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b4155ce0 0x7fe7b413b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:22.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.121+0000 7fe7b2ffd640 1 -- 172.21.15.162:0/2585582631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b4155240 msgr2=0x7fe7b4159da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:22.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.121+0000 7fe7b2ffd640 1 --2- 172.21.15.162:0/2585582631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b4155240 0x7fe7b4159da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:22.124 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.121+0000 7fe7b2ffd640 1 -- 172.21.15.162:0/2585582631 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7b4159300 con 0x7fe7b4154e60 2024-04-25T03:10:22.126 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.125+0000 7fe7b2ffd640 1 --2- 172.21.15.162:0/2585582631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7b4154e60 0x7fe7b41ee7f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400ca70 tx=0x7fe7a400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:22.130 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.129+0000 7fe79bfff640 1 -- 172.21.15.162:0/2585582631 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4018070 con 0x7fe7b4154e60 2024-04-25T03:10:22.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.129+0000 7fe79bfff640 1 -- 172.21.15.162:0/2585582631 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe7a4004cc0 con 0x7fe7b4154e60 2024-04-25T03:10:22.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.129+0000 7fe79bfff640 1 -- 172.21.15.162:0/2585582631 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4007310 con 0x7fe7b4154e60 2024-04-25T03:10:22.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.129+0000 7fe7b98b5640 1 -- 172.21.15.162:0/2585582631 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7b415a2e0 con 0x7fe7b4154e60 2024-04-25T03:10:22.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.129+0000 7fe7b98b5640 1 -- 172.21.15.162:0/2585582631 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7b415afe0 con 0x7fe7b4154e60 2024-04-25T03:10:22.131 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.129+0000 7fe7b98b5640 1 -- 172.21.15.162:0/2585582631 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7b4152190 con 0x7fe7b4154e60 2024-04-25T03:10:22.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.149+0000 7fe79bfff640 1 -- 172.21.15.162:0/2585582631 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe7a401b070 con 0x7fe7b4154e60 2024-04-25T03:10:22.150 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.149+0000 7fe79bfff640 1 --2- 172.21.15.162:0/2585582631 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe7a0067940 0x7fe7a0069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:22.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.149+0000 7fe7b27fc640 1 --2- 172.21.15.162:0/2585582631 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe7a0067940 0x7fe7a0069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:22.151 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.149+0000 7fe7b27fc640 1 --2- 172.21.15.162:0/2585582631 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe7a0067940 0x7fe7a0069e00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40cb500 tx=0x7fe7a80094c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:22.153 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.153+0000 7fe79bfff640 1 -- 172.21.15.162:0/2585582631 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7fe7a4054040 con 0x7fe7b4154e60 2024-04-25T03:10:22.431 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.429+0000 7fe79bfff640 1 -- 172.21.15.162:0/2585582631 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fe7a4022020 con 0x7fe7b4154e60 2024-04-25T03:10:22.612 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.609+0000 7fe7b98b5640 1 -- 172.21.15.162:0/2585582631 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7b404f5f0 con 0x7fe7b4154e60 2024-04-25T03:10:22.686 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.685+0000 7fe79bfff640 1 -- 172.21.15.162:0/2585582631 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) ==== 74+0+16835 (secure 0 0 0) 0x7fe7a4055d40 con 0x7fe7b4154e60 2024-04-25T03:10:22.687 INFO:teuthology.orchestra.run.smithi162.stdout: 2024-04-25T03:10:22.687 INFO:teuthology.orchestra.run.smithi162.stdout:{"epoch":28,"fsid":"e141deed-4794-4a17-83c9-f6e6e8875f5e","created":"2024-04-25T00:49:29.904605+0000","modified":"2024-04-25T00:51:40.137155+0000","last_up_change":"2024-04-25T00:49:51.119342+0000","last_in_change":"2024-04-25T00:49:39.898293+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T00:49:52.297093+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T00:50:31.644475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T00:50:33.242786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e20986cc-3664-4988-959c-c0b02e380775","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6810","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6811","nonce":2734546478}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6812","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6813","nonce":2734546478}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6816","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6817","nonce":2734546478}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6814","nonce":2734546478},{"type":"v1","addr":"172.21.15.162:6815","nonce":2734546478}]},"public_addr":"172.21.15.162:6811/2734546478","cluster_addr":"172.21.15.162:6813/2734546478","heartbeat_back_addr":"172.21.15.162:6817/2734546478","heartbeat_front_addr":"172.21.15.162:6815/2734546478","state":["exists","up"]},{"osd":1,"uuid":"60f1608a-ecb7-4978-b816-ce6f419e275d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6802","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6803","nonce":3488816098}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6804","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6805","nonce":3488816098}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6808","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6809","nonce":3488816098}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6806","nonce":3488816098},{"type":"v1","addr":"172.21.15.162:6807","nonce":3488816098}]},"public_addr":"172.21.15.162:6803/3488816098","cluster_addr":"172.21.15.162:6805/3488816098","heartbeat_back_addr":"172.21.15.162:6809/3488816098","heartbeat_front_addr":"172.21.15.162:6807/3488816098","state":["exists","up"]},{"osd":2,"uuid":"77552061-8e19-4f49-bc3f-1300955a07b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6818","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6819","nonce":234337516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6820","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6821","nonce":234337516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6824","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6825","nonce":234337516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6822","nonce":234337516},{"type":"v1","addr":"172.21.15.162:6823","nonce":234337516}]},"public_addr":"172.21.15.162:6819/234337516","cluster_addr":"172.21.15.162:6821/234337516","heartbeat_back_addr":"172.21.15.162:6825/234337516","heartbeat_front_addr":"172.21.15.162:6823/234337516","state":["exists","up"]},{"osd":3,"uuid":"5b105720-6e6d-4143-b5c4-0a3b1e4a687c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6826","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6827","nonce":1726903362}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6828","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6829","nonce":1726903362}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6832","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6833","nonce":1726903362}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.162:6830","nonce":1726903362},{"type":"v1","addr":"172.21.15.162:6831","nonce":1726903362}]},"public_addr":"172.21.15.162:6827/1726903362","cluster_addr":"172.21.15.162:6829/1726903362","heartbeat_back_addr":"172.21.15.162:6833/1726903362","heartbeat_front_addr":"172.21.15.162:6831/1726903362","state":["exists","up"]},{"osd":4,"uuid":"611eafc5-2fe0-4c96-ba8c-b1efc3930de1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6816","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6817","nonce":3338082657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6818","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6819","nonce":3338082657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6822","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6823","nonce":3338082657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6820","nonce":3338082657},{"type":"v1","addr":"172.21.15.179:6821","nonce":3338082657}]},"public_addr":"172.21.15.179:6817/3338082657","cluster_addr":"172.21.15.179:6819/3338082657","heartbeat_back_addr":"172.21.15.179:6823/3338082657","heartbeat_front_addr":"172.21.15.179:6821/3338082657","state":["exists","up"]},{"osd":5,"uuid":"b39487f5-c314-4026-90bd-02e30ecca04f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6824","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6825","nonce":4129338239}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6826","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6827","nonce":4129338239}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6830","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6831","nonce":4129338239}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6828","nonce":4129338239},{"type":"v1","addr":"172.21.15.179:6829","nonce":4129338239}]},"public_addr":"172.21.15.179:6825/4129338239","cluster_addr":"172.21.15.179:6827/4129338239","heartbeat_back_addr":"172.21.15.179:6831/4129338239","heartbeat_front_addr":"172.21.15.179:6829/4129338239","state":["exists","up"]},{"osd":6,"uuid":"1d902755-f992-4070-b30e-e79f5fb22d7f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6801","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6802","nonce":823843016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6804","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6806","nonce":823843016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6812","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6815","nonce":823843016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6808","nonce":823843016},{"type":"v1","addr":"172.21.15.179:6810","nonce":823843016}]},"public_addr":"172.21.15.179:6802/823843016","cluster_addr":"172.21.15.179:6806/823843016","heartbeat_back_addr":"172.21.15.179:6815/823843016","heartbeat_front_addr":"172.21.15.179:6810/823843016","state":["exists","up"]},{"osd":7,"uuid":"ea529f85-28fd-4dc3-a584-314e71999061","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6800","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6803","nonce":3403659125}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6805","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6807","nonce":3403659125}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6813","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6814","nonce":3403659125}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.179:6809","nonce":3403659125},{"type":"v1","addr":"172.21.15.179:6811","nonce":3403659125}]},"public_addr":"172.21.15.179:6803/3403659125","cluster_addr":"172.21.15.179:6807/3403659125","heartbeat_back_addr":"172.21.15.179:6814/3403659125","heartbeat_front_addr":"172.21.15.179:6811/3403659125","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.684518+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.583123+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.644576+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.815957+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.787155+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.814409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.657210+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T00:49:45.676697+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T03:10:22.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.689+0000 7fe7b98b5640 1 -- 172.21.15.162:0/2585582631 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe7a0067940 msgr2=0x7fe7a0069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:22.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.689+0000 7fe7b98b5640 1 --2- 172.21.15.162:0/2585582631 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe7a0067940 0x7fe7a0069e00 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40cb500 tx=0x7fe7a80094c0 comp rx=0 tx=0).stop 2024-04-25T03:10:22.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.689+0000 7fe7b98b5640 1 -- 172.21.15.162:0/2585582631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7b4154e60 msgr2=0x7fe7b41ee7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:22.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.689+0000 7fe7b98b5640 1 --2- 172.21.15.162:0/2585582631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7b4154e60 0x7fe7b41ee7f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe7a400ca70 tx=0x7fe7a400cf30 comp rx=0 tx=0).stop 2024-04-25T03:10:22.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.689+0000 7fe7b98b5640 1 -- 172.21.15.162:0/2585582631 shutdown_connections 2024-04-25T03:10:22.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.689+0000 7fe7b98b5640 1 --2- 172.21.15.162:0/2585582631 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fe7b4155ce0 0x7fe7b413b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:22.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.689+0000 7fe7b98b5640 1 --2- 172.21.15.162:0/2585582631 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fe7b4155240 0x7fe7b4159da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:22.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.689+0000 7fe7b98b5640 1 --2- 172.21.15.162:0/2585582631 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fe7a0067940 0x7fe7a0069e00 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:22.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.689+0000 7fe7b98b5640 1 --2- 172.21.15.162:0/2585582631 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fe7b4154e60 0x7fe7b41ee7f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:22.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.689+0000 7fe7b98b5640 1 -- 172.21.15.162:0/2585582631 >> 172.21.15.162:0/2585582631 conn(0x7fe7b40c83c0 msgr2=0x7fe7b40c9ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:10:22.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.689+0000 7fe7b98b5640 1 -- 172.21.15.162:0/2585582631 shutdown_connections 2024-04-25T03:10:22.690 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.689+0000 7fe7b98b5640 1 -- 172.21.15.162:0/2585582631 wait complete. 2024-04-25T03:10:22.715 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T03:10:22.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.841+0000 7fb960b9a640 1 Processor -- start 2024-04-25T03:10:22.842 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.841+0000 7fb960b9a640 1 -- start start 2024-04-25T03:10:22.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.841+0000 7fb960b9a640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb95c066fc0 0x7fb95c06b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:22.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.841+0000 7fb960b9a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb95c0c5fe0 0x7fb95c158c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:22.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.841+0000 7fb960b9a640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb95c067490 con 0x7fb95c0c5c00 2024-04-25T03:10:22.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.841+0000 7fb960b9a640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fb95c15b790 con 0x7fb95c066fc0 2024-04-25T03:10:22.843 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.841+0000 7fb960b9a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb95c15c310 con 0x7fb95c0c5fe0 2024-04-25T03:10:22.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.841+0000 7fb959d9b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb95c066fc0 0x7fb95c06b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:22.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.841+0000 7fb959d9b640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fb95c066fc0 0x7fb95c06b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34298/0 (socket says 172.21.15.162:34298) 2024-04-25T03:10:22.844 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.841+0000 7fb959d9b640 1 -- 172.21.15.162:0/1373208394 learned_addr learned my addr 172.21.15.162:0/1373208394 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:10:22.845 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.841+0000 7fb95ad9d640 1 --2- 172.21.15.162:0/1373208394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb95c0c5fe0 0x7fb95c158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:22.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.845+0000 7fb959d9b640 1 -- 172.21.15.162:0/1373208394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb95c0c5fe0 msgr2=0x7fb95c158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:10:22.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.845+0000 7fb959d9b640 1 --2- 172.21.15.162:0/1373208394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb95c0c5fe0 0x7fb95c158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:22.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.845+0000 7fb959d9b640 1 -- 172.21.15.162:0/1373208394 >> v1:172.21.15.162:6789/0 conn(0x7fb95c0c5c00 legacy=0x7fb95c13dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:10:22.847 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.845+0000 7fb959d9b640 1 -- 172.21.15.162:0/1373208394 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95c15b9e0 con 0x7fb95c066fc0 2024-04-25T03:10:22.851 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.849+0000 7fb959d9b640 1 --2- 172.21.15.162:0/1373208394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c066fc0 0x7fb95c06b210 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb95c15b910 tx=0x7fb95001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8cd37e04f05610 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:22.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.853+0000 7fb95959a640 1 -- 172.21.15.162:0/1373208394 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9500b0070 con 0x7fb95c066fc0 2024-04-25T03:10:22.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.853+0000 7fb95959a640 1 -- 172.21.15.162:0/1373208394 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb9500ab600 con 0x7fb95c066fc0 2024-04-25T03:10:22.856 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.853+0000 7fb95959a640 1 -- 172.21.15.162:0/1373208394 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9500ab9f0 con 0x7fb95c066fc0 2024-04-25T03:10:22.857 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.853+0000 7fb960b9a640 1 -- 172.21.15.162:0/1373208394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c066fc0 msgr2=0x7fb95c06b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:22.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb960b9a640 1 --2- 172.21.15.162:0/1373208394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c066fc0 0x7fb95c06b210 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb95c15b910 tx=0x7fb95001c500 comp rx=0 tx=0).stop 2024-04-25T03:10:22.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb960b9a640 1 -- 172.21.15.162:0/1373208394 shutdown_connections 2024-04-25T03:10:22.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb960b9a640 1 --2- 172.21.15.162:0/1373208394 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb95c0c5fe0 0x7fb95c158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:22.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb960b9a640 1 --2- 172.21.15.162:0/1373208394 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c066fc0 0x7fb95c06b210 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:22.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb960b9a640 1 -- 172.21.15.162:0/1373208394 >> 172.21.15.162:0/1373208394 conn(0x7fb95c06fa80 msgr2=0x7fb95c06fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:10:22.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb960b9a640 1 -- 172.21.15.162:0/1373208394 shutdown_connections 2024-04-25T03:10:22.858 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb960b9a640 1 -- 172.21.15.162:0/1373208394 wait complete. 2024-04-25T03:10:22.859 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb960b9a640 1 Processor -- start 2024-04-25T03:10:22.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb960b9a640 1 -- start start 2024-04-25T03:10:22.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb960b9a640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c066fc0 0x7fb95c139310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:22.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb960b9a640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb95c0c5c00 0x7fb95c0cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:22.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb960b9a640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb95c0c5fe0 0x7fb95c0ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:22.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb960b9a640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c164b30 con 0x7fb95c066fc0 2024-04-25T03:10:22.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb960b9a640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fb95c13e400 con 0x7fb95c0c5c00 2024-04-25T03:10:22.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb960b9a640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fb95c164cb0 con 0x7fb95c0c5fe0 2024-04-25T03:10:22.860 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb95a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c066fc0 0x7fb95c139310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:22.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb95a59c640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c066fc0 0x7fb95c139310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34304/0 (socket says 172.21.15.162:34304) 2024-04-25T03:10:22.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb95a59c640 1 -- 172.21.15.162:0/3077861434 learned_addr learned my addr 172.21.15.162:0/3077861434 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:10:22.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb959d9b640 1 --2- 172.21.15.162:0/3077861434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb95c0c5c00 0x7fb95c0cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:22.861 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.857+0000 7fb95ad9d640 1 --2- 172.21.15.162:0/3077861434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb95c0c5fe0 0x7fb95c0ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:22.863 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.861+0000 7fb95a59c640 1 -- 172.21.15.162:0/3077861434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb95c0c5fe0 msgr2=0x7fb95c0ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:22.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.861+0000 7fb95a59c640 1 --2- 172.21.15.162:0/3077861434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb95c0c5fe0 0x7fb95c0ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:22.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.861+0000 7fb95a59c640 1 -- 172.21.15.162:0/3077861434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb95c0c5c00 msgr2=0x7fb95c0cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:22.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.861+0000 7fb95a59c640 1 --2- 172.21.15.162:0/3077861434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb95c0c5c00 0x7fb95c0cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:22.864 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.861+0000 7fb95a59c640 1 -- 172.21.15.162:0/3077861434 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95c1fac40 con 0x7fb95c066fc0 2024-04-25T03:10:22.866 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.865+0000 7fb95a59c640 1 --2- 172.21.15.162:0/3077861434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c066fc0 0x7fb95c139310 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb95400c7d0 tx=0x7fb95400cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:22.870 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.869+0000 7fb94affd640 1 -- 172.21.15.162:0/3077861434 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb954017070 con 0x7fb95c066fc0 2024-04-25T03:10:22.870 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.869+0000 7fb94affd640 1 -- 172.21.15.162:0/3077861434 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fb954003db0 con 0x7fb95c066fc0 2024-04-25T03:10:22.870 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.869+0000 7fb94affd640 1 -- 172.21.15.162:0/3077861434 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9540052d0 con 0x7fb95c066fc0 2024-04-25T03:10:22.870 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.869+0000 7fb960b9a640 1 -- 172.21.15.162:0/3077861434 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb95c1faf20 con 0x7fb95c066fc0 2024-04-25T03:10:22.870 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.869+0000 7fb960b9a640 1 -- 172.21.15.162:0/3077861434 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb95c1fb4e0 con 0x7fb95c066fc0 2024-04-25T03:10:22.871 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:22.869+0000 7fb960b9a640 1 -- 172.21.15.162:0/3077861434 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb95c075110 con 0x7fb95c066fc0 2024-04-25T03:10:23.137 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.133+0000 7fb94affd640 1 -- 172.21.15.162:0/3077861434 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb954006b20 con 0x7fb95c066fc0 2024-04-25T03:10:23.138 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.137+0000 7fb94affd640 1 --2- 172.21.15.162:0/3077861434 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb93c0678c0 0x7fb93c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:23.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.137+0000 7fb959d9b640 1 --2- 172.21.15.162:0/3077861434 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb93c0678c0 0x7fb93c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:23.139 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.137+0000 7fb959d9b640 1 --2- 172.21.15.162:0/3077861434 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb93c0678c0 0x7fb93c069d80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb9500ad000 tx=0x7fb950008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:23.174 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.173+0000 7fb94affd640 1 -- 172.21.15.162:0/3077861434 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5825+0+0 (secure 0 0 0) 0x7fb954053bb0 con 0x7fb95c066fc0 2024-04-25T03:10:23.175 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.173+0000 7fb94affd640 1 -- 172.21.15.162:0/3077861434 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fb95400ce20 con 0x7fb95c066fc0 2024-04-25T03:10:23.476 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.473+0000 7fb960b9a640 1 -- 172.21.15.162:0/3077861434 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb95c152870 con 0x7fb95c066fc0 2024-04-25T03:10:23.714 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.713+0000 7fb94affd640 1 -- 172.21.15.162:0/3077861434 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) ==== 161+0+0 (secure 0 0 0) 0x7fb9540558b0 con 0x7fb95c066fc0 2024-04-25T03:10:23.714 INFO:teuthology.orchestra.run.smithi162.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T03:10:23.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.713+0000 7fb960b9a640 1 -- 172.21.15.162:0/3077861434 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb93c0678c0 msgr2=0x7fb93c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:23.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.713+0000 7fb960b9a640 1 --2- 172.21.15.162:0/3077861434 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb93c0678c0 0x7fb93c069d80 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb9500ad000 tx=0x7fb950008040 comp rx=0 tx=0).stop 2024-04-25T03:10:23.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.713+0000 7fb960b9a640 1 -- 172.21.15.162:0/3077861434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c066fc0 msgr2=0x7fb95c139310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:23.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.713+0000 7fb960b9a640 1 --2- 172.21.15.162:0/3077861434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c066fc0 0x7fb95c139310 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fb95400c7d0 tx=0x7fb95400cbd0 comp rx=0 tx=0).stop 2024-04-25T03:10:23.717 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.713+0000 7fb960b9a640 1 -- 172.21.15.162:0/3077861434 shutdown_connections 2024-04-25T03:10:23.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.713+0000 7fb960b9a640 1 --2- 172.21.15.162:0/3077861434 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fb95c0c5fe0 0x7fb95c0ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:23.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.713+0000 7fb960b9a640 1 --2- 172.21.15.162:0/3077861434 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fb95c0c5c00 0x7fb95c0cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:23.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.713+0000 7fb960b9a640 1 --2- 172.21.15.162:0/3077861434 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fb93c0678c0 0x7fb93c069d80 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:23.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.713+0000 7fb960b9a640 1 --2- 172.21.15.162:0/3077861434 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fb95c066fc0 0x7fb95c139310 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:23.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.713+0000 7fb960b9a640 1 -- 172.21.15.162:0/3077861434 >> 172.21.15.162:0/3077861434 conn(0x7fb95c06fa80 msgr2=0x7fb95c13c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:10:23.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.717+0000 7fb960b9a640 1 -- 172.21.15.162:0/3077861434 shutdown_connections 2024-04-25T03:10:23.718 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.717+0000 7fb960b9a640 1 -- 172.21.15.162:0/3077861434 wait complete. 2024-04-25T03:10:23.741 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T03:10:23.876 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.873+0000 7f59278a2640 1 Processor -- start 2024-04-25T03:10:23.877 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.873+0000 7f59278a2640 1 -- start start 2024-04-25T03:10:23.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.877+0000 7f59278a2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59201523e0 0x7f59200cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:23.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.877+0000 7f59278a2640 1 -- --> v1:172.21.15.162:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f592015b790 con 0x7f592015c230 2024-04-25T03:10:23.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.877+0000 7f59278a2640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5920158a60 con 0x7f59200cd440 2024-04-25T03:10:23.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.877+0000 7f59278a2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f592015c6c0 con 0x7f59201523e0 2024-04-25T03:10:23.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.877+0000 7f5925e3f640 1 --1- >> v1:172.21.15.162:6789/0 conn(0x7f592015c230 0x7f5920071380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.162:6789/0 says I am v1:172.21.15.162:37896/0 (socket says 172.21.15.162:37896) 2024-04-25T03:10:23.878 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.877+0000 7f5925e3f640 1 -- 172.21.15.162:0/3191721171 learned_addr learned my addr 172.21.15.162:0/3191721171 (peer_addr_for_me v1:172.21.15.162:0/0) 2024-04-25T03:10:23.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.881+0000 7f5917fff640 1 -- 172.21.15.162:0/3191721171 <== mon.0 v1:172.21.15.162:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3507032226 0 0) 0x7f592015b790 con 0x7f592015c230 2024-04-25T03:10:23.882 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.881+0000 7f5917fff640 1 -- 172.21.15.162:0/3191721171 --> v1:172.21.15.162:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f590c003530 con 0x7f592015c230 2024-04-25T03:10:23.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.885+0000 7f5917fff640 1 -- 172.21.15.162:0/3191721171 <== mon.0 v1:172.21.15.162:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3854844205 0 0) 0x7f590c003530 con 0x7f592015c230 2024-04-25T03:10:23.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.885+0000 7f5917fff640 1 -- 172.21.15.162:0/3191721171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59201523e0 msgr2=0x7f59200cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:10:23.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.885+0000 7f5917fff640 1 --2- 172.21.15.162:0/3191721171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59201523e0 0x7f59200cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:23.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.885+0000 7f5917fff640 1 -- 172.21.15.162:0/3191721171 >> v1:172.21.15.179:6789/0 conn(0x7f59200cd440 legacy=0x7f59201581a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:10:23.888 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.885+0000 7f5917fff640 1 -- 172.21.15.162:0/3191721171 --> v1:172.21.15.162:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5920158d40 con 0x7f592015c230 2024-04-25T03:10:23.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.889+0000 7f5917fff640 1 -- 172.21.15.162:0/3191721171 <== mon.0 v1:172.21.15.162:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796081654 0 0) 0x7f5918001a00 con 0x7f592015c230 2024-04-25T03:10:23.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.889+0000 7f5917fff640 1 -- 172.21.15.162:0/3191721171 >> v1:172.21.15.162:6789/0 conn(0x7f592015c230 legacy=0x7f5920071380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:23.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.889+0000 7f5917fff640 1 --2- 172.21.15.162:0/3191721171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f590c0039f0 0x7f590c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:23.889 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.889+0000 7f5917fff640 1 --2- 172.21.15.162:0/3191721171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59201523e0 0x7f590c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:23.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.889+0000 7f5917fff640 1 --2- 172.21.15.162:0/3191721171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590c004dc0 0x7f590c005240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:23.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.889+0000 7f5917fff640 1 -- 172.21.15.162:0/3191721171 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f590c00bc40 con 0x7f590c004dc0 2024-04-25T03:10:23.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.889+0000 7f5917fff640 1 -- 172.21.15.162:0/3191721171 --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f590c00bdf0 con 0x7f590c0039f0 2024-04-25T03:10:23.890 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.889+0000 7f5917fff640 1 -- 172.21.15.162:0/3191721171 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f590c00bff0 con 0x7f59201523e0 2024-04-25T03:10:23.892 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.889+0000 7f5924e3d640 1 --2- 172.21.15.162:0/3191721171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59201523e0 0x7f590c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:23.893 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.893+0000 7f5925e3f640 1 --2- 172.21.15.162:0/3191721171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590c004dc0 0x7f590c005240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:23.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.897+0000 7f5925e3f640 1 -- 172.21.15.162:0/3191721171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59201523e0 msgr2=0x7f590c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:10:23.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.897+0000 7f5925e3f640 1 --2- 172.21.15.162:0/3191721171 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f59201523e0 0x7f590c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:23.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.897+0000 7f5925e3f640 1 -- 172.21.15.162:0/3191721171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f590c0039f0 msgr2=0x7f590c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:10:23.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.897+0000 7f5925e3f640 1 --2- 172.21.15.162:0/3191721171 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f590c0039f0 0x7f590c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:23.898 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.897+0000 7f5925e3f640 1 -- 172.21.15.162:0/3191721171 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f590c003530 con 0x7f590c004dc0 2024-04-25T03:10:23.904 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.901+0000 7f5925e3f640 1 --2- 172.21.15.162:0/3191721171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590c004dc0 0x7f590c005240 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f591800a870 tx=0x7f591801d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2963b63dfd1515ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:23.908 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.905+0000 7f5917fff640 1 -- 172.21.15.162:0/3191721171 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591800a470 con 0x7f590c004dc0 2024-04-25T03:10:23.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.905+0000 7f5917fff640 1 -- 172.21.15.162:0/3191721171 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f59180072d0 con 0x7f590c004dc0 2024-04-25T03:10:23.909 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.905+0000 7f5917fff640 1 -- 172.21.15.162:0/3191721171 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59180076e0 con 0x7f590c004dc0 2024-04-25T03:10:23.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.909+0000 7f59278a2640 1 -- 172.21.15.162:0/3191721171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590c004dc0 msgr2=0x7f590c005240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:23.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.909+0000 7f59278a2640 1 --2- 172.21.15.162:0/3191721171 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f590c004dc0 0x7f590c005240 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f591800a870 tx=0x7f591801d2e0 comp rx=0 tx=0).stop 2024-04-25T03:10:23.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.909+0000 7f5925e3f640 1 -- 172.21.15.162:0/3191721171 reap_dead start 2024-04-25T03:10:23.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.909+0000 7f59278a2640 1 -- 172.21.15.162:0/3191721171 shutdown_connections 2024-04-25T03:10:23.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.909+0000 7f59278a2640 1 -- 172.21.15.162:0/3191721171 >> 172.21.15.162:0/3191721171 conn(0x7f592006b810 msgr2=0x7f592006f730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:10:23.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.909+0000 7f59278a2640 1 -- 172.21.15.162:0/3191721171 shutdown_connections 2024-04-25T03:10:23.910 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.909+0000 7f59278a2640 1 -- 172.21.15.162:0/3191721171 wait complete. 2024-04-25T03:10:23.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.909+0000 7f59278a2640 1 Processor -- start 2024-04-25T03:10:23.912 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.909+0000 7f59278a2640 1 -- start start 2024-04-25T03:10:23.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.913+0000 7f59278a2640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f590c004dc0 0x7f592014bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:23.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.913+0000 7f59278a2640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59200c9d90 0x7f59200ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:23.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.913+0000 7f59278a2640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59200c8b40 0x7f59200c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:23.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.913+0000 7f59278a2640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f592015bd10 con 0x7f59200c9d90 2024-04-25T03:10:23.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.913+0000 7f59278a2640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f592015ba30 con 0x7f59200c8b40 2024-04-25T03:10:23.913 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.913+0000 7f59278a2640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f59201527c0 con 0x7f590c004dc0 2024-04-25T03:10:23.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.913+0000 7f5924e3d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59200c9d90 0x7f59200ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:23.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.913+0000 7f592563e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f590c004dc0 0x7f592014bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:23.914 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.913+0000 7f5924e3d640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59200c9d90 0x7f59200ca1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34308/0 (socket says 172.21.15.162:34308) 2024-04-25T03:10:23.915 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.913+0000 7f5924e3d640 1 -- 172.21.15.162:0/1605764697 learned_addr learned my addr 172.21.15.162:0/1605764697 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:10:23.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.917+0000 7f5924e3d640 1 -- 172.21.15.162:0/1605764697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f590c004dc0 msgr2=0x7f592014bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:23.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.917+0000 7f5924e3d640 1 --2- 172.21.15.162:0/1605764697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f590c004dc0 0x7f592014bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:23.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.917+0000 7f5924e3d640 1 -- 172.21.15.162:0/1605764697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59200c8b40 msgr2=0x7f59200c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:23.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.917+0000 7f5924e3d640 1 --2- 172.21.15.162:0/1605764697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59200c8b40 0x7f59200c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:23.918 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.917+0000 7f5924e3d640 1 -- 172.21.15.162:0/1605764697 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5920158200 con 0x7f59200c9d90 2024-04-25T03:10:23.921 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.917+0000 7f5924e3d640 1 --2- 172.21.15.162:0/1605764697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59200c9d90 0x7f59200ca1f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f591000f670 tx=0x7f591000fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:23.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.921+0000 7f5915ffb640 1 -- 172.21.15.162:0/1605764697 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59100050d0 con 0x7f59200c9d90 2024-04-25T03:10:23.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.921+0000 7f59278a2640 1 -- 172.21.15.162:0/1605764697 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5920157f60 con 0x7f59200c9d90 2024-04-25T03:10:23.924 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.921+0000 7f59278a2640 1 -- 172.21.15.162:0/1605764697 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59201ef8b0 con 0x7f59200c9d90 2024-04-25T03:10:23.925 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.925+0000 7f59278a2640 1 -- 172.21.15.162:0/1605764697 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5920075110 con 0x7f59200c9d90 2024-04-25T03:10:23.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.925+0000 7f5915ffb640 1 -- 172.21.15.162:0/1605764697 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5910018070 con 0x7f59200c9d90 2024-04-25T03:10:23.926 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:23.925+0000 7f5915ffb640 1 -- 172.21.15.162:0/1605764697 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5910005470 con 0x7f59200c9d90 2024-04-25T03:10:24.190 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:24.189+0000 7f5915ffb640 1 -- 172.21.15.162:0/1605764697 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f591000d730 con 0x7f59200c9d90 2024-04-25T03:10:24.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:24.189+0000 7f5915ffb640 1 --2- 172.21.15.162:0/1605764697 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f59040678c0 0x7f5904069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:24.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:24.189+0000 7f592563e640 1 --2- 172.21.15.162:0/1605764697 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f59040678c0 0x7f5904069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:24.191 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:24.189+0000 7f592563e640 1 --2- 172.21.15.162:0/1605764697 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f59040678c0 0x7f5904069d80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f591c006fd0 tx=0x7f591c0090e0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:24.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:24.201+0000 7f5915ffb640 1 -- 172.21.15.162:0/1605764697 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6255+0+0 (secure 0 0 0) 0x7f5910054c90 con 0x7f59200c9d90 2024-04-25T03:10:24.205 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:24.201+0000 7f5915ffb640 1 -- 172.21.15.162:0/1605764697 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f5910057090 con 0x7f59200c9d90 2024-04-25T03:10:24.415 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:24.413+0000 7f59278a2640 1 -- 172.21.15.162:0/1605764697 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f59200b2b10 con 0x7f59200c9d90 2024-04-25T03:10:25.336 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.333+0000 7f5915ffb640 1 -- 172.21.15.162:0/1605764697 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) ==== 104+0+0 (secure 0 0 0) 0x7f5910056990 con 0x7f59200c9d90 2024-04-25T03:10:25.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.337+0000 7f59278a2640 1 -- 172.21.15.162:0/1605764697 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f59040678c0 msgr2=0x7f5904069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:25.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.337+0000 7f59278a2640 1 --2- 172.21.15.162:0/1605764697 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f59040678c0 0x7f5904069d80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f591c006fd0 tx=0x7f591c0090e0 comp rx=0 tx=0).stop 2024-04-25T03:10:25.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.337+0000 7f59278a2640 1 -- 172.21.15.162:0/1605764697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59200c9d90 msgr2=0x7f59200ca1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:25.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.337+0000 7f59278a2640 1 --2- 172.21.15.162:0/1605764697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59200c9d90 0x7f59200ca1f0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f591000f670 tx=0x7f591000fb30 comp rx=0 tx=0).stop 2024-04-25T03:10:25.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.337+0000 7f59278a2640 1 -- 172.21.15.162:0/1605764697 shutdown_connections 2024-04-25T03:10:25.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.337+0000 7f59278a2640 1 --2- 172.21.15.162:0/1605764697 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f59200c8b40 0x7f59200c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:25.339 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.337+0000 7f59278a2640 1 --2- 172.21.15.162:0/1605764697 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f59040678c0 0x7f5904069d80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:25.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.337+0000 7f59278a2640 1 --2- 172.21.15.162:0/1605764697 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f59200c9d90 0x7f59200ca1f0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:25.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.337+0000 7f59278a2640 1 --2- 172.21.15.162:0/1605764697 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f590c004dc0 0x7f592014bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:25.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.337+0000 7f59278a2640 1 -- 172.21.15.162:0/1605764697 >> 172.21.15.162:0/1605764697 conn(0x7f592006b810 msgr2=0x7f59200c3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:10:25.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.337+0000 7f59278a2640 1 -- 172.21.15.162:0/1605764697 shutdown_connections 2024-04-25T03:10:25.340 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.337+0000 7f59278a2640 1 -- 172.21.15.162:0/1605764697 wait complete. 2024-04-25T03:10:25.359 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T03:10:25.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.489+0000 7fc9e646e640 1 Processor -- start 2024-04-25T03:10:25.491 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.489+0000 7fc9e646e640 1 -- start start 2024-04-25T03:10:25.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.489+0000 7fc9e646e640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc9e01526a0 0x7fc9e01581f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:25.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.489+0000 7fc9e646e640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7fc9e006b210 0x7fc9e00c6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:25.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.489+0000 7fc9e646e640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9e0159140 con 0x7fc9e01522c0 2024-04-25T03:10:25.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.489+0000 7fc9e646e640 1 -- --> v2:172.21.15.162:3300/0 -- mon_getmap magic: 0 -- 0x7fc9e015c790 con 0x7fc9e01526a0 2024-04-25T03:10:25.492 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.489+0000 7fc9e646e640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7fc9e01588a0 con 0x7fc9e006b210 2024-04-25T03:10:25.545 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.545+0000 7fc9d7fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc9e01526a0 0x7fc9e01581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:25.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.545+0000 7fc9d7fff640 1 --2- >> v2:172.21.15.162:3300/0 conn(0x7fc9e01526a0 0x7fc9e01581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34316/0 (socket says 172.21.15.162:34316) 2024-04-25T03:10:25.546 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.545+0000 7fc9d7fff640 1 -- 172.21.15.162:0/3143257973 learned_addr learned my addr 172.21.15.162:0/3143257973 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:10:25.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.545+0000 7fc9d7fff640 1 -- 172.21.15.162:0/3143257973 >> v2:172.21.15.179:3300/0 conn(0x7fc9e006b210 msgr2=0x7fc9e00c6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:10:25.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.545+0000 7fc9d7fff640 1 --2- 172.21.15.162:0/3143257973 >> v2:172.21.15.179:3300/0 conn(0x7fc9e006b210 0x7fc9e00c6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:25.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.545+0000 7fc9d7fff640 1 -- 172.21.15.162:0/3143257973 >> v1:172.21.15.179:6789/0 conn(0x7fc9e01522c0 legacy=0x7fc9e015c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:10:25.548 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.545+0000 7fc9d7fff640 1 -- 172.21.15.162:0/3143257973 --> v2:172.21.15.162:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e0158b80 con 0x7fc9e01526a0 2024-04-25T03:10:25.552 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.549+0000 7fc9d7fff640 1 --2- 172.21.15.162:0/3143257973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9e01526a0 0x7fc9e01581f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc9e006f360 tx=0x7fc9c801ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737e574e893426e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:25.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.553+0000 7fc9df7fe640 1 -- 172.21.15.162:0/3143257973 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c80b5070 con 0x7fc9e01526a0 2024-04-25T03:10:25.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.553+0000 7fc9df7fe640 1 -- 172.21.15.162:0/3143257973 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc9c80a89d0 con 0x7fc9e01526a0 2024-04-25T03:10:25.557 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.553+0000 7fc9df7fe640 1 -- 172.21.15.162:0/3143257973 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9c80a8dc0 con 0x7fc9e01526a0 2024-04-25T03:10:25.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.557+0000 7fc9e646e640 1 -- 172.21.15.162:0/3143257973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9e01526a0 msgr2=0x7fc9e01581f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:25.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.557+0000 7fc9e646e640 1 --2- 172.21.15.162:0/3143257973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9e01526a0 0x7fc9e01581f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fc9e006f360 tx=0x7fc9c801ecd0 comp rx=0 tx=0).stop 2024-04-25T03:10:25.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.557+0000 7fc9e646e640 1 -- 172.21.15.162:0/3143257973 shutdown_connections 2024-04-25T03:10:25.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.557+0000 7fc9e646e640 1 --2- 172.21.15.162:0/3143257973 >> v2:172.21.15.179:3300/0 conn(0x7fc9e006b210 0x7fc9e00c6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:25.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.557+0000 7fc9e646e640 1 --2- 172.21.15.162:0/3143257973 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9e01526a0 0x7fc9e01581f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:25.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.557+0000 7fc9e646e640 1 -- 172.21.15.162:0/3143257973 >> 172.21.15.162:0/3143257973 conn(0x7fc9e0070280 msgr2=0x7fc9e0070690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:10:25.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.557+0000 7fc9e646e640 1 -- 172.21.15.162:0/3143257973 shutdown_connections 2024-04-25T03:10:25.558 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.557+0000 7fc9e646e640 1 -- 172.21.15.162:0/3143257973 wait complete. 2024-04-25T03:10:25.559 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.557+0000 7fc9e646e640 1 Processor -- start 2024-04-25T03:10:25.560 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.557+0000 7fc9e646e640 1 -- start start 2024-04-25T03:10:25.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.557+0000 7fc9e646e640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9e006b210 0x7fc9e00cd250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:25.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.557+0000 7fc9e646e640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9e01522c0 0x7fc9e01f0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:25.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.561+0000 7fc9e646e640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9e01526a0 0x7fc9e01f0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:25.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.561+0000 7fc9e646e640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e015bb60 con 0x7fc9e006b210 2024-04-25T03:10:25.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.561+0000 7fc9e646e640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7fc9e015b880 con 0x7fc9e01522c0 2024-04-25T03:10:25.561 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.561+0000 7fc9e646e640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7fc9e00c7620 con 0x7fc9e01526a0 2024-04-25T03:10:25.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.561+0000 7fc9dffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9e006b210 0x7fc9e00cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:25.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.561+0000 7fc9dffff640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9e006b210 0x7fc9e00cd250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34318/0 (socket says 172.21.15.162:34318) 2024-04-25T03:10:25.562 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.561+0000 7fc9dffff640 1 -- 172.21.15.162:0/1626667821 learned_addr learned my addr 172.21.15.162:0/1626667821 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:10:25.565 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.565+0000 7fc9d7fff640 1 --2- 172.21.15.162:0/1626667821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9e01522c0 0x7fc9e01f0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:25.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.565+0000 7fc9dffff640 1 -- 172.21.15.162:0/1626667821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9e01526a0 msgr2=0x7fc9e01f0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:25.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.565+0000 7fc9dffff640 1 --2- 172.21.15.162:0/1626667821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9e01526a0 0x7fc9e01f0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:25.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.565+0000 7fc9dffff640 1 -- 172.21.15.162:0/1626667821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9e01522c0 msgr2=0x7fc9e01f0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:25.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.565+0000 7fc9dffff640 1 --2- 172.21.15.162:0/1626667821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9e01522c0 0x7fc9e01f0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:25.566 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.565+0000 7fc9dffff640 1 -- 172.21.15.162:0/1626667821 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9e014d260 con 0x7fc9e006b210 2024-04-25T03:10:25.569 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.569+0000 7fc9dffff640 1 --2- 172.21.15.162:0/1626667821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9e006b210 0x7fc9e00cd250 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000c4c0 tx=0x7fc9d0001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:25.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.577+0000 7fc9dd7fa640 1 -- 172.21.15.162:0/1626667821 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0017070 con 0x7fc9e006b210 2024-04-25T03:10:25.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.577+0000 7fc9dd7fa640 1 -- 172.21.15.162:0/1626667821 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc9d0003600 con 0x7fc9e006b210 2024-04-25T03:10:25.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.577+0000 7fc9e646e640 1 -- 172.21.15.162:0/1626667821 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9e014d540 con 0x7fc9e006b210 2024-04-25T03:10:25.579 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.577+0000 7fc9dd7fa640 1 -- 172.21.15.162:0/1626667821 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9d0003a10 con 0x7fc9e006b210 2024-04-25T03:10:25.580 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.577+0000 7fc9e646e640 1 -- 172.21.15.162:0/1626667821 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9e014db00 con 0x7fc9e006b210 2024-04-25T03:10:25.581 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.581+0000 7fc9e646e640 1 -- 172.21.15.162:0/1626667821 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9e0075110 con 0x7fc9e006b210 2024-04-25T03:10:25.837 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.837+0000 7fc9dd7fa640 1 -- 172.21.15.162:0/1626667821 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc9d001a070 con 0x7fc9e006b210 2024-04-25T03:10:25.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.837+0000 7fc9dd7fa640 1 --2- 172.21.15.162:0/1626667821 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc9c00678c0 0x7fc9c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:25.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.837+0000 7fc9d7fff640 1 --2- 172.21.15.162:0/1626667821 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc9c00678c0 0x7fc9c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:25.838 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.837+0000 7fc9d7fff640 1 --2- 172.21.15.162:0/1626667821 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc9c00678c0 0x7fc9c0069d80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80b2000 tx=0x7fc9c80aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:25.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.853+0000 7fc9dd7fa640 1 -- 172.21.15.162:0/1626667821 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6255+0+0 (secure 0 0 0) 0x7fc9d0053c70 con 0x7fc9e006b210 2024-04-25T03:10:25.853 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:25.853+0000 7fc9dd7fa640 1 -- 172.21.15.162:0/1626667821 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7fc9d0021020 con 0x7fc9e006b210 2024-04-25T03:10:26.008 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:26.005+0000 7fc9e646e640 1 -- 172.21.15.162:0/1626667821 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fc9e00b7f30 con 0x7fc9e006b210 2024-04-25T03:10:27.096 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.092+0000 7fc9dd7fa640 1 -- 172.21.15.162:0/1626667821 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) ==== 181+0+0 (secure 0 0 0) 0x7fc9d0056070 con 0x7fc9e006b210 2024-04-25T03:10:27.096 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'cephfs_metadata' removed 2024-04-25T03:10:27.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.096+0000 7fc9e646e640 1 -- 172.21.15.162:0/1626667821 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc9c00678c0 msgr2=0x7fc9c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:27.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.096+0000 7fc9e646e640 1 --2- 172.21.15.162:0/1626667821 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc9c00678c0 0x7fc9c0069d80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc9c80b2000 tx=0x7fc9c80aa070 comp rx=0 tx=0).stop 2024-04-25T03:10:27.099 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.096+0000 7fc9e646e640 1 -- 172.21.15.162:0/1626667821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9e006b210 msgr2=0x7fc9e00cd250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:27.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.096+0000 7fc9e646e640 1 --2- 172.21.15.162:0/1626667821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9e006b210 0x7fc9e00cd250 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fc9d000c4c0 tx=0x7fc9d0001e80 comp rx=0 tx=0).stop 2024-04-25T03:10:27.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.096+0000 7fc9e646e640 1 -- 172.21.15.162:0/1626667821 shutdown_connections 2024-04-25T03:10:27.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.096+0000 7fc9e646e640 1 --2- 172.21.15.162:0/1626667821 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7fc9e01526a0 0x7fc9e01f0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:27.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.096+0000 7fc9e646e640 1 --2- 172.21.15.162:0/1626667821 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7fc9e01522c0 0x7fc9e01f0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:27.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.096+0000 7fc9e646e640 1 --2- 172.21.15.162:0/1626667821 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7fc9c00678c0 0x7fc9c0069d80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:27.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.096+0000 7fc9e646e640 1 --2- 172.21.15.162:0/1626667821 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7fc9e006b210 0x7fc9e00cd250 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:27.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.096+0000 7fc9e646e640 1 -- 172.21.15.162:0/1626667821 >> 172.21.15.162:0/1626667821 conn(0x7fc9e0070280 msgr2=0x7fc9e00c78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:10:27.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.096+0000 7fc9e646e640 1 -- 172.21.15.162:0/1626667821 shutdown_connections 2024-04-25T03:10:27.100 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.096+0000 7fc9e646e640 1 -- 172.21.15.162:0/1626667821 wait complete. 2024-04-25T03:10:27.121 DEBUG:teuthology.orchestra.run.smithi162:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T03:10:27.263 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.260+0000 7f4882dbc640 1 Processor -- start 2024-04-25T03:10:27.264 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.260+0000 7f4882dbc640 1 -- start start 2024-04-25T03:10:27.264 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.260+0000 7f4882dbc640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f487c1570d0 0x7f487c15b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:27.264 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.260+0000 7f4882dbc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f487c0c2cc0 0x7f487c072c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:27.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.260+0000 7f4882dbc640 1 -- --> v1:172.21.15.179:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f487c15a760 con 0x7f487c151410 2024-04-25T03:10:27.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.260+0000 7f4882dbc640 1 -- --> v2:172.21.15.179:3300/0 -- mon_getmap magic: 0 -- 0x7f487c157520 con 0x7f487c1570d0 2024-04-25T03:10:27.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.260+0000 7f4882dbc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f487c1517f0 con 0x7f487c0c2cc0 2024-04-25T03:10:27.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.264+0000 7f4881359640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f487c0c2cc0 0x7f487c072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:27.265 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.264+0000 7f487bfff640 1 --2- >> v2:172.21.15.179:3300/0 conn(0x7f487c1570d0 0x7f487c15b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:27.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.264+0000 7f4881359640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f487c0c2cc0 0x7f487c072c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.179:3301/0 says I am v2:172.21.15.162:58408/0 (socket says 172.21.15.162:58408) 2024-04-25T03:10:27.266 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.264+0000 7f4881359640 1 -- 172.21.15.162:0/4053459335 learned_addr learned my addr 172.21.15.162:0/4053459335 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:10:27.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.268+0000 7f4881359640 1 -- 172.21.15.162:0/4053459335 >> v2:172.21.15.179:3300/0 conn(0x7f487c1570d0 msgr2=0x7f487c15b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T03:10:27.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.268+0000 7f4881359640 1 --2- 172.21.15.162:0/4053459335 >> v2:172.21.15.179:3300/0 conn(0x7f487c1570d0 0x7f487c15b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:27.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.268+0000 7f4881359640 1 -- 172.21.15.162:0/4053459335 >> v1:172.21.15.179:6789/0 conn(0x7f487c151410 legacy=0x7f487c0c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:27.272 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.268+0000 7f4881359640 1 -- 172.21.15.162:0/4053459335 --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487c0c3430 con 0x7f487c0c2cc0 2024-04-25T03:10:27.277 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.276+0000 7f4881359640 1 --2- 172.21.15.162:0/4053459335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f487c0c2cc0 0x7f487c072c80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f486c009870 tx=0x7f486c01ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6f996e23c5e9fea server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:27.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.284+0000 7f487b7fe640 1 -- 172.21.15.162:0/4053459335 <== mon.2 v2:172.21.15.179:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c0b5070 con 0x7f487c0c2cc0 2024-04-25T03:10:27.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.284+0000 7f487b7fe640 1 -- 172.21.15.162:0/4053459335 <== mon.2 v2:172.21.15.179:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f486c0a8a50 con 0x7f487c0c2cc0 2024-04-25T03:10:27.288 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.284+0000 7f487b7fe640 1 -- 172.21.15.162:0/4053459335 <== mon.2 v2:172.21.15.179:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c0a8e40 con 0x7f487c0c2cc0 2024-04-25T03:10:27.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.284+0000 7f4882dbc640 1 -- 172.21.15.162:0/4053459335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f487c0c2cc0 msgr2=0x7f487c072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:27.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.284+0000 7f4882dbc640 1 --2- 172.21.15.162:0/4053459335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f487c0c2cc0 0x7f487c072c80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f486c009870 tx=0x7f486c01ed50 comp rx=0 tx=0).stop 2024-04-25T03:10:27.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.284+0000 7f4882dbc640 1 -- 172.21.15.162:0/4053459335 shutdown_connections 2024-04-25T03:10:27.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.284+0000 7f4882dbc640 1 --2- 172.21.15.162:0/4053459335 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f487c0c2cc0 0x7f487c072c80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:27.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.284+0000 7f4882dbc640 1 --2- 172.21.15.162:0/4053459335 >> v2:172.21.15.179:3300/0 conn(0x7f487c1570d0 0x7f487c15b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:27.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.284+0000 7f4882dbc640 1 -- 172.21.15.162:0/4053459335 >> 172.21.15.162:0/4053459335 conn(0x7f487c06b210 msgr2=0x7f487c06b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:10:27.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.284+0000 7f4882dbc640 1 -- 172.21.15.162:0/4053459335 shutdown_connections 2024-04-25T03:10:27.289 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.284+0000 7f4882dbc640 1 -- 172.21.15.162:0/4053459335 wait complete. 2024-04-25T03:10:27.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.288+0000 7f4882dbc640 1 Processor -- start 2024-04-25T03:10:27.290 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.288+0000 7f4882dbc640 1 -- start start 2024-04-25T03:10:27.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.288+0000 7f4882dbc640 1 --2- >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f487c0c2cc0 0x7f487c0c8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:27.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.288+0000 7f4882dbc640 1 --2- >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f487c151410 0x7f487c1f1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:27.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.288+0000 7f4882dbc640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f487c1570d0 0x7f487c1ee560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:27.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.288+0000 7f4882dbc640 1 -- --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_getmap magic: 0 -- 0x7f487c15acb0 con 0x7f487c1570d0 2024-04-25T03:10:27.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.288+0000 7f4882dbc640 1 -- --> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] -- mon_getmap magic: 0 -- 0x7f487c15a9d0 con 0x7f487c0c2cc0 2024-04-25T03:10:27.291 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.288+0000 7f4882dbc640 1 -- --> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] -- mon_getmap magic: 0 -- 0x7f487c0c3150 con 0x7f487c151410 2024-04-25T03:10:27.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.288+0000 7f4881359640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f487c1570d0 0x7f487c1ee560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:27.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.288+0000 7f4881359640 1 --2- >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f487c1570d0 0x7f487c1ee560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.162:3300/0 says I am v2:172.21.15.162:34322/0 (socket says 172.21.15.162:34322) 2024-04-25T03:10:27.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.288+0000 7f4881359640 1 -- 172.21.15.162:0/1058838922 learned_addr learned my addr 172.21.15.162:0/1058838922 (peer_addr_for_me v2:172.21.15.162:0/0) 2024-04-25T03:10:27.292 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.288+0000 7f4880b58640 1 --2- 172.21.15.162:0/1058838922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f487c0c2cc0 0x7f487c0c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:27.294 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.292+0000 7f487bfff640 1 --2- 172.21.15.162:0/1058838922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f487c151410 0x7f487c1f1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:27.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.292+0000 7f4881359640 1 -- 172.21.15.162:0/1058838922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f487c151410 msgr2=0x7f487c1f1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:27.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.292+0000 7f4881359640 1 --2- 172.21.15.162:0/1058838922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f487c151410 0x7f487c1f1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:27.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.292+0000 7f4881359640 1 -- 172.21.15.162:0/1058838922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f487c0c2cc0 msgr2=0x7f487c0c8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:27.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.292+0000 7f4881359640 1 --2- 172.21.15.162:0/1058838922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f487c0c2cc0 0x7f487c0c8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:27.296 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.292+0000 7f4881359640 1 -- 172.21.15.162:0/1058838922 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487c0c76b0 con 0x7f487c1570d0 2024-04-25T03:10:27.298 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.296+0000 7f4881359640 1 --2- 172.21.15.162:0/1058838922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f487c1570d0 0x7f487c1ee560 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f486c01b960 tx=0x7f486c01baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:27.302 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.300+0000 7f48797fa640 1 -- 172.21.15.162:0/1058838922 <== mon.0 v2:172.21.15.162:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c0b5040 con 0x7f487c1570d0 2024-04-25T03:10:27.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.300+0000 7f48797fa640 1 -- 172.21.15.162:0/1058838922 <== mon.0 v2:172.21.15.162:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f486c0be070 con 0x7f487c1570d0 2024-04-25T03:10:27.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.300+0000 7f48797fa640 1 -- 172.21.15.162:0/1058838922 <== mon.0 v2:172.21.15.162:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f486c0b9440 con 0x7f487c1570d0 2024-04-25T03:10:27.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.300+0000 7f4882dbc640 1 -- 172.21.15.162:0/1058838922 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f487c06dc60 con 0x7f487c1570d0 2024-04-25T03:10:27.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.300+0000 7f4882dbc640 1 -- 172.21.15.162:0/1058838922 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f487c0c7c30 con 0x7f487c1570d0 2024-04-25T03:10:27.303 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.300+0000 7f4882dbc640 1 -- 172.21.15.162:0/1058838922 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f487c068310 con 0x7f487c1570d0 2024-04-25T03:10:27.322 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.320+0000 7f48797fa640 1 -- 172.21.15.162:0/1058838922 <== mon.0 v2:172.21.15.162:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f486c0a8910 con 0x7f487c1570d0 2024-04-25T03:10:27.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.320+0000 7f48797fa640 1 --2- 172.21.15.162:0/1058838922 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f485c067910 0x7f485c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T03:10:27.323 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.320+0000 7f4880b58640 1 --2- 172.21.15.162:0/1058838922 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f485c067910 0x7f485c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T03:10:27.324 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.320+0000 7f4880b58640 1 --2- 172.21.15.162:0/1058838922 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f485c067910 0x7f485c069dd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4874001ea0 tx=0x7f4874009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T03:10:27.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.600+0000 7f48797fa640 1 -- 172.21.15.162:0/1058838922 <== mon.0 v2:172.21.15.162:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5817+0+0 (secure 0 0 0) 0x7f486c0f2300 con 0x7f487c1570d0 2024-04-25T03:10:27.603 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.600+0000 7f48797fa640 1 -- 172.21.15.162:0/1058838922 <== mon.0 v2:172.21.15.162:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (secure 0 0 0) 0x7f486c0188b0 con 0x7f487c1570d0 2024-04-25T03:10:27.771 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:27.768+0000 7f4882dbc640 1 -- 172.21.15.162:0/1058838922 --> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f487c0c26c0 con 0x7f487c1570d0 2024-04-25T03:10:28.458 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:28.456+0000 7f48797fa640 1 -- 172.21.15.162:0/1058838922 <== mon.0 v2:172.21.15.162:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) ==== 169+0+0 (secure 0 0 0) 0x7f486c0f4960 con 0x7f487c1570d0 2024-04-25T03:10:28.459 INFO:teuthology.orchestra.run.smithi162.stderr:pool 'cephfs_data' removed 2024-04-25T03:10:28.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:28.460+0000 7f4882dbc640 1 -- 172.21.15.162:0/1058838922 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f485c067910 msgr2=0x7f485c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:28.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:28.460+0000 7f4882dbc640 1 --2- 172.21.15.162:0/1058838922 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f485c067910 0x7f485c069dd0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4874001ea0 tx=0x7f4874009040 comp rx=0 tx=0).stop 2024-04-25T03:10:28.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:28.460+0000 7f4882dbc640 1 -- 172.21.15.162:0/1058838922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f487c1570d0 msgr2=0x7f487c1ee560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T03:10:28.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:28.460+0000 7f4882dbc640 1 --2- 172.21.15.162:0/1058838922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f487c1570d0 0x7f487c1ee560 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f486c01b960 tx=0x7f486c01baf0 comp rx=0 tx=0).stop 2024-04-25T03:10:28.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:28.460+0000 7f4882dbc640 1 -- 172.21.15.162:0/1058838922 shutdown_connections 2024-04-25T03:10:28.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:28.460+0000 7f4882dbc640 1 --2- 172.21.15.162:0/1058838922 >> [v2:172.21.15.162:6800/3960394531,v1:172.21.15.162:6801/3960394531] conn(0x7f485c067910 0x7f485c069dd0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:28.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:28.460+0000 7f4882dbc640 1 --2- 172.21.15.162:0/1058838922 >> [v2:172.21.15.162:3300/0,v1:172.21.15.162:6789/0] conn(0x7f487c1570d0 0x7f487c1ee560 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:28.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:28.460+0000 7f4882dbc640 1 --2- 172.21.15.162:0/1058838922 >> [v2:172.21.15.179:3301/0,v1:172.21.15.179:6790/0] conn(0x7f487c151410 0x7f487c1f1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:28.463 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:28.460+0000 7f4882dbc640 1 --2- 172.21.15.162:0/1058838922 >> [v2:172.21.15.179:3300/0,v1:172.21.15.179:6789/0] conn(0x7f487c0c2cc0 0x7f487c0c8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T03:10:28.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:28.460+0000 7f4882dbc640 1 -- 172.21.15.162:0/1058838922 >> 172.21.15.162:0/1058838922 conn(0x7f487c06b210 msgr2=0x7f487c150620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T03:10:28.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:28.460+0000 7f4882dbc640 1 -- 172.21.15.162:0/1058838922 shutdown_connections 2024-04-25T03:10:28.464 INFO:teuthology.orchestra.run.smithi162.stderr:2024-04-25T03:10:28.460+0000 7f4882dbc640 1 -- 172.21.15.162:0/1058838922 wait complete. 2024-04-25T03:10:28.488 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T03:10:28.488 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T03:10:28.488 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:10:28.489 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T03:10:28.489 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T03:10:28.489 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:10:28.489 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T03:10:28.489 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-25T03:10:28.489 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:10:28.489 INFO:tasks.ceph.mds.e:Stopped 2024-04-25T03:10:28.489 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T03:10:28.489 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:10:28.490 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T03:10:28.490 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T03:10:28.490 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:10:28.536 INFO:tasks.ceph.mds.d.smithi179.stderr:2024-04-25T03:10:28.498+0000 b9e7640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mds.d.log --time-stamp=yes --vgdb=yes --tool=memcheck ceph-mds -f --cluster ceph -i d (PID: 33754) UID: 0 2024-04-25T03:10:28.537 INFO:tasks.ceph.mds.d.smithi179.stderr:2024-04-25T03:10:28.506+0000 b9e7640 -1 mds.d *** got signal Terminated *** 2024-04-25T03:10:29.912 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f is failed for ~0s 2024-04-25T03:10:34.591 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T03:10:34.592 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-25T03:10:34.592 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:10:34.592 INFO:tasks.ceph.mds.f:Stopped 2024-04-25T03:10:34.592 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T03:10:34.592 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T03:10:34.592 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:10:34.593 INFO:tasks.ceph.osd.0.smithi162.stderr:2024-04-25T03:10:34.592+0000 7fd2370e8640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 0 (PID: 28038) UID: 0 2024-04-25T03:10:34.594 INFO:tasks.ceph.osd.0.smithi162.stderr:2024-04-25T03:10:34.592+0000 7fd2370e8640 -1 osd.0 32 *** Got signal Terminated *** 2024-04-25T03:10:36.223 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.f has been restored 2024-04-25T03:10:38.678 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:10:38.684 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:10:40.694 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T03:10:40.695 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T03:10:40.695 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:10:40.696 INFO:tasks.ceph.osd.1.smithi162.stderr:2024-04-25T03:10:40.692+0000 7f374fb6d640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 1 (PID: 28040) UID: 0 2024-04-25T03:10:40.697 INFO:tasks.ceph.osd.1.smithi162.stderr:2024-04-25T03:10:40.692+0000 7f374fb6d640 -1 osd.1 34 *** Got signal Terminated *** 2024-04-25T03:10:44.288 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:21:33.725 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T03:10:44.298 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:21:33.735 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T03:10:44.406 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:21:33.758 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T03:10:44.412 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:21:33.765 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T03:10:44.415 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:21:33.767 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T03:10:44.419 INFO:tasks.ceph.mon.a.smithi162.stderr:==00:02:21:33.856 27845== Warning: unimplemented fcntl command: 1036 2024-04-25T03:10:44.419 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:21:33.772 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T03:10:44.487 INFO:tasks.ceph.mon.b.smithi179.stderr:==00:02:21:33.840 27835== Warning: unimplemented fcntl command: 1036 2024-04-25T03:10:44.530 INFO:tasks.ceph.mon.c.smithi179.stderr:==00:02:21:33.882 27836== Warning: unimplemented fcntl command: 1036 2024-04-25T03:10:46.797 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T03:10:46.797 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T03:10:46.797 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:10:46.798 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-04-25T03:10:46.796+0000 7f6608116640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 2 (PID: 28042) UID: 0 2024-04-25T03:10:46.798 INFO:tasks.ceph.osd.2.smithi162.stderr:2024-04-25T03:10:46.796+0000 7f6608116640 -1 osd.2 35 *** Got signal Terminated *** 2024-04-25T03:10:52.898 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T03:10:52.899 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T03:10:52.899 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:10:52.900 INFO:tasks.ceph.osd.3.smithi162.stderr:2024-04-25T03:10:52.896+0000 7f5e1564b640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 3 (PID: 28045) UID: 0 2024-04-25T03:10:52.900 INFO:tasks.ceph.osd.3.smithi162.stderr:2024-04-25T03:10:52.896+0000 7f5e1564b640 -1 osd.3 36 *** Got signal Terminated *** 2024-04-25T03:10:59.000 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T03:10:59.001 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T03:10:59.001 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:10:59.002 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-04-25T03:10:59.001+0000 7fad86632640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 4 (PID: 28152) UID: 0 2024-04-25T03:10:59.002 INFO:tasks.ceph.osd.4.smithi179.stderr:2024-04-25T03:10:59.001+0000 7fad86632640 -1 osd.4 37 *** Got signal Terminated *** 2024-04-25T03:11:05.103 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T03:11:05.104 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T03:11:05.104 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:11:05.106 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-04-25T03:11:05.105+0000 7f1701b6f640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 5 (PID: 28154) UID: 0 2024-04-25T03:11:05.106 INFO:tasks.ceph.osd.5.smithi179.stderr:2024-04-25T03:11:05.105+0000 7f1701b6f640 -1 osd.5 38 *** Got signal Terminated *** 2024-04-25T03:11:08.760 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:11:08.763 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:11:11.206 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T03:11:11.206 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T03:11:11.206 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:11:11.208 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-04-25T03:11:11.205+0000 7f100a931640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 6 (PID: 28156) UID: 0 2024-04-25T03:11:11.208 INFO:tasks.ceph.osd.6.smithi179.stderr:2024-04-25T03:11:11.205+0000 7f100a931640 -1 osd.6 39 *** Got signal Terminated *** 2024-04-25T03:11:17.308 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T03:11:17.308 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T03:11:17.309 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:11:17.310 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-04-25T03:11:17.309+0000 7f8ed90ba640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-osd -f --cluster ceph -i 7 (PID: 28158) UID: 0 2024-04-25T03:11:17.310 INFO:tasks.ceph.osd.7.smithi179.stderr:2024-04-25T03:11:17.309+0000 7f8ed90ba640 -1 osd.7 39 *** Got signal Terminated *** 2024-04-25T03:11:17.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-25T03:11:23.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-04-25T03:11:23.082 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-25T03:11:23.414 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T03:11:23.415 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T03:11:23.415 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T03:11:23.415 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:11:23.417 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T03:11:23.415+0000 7fdf9b352640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term ceph-mgr -f --cluster ceph -i y (PID: 27848) UID: 0 2024-04-25T03:11:23.417 INFO:tasks.ceph.mgr.y.smithi162.stderr:2024-04-25T03:11:23.415+0000 7fdf9b352640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-25T03:11:23.446 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T03:11:23.446 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T03:11:23.446 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:11:23.481 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T03:11:23.481 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T03:11:23.481 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T03:11:23.481 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:11:23.505 INFO:tasks.ceph.mon.a.smithi162.stderr:2024-04-25T03:11:23.495+0000 a388640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a (PID: 27843) UID: 0 2024-04-25T03:11:23.505 INFO:tasks.ceph.mon.a.smithi162.stderr:2024-04-25T03:11:23.495+0000 a388640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-25T03:11:28.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2024-04-25T03:11:28.285 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-04-25T03:11:29.583 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T03:11:29.584 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T03:11:29.584 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:11:29.624 INFO:tasks.ceph.mon.b.smithi179.stderr:2024-04-25T03:11:29.593+0000 a388640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b (PID: 27828) UID: 0 2024-04-25T03:11:29.625 INFO:tasks.ceph.mon.b.smithi179.stderr:2024-04-25T03:11:29.597+0000 a388640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-04-25T03:11:33.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-04-25T03:11:33.387 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2024-04-25T03:11:35.686 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T03:11:35.686 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T03:11:35.686 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T03:11:35.727 INFO:tasks.ceph.mon.c.smithi179.stderr:2024-04-25T03:11:35.693+0000 a388640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --vgdb=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c (PID: 27831) UID: 0 2024-04-25T03:11:35.728 INFO:tasks.ceph.mon.c.smithi179.stderr:2024-04-25T03:11:35.697+0000 a388640 -1 mon.c@2(probing) e1 *** Got Signal Terminated *** 2024-04-25T03:11:38.388 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-04-25T03:11:38.388 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-04-25T03:11:38.877 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:11:38.880 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:11:41.789 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T03:11:41.789 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T03:11:41.789 DEBUG:teuthology.orchestra.run.smithi162:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow request' | egrep -v SLOW_OPS | egrep -v MON_DOWN | head -n 1 2024-04-25T03:11:41.809 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi162.front.sepia.ceph.com 2024-04-25T03:11:41.809 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T03:11:42.036 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi162.front.sepia.ceph.com 2024-04-25T03:11:42.036 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T03:11:42.291 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi162.front.sepia.ceph.com 2024-04-25T03:11:42.291 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T03:11:42.455 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi162.front.sepia.ceph.com 2024-04-25T03:11:42.455 DEBUG:teuthology.orchestra.run.smithi162:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T03:11:42.614 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-25T03:11:42.614 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T03:11:42.840 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-25T03:11:42.840 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T03:11:43.030 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-25T03:11:43.031 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T03:11:43.246 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi179.front.sepia.ceph.com 2024-04-25T03:11:43.247 DEBUG:teuthology.orchestra.run.smithi179:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T03:11:43.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-04-25T03:11:43.432 INFO:tasks.ceph:Archiving mon data... 2024-04-25T03:11:43.433 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672274/data/mon.a.tgz 2024-04-25T03:11:43.434 DEBUG:teuthology.orchestra.run.smithi162:> mktemp 2024-04-25T03:11:43.440 INFO:teuthology.orchestra.run.smithi162.stdout:/tmp/tmp.RWak8R4joc 2024-04-25T03:11:43.440 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.RWak8R4joc 2024-04-25T03:11:43.569 DEBUG:teuthology.orchestra.run.smithi162:> sudo chmod 0666 /tmp/tmp.RWak8R4joc 2024-04-25T03:11:43.635 DEBUG:teuthology.orchestra.remote:smithi162:/tmp/tmp.RWak8R4joc is 431KB 2024-04-25T03:11:43.700 DEBUG:teuthology.orchestra.run.smithi162:> rm -fr /tmp/tmp.RWak8R4joc 2024-04-25T03:11:43.705 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672274/data/mon.b.tgz 2024-04-25T03:11:43.705 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-04-25T03:11:43.711 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.tDj2jR9iOc 2024-04-25T03:11:43.711 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.tDj2jR9iOc 2024-04-25T03:11:43.848 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.tDj2jR9iOc 2024-04-25T03:11:43.913 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.tDj2jR9iOc is 436KB 2024-04-25T03:11:43.976 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.tDj2jR9iOc 2024-04-25T03:11:43.981 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672274/data/mon.c.tgz 2024-04-25T03:11:43.981 DEBUG:teuthology.orchestra.run.smithi179:> mktemp 2024-04-25T03:11:44.029 INFO:teuthology.orchestra.run.smithi179.stdout:/tmp/tmp.Jjb09BKJuh 2024-04-25T03:11:44.030 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Jjb09BKJuh 2024-04-25T03:11:44.161 DEBUG:teuthology.orchestra.run.smithi179:> sudo chmod 0666 /tmp/tmp.Jjb09BKJuh 2024-04-25T03:11:44.226 DEBUG:teuthology.orchestra.remote:smithi179:/tmp/tmp.Jjb09BKJuh is 436KB 2024-04-25T03:11:44.288 DEBUG:teuthology.orchestra.run.smithi179:> rm -fr /tmp/tmp.Jjb09BKJuh 2024-04-25T03:11:44.293 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T03:11:44.294 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T03:11:44.296 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T03:11:44.745 DEBUG:tasks.ceph:valgrind exception message: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2024-04-25T03:11:45.014 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T03:11:45.016 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672274/remote/smithi162/crash 2024-04-25T03:11:45.017 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T03:11:45.031 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672274/remote/smithi179/crash 2024-04-25T03:11:45.032 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T03:11:45.046 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T03:11:45.046 DEBUG:teuthology.orchestra.run.smithi162:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:11:45.081 DEBUG:teuthology.orchestra.run.smithi179:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T03:11:45.139 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T03:11:45.177 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T03:11:45.191 INFO:tasks.ceph:Compressing logs... 2024-04-25T03:11:45.191 DEBUG:teuthology.orchestra.run.smithi162:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T03:11:45.223 DEBUG:teuthology.orchestra.run.smithi179:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T03:11:45.243 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37099.log 2024-04-25T03:11:45.244 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36453.log 2024-04-25T03:11:45.244 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34133.log 2024-04-25T03:11:45.245 INFO:teuthology.orchestra.run.smithi162.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37099.log.gz 2024-04-25T03:11:45.245 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36453.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T03:11:45.245 INFO:teuthology.orchestra.run.smithi162.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36453.log.gz 2024-04-25T03:11:45.245 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34910.log 2024-04-25T03:11:45.248 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.34133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36787.log 2024-04-25T03:11:45.248 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33632.log 2024-04-25T03:11:45.248 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34133.log.gz 2024-04-25T03:11:45.248 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36787.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34910.log.gz 2024-04-25T03:11:45.248 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34120.log 2024-04-25T03:11:45.248 INFO:teuthology.orchestra.run.smithi162.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36787.log.gz 2024-04-25T03:11:45.248 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28195.log 2024-04-25T03:11:45.249 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34120.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T03:11:45.249 INFO:teuthology.orchestra.run.smithi162.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33632.log.gz 2024-04-25T03:11:45.249 INFO:teuthology.orchestra.run.smithi162.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34120.log.gz 2024-04-25T03:11:45.249 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.28195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37465.log 2024-04-25T03:11:45.249 INFO:teuthology.orchestra.run.smithi162.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28195.log.gz 2024-04-25T03:11:45.249 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33413.log 2024-04-25T03:11:45.249 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37073.log 2024-04-25T03:11:45.249 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33413.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37465.log.gz 2024-04-25T03:11:45.249 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33740.log 2024-04-25T03:11:45.252 INFO:teuthology.orchestra.run.smithi162.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33413.log.gz 2024-04-25T03:11:45.252 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33792.log 2024-04-25T03:11:45.253 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37073.log: /var/log/ceph/ceph-client.admin.33740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33766.log 2024-04-25T03:11:45.253 INFO:teuthology.orchestra.run.smithi162.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37073.log.gz 2024-04-25T03:11:45.253 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33792.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33740.log.gz 2024-04-25T03:11:45.253 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37387.log 2024-04-25T03:11:45.253 INFO:teuthology.orchestra.run.smithi162.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33792.log.gz 2024-04-25T03:11:45.253 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36995.log 2024-04-25T03:11:45.253 INFO:teuthology.orchestra.run.smithi162.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33766.log.gz 2024-04-25T03:11:45.253 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36665.log 2024-04-25T03:11:45.253 INFO:teuthology.orchestra.run.smithi162.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37387.log.gz 2024-04-25T03:11:45.253 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34484.log 2024-04-25T03:11:45.253 INFO:teuthology.orchestra.run.smithi162.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36995.log.gz 2024-04-25T03:11:45.253 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33111.log 2024-04-25T03:11:45.253 INFO:teuthology.orchestra.run.smithi162.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36665.log.gz 2024-04-25T03:11:45.254 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34484.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T03:11:45.254 INFO:teuthology.orchestra.run.smithi162.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34484.log.gz 2024-04-25T03:11:45.254 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33491.log 2024-04-25T03:11:45.254 INFO:teuthology.orchestra.run.smithi162.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33111.log.gz 2024-04-25T03:11:45.254 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34489.log 2024-04-25T03:11:45.262 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27973.log 2024-04-25T03:11:45.262 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28077.log 2024-04-25T03:11:45.262 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.27973.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T03:11:45.262 INFO:teuthology.orchestra.run.smithi179.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27973.log.gz 2024-04-25T03:11:45.262 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.28077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27947.log 2024-04-25T03:11:45.263 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T03:11:45.263 INFO:teuthology.orchestra.run.smithi179.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28077.log.gz 2024-04-25T03:11:45.263 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.27947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28028.log 2024-04-25T03:11:45.263 INFO:teuthology.orchestra.run.smithi179.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27947.log.gz 2024-04-25T03:11:45.263 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28125.log 2024-04-25T03:11:45.263 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T03:11:45.263 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.28028.log: /var/log/ceph/ceph-client.admin.28125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28052.log 2024-04-25T03:11:45.263 INFO:teuthology.orchestra.run.smithi179.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28125.log.gz 2024-04-25T03:11:45.263 INFO:teuthology.orchestra.run.smithi179.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.28028.log.gz 2024-04-25T03:11:45.263 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T03:11:45.263 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-25T03:11:45.263 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.28052.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T03:11:45.263 INFO:teuthology.orchestra.run.smithi179.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28052.log.gz 2024-04-25T03:11:45.263 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T03:11:45.263 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T03:11:45.264 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T03:11:45.264 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph.audit.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T03:11:45.264 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.c.log 2024-04-25T03:11:45.275 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36585.log 2024-04-25T03:11:45.275 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33491.log.gz 2024-04-25T03:11:45.275 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33545.log 2024-04-25T03:11:45.275 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34489.log: /var/log/ceph/ceph-client.admin.36585.log: gzip -5 --verbose 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36585.log.gz 2024-04-25T03:11:45.275 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34489.log.gz 2024-04-25T03:11:45.275 INFO:teuthology.orchestra.run.smithi162.stderr: -- /var/log/ceph/ceph-client.admin.33251.log 2024-04-25T03:11:45.275 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37413.log 2024-04-25T03:11:45.275 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33251.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33545.log.gz 2024-04-25T03:11:45.276 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33844.log 2024-04-25T03:11:45.276 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33251.log.gz 2024-04-25T03:11:45.276 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34227.log 2024-04-25T03:11:45.276 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37413.log: /var/log/ceph/ceph-client.admin.33844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34247.log 2024-04-25T03:11:45.276 INFO:teuthology.orchestra.run.smithi162.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37413.log.gz 2024-04-25T03:11:45.276 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33844.log.gz 2024-04-25T03:11:45.276 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34227.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T03:11:45.276 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34247.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34227.log.gz 2024-04-25T03:11:45.276 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37335.log 2024-04-25T03:11:45.276 INFO:teuthology.orchestra.run.smithi162.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34247.log.gz 2024-04-25T03:11:45.276 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35036.log 2024-04-25T03:11:45.276 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.37335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34936.log 2024-04-25T03:11:45.276 INFO:teuthology.orchestra.run.smithi162.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37335.log.gz 2024-04-25T03:11:45.276 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.35036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34648.log 2024-04-25T03:11:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:gzip/var/log/ceph/ceph-client.admin.34936.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34188.log 2024-04-25T03:11:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34648.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.35036.log.gz 2024-04-25T03:11:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33356.log 2024-04-25T03:11:45.277 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% 90.9% -- replaced with /var/log/ceph/ceph-client.admin.34936.log.gz 2024-04-25T03:11:45.277 INFO:teuthology.orchestra.run.smithi162.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34648.log.gz 2024-04-25T03:11:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34856.log 2024-04-25T03:11:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34188.log: /var/log/ceph/ceph-client.admin.33356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34726.log 2024-04-25T03:11:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34856.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34188.log.gz 2024-04-25T03:11:45.277 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33356.log.gz 2024-04-25T03:11:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34213.log 2024-04-25T03:11:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34726.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34856.log.gz 2024-04-25T03:11:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36813.log 2024-04-25T03:11:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36532.log 2024-04-25T03:11:45.277 INFO:teuthology.orchestra.run.smithi162.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34726.log.gz 2024-04-25T03:11:45.277 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34213.log: /var/log/ceph/ceph-client.admin.36813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34456.log 2024-04-25T03:11:45.278 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34213.log.gz 2024-04-25T03:11:45.278 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36532.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36813.log.gz 2024-04-25T03:11:45.278 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34622.log 2024-04-25T03:11:45.278 INFO:teuthology.orchestra.run.smithi162.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36532.log.gz 2024-04-25T03:11:45.278 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37125.log 2024-04-25T03:11:45.278 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34622.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34456.log.gz 2024-04-25T03:11:45.278 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34380.log 2024-04-25T03:11:45.278 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34622.log.gz 2024-04-25T03:11:45.278 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33714.log 2024-04-25T03:11:45.278 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37125.log: /var/log/ceph/ceph-client.admin.34380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35086.log 2024-04-25T03:11:45.278 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37125.log.gz 2024-04-25T03:11:45.278 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33714.log: -- replaced with /var/log/ceph/ceph-client.admin.34380.log.gz 2024-04-25T03:11:45.278 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36891.log 2024-04-25T03:11:45.278 INFO:teuthology.orchestra.run.smithi162.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33714.log.gz 2024-04-25T03:11:45.279 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.35086.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T03:11:45.279 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33905.log 2024-04-25T03:11:45.279 INFO:teuthology.orchestra.run.smithi162.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.35086.log.gz/var/log/ceph/ceph-osd.3.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36891.log.gz 2024-04-25T03:11:45.279 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-04-25T03:11:45.279 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33688.log 2024-04-25T03:11:45.279 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34700.log 2024-04-25T03:11:45.279 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33905.log: /var/log/ceph/ceph-client.admin.33688.log: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36427.log 2024-04-25T03:11:45.279 INFO:teuthology.orchestra.run.smithi162.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33905.log.gz 2024-04-25T03:11:45.279 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34700.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33688.log.gz 88.7% 2024-04-25T03:11:45.279 INFO:teuthology.orchestra.run.smithi162.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34700.log.gz 2024-04-25T03:11:45.279 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33277.log 2024-04-25T03:11:45.279 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36865.log 2024-04-25T03:11:45.279 INFO:teuthology.orchestra.run.smithi162.stderr: 88.2%/var/log/ceph/ceph-client.admin.33277.log: -- replaced with /var/log/ceph/ceph-client.admin.36427.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33465.log 2024-04-25T03:11:45.279 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-04-25T03:11:45.279 INFO:teuthology.orchestra.run.smithi162.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33277.log.gz 2024-04-25T03:11:45.280 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36865.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36865.log.gz 2024-04-25T03:11:45.280 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T03:11:45.280 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34804.log 2024-04-25T03:11:45.280 INFO:teuthology.orchestra.run.smithi162.stderr: 87.9%/var/log/ceph/ceph-osd.1.log: -- replaced with /var/log/ceph/ceph-client.admin.33465.log.gz 2024-04-25T03:11:45.280 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33658.log 2024-04-25T03:11:45.280 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36969.log 2024-04-25T03:11:45.280 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34804.log: /var/log/ceph/ceph-client.admin.33658.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34804.log.gz 2024-04-25T03:11:45.280 INFO:teuthology.orchestra.run.smithi162.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33658.log.gz 2024-04-25T03:11:45.280 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33439.log 2024-04-25T03:11:45.280 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36969.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36969.log.gz 2024-04-25T03:11:45.280 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34752.log 2024-04-25T03:11:45.280 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33957.log 2024-04-25T03:11:45.280 INFO:teuthology.orchestra.run.smithi162.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33439.log.gz/var/log/ceph/ceph-client.admin.34752.log: 2024-04-25T03:11:45.280 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34752.log.gz 2024-04-25T03:11:45.280 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37047.log 2024-04-25T03:11:45.281 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37177.log 2024-04-25T03:11:45.281 INFO:teuthology.orchestra.run.smithi162.stderr: 87.7%/var/log/ceph/ceph-client.admin.37047.log: -- replaced with /var/log/ceph/ceph-client.admin.33957.log.gz 2024-04-25T03:11:45.281 INFO:teuthology.orchestra.run.smithi162.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37047.log.gz 2024-04-25T03:11:45.283 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/valgrind/mds.f.log 2024-04-25T03:11:45.283 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/valgrind/mon.c.log: 91.6% -- replaced with /var/log/ceph/valgrind/mon.c.log.gz 2024-04-25T03:11:45.283 INFO:teuthology.orchestra.run.smithi179.stderr: 94.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T03:11:45.284 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T03:11:45.284 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36639.log 2024-04-25T03:11:45.284 INFO:teuthology.orchestra.run.smithi162.stderr: 88.5%/var/log/ceph/ceph.log: -- replaced with /var/log/ceph/ceph-client.admin.37177.log.gz 2024-04-25T03:11:45.285 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37021.log 2024-04-25T03:11:45.285 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36639.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36639.log.gz 2024-04-25T03:11:45.285 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37309.log 2024-04-25T03:11:45.285 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37021.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37021.log.gz 2024-04-25T03:11:45.285 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37229.log 2024-04-25T03:11:45.285 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37309.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37309.log.gz 2024-04-25T03:11:45.285 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34353.log 2024-04-25T03:11:45.286 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.b.log 2024-04-25T03:11:45.287 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37229.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37229.log.gz 2024-04-25T03:11:45.287 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34424.log 2024-04-25T03:11:45.287 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34353.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34353.log.gz 2024-04-25T03:11:45.287 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33818.log 2024-04-25T03:11:45.287 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34424.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34424.log.gz 2024-04-25T03:11:45.288 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36709.log 2024-04-25T03:11:45.289 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/valgrind/mds.f.log: 95.6% -- replaced with /var/log/ceph/valgrind/mds.f.log.gz 2024-04-25T03:11:45.289 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33818.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33818.log.gz 2024-04-25T03:11:45.289 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37439.log 2024-04-25T03:11:45.290 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.d.log 2024-04-25T03:11:45.291 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36709.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36709.log.gz 2024-04-25T03:11:45.291 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36479.log 2024-04-25T03:11:45.291 INFO:teuthology.orchestra.run.smithi162.stderr: 88.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T03:11:45.292 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37439.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22998.log 2024-04-25T03:11:45.292 INFO:teuthology.orchestra.run.smithi162.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37439.log.gz 2024-04-25T03:11:45.294 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37151.log 2024-04-25T03:11:45.294 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36479.log: /var/log/ceph/ceph.tmp-client.admin.22998.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22998.log.gz 2024-04-25T03:11:45.294 INFO:teuthology.orchestra.run.smithi162.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36479.log.gz 2024-04-25T03:11:45.295 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33951.log 2024-04-25T03:11:45.295 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33222.log 2024-04-25T03:11:45.295 INFO:teuthology.orchestra.run.smithi162.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37151.log.gz 2024-04-25T03:11:45.295 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33951.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33951.log.gz 2024-04-25T03:11:45.295 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33870.log 2024-04-25T03:11:45.299 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/valgrind/mds.b.log: 95.5% -- replaced with /var/log/ceph/valgrind/mds.b.log.gz 2024-04-25T03:11:45.300 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.b.log 2024-04-25T03:11:45.300 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/valgrind/mds.d.log: 57.6% -- replaced with /var/log/ceph/valgrind/mds.d.log.gz 2024-04-25T03:11:45.300 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28101.log 2024-04-25T03:11:45.300 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/valgrind/mon.b.log: 91.6% -- replaced with /var/log/ceph/valgrind/mon.b.log.gz 2024-04-25T03:11:45.300 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T03:11:45.300 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-client.admin.28101.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28101.log.gz 2024-04-25T03:11:45.300 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T03:11:45.300 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mds.b.log: 92.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T03:11:45.300 INFO:teuthology.orchestra.run.smithi179.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-25T03:11:45.302 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34778.log 2024-04-25T03:11:45.302 INFO:teuthology.orchestra.run.smithi162.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33222.log.gz 2024-04-25T03:11:45.302 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33870.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33870.log.gz 2024-04-25T03:11:45.302 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33958.log 2024-04-25T03:11:45.302 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37203.log 2024-04-25T03:11:45.302 INFO:teuthology.orchestra.run.smithi162.stderr: 88.8%/var/log/ceph/ceph-client.admin.33958.log: -- replaced with /var/log/ceph/ceph-client.admin.34778.log.gz 2024-04-25T03:11:45.302 INFO:teuthology.orchestra.run.smithi162.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33958.log.gz 2024-04-25T03:11:45.303 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36559.log 2024-04-25T03:11:45.303 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33606.log 2024-04-25T03:11:45.303 INFO:teuthology.orchestra.run.smithi162.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37203.log.gz 2024-04-25T03:11:45.303 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36559.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36559.log.gz 2024-04-25T03:11:45.303 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34986.log 2024-04-25T03:11:45.303 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35191.log 2024-04-25T03:11:45.303 INFO:teuthology.orchestra.run.smithi162.stderr: 88.1%/var/log/ceph/ceph-client.admin.34986.log: -- replaced with /var/log/ceph/ceph-client.admin.33606.log.gz 2024-04-25T03:11:45.303 INFO:teuthology.orchestra.run.smithi162.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.34986.log.gz 2024-04-25T03:11:45.303 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34596.log 2024-04-25T03:11:45.303 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.35191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33387.log 2024-04-25T03:11:45.303 INFO:teuthology.orchestra.run.smithi162.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35191.log.gz 2024-04-25T03:11:45.303 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34596.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34596.log.gz 2024-04-25T03:11:45.305 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34882.log 2024-04-25T03:11:45.305 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35320.log 2024-04-25T03:11:45.305 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34882.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33387.log.gz 2024-04-25T03:11:45.305 INFO:teuthology.orchestra.run.smithi162.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34882.log.gz 2024-04-25T03:11:45.305 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37361.log 2024-04-25T03:11:45.305 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.0.35320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36761.log 2024-04-25T03:11:45.306 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37361.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37361.log.gz 2024-04-25T03:11:45.306 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33170.log 2024-04-25T03:11:45.307 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36761.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36761.log.gz 2024-04-25T03:11:45.307 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34125.log 2024-04-25T03:11:45.308 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33170.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33170.log.gz 2024-04-25T03:11:45.308 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T03:11:45.309 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34125.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34125.log.gz 2024-04-25T03:11:45.310 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T03:11:45.311 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph.audit.log: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T03:11:45.312 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T03:11:45.313 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27997.log 2024-04-25T03:11:45.325 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36839.log 2024-04-25T03:11:45.329 INFO:teuthology.orchestra.run.smithi179.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.27997.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27997.log.gz 2024-04-25T03:11:45.341 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34830.log 2024-04-25T03:11:45.342 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36839.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36839.log.gz 2024-04-25T03:11:45.345 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36917.log 2024-04-25T03:11:45.346 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34830.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34830.log.gz 2024-04-25T03:11:45.352 INFO:teuthology.orchestra.run.smithi179.stderr: 95.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T03:11:45.353 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34567.log 2024-04-25T03:11:45.354 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36917.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36917.log.gz 2024-04-25T03:11:45.369 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37259.log 2024-04-25T03:11:45.370 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34567.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34567.log.gz 2024-04-25T03:11:45.389 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/client.0.log 2024-04-25T03:11:45.390 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37259.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37259.log.gz 2024-04-25T03:11:45.397 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.a.log 2024-04-25T03:11:45.398 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/valgrind/client.0.log: 77.9% -- replaced with /var/log/ceph/valgrind/client.0.log.gz 2024-04-25T03:11:45.405 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mon.a.log 2024-04-25T03:11:45.421 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/valgrind/mds.a.log: 95.4% -- replaced with /var/log/ceph/valgrind/mds.a.log.gz 2024-04-25T03:11:45.421 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.c.log 2024-04-25T03:11:45.422 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/valgrind/mon.a.log: 91.6% -- replaced with /var/log/ceph/valgrind/mon.a.log.gz 2024-04-25T03:11:45.429 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/mds.e.log 2024-04-25T03:11:45.445 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/valgrind/mds.c.log: 95.5% -- replaced with /var/log/ceph/valgrind/mds.c.log.gz 2024-04-25T03:11:45.445 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27850.log 2024-04-25T03:11:45.449 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/valgrind/mds.e.log: 95.2% -- replaced with /var/log/ceph/valgrind/mds.e.log.gz 2024-04-25T03:11:45.453 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33959.log 2024-04-25T03:11:45.455 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.27850.log: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.27850.log.gz 2024-04-25T03:11:45.469 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36943.log 2024-04-25T03:11:45.470 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33959.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33959.log.gz 2024-04-25T03:11:45.494 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33571.log 2024-04-25T03:11:45.495 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36943.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36943.log.gz 2024-04-25T03:11:45.505 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35136.log 2024-04-25T03:11:45.506 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33571.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33571.log.gz 2024-04-25T03:11:45.524 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36735.log 2024-04-25T03:11:45.524 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.35136.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.35136.log.gz 2024-04-25T03:11:45.533 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28049.log 2024-04-25T03:11:45.534 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36735.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36735.log.gz 2024-04-25T03:11:45.549 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33517.log 2024-04-25T03:11:45.550 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.28049.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28049.log.gz 2024-04-25T03:11:45.561 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37283.log 2024-04-25T03:11:45.562 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33517.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33517.log.gz 2024-04-25T03:11:45.573 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36506.log 2024-04-25T03:11:45.574 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.37283.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37283.log.gz 2024-04-25T03:11:45.597 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-25T03:11:45.598 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36506.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36506.log.gz 2024-04-25T03:11:45.612 INFO:teuthology.orchestra.run.smithi179.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-25T03:11:45.613 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34674.log 2024-04-25T03:11:45.625 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33946.log 2024-04-25T03:11:45.626 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34674.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34674.log.gz 2024-04-25T03:11:45.629 INFO:teuthology.orchestra.run.smithi179.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T03:11:45.641 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36611.log 2024-04-25T03:11:45.642 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33946.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33946.log.gz 2024-04-25T03:11:45.649 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33952.log 2024-04-25T03:11:45.650 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.36611.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36611.log.gz 2024-04-25T03:11:45.657 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34541.log 2024-04-25T03:11:45.658 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33952.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33952.log.gz 2024-04-25T03:11:45.666 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33950.log 2024-04-25T03:11:45.666 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34541.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34541.log.gz 2024-04-25T03:11:45.673 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34345.log 2024-04-25T03:11:45.674 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33950.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33950.log.gz 2024-04-25T03:11:45.681 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34167.log 2024-04-25T03:11:45.682 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34345.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34345.log.gz 2024-04-25T03:11:45.690 INFO:teuthology.orchestra.run.smithi162.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33948.log 2024-04-25T03:11:45.690 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.34167.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34167.log.gz 2024-04-25T03:11:45.706 INFO:teuthology.orchestra.run.smithi162.stderr:/var/log/ceph/ceph-client.admin.33948.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33948.log.gz 2024-04-25T03:11:45.797 INFO:teuthology.orchestra.run.smithi162.stderr: 94.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T03:11:46.102 INFO:teuthology.orchestra.run.smithi162.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-25T03:11:46.462 INFO:teuthology.orchestra.run.smithi162.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T03:11:46.719 INFO:teuthology.orchestra.run.smithi179.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T03:11:47.386 INFO:teuthology.orchestra.run.smithi179.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T03:11:48.464 INFO:teuthology.orchestra.run.smithi179.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T03:11:49.979 INFO:teuthology.orchestra.run.smithi179.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T03:11:50.183 INFO:teuthology.orchestra.run.smithi179.stderr: 92.4% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T03:11:50.398 INFO:teuthology.orchestra.run.smithi179.stderr: 92.5% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T03:11:50.399 INFO:teuthology.orchestra.run.smithi179.stderr: 2024-04-25T03:11:50.399 INFO:teuthology.orchestra.run.smithi179.stderr:real 0m5.164s 2024-04-25T03:11:50.399 INFO:teuthology.orchestra.run.smithi179.stderr:user 0m21.580s 2024-04-25T03:11:50.400 INFO:teuthology.orchestra.run.smithi179.stderr:sys 0m0.762s 2024-04-25T03:11:50.622 INFO:teuthology.orchestra.run.smithi162.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T03:11:50.711 INFO:teuthology.orchestra.run.smithi162.stderr: 89.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T03:11:51.077 INFO:teuthology.orchestra.run.smithi162.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T03:11:51.181 INFO:teuthology.orchestra.run.smithi162.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T03:11:52.900 INFO:teuthology.orchestra.run.smithi162.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T03:12:02.462 INFO:teuthology.orchestra.run.smithi162.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.0.35320.log.gz 2024-04-25T03:12:47.048 INFO:teuthology.orchestra.run.smithi162.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T03:12:47.049 INFO:teuthology.orchestra.run.smithi162.stderr: 2024-04-25T03:12:47.049 INFO:teuthology.orchestra.run.smithi162.stderr:real 1m1.824s 2024-04-25T03:12:47.049 INFO:teuthology.orchestra.run.smithi162.stderr:user 1m47.085s 2024-04-25T03:12:47.049 INFO:teuthology.orchestra.run.smithi162.stderr:sys 0m3.286s 2024-04-25T03:12:47.050 INFO:tasks.ceph:Archiving logs... 2024-04-25T03:12:47.051 DEBUG:teuthology.misc:Transferring archived files from smithi162:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672274/remote/smithi162/log 2024-04-25T03:12:47.052 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T03:13:00.560 DEBUG:teuthology.misc:Transferring archived files from smithi179:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672274/remote/smithi179/log 2024-04-25T03:13:00.561 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T03:13:03.287 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2024-04-25T03:13:03.288 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T03:13:03.297 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks/ceph.py", line 1935, in task mon0_remote.run( File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 54, in nested raise exc[1] File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks/ceph.py", line 252, in ceph_log yield File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/contextutil.py", line 46, in nested if exit(*exc): File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks/ceph.py", line 346, in valgrind_post raise valgrind_exception Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2024-04-25T03:13:03.298 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T03:13:03.298 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T03:13:03.301 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T03:13:03.377 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T03:13:03.386 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T03:13:03.386 DEBUG:teuthology.orchestra.run.smithi162:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T03:13:03.389 DEBUG:teuthology.orchestra.run.smithi179:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T03:13:03.403 INFO:teuthology.orchestra.run.smithi162.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T03:13:03.403 INFO:teuthology.orchestra.run.smithi162.stdout:============================================================================== 2024-04-25T03:13:03.403 INFO:teuthology.orchestra.run.smithi162.stdout:+hv01.front.sepi 44.4.53.2 2 u 111 128 377 0.194 -5.448 0.584 2024-04-25T03:13:03.403 INFO:teuthology.orchestra.run.smithi162.stdout:+hv02.front.sepi 63.231.80.2 3 u 20 128 377 0.191 -2.960 0.504 2024-04-25T03:13:03.403 INFO:teuthology.orchestra.run.smithi162.stdout:*hv03.front.sepi 74.6.168.72 3 u 128 128 377 0.144 -3.950 0.260 2024-04-25T03:13:03.403 INFO:teuthology.orchestra.run.smithi162.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-25T03:13:03.405 INFO:teuthology.orchestra.run.smithi179.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T03:13:03.406 INFO:teuthology.orchestra.run.smithi179.stdout:============================================================================== 2024-04-25T03:13:03.406 INFO:teuthology.orchestra.run.smithi179.stdout:+hv01.front.sepi 44.4.53.2 2 u 187 512 377 0.180 -3.954 0.234 2024-04-25T03:13:03.406 INFO:teuthology.orchestra.run.smithi179.stdout:+hv02.front.sepi 63.231.80.2 3 u 209 512 377 0.207 -1.761 0.219 2024-04-25T03:13:03.406 INFO:teuthology.orchestra.run.smithi179.stdout:*hv03.front.sepi 74.6.168.72 3 u 146 512 377 0.177 -2.584 0.191 2024-04-25T03:13:03.406 INFO:teuthology.orchestra.run.smithi179.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-04-25T03:13:03.407 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T03:13:03.419 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T03:13:03.419 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T03:13:03.476 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T03:13:03.511 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T03:13:03.544 INFO:teuthology.task.internal:Duration was 9662.818045 seconds 2024-04-25T03:13:03.545 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T03:13:03.578 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T03:13:03.578 DEBUG:teuthology.orchestra.run.smithi162:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T03:13:03.580 DEBUG:teuthology.orchestra.run.smithi179:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T03:13:03.618 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T03:13:03.618 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi162.front.sepia.ceph.com 2024-04-25T03:13:03.618 DEBUG:teuthology.orchestra.run.smithi162:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T03:13:03.667 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi179.front.sepia.ceph.com 2024-04-25T03:13:03.667 DEBUG:teuthology.orchestra.run.smithi179:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T03:13:03.677 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T03:13:03.678 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T03:13:03.711 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T03:13:03.748 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T03:13:03.749 DEBUG:teuthology.orchestra.run.smithi162:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T03:13:03.783 DEBUG:teuthology.orchestra.run.smithi179:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T03:13:03.855 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T03:13:03.865 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T03:13:03.865 DEBUG:teuthology.orchestra.run.smithi162:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T03:13:03.876 DEBUG:teuthology.orchestra.run.smithi179:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T03:13:03.889 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T03:13:03.898 DEBUG:teuthology.orchestra.run.smithi162:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T03:13:03.918 DEBUG:teuthology.orchestra.run.smithi179:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T03:13:03.926 INFO:teuthology.orchestra.run.smithi162.stdout:kernel.core_pattern = core 2024-04-25T03:13:03.943 INFO:teuthology.orchestra.run.smithi179.stdout:kernel.core_pattern = core 2024-04-25T03:13:04.183 DEBUG:teuthology.orchestra.run.smithi162:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T03:13:04.188 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T03:13:04.189 DEBUG:teuthology.orchestra.run.smithi179:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T03:13:04.229 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T03:13:04.229 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T03:13:04.239 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T03:13:04.240 DEBUG:teuthology.misc:Transferring archived files from smithi162:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672274/remote/smithi162 2024-04-25T03:13:04.240 DEBUG:teuthology.orchestra.run.smithi162:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T03:13:04.262 DEBUG:teuthology.misc:Transferring archived files from smithi179:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672274/remote/smithi179 2024-04-25T03:13:04.263 DEBUG:teuthology.orchestra.run.smithi179:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T03:13:04.294 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T03:13:04.294 DEBUG:teuthology.orchestra.run.smithi162:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T03:13:04.304 DEBUG:teuthology.orchestra.run.smithi179:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T03:13:04.342 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T03:13:04.352 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T03:13:04.352 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T03:13:04.392 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T03:13:04.392 DEBUG:teuthology.orchestra.run.smithi162:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T03:13:04.395 DEBUG:teuthology.orchestra.run.smithi179:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T03:13:04.398 INFO:teuthology.orchestra.run.smithi162.stdout: 658636 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 03:13 /home/ubuntu/cephtest 2024-04-25T03:13:04.401 INFO:teuthology.orchestra.run.smithi179.stdout: 658625 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 03:13 /home/ubuntu/cephtest 2024-04-25T03:13:04.402 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T03:13:04.420 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T03:13:04.455 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: Exception: valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions 2024-04-25T03:13:04.455 INFO:teuthology.nuke:Checking targets against current locks 2024-04-25T03:13:04.482 DEBUG:teuthology.nuke:shortname: smithi162 2024-04-25T03:13:04.483 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T03:13:04.510 DEBUG:teuthology.nuke:shortname: smithi179 2024-04-25T03:13:04.510 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T03:13:04.514 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi162.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672274', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 00:22:40.366635', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM904qXsBlfruaETNbdYlRUpEJ04/ypC+Ggk6Wg50rh5Pe0298/XAaVO+vkfA2SN8NeO2X1QEWDk23DYYEQSvOc='} 2024-04-25T03:13:04.533 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi179.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672274', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 00:22:40.368593', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPZBoJii4aVktl98RvFIdboPuZoht2OQaKgvhGp/sByOOV+kDADxPqLoUBI0u9faJbfWEiXwWJH1YWv4cW+3oaM='} 2024-04-25T03:13:04.563 INFO:teuthology.orchestra.console.smithi162:Power off 2024-04-25T03:13:04.563 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T03:13:04.580 INFO:teuthology.orchestra.console.smithi179:Power off 2024-04-25T03:13:04.580 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T03:13:04.592 DEBUG:teuthology.orchestra.console.smithi162:power off output: Chassis Power Control: Down/Off 2024-04-25T03:13:04.592 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T03:13:04.604 DEBUG:teuthology.orchestra.console.smithi179:power off output: Chassis Power Control: Down/Off 2024-04-25T03:13:04.604 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T03:13:04.616 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-04-25T03:13:04.626 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-04-25T03:13:08.617 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T03:13:08.627 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T03:13:08.728 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is on 2024-04-25T03:13:08.737 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-04-25T03:13:12.730 DEBUG:teuthology.orchestra.console.smithi162:pexpect command: ipmitool -H smithi162.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T03:13:12.740 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T03:13:12.842 DEBUG:teuthology.orchestra.console.smithi162:check power output: Chassis Power is off 2024-04-25T03:13:12.850 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is on 2024-04-25T03:13:12.944 INFO:teuthology.orchestra.console.smithi162:Power off completed 2024-04-25T03:13:16.852 DEBUG:teuthology.orchestra.console.smithi179:pexpect command: ipmitool -H smithi179.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T03:13:16.962 DEBUG:teuthology.orchestra.console.smithi179:check power output: Chassis Power is off 2024-04-25T03:13:17.063 INFO:teuthology.orchestra.console.smithi179:Power off completed 2024-04-25T03:13:17.167 INFO:teuthology.run:Summary data: description: fs/verify/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu/{overrides ubuntu_latest}} mount/fuse objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug pg_health session_timeout} ranks/5 tasks/fsstress validater/valgrind} duration: 9662.818045139313 failure_reason: 'valgrind error: Leak_StillReachable calloc calloc _dl_check_map_versions' flavor: default owner: scheduled_teuthology@teuthology status: fail success: false 2024-04-25T03:13:17.168 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T03:13:17.252 INFO:teuthology.run:FAIL